00010000:00010000:0.0:1746155550.161635:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134ad1800/0x844e5faceb5e7dac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eada expref: 28 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.161642:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ad1800, rc 0) 00000100:00100000:0.0:1746155550.166903:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124345984:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155550.166927:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe7f200/0x844e5faceb5e7da5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ead3 expref: 30 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.166939:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe7f200/0x844e5faceb5e7da5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ead3 expref: 30 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.166948:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe7f200, rc 0) 00000100:00100000:0.0:1746155550.166971:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123139840:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6287us (6515us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155550.166977:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10598 00002000:00010000:0.0:1746155550.167834:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1703 -> 1895 00000100:00100000:0.0:1746155550.167842:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124345856:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155550.167860:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe7e400/0x844e5faceb5e7d9e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eacc expref: 26 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.167871:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe7e400/0x844e5faceb5e7d9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eacc expref: 26 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.167880:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe7e400, rc 0) 00000100:00100000:0.0:1746155550.168103:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123139712:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7559us (7656us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155550.168109:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10597 00000100:00100000:0.0:1746155550.178976:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123140992 00000100:00100000:0.0:1746155550.178985:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123140992 00000100:00100000:0.0:1746155550.179019:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3829 00000100:00100000:0.0:1746155550.179025:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+7:28405:x1830976123140992:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155550.179401:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+8:28405:x1830976123140992:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 375us (506us total) trans 8589943550 rc 0/0 00000100:00100000:0.0:1746155550.179407:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3829 00000100:00100000:0.0:1746155550.191283:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123141120 00000100:00100000:0.0:1746155550.191289:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123141120 00000100:00100000:0.0:1746155550.192321:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123141248 00000100:00100000:0.0:1746155550.192326:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123141248 00000100:00100000:0.0:1746155550.192351:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10600 00000100:00100000:0.0:1746155550.192358:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123141120:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155550.192371:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155550.192384:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5e7db3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0eae1 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155550.192423:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124346240:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155550.192474:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155550.192489:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10601 00000100:00100000:0.0:1746155550.192495:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123141248:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155550.192513:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155550.192521:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3000/0x844e5faceb5e7dba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0eae8 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155550.192540:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124346368:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155550.192558:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338250c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155550.199074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.199096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.199146:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123141376 00000100:00100000:0.0:1746155550.199153:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123141376 00000100:00100000:0.0:1746155550.199180:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123141504 00000100:00100000:0.0:1746155550.199182:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123141504 00000100:00100000:0.0:1746155550.199195:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10602 00000100:00100000:0.0:1746155550.199202:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123141376:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155550.199218:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155550.199233:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5e7dc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0eaef expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155550.199276:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124346496:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155550.199327:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825000 going to sleep for 11 seconds 00002000:00010000:0.0:1746155550.199396:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2077 -> 2081 00000100:00100000:0.0:1746155550.199402:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124346368:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155550.199421:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3000/0x844e5faceb5e7dba lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eae8 expref: 35 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.199430:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3000/0x844e5faceb5e7dba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eae8 expref: 35 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.199438:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe3000, rc 0) 00000100:00100000:0.0:1746155550.199461:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123141248:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6965us (8694us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155550.199470:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10601 00000100:00100000:0.0:1746155550.199484:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10603 00000100:00100000:0.0:1746155550.199489:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+7:1963:x1830976123141504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155550.199495:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155550.199523:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d583e00/0x844e5faceb5e7dc8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0eaf6 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155550.199546:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124346624:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155550.199564:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338250c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155550.201478:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124346240:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155550.201499:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5e7db3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eae1 expref: 20 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.201534:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5e7db3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eae1 expref: 20 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.201543:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe3600, rc 0) 00000100:00100000:0.0:1746155550.201575:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123141120:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9218us (10857us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155550.201582:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10600 00000100:00100000:0.0:1746155550.201809:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124346496:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155550.201824:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5e7dc1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eaef expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.201837:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5e7dc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eaef expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.201844:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d582200, rc 0) 00000100:00100000:0.0:1746155550.201863:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123141376:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2662us (2797us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155550.201868:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10602 00000100:00100000:0.0:1746155550.201933:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124346624:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155550.201947:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d583e00/0x844e5faceb5e7dc8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eaf6 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.201955:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d583e00/0x844e5faceb5e7dc8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eaf6 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.201962:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d583e00, rc 0) 00000100:00100000:0.0:1746155550.201978:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+7:1963:x1830976123141504:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2490us (2882us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155550.201983:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10603 00000100:00100000:0.0:1746155550.215241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.215269:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123142272 00000100:00100000:0.0:1746155550.215277:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123142272 00000100:00100000:0.0:1746155550.215312:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3830 00000100:00100000:0.0:1746155550.215319:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+8:28408:x1830976123142272:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155550.215493:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+9:28408:x1830976123142272:12345-192.168.202.51@tcp:35:cat.0 Request processed in 174us (258us total) trans 8589943551 rc 0/0 00000100:00100000:0.0:1746155550.215499:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3830 00000100:00100000:0.0:1746155550.237209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.240283:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.240317:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.240726:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.240926:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.245934:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.248687:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.251305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.253311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.255263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.255592:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.255620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.255653:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.256194:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10615 00000100:00100000:0.0:1746155550.256201:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123144576:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155550.256207:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155550.256214:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5e7e5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0eb58 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155550.256233:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124348544:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155550.256359:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155550.258282:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009018a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124348544:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155550.258305:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5e7e5b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb58 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.258324:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5e7e5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb58 expref: 8 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.258333:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d583800, rc 0) 00000100:00100000:0.0:1746155550.258715:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976123144576:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2513us (3060us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155550.258720:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10615 00000100:00100000:0.0:1746155550.260828:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.263401:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.263446:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.264047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.264097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.264110:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.264127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.266227:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.266268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.288323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155550.289257:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f62e600/0x844e5faceb5e7e77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.289265:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f62e600/0x844e5faceb5e7e77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.289280:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f62e600/0x844e5faceb5e7e77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.289292:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f62e600/0x844e5faceb5e7e77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.289298:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f62e600/0x844e5faceb5e7e77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.289304:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f62e600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155550.289307:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f62e600/0x844e5faceb5e7e77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.289314:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f62e600/0x844e5faceb5e7e77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.289323:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f62e600/0x844e5faceb5e7e77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.289329:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f62e600/0x844e5faceb5e7e77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155550.289368:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123145088:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 25712us (25972us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155550.289374:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10616 00000100:00100000:0.0:1746155550.289411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.290780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.291006:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5223 00000100:00100000:0.0:1746155550.291013:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1962:x1830976123147264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155550.291021:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155550.291032:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d41b800/0x844e5faceb5e7d5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ea8d expref: 13 pid: 18270 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746155550.291039:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d41b800/0x844e5faceb5e7d5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ea8d expref: 13 pid: 18270 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746155550.291049:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d41b800/0x844e5faceb5e7d5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ea8d expref: 13 pid: 18270 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746155550.291057:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155550.291059:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155550.291061:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b18d400/0x844e5faceb5e7e85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.291067:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b18d400/0x844e5faceb5e7e85 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.291080:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155550.291095:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1962:x1830976123147264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 83us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155550.291100:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5223 00010000:00010000:0.0:1746155550.291117:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b18d400/0x844e5faceb5e7e85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.291123:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b18d400/0x844e5faceb5e7e85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.291140:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b18d400/0x844e5faceb5e7e85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.291146:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b18d400/0x844e5faceb5e7e85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.291152:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b18d400/0x844e5faceb5e7e85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.291157:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b18d400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155550.291160:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b18d400/0x844e5faceb5e7e85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.291166:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b18d400/0x844e5faceb5e7e85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.291175:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b18d400/0x844e5faceb5e7e85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.291185:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b18d400/0x844e5faceb5e7e85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155550.291229:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123145600:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 26938us (27181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155550.291235:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10618 00000100:00100000:0.0:1746155550.292265:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.309094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.312723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.318800:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.318829:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.318873:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000040:00080000:0.0:1746155550.320581:0:14232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2678, 88 off222768 00000004:00080000:0.0:1746155550.320586:0:14232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679470083524ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155550.320607:0:14232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2713, 88 off226112 00000004:00080000:0.0:1746155550.320610:0:14232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679470107278ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155550.320624:0:14232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2714, 88 off226200 00000004:00080000:0.0:1746155550.320627:0:14232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679470123871ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155550.320632:0:14232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2715, 88 off226288 00000004:00080000:0.0:1746155550.320634:0:14232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679470131574ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155550.320639:0:14232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2716, 88 off226376 00000004:00080000:0.0:1746155550.320641:0:14232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679470138419ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155550.320646:0:14232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2679, 88 off222856 00000004:00080000:0.0:1746155550.320648:0:14232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679470145403ns, next at 645866785986ns, rc = 0 00000100:00100000:0.0:1746155550.344523:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124351616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.344549:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.344562:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124352128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.344579:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.344589:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746155550.344592:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124351744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.344609:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.344618:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124352256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.344635:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.344657:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124351616 00000100:00100000:0.0:1746155550.344659:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124351616 00000100:00100000:0.0:1746155550.344677:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124352128 00000100:00100000:0.0:1746155550.344679:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124352128 00000100:00100000:0.0:1746155550.344686:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124351744 00000100:00100000:0.0:1746155550.344687:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124351744 00000100:00100000:0.0:1746155550.344703:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10634 00000100:00100000:0.0:1746155550.344708:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976124351616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.344826:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3297:x1830976124351616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (274us total) trans 17179872941 rc 0/0 00000100:00100000:0.0:1746155550.344831:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10634 00000100:00100000:0.0:1746155550.344841:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10637 00000100:00100000:0.0:1746155550.344851:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124352256:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155550.344932:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095269500/2, rc 0, transno 17179872942 00000100:00100000:0.0:1746155550.344935:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124351744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155550.344947:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526a300/2, rc 0, transno 17179872941 00000100:00100000:0.0:1746155550.344949:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124351616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155550.344955:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fef0700/2, rc 0, transno 17179872943 00000100:00100000:0.0:1746155550.344957:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124352128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155550.344963:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ee680/2, rc 0, transno 17179872944 00000100:00100000:0.0:1746155550.344971:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124352256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.346631:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.349843:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.352707:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.352740:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.352933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.353035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.353046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.353065:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.353338:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10640 00000100:00100000:0.0:1746155550.353346:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123148928:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155550.353354:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155550.353362:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d583600/0x844e5faceb5e7ec4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0eb90 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155550.353375:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x6814381e, atime: 0x6814381e, ctime: 0x6814381e, blocks: 0x821 00010000:00010000:0.0:1746155550.353385:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155550.353386:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155550.353394:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d583600/0x844e5faceb5e7ec4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb90 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.353403:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d583600/0x844e5faceb5e7ec4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb90 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.353409:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d583600, rc 0) 00000100:00100000:0.0:1746155550.353426:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123148928:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 82us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155550.353431:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10640 00000100:00100000:0.0:1746155550.353443:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10644 00000100:00100000:0.0:1746155550.353448:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123149056:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155550.353453:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155550.353461:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5e7ee0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0eb97 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155550.353470:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d9:0x0] initial LVB size: 4603200, mtime: 0x6814381e, atime: 0x6814381e, ctime: 0x6814381e, blocks: 0x135d 00010000:00010000:0.0:1746155550.353477:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155550.353478:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155550.353482:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5e7ee0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb97 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.353489:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5e7ee0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb97 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.353495:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d583200, rc 0) 00000100:00100000:0.0:1746155550.353537:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123149056:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 89us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155550.353542:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10644 00000100:00100000:0.0:1746155550.361448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.363320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.363350:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.363387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.363406:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123149696 00000100:00100000:0.0:1746155550.363409:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123149696 00000100:00100000:0.0:1746155550.363432:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123149952 00000100:00100000:0.0:1746155550.363434:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123149952 00000100:00100000:0.0:1746155550.363446:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123150208 00000100:00100000:0.0:1746155550.363448:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123150208 00000100:00100000:0.0:1746155550.363461:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3840 00000100:00100000:0.0:1746155550.363466:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123149696:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155550.363482:0:31249:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5e7eee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.363492:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155550.363493:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155550.363495:0:31249:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5e7eee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.363518:0:31249:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5e7eee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155550.365696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.397178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.399440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.399471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.399497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.399981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.400059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.400091:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123152000 00000100:00100000:0.0:1746155550.400093:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123152000 00000100:00100000:0.0:1746155550.400112:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10646 00000100:00100000:0.0:1746155550.400116:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123151872:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:0.0:1746155550.400196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:0.0:1746155550.400270:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155550.400273:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.400275:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.400276:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.400278:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155550.400316:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123151872:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 199us (817us total) trans 17179872946 rc 0/0 00000100:00100000:0.0:1746155550.400325:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10646 00000100:00100000:0.0:1746155550.402995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.404543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.426722:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124353024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.426750:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.426762:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124353536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.426776:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.427057:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124352768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.427074:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.427152:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124353280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.427167:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.427188:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10651 00000100:00100000:0.0:1746155550.427194:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3296:x1830976124352640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155550.427339:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155550.427342:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.427344:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.427346:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.427347:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:0.0:1746155550.427368:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3296:x1830976124352640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (681us total) trans 21474840316 rc 0/0 00000100:00100000:0.0:1746155550.427636:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10651 00000100:00100000:0.0:1746155550.427646:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10654 00000100:00100000:0.0:1746155550.427651:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976124353536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.427926:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3295:x1830976124353536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 275us (1148us total) trans 21474840317 rc 0/0 00000100:00100000:0.0:1746155550.427931:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10654 00000004:00080000:0.0:1746155550.427961:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910d9f80/2, rc 0, transno 21474840316 00000100:00100000:0.0:1746155550.427968:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124352640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.428004:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3296:x1830976124353152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 804us (1278us total) trans 21474840315 rc 0/0 00000100:00100000:0.0:1746155550.428008:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10652 00000004:00080000:0.0:1746155550.428026:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910dad80/2, rc 0, transno 21474840315 00000100:00100000:0.0:1746155550.428029:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124353152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155550.428042:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910dbb80/2, rc 0, transno 21474840314 00000100:00100000:0.0:1746155550.428045:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124353024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155550.428050:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c5180/2, rc 0, transno 21474840317 00000100:00100000:0.0:1746155550.428052:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124353536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.428781:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.428821:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124354048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.428839:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.428852:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124354560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.428864:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.428872:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746155550.428876:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124354176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.428887:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.428895:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009486ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124354688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.428904:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.428916:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124354048 00000100:00100000:0.0:1746155550.428919:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124354048 00000100:00100000:0.0:1746155550.428930:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124354560 00000100:00100000:0.0:1746155550.428932:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124354560 00000100:00100000:0.0:1746155550.428939:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124354176 00000100:00100000:0.0:1746155550.428940:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124354176 00000100:00100000:0.0:1746155550.428947:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124354688 00000100:00100000:0.0:1746155550.428949:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124354688 00000100:00100000:0.0:1746155550.428958:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10660 00000100:00100000:0.0:1746155550.428962:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3295:x1830976124354048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155550.429045:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155550.429048:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.429049:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.429051:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.429053:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155550.429067:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3295:x1830976124354048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (227us total) trans 17179872948 rc 0/0 00000100:00100000:0.0:1746155550.429072:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10660 00000100:00100000:0.0:1746155550.429409:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10662 00000100:00100000:0.0:1746155550.429425:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3295:x1830976124354176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.430375:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3295:x1830976124354176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 949us (1485us total) trans 17179872952 rc 0/0 00000100:00100000:0.0:1746155550.430379:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10662 00000100:00100000:0.0:1746155550.432095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.450266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.455516:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123153920 00000100:00100000:0.0:1746155550.455520:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123153920 00000100:00100000:0.0:1746155550.455547:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10668 00000100:00100000:0.0:1746155550.455552:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:28429:x1830976123153920:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155550.455559:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155550.455566:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f76c00/0x844e5faceb5e7f88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ebc1 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.455578:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155550.455580:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155550.455585:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f76c00/0x844e5faceb5e7f88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebc1 expref: 13 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.455594:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135f76c00/0x844e5faceb5e7f88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebc1 expref: 13 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.455601:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f76c00, rc 0) 00000100:00100000:0.0:1746155550.456362:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:28429:x1830976123153920:12345-192.168.202.51@tcp:101:cat.0 Request processed in 808us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155550.456368:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10668 00000100:00100000:0.0:1746155550.459420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.461822:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.462474:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.479789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.483069:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.483108:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.483183:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.483925:0:14233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9694 00000100:00100000:0.0:1746155550.483933:0:14233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:28430:x1830976123155200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155550.483954:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155550.483970:0:14233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5e7fc0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ebdd expref: -99 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.484096:0:14233:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5e7fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebdd expref: 12 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.484108:0:14233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5e7fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebdd expref: 12 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.484124:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155550.484126:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155550.484129:0:14233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca18e00, rc 0) 00000100:00100000:0.0:1746155550.484166:0:14233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:28430:x1830976123155200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 234us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155550.484171:0:14233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9694 00000100:00100000:0.0:1746155550.492431:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.492486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.505488:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.505549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.505571:0:14233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123155968 00000100:00100000:0.0:1746155550.505578:0:14233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123155968 00000100:00100000:0.0:1746155550.508116:0:14233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9695 00000100:00100000:0.0:1746155550.508125:0:14233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:28429:x1830976123155968:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155550.508141:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155550.508151:0:14233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19800/0x844e5faceb5e7fdc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ebeb expref: -99 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.508187:0:14233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bca000/0x844e5faceb5e7fce lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155550.508194:0:14233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19800/0x844e5faceb5e7fdc lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebeb expref: 289 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.508205:0:14233:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093bca000/0x844e5faceb5e7fce lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155550.508214:0:14233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19800/0x844e5faceb5e7fdc lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebeb expref: 289 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.508221:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155550.508224:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155550.508226:0:14233:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19800/0x844e5faceb5e7fdc lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebeb expref: 289 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.508231:0:14233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19800, rc 0) 00000100:00100000:0.0:1746155550.511400:0:14233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:28429:x1830976123155968:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3274us (5848us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155550.511407:0:14233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9695 00000100:00100000:0.0:1746155550.520050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.524100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.534725:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124355456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.534775:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.534792:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124355968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.534811:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.534827:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746155550.534831:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124355584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.534847:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.534857:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124356096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.534867:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.534885:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124355712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.534898:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.534909:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124356224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.534921:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.534930:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746155550.534933:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124355840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.534943:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.534950:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124356352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.534960:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.534979:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124355456 00000100:00100000:0.0:1746155550.534985:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124355456 00000100:00100000:0.0:1746155550.535015:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124355968 00000100:00100000:0.0:1746155550.535017:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124355968 00000100:00100000:0.0:1746155550.535027:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124355584 00000100:00100000:0.0:1746155550.535029:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124355584 00000100:00100000:0.0:1746155550.535038:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124356096 00000100:00100000:0.0:1746155550.535040:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124356096 00000100:00100000:0.0:1746155550.535048:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124355712 00000100:00100000:0.0:1746155550.535049:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124355712 00000100:00100000:0.0:1746155550.535055:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124356224 00000100:00100000:0.0:1746155550.535057:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124356224 00000100:00100000:0.0:1746155550.535062:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124355840 00000100:00100000:0.0:1746155550.535064:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124355840 00000100:00100000:0.0:1746155550.535070:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124356352 00000100:00100000:0.0:1746155550.535072:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124356352 00000100:00100000:0.0:1746155550.535080:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10672 00000100:00100000:0.0:1746155550.535086:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3297:x1830976124355456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155550.535232:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155550.535235:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.535237:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.535239:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.535240:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155550.535266:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3297:x1830976124355456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (491us total) trans 17179872956 rc 0/0 00000100:00100000:0.0:1746155550.535272:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10672 00000100:00100000:0.0:1746155550.535286:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10673 00000100:00100000:0.0:1746155550.535291:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3297:x1830976124355968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.535371:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3297:x1830976124355968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (558us total) trans 17179872957 rc 0/0 00000100:00100000:0.0:1746155550.535376:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10673 00000100:00100000:0.0:1746155550.535385:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10674 00000100:00100000:0.0:1746155550.535389:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3297:x1830976124355584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155550.535453:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155550.535455:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.535457:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.535459:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.535461:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155550.535478:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3297:x1830976124355584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (629us total) trans 17179872958 rc 0/0 00000100:00100000:0.0:1746155550.535483:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10674 00000100:00100000:0.0:1746155550.535492:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10675 00000100:00100000:0.0:1746155550.535497:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3297:x1830976124356096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.535587:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3297:x1830976124356096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (718us total) trans 17179872959 rc 0/0 00000100:00100000:0.0:1746155550.535592:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10675 00000100:00100000:0.0:1746155550.535600:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10676 00000100:00100000:0.0:1746155550.535604:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830976124355712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155550.535662:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155550.535664:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.535666:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.535668:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155550.535669:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155550.535688:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830976124355712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (789us total) trans 17179872960 rc 0/0 00000100:00100000:0.0:1746155550.535693:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10676 00000100:00100000:0.0:1746155550.535702:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10677 00000100:00100000:0.0:1746155550.535706:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830976124356224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.535785:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830976124356224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (862us total) trans 17179872961 rc 0/0 00000100:00100000:0.0:1746155550.535789:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10677 00000100:00100000:0.0:1746155550.535797:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10678 00000100:00100000:0.0:1746155550.535802:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830976124355840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.535871:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830976124355840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (925us total) trans 17179872962 rc 0/0 00000100:00100000:0.0:1746155550.535875:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10678 00000100:00100000:0.0:1746155550.535883:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10679 00000100:00100000:0.0:1746155550.535888:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830976124356352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.535949:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830976124356352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (988us total) trans 17179872963 rc 0/0 00000100:00100000:0.0:1746155550.535954:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10679 00000004:00080000:0.0:1746155550.535996:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f700e00/2, rc 0, transno 17179872962 00000100:00100000:0.0:1746155550.536001:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124355840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155550.536007:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f703800/2, rc 0, transno 17179872963 00000100:00100000:0.0:1746155550.536010:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124356352:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155550.536015:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c28df80/2, rc 0, transno 17179872960 00000100:00100000:0.0:1746155550.536017:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124355712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155550.536022:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f703480/2, rc 0, transno 17179872961 00000100:00100000:0.0:1746155550.536024:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124356224:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155550.536037:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c28e680/2, rc 0, transno 17179872958 00000100:00100000:0.0:1746155550.536039:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124355584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155550.536044:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f700700/2, rc 0, transno 17179872959 00000100:00100000:0.0:1746155550.536046:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124356096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155550.536052:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c28d500/2, rc 0, transno 17179872956 00000100:00100000:0.0:1746155550.536053:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124355456:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155550.536058:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f700a80/2, rc 0, transno 17179872957 00000100:00100000:0.0:1746155550.536060:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124355968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155550.537529:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124356608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.537547:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.538170:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124357120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.538186:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.540095:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1746155550.540105:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124356480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.540133:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.541004:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124356992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.541020:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.541469:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124357504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.541486:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155550.541517:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ed880/2, rc 0, transno 21474840328 00000100:00100000:0.0:1746155550.541521:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124356608:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155550.541529:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ef800/2, rc 0, transno 21474840327 00000100:00100000:0.0:1746155550.541532:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124357120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.542235:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000004:00080000:0.0:1746155550.542717:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ec380/2, rc 0, transno 21474840331 00000100:00100000:0.0:1746155550.542720:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124356480:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155550.542726:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3edc00/2, rc 0, transno 21474840329 00000100:00100000:0.0:1746155550.542738:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124356992:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155550.542744:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf4700/2, rc 0, transno 21474840330 00000100:00100000:0.0:1746155550.542746:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124357504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155550.544795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.547257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.549853:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.551645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.555385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.568382:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.574887:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.574926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.576110:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123158144 00000100:00100000:0.0:1746155550.576113:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123158144 00000100:00100000:0.0:1746155550.576135:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10691 00000100:00100000:0.0:1746155550.576140:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:28424:x1830976123158144:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155550.576147:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155550.576156:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fa5e00/0x844e5faceb5e8006 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ec15 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.576172:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5e7ebd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb82 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.576180:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50e00/0x844e5faceb5e7fe3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebf2 expref: 7 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.576190:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fccc600/0x844e5faceb5e7fd5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebe4 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.576195:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155550.576196:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155550.576199:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fa5e00/0x844e5faceb5e8006 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1118208->1613823] (req 1118208->1613823) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec15 expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.576223:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fccc600/0x844e5faceb5e7fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebe4 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.576237:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fccc600/0x844e5faceb5e7fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebe4 expref: 22 pid: 8437 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746155550.576247:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124357888:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155550.576295:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd50e00/0x844e5faceb5e7fe3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebf2 expref: 7 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.576302:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd50e00/0x844e5faceb5e7fe3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebf2 expref: 7 pid: 9235 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746155550.576308:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124358016:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155550.576326:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5e7ebd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb82 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155550.576333:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5e7ebd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb82 expref: 10 pid: 1625 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746155550.576340:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124358144:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155550.576353:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155550.581445:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123158272 00000100:00100000:0.0:1746155550.581448:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123158272 00010000:00010000:0.0:1746155550.581461:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fccc600/0x844e5faceb5e7fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebe4 expref: 22 pid: 8437 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746155550.581497:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5234 00000100:00100000:0.0:1746155550.582310:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123158272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155550.582324:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155550.582343:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fccc600/0x844e5faceb5e7fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebe4 expref: 22 pid: 8437 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746155550.582352:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fccc600/0x844e5faceb5e7fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebe4 expref: 22 pid: 8437 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746155550.582369:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fccc600/0x844e5faceb5e7fd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebe4 expref: 22 pid: 8437 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746155550.582387:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155550.582417:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123158272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 913us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155550.582423:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5234 00000100:00100000:0.0:1746155550.582438:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5235 00000100:00100000:0.0:1746155550.582443:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123158400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155550.582450:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155550.582457:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5e7ebd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb82 expref: 11 pid: 1625 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746155550.582464:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5e7ebd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb82 expref: 11 pid: 1625 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746155550.582479:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5e7ebd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb82 expref: 11 pid: 1625 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746155550.582487:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155550.582793:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123158400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 348us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155550.582798:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5235 00000100:00100000:0.0:1746155550.583457:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3853 00000100:00100000:0.0:1746155550.583462:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123159040:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155550.586670:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.592558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.596614:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.604222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.605079:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.607223:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.611631:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.612767:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.632430:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.632463:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.632497:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.643912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.644645:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.649153:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.650723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.652678:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.657244:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123161856:12345-192.168.202.51@tcp:4:cat.0 Request processed in 7362us (8090us total) trans 21474840332 rc 0/0 00000100:00100000:0.0:1746155550.657254:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 521 00002000:00100000:0.0:1746155550.657264:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3649536->3964927) req@ffff88013089ad80 x1830976123161856/t21474840332(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:621/0 lens 488/448 e 0 to 0 dl 1746155561 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155550.657272:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089ad80 with x1830976123161856 ext(3649536->3964927) 00010000:00010000:0.0:1746155550.657280:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5e7ff8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3649536->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec07 expref: 14 pid: 18270 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746155550.657294:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5e7ff8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3649536->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec07 expref: 14 pid: 18270 timeout: 779 lvb_type: 0 00002000:00010000:0.0:1746155550.657300:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013089ad80 00000100:00100000:0.0:1746155550.676164:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.680163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.680215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.686442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.686480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.686544:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.688471:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3866 00000100:00100000:0.0:1746155550.688480:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123164160:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155550.704575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.705708:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123164160:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17228us (19161us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155550.705714:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3866 00002000:00100000:0.0:1746155550.705721:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800a6060e00 x1830976123164160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:621/0 lens 488/440 e 0 to 0 dl 1746155561 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155550.705737:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060e00 with x1830976123164160 ext(3145728->4194303) 00002000:00010000:0.0:1746155550.705740:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6060e00 00000100:00100000:0.0:1746155550.713452:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.715208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.728172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.728225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.736642:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.744690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.786692:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124359168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746155550.786758:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155550.787023:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124359168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746155550.810835:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.828819:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.837971:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.866385:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.872367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.872434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.875168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.877643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.881135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.881166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.881199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.889156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.894988:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.895035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.905385:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.920649:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.926830:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.945789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.957746:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.972069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.972797:0:14233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123169408 00000100:00100000:0.0:1746155550.972805:0:14233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123169408 00000100:00100000:0.0:1746155550.972841:0:14233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9701 00000100:00100000:0.0:1746155550.972848:0:14233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:28445:x1830976123169408:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155550.972866:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155550.972880:0:14233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130886a00/0x844e5faceb5e80df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ec9a expref: -99 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.972952:0:14233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886600/0x844e5faceb5e80e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.972962:0:14233:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130886600/0x844e5faceb5e80e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.972970:0:14233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130886600/0x844e5faceb5e80e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.972980:0:14233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5e80ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.972985:0:14233:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5e80ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.972989:0:14233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5e80ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973067:0:14233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5e80f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973074:0:14233:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5e80f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973078:0:14233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5e80f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 00000004:00200000:0.0:1746155550.973085:0:14233:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 8797504 00010000:00010000:0.0:1746155550.973140:0:14233:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886600/0x844e5faceb5e80e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973145:0:14233:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130886600/0x844e5faceb5e80e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973150:0:14233:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130886600/0x844e5faceb5e80e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973154:0:14233:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130886600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155550.973156:0:14233:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130886600/0x844e5faceb5e80e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973161:0:14233:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130886600/0x844e5faceb5e80e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973168:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155550.973170:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155550.973172:0:14233:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130886600/0x844e5faceb5e80e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973176:0:14233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130886600/0x844e5faceb5e80e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973201:0:14233:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5e80ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973205:0:14233:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5e80ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973209:0:14233:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5e80ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973212:0:14233:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130886000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155550.973214:0:14233:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5e80ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973218:0:14233:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5e80ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973222:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a541d200) 00010000:00010000:0.0:1746155550.973224:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155550.973225:0:14233:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5e80ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973229:0:14233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5e80ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155550.973254:0:14233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130886a00/0x844e5faceb5e80df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec9a expref: 294 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.973261:0:14233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5e80f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec9a expref: 293 pid: 14233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155550.973266:0:14233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155550.973268:0:14233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155550.973270:0:14233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130886200, rc 0) 00000100:00100000:0.0:1746155550.973288:0:14233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:28445:x1830976123169408:12345-192.168.202.51@tcp:101:cat.0 Request processed in 441us (1228us total) trans 8589943573 rc 0/0 00000100:00100000:0.0:1746155550.973293:0:14233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9701 00000100:00100000:0.0:1746155550.977114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.977154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.977197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.977832:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.991658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.991691:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.991711:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.991752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.997370:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155550.997394:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123171200 00000100:00100000:0.0:1746155550.997400:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123171200 00002000:00100000:0.0:1746155550.997433:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009286ed80 x1830976123171200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:621/0 lens 488/0 e 0 to 0 dl 1746155561 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155550.997441:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286ed80 with x1830976123171200 ext(0->1048575) 00002000:00010000:0.0:1746155550.997445:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286ed80 00000100:00100000:0.0:1746155550.997463:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3876 00000100:00100000:0.0:1746155550.997470:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1962:x1830976123171200:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155551.022845:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1962:x1830976123171200:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25372us (25479us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155551.022853:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3876 00002000:00100000:0.0:1746155551.022860:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009286ed80 x1830976123171200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:621/0 lens 488/440 e 0 to 0 dl 1746155561 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.022869:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286ed80 with x1830976123171200 ext(0->1048575) 00002000:00010000:0.0:1746155551.022873:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286ed80 00000100:00100000:0.0:1746155551.027599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.029319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.042190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.044563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.047494:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.047550:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.056892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.056937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.060740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.061170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.061185:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123173504 00000100:00100000:0.0:1746155551.061187:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123173504 00002000:00100000:0.0:1746155551.061210:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3317759) req@ffff88009ca94e00 x1830976123173504/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:622/0 lens 488/0 e 0 to 0 dl 1746155562 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.061219:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94e00 with x1830976123173504 ext(3145728->3317759) 00010000:00010000:0.0:1746155551.061224:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880132b0ec00/0x844e5faceb5e80ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec85 expref: 12 pid: 18270 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.061233:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880132b0ec00/0x844e5faceb5e80ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3317759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec85 expref: 12 pid: 18270 timeout: 780 lvb_type: 0 00002000:00010000:0.0:1746155551.061239:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca94e00 00000100:00100000:0.0:1746155551.061249:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 527 00000100:00100000:0.0:1746155551.061254:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123173504:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155551.071261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.076208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.081427:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.087036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.108966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.109903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.113558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.114426:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.127791:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976123174912:12345-192.168.202.51@tcp:4:cat.0 Request processed in 13613us (14230us total) trans 21474840334 rc 0/0 00000100:00100000:0.0:1746155551.127803:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 528 00002000:00100000:0.0:1746155551.127812:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3932159) req@ffff88009ca96d80 x1830976123174912/t21474840334(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:622/0 lens 488/448 e 0 to 0 dl 1746155562 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.127821:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96d80 with x1830976123174912 ext(3145728->3932159) 00010000:00010000:0.0:1746155551.127830:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1da7c00/0x844e5faceb5e8156 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3932159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ecd9 expref: 18 pid: 19959 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.127842:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1da7c00/0x844e5faceb5e8156 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3932159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ecd9 expref: 18 pid: 19959 timeout: 780 lvb_type: 0 00002000:00010000:0.0:1746155551.127849:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca96d80 00000100:00100000:0.0:1746155551.136244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.147254:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.151830:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123175936 00000100:00100000:0.0:1746155551.151835:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123175936 00002000:00100000:0.0:1746155551.151858:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009b2f7800 x1830976123175936/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:622/0 lens 488/0 e 0 to 0 dl 1746155562 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.151866:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2f7800 with x1830976123175936 ext(3145728->4194303) 00002000:00010000:0.0:1746155551.151869:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b2f7800 00000100:00100000:0.0:1746155551.151883:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123176320 00000100:00100000:0.0:1746155551.151884:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123176320 00002000:00100000:0.0:1746155551.151895:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009b2f7b80 x1830976123176320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:622/0 lens 488/0 e 0 to 0 dl 1746155562 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.151901:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2f7b80 with x1830976123176320 ext(3145728->4194303) 00002000:00010000:0.0:1746155551.151903:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b2f7b80 00000100:00100000:0.0:1746155551.151910:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123176448 00000100:00100000:0.0:1746155551.151912:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123176448 00002000:00100000:0.0:1746155551.151920:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009b2f7100 x1830976123176448/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:622/0 lens 488/0 e 0 to 0 dl 1746155562 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.151926:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b2f7100 with x1830976123176448 ext(3145728->4194303) 00002000:00010000:0.0:1746155551.151928:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b2f7100 00000100:00100000:0.0:1746155551.151938:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3883 00000100:00100000:0.0:1746155551.151943:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123175936:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155551.162671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.171128:0:14233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdece00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14233:1830976124362368:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155551.171147:0:14233:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287600/0x844e5faceb5e818e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 00000100:00100000:0.0:1746155551.176366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.180892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.185129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.192207:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.195870:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123177728 00000100:00100000:0.0:1746155551.195877:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123177728 00000100:00100000:0.0:1746155551.195921:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10721 00000100:00100000:0.0:1746155551.195927:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b2f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123177728:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155551.195934:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155551.195944:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x844e5faceb5e81a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ed0a expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.195955:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.195956:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.195961:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x844e5faceb5e81a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed0a expref: 12 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.195970:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x844e5faceb5e81a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed0a expref: 12 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.195976:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d400, rc 0) 00000100:00100000:0.0:1746155551.196000:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b2f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123177728:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.196005:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10721 00000100:00100000:0.0:1746155551.206231:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.207915:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.213170:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.217326:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.221492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.221624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.225826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.228938:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123180544 00000100:00100000:0.0:1746155551.228943:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123180544 00000100:00100000:0.0:1746155551.228973:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10724 00000100:00100000:0.0:1746155551.228978:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+14:28447:x1830976123180544:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155551.228986:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155551.228995:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1c000/0x844e5faceb5e81fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ed42 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.229012:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5e816b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ecee expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.229020:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x844e5faceb5e81a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed0a expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.229027:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1da6000/0x844e5faceb5e8172 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ecf5 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.229032:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.229033:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.229036:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1c000/0x844e5faceb5e81fe lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [4194304->4575231] (req 4194304->4575231) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed42 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.229062:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1da6000/0x844e5faceb5e8172 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ecf5 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.229072:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1da6000/0x844e5faceb5e8172 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ecf5 expref: 17 pid: 20796 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746155551.229085:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124363392:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155551.229158:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x844e5faceb5e81a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed0a expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.229166:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d400/0x844e5faceb5e81a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed0a expref: 11 pid: 10591 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746155551.229173:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124363520:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155551.229195:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5e816b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ecee expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.229202:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5e816b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ecee expref: 15 pid: 20796 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746155551.229209:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124363648:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155551.229224:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155551.234220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.234259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.237025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.238804:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.246498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.248829:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.250671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.253788:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.253827:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.254103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.254116:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123182208 00000100:00100000:0.0:1746155551.254119:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123182208 00010000:00010000:0.0:1746155551.254132:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5faa400/0x844e5faceb5e80d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec93 expref: 12 pid: 19959 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746155551.254149:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5259 00000100:00100000:0.0:1746155551.254155:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123182208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155551.254162:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155551.254428:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5faa400/0x844e5faceb5e80d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec93 expref: 12 pid: 19959 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.254443:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5faa400/0x844e5faceb5e80d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec93 expref: 12 pid: 19959 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.254455:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5faa400/0x844e5faceb5e80d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec93 expref: 12 pid: 19959 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.254741:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.254743:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.254749:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5e8213 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1662975) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed49 expref: 24 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.254757:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5e8213 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1662975) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed49 expref: 24 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.254782:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5e8213 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed49 expref: 24 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155551.254791:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124364288:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155551.255029:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155551.256446:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.261606:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.264430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.324416:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.327361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.327884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.335126:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.335315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.339159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.339194:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.352734:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123184512 00000100:00100000:0.0:1746155551.352741:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123184512 00000100:00100000:0.0:1746155551.352769:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123184384 00000100:00100000:0.0:1746155551.352771:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123184384 00000100:00100000:0.0:1746155551.352780:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123184640 00000100:00100000:0.0:1746155551.352781:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123184640 00000100:00100000:0.0:1746155551.352793:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10730 00000100:00100000:0.0:1746155551.352799:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123184512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155551.352812:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155551.352825:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5e826e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ed81 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155551.352864:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124365056:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155551.352929:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155551.356543:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.360462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.368562:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123185024 00000100:00100000:0.0:1746155551.368570:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123185024 00002000:00100000:0.0:1746155551.368604:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3620864->4194303) req@ffff880130c9d880 x1830976123185024/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:622/0 lens 488/0 e 0 to 0 dl 1746155562 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.368613:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9d880 with x1830976123185024 ext(3620864->4194303) 00010000:00010000:0.0:1746155551.368622:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094219c00/0x844e5faceb5e81bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed1f expref: 12 pid: 9235 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.368632:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094219c00/0x844e5faceb5e81bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed1f expref: 12 pid: 9235 timeout: 780 lvb_type: 0 00002000:00010000:0.0:1746155551.368639:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130c9d880 00000100:00100000:0.0:1746155551.368666:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 530 00000100:00100000:0.0:1746155551.368673:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123185024:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155551.380466:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123185408 00000100:00100000:0.0:1746155551.380474:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123185408 00002000:00100000:0.0:1746155551.380541:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009f702d80 x1830976123185408/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:622/0 lens 488/0 e 0 to 0 dl 1746155562 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.380550:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f702d80 with x1830976123185408 ext(1048576->2097151) 00002000:00010000:0.0:1746155551.380562:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f702d80 00000100:00100000:0.0:1746155551.380583:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3893 00000100:00100000:0.0:1746155551.380591:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123185408:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155551.384820:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.390925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.405688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.409100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.409174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.411394:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.412470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.416035:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.422952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.422982:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.428874:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.429137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.437617:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.446584:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.448520:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.451670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.452408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.452568:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.453169:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123190016 00000100:00100000:0.0:1746155551.453172:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123190016 00002000:00100000:0.0:1746155551.453187:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012cdcc380 x1830976123190016/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:622/0 lens 504/0 e 0 to 0 dl 1746155562 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.453194:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcc380 with x1830976123190016 ext(3145728->4194303) 00010000:00010000:0.0:1746155551.453198:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800903df400/0x844e5faceb5e82c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->3883007) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0edb2 expref: 15 pid: 20796 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.453206:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800903df400/0x844e5faceb5e82c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3747840->3883007) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0edb2 expref: 15 pid: 20796 timeout: 780 lvb_type: 0 00002000:00010000:0.0:1746155551.453212:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdcc380 00000100:00100000:0.0:1746155551.453224:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 532 00000100:00100000:0.0:1746155551.453231:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976123189504:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155551.467138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.467832:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.471600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.473830:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.488482:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.488549:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.488576:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.488765:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10743 00000100:00100000:0.0:1746155551.488771:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123191040:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155551.488777:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155551.488785:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cf0f800/0x844e5faceb5e82ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0eddc expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.488794:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.488795:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.488802:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0f800/0x844e5faceb5e82ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eddc expref: 28 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.488813:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cf0f800/0x844e5faceb5e82ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eddc expref: 28 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.488821:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0f800, rc 0) 00000100:00100000:0.0:1746155551.488854:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123191040:12345-192.168.202.51@tcp:101:cat.0 Request processed in 83us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.488859:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10743 00000100:00100000:0.0:1746155551.493128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.495157:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.496158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.503291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.505843:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.509954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.512555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.514713:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.520618:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.550605:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.557463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.557925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.561142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.563530:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123193728 00000100:00100000:0.0:1746155551.563537:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123193728 00010000:00010000:0.0:1746155551.563563:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800903de400/0x844e5faceb5e829f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed9d expref: 300 pid: 14232 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746155551.563593:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5270 00000100:00100000:0.0:1746155551.563600:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1962:x1830976123193728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155551.563614:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155551.563619:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800903de400/0x844e5faceb5e829f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed9d expref: 300 pid: 14232 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.563628:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800903de400/0x844e5faceb5e829f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed9d expref: 300 pid: 14232 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.563644:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903de400/0x844e5faceb5e829f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ed9d expref: 300 pid: 14232 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.563660:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155551.563664:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac8800/0x844e5faceb5e8324 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155551.563671:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac8800/0x844e5faceb5e8324 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155551.564021:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac8800/0x844e5faceb5e8324 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14233 initiator: MDT0 00000100:00100000:0.0:1746155551.570320:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.570357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.570392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.572690:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.574641:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.577156:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.582081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.586981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.591924:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123195136 00000100:00100000:0.0:1746155551.591932:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123195136 00000100:00100000:0.0:1746155551.591979:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10750 00000100:00100000:0.0:1746155551.591987:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123195136:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155551.592022:0:10591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012a272e00/0x844e5faceb5e8378 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.592038:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff40200/0x844e5faceb5e7ed2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb7b expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.592051:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5e7fb9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebcf expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.592057:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f76c00/0x844e5faceb5e7f88 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebc1 expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.592064:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.592065:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.592067:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a272e00/0x844e5faceb5e8378 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.592094:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135f76c00/0x844e5faceb5e7f88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebc1 expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.592104:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135f76c00/0x844e5faceb5e7f88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebc1 expref: 20 pid: 9235 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746155551.592119:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124368000:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155551.592255:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5e7fb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebcf expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.592264:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5e7fb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebcf expref: 17 pid: 9235 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746155551.592271:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124368128:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155551.592299:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff40200/0x844e5faceb5e7ed2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb7b expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.592307:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff40200/0x844e5faceb5e7ed2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eb7b expref: 12 pid: 1625 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746155551.592314:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124368256:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155551.592331:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155551.612399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.615118:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123196416 00000100:00100000:0.0:1746155551.615122:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123196416 00010000:00010000:0.0:1746155551.615139:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132b0fa00/0x844e5faceb5e801b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec2a expref: 17 pid: 18270 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746155551.615159:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123196544 00000100:00100000:0.0:1746155551.615161:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123196544 00010000:00010000:0.0:1746155551.615168:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da8e800/0x844e5faceb5e8339 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee14 expref: 14 pid: 29728 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746155551.615178:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123196672 00000100:00100000:0.0:1746155551.615179:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123196672 00010000:00010000:0.0:1746155551.615187:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094219800/0x844e5faceb5e82de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0edce expref: 16 pid: 29728 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746155551.615197:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5277 00000100:00100000:0.0:1746155551.615201:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123196416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155551.615209:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155551.615218:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132b0fa00/0x844e5faceb5e801b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec2a expref: 17 pid: 18270 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.615226:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132b0fa00/0x844e5faceb5e801b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec2a expref: 17 pid: 18270 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.615238:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132b0fa00/0x844e5faceb5e801b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec2a expref: 17 pid: 18270 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.615249:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155551.615268:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123196416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 66us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.615273:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5277 00000100:00100000:0.0:1746155551.615301:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5278 00000100:00100000:0.0:1746155551.615306:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1963:x1830976123196544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155551.615312:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155551.615321:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da8e800/0x844e5faceb5e8339 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee14 expref: 14 pid: 29728 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746155551.615329:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da8e800/0x844e5faceb5e8339 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee14 expref: 14 pid: 29728 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746155551.615339:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da8e800/0x844e5faceb5e8339 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee14 expref: 14 pid: 29728 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746155551.615351:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155551.615361:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1963:x1830976123196544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 55us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.615366:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5278 00000100:00100000:0.0:1746155551.615374:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5279 00000100:00100000:0.0:1746155551.615378:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123196672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155551.615383:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155551.615388:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094219800/0x844e5faceb5e82de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0edce expref: 16 pid: 29728 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.615395:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094219800/0x844e5faceb5e82de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0edce expref: 16 pid: 29728 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.615403:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094219800/0x844e5faceb5e82de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0edce expref: 16 pid: 29728 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.615410:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155551.615418:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123196672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 40us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.615423:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5279 00000100:00100000:0.0:1746155551.636705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.636744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.636893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.638074:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123199104 00000100:00100000:0.0:1746155551.638120:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123199104 00010000:00010000:0.0:1746155551.638135:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faa800/0x844e5faceb5e8092 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ec70 expref: 299 pid: 14233 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746155551.638151:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123199744 00000100:00100000:0.0:1746155551.638153:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123199744 00010000:00010000:0.0:1746155551.638161:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bca000/0x844e5faceb5e7fce lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebd6 expref: 21 pid: 20364 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746155551.638174:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5298 00000100:00100000:0.0:1746155551.638180:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123199616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155551.638186:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155551.638190:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f089e00/0x844e5faceb5e7fea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebf9 expref: 21 pid: 14233 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.638205:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f089e00/0x844e5faceb5e7fea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebf9 expref: 21 pid: 14233 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.638217:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f089e00/0x844e5faceb5e7fea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ebf9 expref: 21 pid: 14233 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.638227:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155551.638231:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29a600/0x844e5faceb5e83a2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14233 initiator: MDT0 00010000:00010000:0.0:1746155551.638236:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155551.638252:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123199616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.638257:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5298 00000100:00100000:0.0:1746155551.639991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.645671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.656159:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.656192:0:14232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123200384 00000100:00100000:0.0:1746155551.656200:0:14232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123200384 00000100:00100000:0.0:1746155551.656237:0:14232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9718 00000100:00100000:0.0:1746155551.656244:0:14232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+18:28480:x1830976123200384:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155551.656264:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155551.656279:0:14232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5e83be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ee37 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.657251:0:14232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0e200/0x844e5faceb5e83c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155551.657265:0:14232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0e200/0x844e5faceb5e83c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155551.657273:0:14232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0e200/0x844e5faceb5e83c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155551.657281:0:14232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e83cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155551.657286:0:14232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e83cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155551.657291:0:14232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e83cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00000100:00100000:0.0:1746155551.673120:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124372096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.673140:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155551.673152:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124371840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.673164:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155551.673177:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124372352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.673187:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155551.673198:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746155551.673201:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124371712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.673212:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155551.673221:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124372224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.673232:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155551.673246:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124372224 00000100:00100000:0.0:1746155551.673247:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124372224 00000100:00100000:0.0:1746155551.673263:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10757 00000100:00100000:0.0:1746155551.673266:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3296:x1830976124372096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.673320:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10758 00000100:00100000:0.0:1746155551.673324:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3298:x1830976124371840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.673422:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3298:x1830976124371840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (256us total) trans 17179872970 rc 0/0 00000100:00100000:0.0:1746155551.673427:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10758 00000100:00100000:0.0:1746155551.673439:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10761 00000100:00100000:0.0:1746155551.673443:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3298:x1830976124372224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.673531:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3298:x1830976124372224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (297us total) trans 17179872972 rc 0/0 00000100:00100000:0.0:1746155551.673535:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10761 00000004:00080000:0.0:1746155551.673612:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb6b800/2, rc 0, transno 17179872971 00000100:00100000:0.0:1746155551.673616:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124371712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155551.673623:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9ca80/2, rc 0, transno 17179872972 00000100:00100000:0.0:1746155551.673626:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124372224:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155551.673631:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb6b480/2, rc 0, transno 17179872970 00000100:00100000:0.0:1746155551.673633:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124371840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.674582:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3296:x1830976124372096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1314us (1441us total) trans 17179872974 rc 0/0 00000100:00100000:0.0:1746155551.674587:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10757 00000100:00100000:0.0:1746155551.674599:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124373120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155551.674613:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155551.674631:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb6ad80/2, rc 0, transno 17179872974 00000100:00100000:0.0:1746155551.674634:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124372096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.674640:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124373632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155551.674652:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124373120 00000100:00100000:0.0:1746155551.674654:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124373120 00000100:00100000:0.0:1746155551.674664:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124372736 00000100:00100000:0.0:1746155551.674666:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124372736 00000100:00100000:0.0:1746155551.674672:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124373248 00000100:00100000:0.0:1746155551.674673:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124373248 00000100:00100000:0.0:1746155551.674679:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124372864 00000100:00100000:0.0:1746155551.674680:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124372864 00000100:00100000:0.0:1746155551.674687:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10765 00000100:00100000:0.0:1746155551.674691:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3296:x1830976124373120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155551.674780:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3296:x1830976124373120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (165us total) trans 21474840338 rc 0/0 00000100:00100000:0.0:1746155551.674785:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10765 00000100:00100000:0.0:1746155551.674794:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10767 00000100:00100000:0.0:1746155551.674798:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3297:x1830976124373248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155551.674865:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830976124373248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (217us total) trans 21474840340 rc 0/0 00000100:00100000:0.0:1746155551.674870:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10767 00000100:00100000:0.0:1746155551.674879:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10769 00000100:00100000:0.0:1746155551.674883:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3297:x1830976124373376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155551.674951:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3297:x1830976124373376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (262us total) trans 21474840342 rc 0/0 00000100:00100000:0.0:1746155551.674956:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10769 00000100:00100000:0.0:1746155551.674968:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155551.674983:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1f3100/2, rc 0, transno 21474840338 00000100:00100000:0.0:1746155551.674986:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124373120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155551.674990:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746155551.674993:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124372992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155551.675006:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155551.675015:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124373504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155551.675026:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155551.675074:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3295:x1830976124371584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1812us (1949us total) trans 17179872975 rc 0/0 00000100:00100000:0.0:1746155551.675078:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10756 00000100:00100000:0.0:1746155551.675086:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124373632 00000100:00100000:0.0:1746155551.675088:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124373632 00000100:00100000:0.0:1746155551.675098:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124372992 00000100:00100000:0.0:1746155551.675099:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124372992 00000100:00100000:0.0:1746155551.675104:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124373504 00000100:00100000:0.0:1746155551.675106:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124373504 00000100:00100000:0.0:1746155551.675112:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10770 00000100:00100000:0.0:1746155551.675115:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976124373632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155551.675189:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3296:x1830976124373632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (218us total) trans 21474840343 rc 0/0 00000100:00100000:0.0:1746155551.675193:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10770 00000100:00100000:0.0:1746155551.675203:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10771 00000100:00100000:0.0:1746155551.675206:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976124372992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155551.676128:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:0.0:1746155551.676131:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155551.676133:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155551.676135:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155551.676136:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:0.0:1746155551.676154:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3296:x1830976124372992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 947us (1147us total) trans 21474840344 rc 0/0 00000100:00100000:0.0:1746155551.676159:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10771 00000004:00080000:0.0:1746155551.676183:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a0a80/2, rc 0, transno 17179872973 00000100:00100000:0.0:1746155551.676186:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124372352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.680405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.680908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.680931:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.680946:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123200640 00000100:00100000:0.0:1746155551.680949:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123200640 00010000:00010000:0.0:1746155551.680965:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5e836a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee29 expref: 9 pid: 14233 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746155551.680986:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5301 00000100:00100000:0.0:1746155551.680990:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123200640:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155551.680997:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155551.681001:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5e836a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee29 expref: 9 pid: 14233 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.681008:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5e836a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee29 expref: 9 pid: 14233 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.681020:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5e836a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee29 expref: 9 pid: 14233 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746155551.681032:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155551.681036:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f088200/0x844e5faceb5e83e1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155551.681042:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f088200/0x844e5faceb5e83e1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155551.681046:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f088200/0x844e5faceb5e83e1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155551.681058:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155551.681086:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123200640:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.681092:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5301 00000100:00100000:0.0:1746155551.686277:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.691555:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.692086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.692100:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.692111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.692142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.692156:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123202048 00000100:00100000:0.0:1746155551.692158:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123202048 00000100:00100000:0.0:1746155551.692172:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123201408 00000100:00100000:0.0:1746155551.692174:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123201408 00000100:00100000:0.0:1746155551.692181:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123201920 00000100:00100000:0.0:1746155551.692183:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123201920 00000100:00100000:0.0:1746155551.692194:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10776 00000100:00100000:0.0:1746155551.692198:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123201408:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155551.692203:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155551.692209:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5e843c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ee53 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155551.692218:0:10591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x6814381e, atime: 0x6814381e, ctime: 0x6814381e, blocks: 0x767 00010000:00010000:0.0:1746155551.692223:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.692224:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.692228:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5e843c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee53 expref: 19 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.692236:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5e843c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee53 expref: 19 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.692243:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0f800, rc 0) 00000100:00100000:0.0:1746155551.692256:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123201408:12345-192.168.202.51@tcp:101:cat.0 Request processed in 57us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.692271:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10776 00000100:00100000:0.0:1746155551.692281:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10777 00000100:00100000:0.0:1746155551.692285:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123201664:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155551.692290:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155551.692296:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5e8443 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ee61 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155551.692305:0:10591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3db:0x0] initial LVB size: 2097152, mtime: 0x6814381e, atime: 0x6814381e, ctime: 0x6814381e, blocks: 0x81f 00010000:00010000:0.0:1746155551.692312:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.692313:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.692316:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5e8443 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee61 expref: 29 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.692324:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5e8443 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee61 expref: 29 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.692330:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0e200, rc 0) 00000100:00100000:0.0:1746155551.692342:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123201664:12345-192.168.202.51@tcp:101:cat.0 Request processed in 57us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.692347:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10777 00000100:00100000:0.0:1746155551.701529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.703361:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.705062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.705678:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.711099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.711336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.711707:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.711729:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.711744:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.738929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.747252:0:14230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124374144 00000100:00100000:0.0:1746155551.747255:0:14230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124374144 00000100:00100000:0.0:1746155551.747274:0:14230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1746155551.747279:0:14230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3298:x1830976124374144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746155551.747305:0:14230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3298:x1830976124374144:12345-0@lo:400:kworker.0 Request processed in 25us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.747309:0:14230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1746155551.753553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.760429:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124374912 00000100:00100000:0.0:1746155551.760435:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124374912 00000100:00100000:0.0:1746155551.760572:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124375424 00000100:00100000:0.0:1746155551.760574:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124375424 00000100:00100000:0.0:1746155551.760586:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124375936 00000100:00100000:0.0:1746155551.760587:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124375936 00000100:00100000:0.0:1746155551.760597:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124376448 00000100:00100000:0.0:1746155551.760598:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124376448 00000100:00100000:0.0:1746155551.760610:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124375040 00000100:00100000:0.0:1746155551.760611:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124375040 00000100:00100000:0.0:1746155551.760622:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10779 00000100:00100000:0.0:1746155551.760628:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:3298:x1830976124374912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155551.760783:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155551.760786:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155551.760788:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155551.760790:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155551.760792:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155551.760816:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3298:x1830976124374912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (439us total) trans 21474840346 rc 0/0 00000100:00100000:0.0:1746155551.760822:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10779 00000100:00100000:0.0:1746155551.760835:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10781 00000100:00100000:0.0:1746155551.760839:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3298:x1830976124375936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155551.760916:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155551.760919:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155551.760920:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155551.760922:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155550 -> 1746155550 00002000:00010000:0.0:1746155551.760923:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155551.760941:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3298:x1830976124375936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (507us total) trans 17179872978 rc 0/0 00000100:00100000:0.0:1746155551.760946:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10781 00000100:00100000:0.0:1746155551.760956:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10783 00000100:00100000:0.0:1746155551.760960:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3295:x1830976124375040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155551.761024:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4603200 -> 4603200 00002000:00010000:0.0:1746155551.761026:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155551 -> 1746155551 00002000:00010000:0.0:1746155551.761028:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155551 -> 1746155551 00002000:00010000:0.0:1746155551.761030:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155551 -> 1746155551 00002000:00010000:0.0:1746155551.761031:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 4957 -> 4957 00000100:00100000:0.0:1746155551.761050:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3295:x1830976124375040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (447us total) trans 21474840348 rc 0/0 00000100:00100000:0.0:1746155551.761054:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10783 00000100:00100000:0.0:1746155551.761062:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10785 00000100:00100000:0.0:1746155551.761066:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3295:x1830976124376064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155551.761120:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155551.761122:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155551 -> 1746155551 00002000:00010000:0.0:1746155551.761124:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155551 -> 1746155551 00002000:00010000:0.0:1746155551.761125:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155551 -> 1746155551 00002000:00010000:0.0:1746155551.761127:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155551.761141:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3295:x1830976124376064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (494us total) trans 17179872980 rc 0/0 00000100:00100000:0.0:1746155551.761145:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10785 00000100:00100000:0.0:1746155551.761153:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10787 00000100:00100000:0.0:1746155551.761157:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3295:x1830976124375168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155551.761216:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:0.0:1746155551.761218:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155551.761220:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155551.761222:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155551.761224:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:0.0:1746155551.761238:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3295:x1830976124375168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (551us total) trans 21474840350 rc 0/0 00000100:00100000:0.0:1746155551.761242:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10787 00000100:00100000:0.0:1746155551.761250:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10790 00000100:00100000:0.0:1746155551.761254:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3295:x1830976124376704:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155551.761288:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366d180/2, rc 0, transno 21474840350 00000100:00100000:0.0:1746155551.761295:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124375168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155551.761303:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c6300/2, rc 0, transno 17179872982 00000100:00100000:0.0:1746155551.761306:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124376192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155551.761312:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366ca80/2, rc 0, transno 21474840348 00000100:00100000:0.0:1746155551.761314:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124375040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155551.761320:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366f100/2, rc 0, transno 21474840349 00000100:00100000:0.0:1746155551.761323:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124375552:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155551.761328:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c5f80/2, rc 0, transno 17179872980 00000100:00100000:0.0:1746155551.761330:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124376064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155551.761335:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526ad80/2, rc 0, transno 17179872981 00000100:00100000:0.0:1746155551.761338:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124376576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.761406:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3295:x1830976124375680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (702us total) trans 21474840351 rc 0/0 00000100:00100000:0.0:1746155551.761411:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10788 00000100:00100000:0.0:1746155551.761418:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124374784 00000100:00100000:0.0:1746155551.761421:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124374784 00000100:00100000:0.0:1746155551.761430:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124375296 00000100:00100000:0.0:1746155551.761431:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124375296 00000100:00100000:0.0:1746155551.761438:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124376320 00000100:00100000:0.0:1746155551.761439:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124376320 00000100:00100000:0.0:1746155551.761449:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10792 00000100:00100000:0.0:1746155551.761452:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3298:x1830976124375296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155551.761537:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3298:x1830976124375296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (147us total) trans 21474840352 rc 0/0 00000100:00100000:0.0:1746155551.761542:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10792 00000100:00100000:0.0:1746155551.761550:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10794 00000100:00100000:0.0:1746155551.761554:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3298:x1830976124376320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155551.761621:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3298:x1830976124376320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (198us total) trans 17179872984 rc 0/0 00000100:00100000:0.0:1746155551.761625:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10794 00000004:00080000:0.0:1746155551.761658:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca97b80/2, rc 0, transno 21474840351 00000100:00100000:0.0:1746155551.761661:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124375680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155551.761738:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3295:x1830976124376704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 483us (993us total) trans 17179872985 rc 0/0 00000100:00100000:0.0:1746155551.761743:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10790 00000100:00100000:0.0:1746155551.770360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.798080:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.798499:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.798744:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.798763:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123205120 00000100:00100000:0.0:1746155551.798766:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123205120 00000100:00100000:0.0:1746155551.803673:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123205248 00000100:00100000:0.0:1746155551.803680:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123205248 00000100:00100000:0.0:1746155551.803713:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10813 00000100:00100000:0.0:1746155551.803731:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123205248:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155551.803745:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155551.803757:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132b0f000/0x844e5faceb5e84ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0eeb5 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.803775:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.803777:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.803784:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132b0f000/0x844e5faceb5e84ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeb5 expref: 14 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.803797:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132b0f000/0x844e5faceb5e84ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeb5 expref: 14 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.803806:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b0f000, rc 0) 00000100:00100000:0.0:1746155551.803846:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976123205248:12345-192.168.202.51@tcp:101:cat.0 Request processed in 116us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.803851:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10813 00000100:00100000:0.0:1746155551.804412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.804437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.804460:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.804472:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.804532:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.804549:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123205504 00000100:00100000:0.0:1746155551.804552:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123205504 00000100:00100000:0.0:1746155551.804569:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123205632 00000100:00100000:0.0:1746155551.804570:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123205632 00000100:00100000:0.0:1746155551.804591:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123205760 00000100:00100000:0.0:1746155551.804593:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123205760 00000100:00100000:0.0:1746155551.804603:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123205888 00000100:00100000:0.0:1746155551.804604:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123205888 00000100:00100000:0.0:1746155551.804615:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10814 00000100:00100000:0.0:1746155551.804620:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28480:x1830976123205504:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155551.804628:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155551.804637:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132b0fe00/0x844e5faceb5e84c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0eebc expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.804655:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f089800/0x844e5faceb5e8435 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee76 expref: 27 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.804661:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.804663:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.804665:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132b0fe00/0x844e5faceb5e84c1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2686976->2961407] (req 2686976->2961407) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eebc expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.804687:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f089800/0x844e5faceb5e8435 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee76 expref: 27 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.804696:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f089800/0x844e5faceb5e8435 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee76 expref: 27 pid: 9235 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746155551.804706:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124379264:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155551.804767:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155551.804784:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10817 00000100:00100000:0.0:1746155551.804789:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976123205888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155551.804796:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155551.804803:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903d2600/0x844e5faceb5e84d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0eed1 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.804812:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.804813:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.804817:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800903d2600/0x844e5faceb5e84d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eed1 expref: 15 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.804825:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903d2600/0x844e5faceb5e84d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eed1 expref: 15 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.804831:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903d2600, rc 0) 00000100:00100000:0.0:1746155551.804847:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123205888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 58us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.804852:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10817 00000100:00100000:0.0:1746155551.807691:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124379264:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155551.807713:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132b0fe00/0x844e5faceb5e84c1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2686976->2961407] (req 2686976->2961407) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eebc expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.807732:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b0fe00, rc 0) 00000100:00100000:0.0:1746155551.807748:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28480:x1830976123205504:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3128us (3337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.807754:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10814 00000100:00100000:0.0:1746155551.811345:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.811408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.817726:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.817762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.817872:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.818406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.818483:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.818524:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.818540:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123207808 00000100:00100000:0.0:1746155551.818543:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123207808 00002000:00100000:0.0:1746155551.818560:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009f881880 x1830976123207808/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:622/0 lens 488/0 e 0 to 0 dl 1746155562 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.818567:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881880 with x1830976123207808 ext(0->1048575) 00002000:00010000:0.0:1746155551.818570:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f881880 00000100:00100000:0.0:1746155551.818579:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123208320 00000100:00100000:0.0:1746155551.818581:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123208320 00002000:00100000:0.0:1746155551.818588:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009f881500 x1830976123208320/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:622/0 lens 488/0 e 0 to 0 dl 1746155562 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.818594:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881500 with x1830976123208320 ext(1048576->2097151) 00002000:00010000:0.0:1746155551.818596:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f881500 00000100:00100000:0.0:1746155551.818604:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3912 00000100:00100000:0.0:1746155551.818608:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123207296:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155551.818690:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123207296:12345-192.168.202.51@tcp:3:cat.0 Request processed in 81us (927us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155551.818700:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3912 00002000:00100000:0.0:1746155551.818704:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2957312->2961407) req@ffff88009f883480 x1830976123207296/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:622/0 lens 488/4536 e 0 to 0 dl 1746155562 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.818711:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f883480 with x1830976123207296 ext(2957312->2961407) 00002000:00010000:0.0:1746155551.818713:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f883480 00000100:00100000:0.0:1746155551.818739:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3913 00000100:00100000:0.0:1746155551.818744:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123207808:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155551.826629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.826651:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123208576 00000100:00100000:0.0:1746155551.826658:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123208576 00002000:00100000:0.0:1746155551.826694:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1331200->1335295) req@ffff88009f882300 x1830976123208576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:622/0 lens 488/0 e 0 to 0 dl 1746155562 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.826702:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882300 with x1830976123208576 ext(1331200->1335295) 00002000:00010000:0.0:1746155551.826707:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f882300 00000100:00100000:0.0:1746155551.826733:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3916 00000100:00100000:0.0:1746155551.826740:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123208576:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155551.826856:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123208576:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 115us (234us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155551.826861:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3916 00002000:00100000:0.0:1746155551.826866:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1331200->1335295) req@ffff88009f882300 x1830976123208576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:622/0 lens 488/4536 e 0 to 0 dl 1746155562 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.826873:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882300 with x1830976123208576 ext(1331200->1335295) 00002000:00010000:0.0:1746155551.826875:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f882300 00000100:00100000:0.0:1746155551.829764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.839358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.844427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.863852:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.871378:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.871422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.872951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.876577:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.877938:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.895344:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.895379:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.895400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.895422:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.895457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.909886:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.917082:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.918585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.921063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.922868:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10828 00000100:00100000:0.0:1746155551.922875:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123212672:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155551.922881:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155551.922886:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1da6e00/0x844e5faceb5e8538 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ef1e expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.922895:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.922896:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.922900:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1da6e00/0x844e5faceb5e8538 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef1e expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.922907:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1da6e00/0x844e5faceb5e8538 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef1e expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.922918:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1da6e00, rc 0) 00000100:00100000:0.0:1746155551.922928:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123212672:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 56us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.922932:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10828 00000100:00100000:0.0:1746155551.923200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.923259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.925769:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.927667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.927706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155551.929008:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009355c400/0x844e5faceb5e8562 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155551.929014:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009355c400/0x844e5faceb5e8562 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155551.929027:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 8797504 00010000:00010000:0.0:1746155551.929405:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009355d400/0x844e5faceb5e855b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef41 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.929438:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009355c400/0x844e5faceb5e8562 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef41 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.929444:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155551.929446:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155551.929448:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009355c400, rc 0) 00000100:00100000:0.0:1746155551.929476:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28487:x1830976123213440:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 3586us (3710us total) trans 8589943604 rc 0/0 00000100:00100000:0.0:1746155551.929485:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9731 00000100:00100000:0.0:1746155551.930076:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.930439:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.930475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.934757:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123215232 00000100:00100000:0.0:1746155551.934763:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123215232 00000100:00100000:0.0:1746155551.934797:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9732 00000100:00100000:0.0:1746155551.934803:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28487:x1830976123215232:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155551.934818:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155551.934821:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746155551.934841:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009355c400/0x844e5faceb5e8562 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef41 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.934854:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155551.934858:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155551.934867:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1da7600/0x844e5faceb5e8570 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ef48 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.934936:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1da6800/0x844e5faceb5e8577 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155551.934946:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1da6800/0x844e5faceb5e8577 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155551.934953:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1da6800/0x844e5faceb5e8577 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155551.934961:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 8797504 00010000:00010000:0.0:1746155551.935056:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1da7600/0x844e5faceb5e8570 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef48 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.935066:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1da6800/0x844e5faceb5e8577 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef48 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.935071:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155551.935073:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155551.935075:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1da6800, rc 0) 00000100:00100000:0.0:1746155551.935098:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:28487:x1830976123215232:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 295us (2679us total) trans 8589943605 rc 0/0 00000100:00100000:0.0:1746155551.935104:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9732 00000100:00100000:0.0:1746155551.946373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.953868:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123215872 00000100:00100000:0.0:1746155551.953871:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123215872 00000100:00100000:0.0:1746155551.954133:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10835 00000100:00100000:0.0:1746155551.954139:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976123215872:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155551.954154:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012da8e600/0x844e5faceb5e85a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.954163:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5e8443 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee61 expref: 27 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.954169:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903d2200/0x844e5faceb5e8546 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef25 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.954175:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a273000/0x844e5faceb5e84cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeca expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.954184:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.954186:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.954187:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da8e600/0x844e5faceb5e85a1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.954202:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012a273000/0x844e5faceb5e84cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeca expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.954209:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012a273000/0x844e5faceb5e84cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeca expref: 17 pid: 8437 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155551.954215:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009100aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124381568:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155551.955749:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800903d2200/0x844e5faceb5e8546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef25 expref: 13 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.955756:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800903d2200/0x844e5faceb5e8546 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef25 expref: 13 pid: 20200 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155551.955763:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009100ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124382848:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155551.955779:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5e8443 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee61 expref: 27 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155551.955787:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5e8443 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee61 expref: 27 pid: 10591 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155551.955799:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009100b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124382976:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155551.955809:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155551.959754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.962362:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124381184:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155551.964469:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123216896 00000100:00100000:0.0:1746155551.964474:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123216896 00010000:00010000:0.0:1746155551.964495:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3f61800/0x844e5faceb5e8531 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef17 expref: 15 pid: 29728 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155551.964530:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123217408 00000100:00100000:0.0:1746155551.964533:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123217408 00010000:00010000:0.0:1746155551.964545:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a272200/0x844e5faceb5e84c8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eec3 expref: 18 pid: 8437 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155551.964569:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5312 00000100:00100000:0.0:1746155551.964575:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123217024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155551.964582:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155551.964590:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132b0f000/0x844e5faceb5e84ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeb5 expref: 18 pid: 4461 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.964615:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132b0f000/0x844e5faceb5e84ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeb5 expref: 18 pid: 4461 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.964637:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132b0f000/0x844e5faceb5e84ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeb5 expref: 18 pid: 4461 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.964652:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155551.964672:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123217024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 98us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.964680:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5312 00000100:00100000:0.0:1746155551.964710:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124381440:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155551.964744:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5e8593 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155551.969806:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009100ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124382848:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155551.970110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.970137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.970149:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.970163:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.970175:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.970186:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123218560 00000100:00100000:0.0:1746155551.970189:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123218560 00010000:00010000:0.0:1746155551.970202:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5e8443 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee61 expref: 28 pid: 10591 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155551.970214:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123217920 00000100:00100000:0.0:1746155551.970215:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123217920 00010000:00010000:0.0:1746155551.970224:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800903d2600/0x844e5faceb5e854d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef33 expref: 15 pid: 8438 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155551.970291:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5315 00000100:00100000:0.0:1746155551.970298:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009100bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123218560:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155551.970305:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155551.970314:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5e8443 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee61 expref: 28 pid: 10591 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.970322:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5e8443 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee61 expref: 28 pid: 10591 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.970333:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5e8443 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee61 expref: 28 pid: 10591 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.970342:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155551.970358:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009100bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123218560:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 61us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.970363:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5315 00000100:00100000:0.0:1746155551.970376:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5317 00000100:00100000:0.0:1746155551.970381:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1960:x1830976123217920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155551.970387:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155551.970398:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800903d2600/0x844e5faceb5e854d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef33 expref: 15 pid: 8438 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.970406:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800903d2600/0x844e5faceb5e854d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef33 expref: 15 pid: 8438 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.970417:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903d2600/0x844e5faceb5e854d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef33 expref: 15 pid: 8438 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.970430:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155551.970445:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976123217920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 64us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.970450:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5317 00000100:00100000:0.0:1746155551.970494:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.970549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.970556:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123218688 00000100:00100000:0.0:1746155551.970558:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123218688 00010000:00010000:0.0:1746155551.970565:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5611e00/0x844e5faceb5e84f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeed expref: 17 pid: 18270 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746155551.970572:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123218944 00000100:00100000:0.0:1746155551.970573:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123218944 00010000:00010000:0.0:1746155551.970577:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a273000/0x844e5faceb5e84cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeca expref: 17 pid: 8437 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155551.970586:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5319 00000100:00100000:0.0:1746155551.970590:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009100b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123218688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155551.970595:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155551.970602:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5611e00/0x844e5faceb5e84f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeed expref: 17 pid: 18270 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746155551.970609:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5611e00/0x844e5faceb5e84f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeed expref: 17 pid: 18270 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746155551.970620:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5611e00/0x844e5faceb5e84f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eeed expref: 17 pid: 18270 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746155551.970627:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155551.970642:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009100b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123218688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.970647:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5319 00000100:00100000:0.0:1746155551.970675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.970683:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123217536 00000100:00100000:0.0:1746155551.970685:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123217536 00010000:00010000:0.0:1746155551.970694:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5e843c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee53 expref: 23 pid: 10591 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155551.970705:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5321 00000100:00100000:0.0:1746155551.970709:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123217536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155551.970727:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155551.970736:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5e843c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee53 expref: 23 pid: 10591 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.970744:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5e843c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee53 expref: 23 pid: 10591 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.970754:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5e843c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee53 expref: 23 pid: 10591 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.970762:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.970763:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155551.970766:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5e8593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.970776:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5e8593 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.970788:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155551.970803:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123217536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 93us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.970808:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5321 00010000:00010000:0.0:1746155551.970822:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5e8593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.970833:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5e8593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.970844:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5e8593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.970850:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5e8593 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.970856:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5e8593 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.970861:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a9577a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155551.970863:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5e8593 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.970873:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5e8593 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.970881:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5e8593 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155551.970886:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5e8593 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155551.970917:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123215616:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 16999us (17761us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155551.970937:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10833 00000100:00100000:0.0:1746155551.971054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.971079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.971099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.971118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.971166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.971399:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123216768:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8409us (9142us total) trans 0 rc 409600/409600 00000100:00100000:0.0:1746155551.971407:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 539 00002000:00100000:0.0:1746155551.971415:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4603903) req@ffff8800a0a89880 x1830976123216768/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:622/0 lens 488/440 e 0 to 0 dl 1746155562 ref 1 fl Complete:H/200/0 rc 409600/409600 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155551.971423:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a89880 with x1830976123216768 ext(4194304->4603903) 00010000:00010000:0.0:1746155551.971428:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a273800/0x844e5faceb5e844a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee6f expref: 21 pid: 8436 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155551.971440:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a273800/0x844e5faceb5e844a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ee6f expref: 21 pid: 8436 timeout: 781 lvb_type: 1 00002000:00010000:0.0:1746155551.971446:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0a89880 00000100:00100000:0.0:1746155551.982370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.982428:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.982461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.982672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.984899:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.985730:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.986280:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.986347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.998174:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.998219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155551.998966:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.084362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.124466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.125948:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.126050:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124383488:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155552.126058:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124383616:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155552.126079:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3f60e00/0x844e5faceb5e865e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [475136->1007615] (req 475136->1007615) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0efc6 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.126089:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3f60e00, rc 0) 00000100:00100000:0.0:1746155552.126110:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:28495:x1830976123223296:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1499us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155552.126116:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10852 00000100:00100000:0.0:1746155552.130097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.130108:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123224320 00000100:00100000:0.0:1746155552.130111:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123224320 00000100:00100000:0.0:1746155552.130233:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10854 00000100:00100000:0.0:1746155552.130240:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123224320:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155552.130247:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155552.130253:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5611800/0x844e5faceb5e86a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0efe2 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155552.130274:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124384128:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155552.130292:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155552.131181:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.134914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.135287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.135411:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123224576 00000100:00100000:0.0:1746155552.135416:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123224576 00010000:00010000:0.0:1746155552.135439:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5355600/0x844e5faceb5e860a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef6b expref: 20 pid: 19959 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155552.135458:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123224832 00000100:00100000:0.0:1746155552.135460:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123224832 00010000:00010000:0.0:1746155552.135475:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3f61200/0x844e5faceb5e85e0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef87 expref: 28 pid: 4461 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155552.135495:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5332 00000100:00100000:0.0:1746155552.135525:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123224576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155552.135535:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155552.135550:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5355600/0x844e5faceb5e860a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef6b expref: 20 pid: 19959 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155552.135559:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5355600/0x844e5faceb5e860a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef6b expref: 20 pid: 19959 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155552.135755:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5355600/0x844e5faceb5e860a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef6b expref: 19 pid: 19959 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155552.135777:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155552.135779:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155552.135784:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f020800/0x844e5faceb5e869d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0efdb expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.135791:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f020800/0x844e5faceb5e869d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0efdb expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.135814:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f020800/0x844e5faceb5e869d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0efdb expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155552.135824:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124384384:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155552.135881:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155552.136418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.139626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.140988:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.141019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.149312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.149333:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123225984 00000100:00100000:0.0:1746155552.149339:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123225984 00000100:00100000:0.0:1746155552.149375:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10857 00000100:00100000:0.0:1746155552.149381:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:28489:x1830976123225984:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155552.149395:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155552.149409:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd51000/0x844e5faceb5e86b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0eff7 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.149436:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a272200/0x844e5faceb5e85fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef8e expref: 26 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155552.149443:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a3f61a00/0x844e5faceb5e862d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef72 expref: 19 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155552.149448:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155552.149449:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155552.149452:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd51000/0x844e5faceb5e86b9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eff7 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.149473:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a3f61a00/0x844e5faceb5e862d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef72 expref: 19 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155552.149484:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a3f61a00/0x844e5faceb5e862d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef72 expref: 19 pid: 9235 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155552.149493:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124384640:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155552.149589:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012a272200/0x844e5faceb5e85fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef8e expref: 26 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155552.149598:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012a272200/0x844e5faceb5e85fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ef8e expref: 26 pid: 20796 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155552.149605:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124384768:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155552.149623:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155552.149651:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.149961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.151825:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124384640:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155552.152261:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124384768:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155552.152281:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd51000/0x844e5faceb5e86b9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0eff7 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.152293:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd51000, rc 0) 00000100:00100000:0.0:1746155552.152311:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+19:28489:x1830976123225984:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2929us (3005us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155552.152317:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10857 00000100:00100000:0.0:1746155552.152551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.152652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.155972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.160565:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123227136 00000100:00100000:0.0:1746155552.160572:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123227136 00000100:00100000:0.0:1746155552.160647:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3863 00000100:00100000:0.0:1746155552.160654:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:28489:x1830976123227136:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155552.161224:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:28489:x1830976123227136:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 569us (1377us total) trans 8589943615 rc 0/0 00000100:00100000:0.0:1746155552.161230:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3863 00000100:00100000:0.0:1746155552.169029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.170333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.172879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.177356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.177381:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123228032 00000100:00100000:0.0:1746155552.177389:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123228032 00002000:00100000:0.0:1746155552.177424:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800a0a8b480 x1830976123228032/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:623/0 lens 488/0 e 0 to 0 dl 1746155563 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155552.177434:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a8b480 with x1830976123228032 ext(0->1048575) 00002000:00010000:0.0:1746155552.177440:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a8b480 00000100:00100000:0.0:1746155552.177457:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3935 00000100:00100000:0.0:1746155552.177465:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123228032:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155552.188473:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.192548:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.192616:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.200181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.200229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.200455:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.200467:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123229312 00000100:00100000:0.0:1746155552.200469:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123229312 00002000:00100000:0.0:1746155552.200482:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880136630380 x1830976123229312/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:623/0 lens 488/0 e 0 to 0 dl 1746155563 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155552.200493:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136630380 with x1830976123229312 ext(1048576->2097151) 00002000:00010000:0.0:1746155552.200495:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136630380 00000100:00100000:0.0:1746155552.200523:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3939 00000100:00100000:0.0:1746155552.200528:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123229312:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155552.211564:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.211945:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123229312:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11416us (11488us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155552.211954:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3939 00002000:00100000:0.0:1746155552.211965:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880136630380 x1830976123229312/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:623/0 lens 488/440 e 0 to 0 dl 1746155563 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155552.211974:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136630380 with x1830976123229312 ext(1048576->2097151) 00002000:00010000:0.0:1746155552.211978:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136630380 00000100:00100000:0.0:1746155552.216433:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.216497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.225078:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.235479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.235540:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.255445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.255476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.255524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.255981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.255991:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123231488 00000100:00100000:0.0:1746155552.255993:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123231488 00002000:00100000:0.0:1746155552.256008:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880136632300 x1830976123231488/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:623/0 lens 488/0 e 0 to 0 dl 1746155563 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155552.256015:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632300 with x1830976123231488 ext(3145728->4194303) 00002000:00010000:0.0:1746155552.256018:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136632300 00000100:00100000:0.0:1746155552.256027:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3946 00000100:00100000:0.0:1746155552.256031:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123231488:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155552.257521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.267273:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.267336:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.267370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.267383:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.271640:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123231360:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15780us (16127us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155552.271654:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3945 00002000:00100000:0.0:1746155552.271668:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880136631f80 x1830976123231360/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:623/0 lens 488/440 e 0 to 0 dl 1746155563 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155552.271679:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631f80 with x1830976123231360 ext(2097152->3145727) 00002000:00010000:0.0:1746155552.271686:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136631f80 00000100:00100000:0.0:1746155552.293855:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.303243:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.305489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.307567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.382781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.385867:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.398980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155552.399381:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b800/0x844e5faceb5e86ea lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155552.399387:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b800/0x844e5faceb5e86ea lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155552.399402:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 8797504 00010000:00010000:0.0:1746155552.399525:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b600/0x844e5faceb5e86e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f021 expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.399546:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b800/0x844e5faceb5e86ea lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f021 expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.399551:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155552.399554:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155552.399556:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e7b800, rc 0) 00000100:00100000:0.0:1746155552.399584:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:28507:x1830976123233920:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 16580us (16810us total) trans 8589943617 rc 0/0 00000100:00100000:0.0:1746155552.399589:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9739 00000100:00100000:0.0:1746155552.410757:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.437942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.447835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.447881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.447918:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123235200 00000100:00100000:0.0:1746155552.447925:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123235200 00000100:00100000:0.0:1746155552.447960:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3865 00000100:00100000:0.0:1746155552.447968:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:28515:x1830976123235200:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155552.462870:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.466661:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.466732:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.478725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.488166:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.488202:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.492894:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.493552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.501189:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.502302:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.516952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.521191:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.521771:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.523285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.531542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.537649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.542569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.543126:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.543171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.546637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.546942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.546980:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.547196:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10870 00000100:00100000:0.0:1746155552.547201:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976123239296:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155552.547207:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155552.547213:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131347e00/0x844e5faceb5e87ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f075 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.547222:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155552.547223:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155552.547227:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131347e00/0x844e5faceb5e87ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f075 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155552.547236:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131347e00/0x844e5faceb5e87ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f075 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155552.547243:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131347e00, rc 0) 00000100:00100000:0.0:1746155552.547255:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976123239296:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 55us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155552.547259:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10870 00000100:00100000:0.0:1746155552.549357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.559211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.567335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.571080:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123240192 00000100:00100000:0.0:1746155552.571084:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123240192 00010000:00010000:0.0:1746155552.571220:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5e87c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f083 expref: 14 pid: 27374 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746155552.571246:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5348 00000100:00100000:0.0:1746155552.571252:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094776d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123240192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155552.571261:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155552.571265:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5e87c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f083 expref: 14 pid: 27374 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746155552.571274:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5e87c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f083 expref: 14 pid: 27374 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746155552.571288:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5e87c3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f083 expref: 14 pid: 27374 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746155552.571307:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155552.571310:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800903d2600/0x844e5faceb5e87d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155552.571317:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903d2600/0x844e5faceb5e87d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155552.571322:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800903d2600/0x844e5faceb5e87d8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155552.571333:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155552.571361:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094776d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123240192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 110us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155552.571367:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5348 00000100:00100000:0.0:1746155552.574281:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123240320 00000100:00100000:0.0:1746155552.574286:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123240320 00010000:00010000:0.0:1746155552.574308:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094219e00/0x844e5faceb5e87a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f06e expref: 12 pid: 1625 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746155552.574337:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5349 00000100:00100000:0.0:1746155552.574343:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094777100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123240320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155552.574352:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155552.574369:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094219e00/0x844e5faceb5e87a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f06e expref: 12 pid: 1625 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155552.574377:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094219e00/0x844e5faceb5e87a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f06e expref: 12 pid: 1625 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155552.574399:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094219e00/0x844e5faceb5e87a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f06e expref: 12 pid: 1625 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155552.574413:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155552.574448:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094777100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123240320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 104us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155552.574452:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5349 00000100:00100000:0.0:1746155552.575134:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.575360:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.575382:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.577751:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.578192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.580020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.592985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.593969:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.594060:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5354 00000100:00100000:0.0:1746155552.594068:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123242112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155552.594075:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155552.594086:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a3f61c00/0x844e5faceb5e8626 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0efaa expref: 17 pid: 1625 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155552.594110:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a3f61c00/0x844e5faceb5e8626 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0efaa expref: 17 pid: 1625 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155552.594231:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3f61c00/0x844e5faceb5e8626 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0efaa expref: 17 pid: 1625 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746155552.594266:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155552.594322:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123242112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 256us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155552.594329:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5354 00000100:00100000:0.0:1746155552.600774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.603563:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123242624 00000100:00100000:0.0:1746155552.603572:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123242624 00000100:00100000:0.0:1746155552.603658:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9747 00000100:00100000:0.0:1746155552.603665:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:28524:x1830976123242624:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155552.603683:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155552.603697:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131347600/0x844e5faceb5e8809 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f0b4 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.603794:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131347400/0x844e5faceb5e8810 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.603805:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131347400/0x844e5faceb5e8810 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.603813:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131347400/0x844e5faceb5e8810 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.603822:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131346e00/0x844e5faceb5e8817 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.603827:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131346e00/0x844e5faceb5e8817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.603831:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131346e00/0x844e5faceb5e8817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.603924:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131346800/0x844e5faceb5e881e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.603931:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131346800/0x844e5faceb5e881e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.603936:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131346800/0x844e5faceb5e881e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155552.603943:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 8797504 00010000:00010000:0.0:1746155552.604007:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131347400/0x844e5faceb5e8810 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604013:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131347400/0x844e5faceb5e8810 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604017:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131347400/0x844e5faceb5e8810 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604022:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131347400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155552.604025:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131347400/0x844e5faceb5e8810 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604030:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131347400/0x844e5faceb5e8810 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604038:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155552.604041:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155552.604044:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131347400/0x844e5faceb5e8810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604048:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131347400/0x844e5faceb5e8810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604072:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131346e00/0x844e5faceb5e8817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604077:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131346e00/0x844e5faceb5e8817 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604081:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131346e00/0x844e5faceb5e8817 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604085:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131346e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155552.604087:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131346e00/0x844e5faceb5e8817 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604091:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131346e00/0x844e5faceb5e8817 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604097:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d55ac00) 00010000:00010000:0.0:1746155552.604099:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155552.604101:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131346e00/0x844e5faceb5e8817 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604105:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131346e00/0x844e5faceb5e8817 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.604133:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131347600/0x844e5faceb5e8809 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0b4 expref: 20 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.604141:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131346800/0x844e5faceb5e881e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0b4 expref: 19 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.604146:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155552.604149:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155552.604151:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131346800, rc 0) 00000100:00100000:0.0:1746155552.604192:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:28524:x1830976123242624:12345-192.168.202.51@tcp:101:cat.0 Request processed in 527us (700us total) trans 8589943626 rc 0/0 00000100:00100000:0.0:1746155552.604198:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9747 00000100:00100000:0.0:1746155552.605597:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.605677:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.605721:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.616752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.626863:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.631046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.645321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.649933:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.652816:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.652859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.653087:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3962 00000100:00100000:0.0:1746155552.653095:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123244544:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155552.659987:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123244544:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6885us (7119us total) trans 0 rc 847872/847872 00000100:00100000:0.0:1746155552.659998:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3962 00002000:00100000:0.0:1746155552.660008:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1896447) req@ffff880095269880 x1830976123244544/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:623/0 lens 488/440 e 0 to 0 dl 1746155563 ref 1 fl Complete:/200/0 rc 847872/847872 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155552.660016:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269880 with x1830976123244544 ext(1048576->1896447) 00002000:00010000:0.0:1746155552.660020:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095269880 00000100:00100000:0.0:1746155552.671818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.675650:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.675698:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.677765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.683367:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.686588:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.686644:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.686671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.686686:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123245696 00000100:00100000:0.0:1746155552.686689:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123245696 00000100:00100000:0.0:1746155552.686707:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123245824 00000100:00100000:0.0:1746155552.686730:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123245824 00000100:00100000:0.0:1746155552.686743:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123245952 00000100:00100000:0.0:1746155552.686745:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123245952 00000100:00100000:0.0:1746155552.686754:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10880 00000100:00100000:0.0:1746155552.686759:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123245696:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155552.686771:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155552.686782:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009355ce00/0x844e5faceb5e886b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f0de expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.686796:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155552.686798:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155552.686803:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009355ce00/0x844e5faceb5e886b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0de expref: 32 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155552.686814:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009355ce00/0x844e5faceb5e886b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0de expref: 32 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155552.686822:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009355ce00, rc 0) 00000100:00100000:0.0:1746155552.686841:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123245696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 82us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155552.686849:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10880 00000100:00100000:0.0:1746155552.686860:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10881 00000100:00100000:0.0:1746155552.686865:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123245824:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155552.686871:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155552.686879:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009355c200/0x844e5faceb5e8872 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f0e5 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155552.686905:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124389632:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155552.686943:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155552.686971:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.689754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.692795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.696858:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.699766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.699801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.701721:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123247104 00000100:00100000:0.0:1746155552.701726:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123247104 00002000:00100000:0.0:1746155552.701751:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880094774e00 x1830976123247104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:623/0 lens 488/0 e 0 to 0 dl 1746155563 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155552.701759:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094774e00 with x1830976123247104 ext(1048576->2097151) 00002000:00010000:0.0:1746155552.701762:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094774e00 00000100:00100000:0.0:1746155552.701785:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3966 00000100:00100000:0.0:1746155552.701792:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123247104:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155552.709974:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123247104:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8181us (8282us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155552.709982:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3966 00002000:00100000:0.0:1746155552.709989:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880094774e00 x1830976123247104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:623/0 lens 488/440 e 0 to 0 dl 1746155563 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155552.709998:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094774e00 with x1830976123247104 ext(1048576->2097151) 00002000:00010000:0.0:1746155552.710002:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094774e00 00000100:00100000:0.0:1746155552.716236:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124390272:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155552.716253:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155552.716296:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094775180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123247232:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6476us (7007us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155552.716306:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5359 00000100:00100000:0.0:1746155552.718683:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.718739:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.726053:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123247744 00000100:00100000:0.0:1746155552.726061:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123247744 00010000:00010000:0.0:1746155552.726090:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9577800/0x844e5faceb5e8802 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2834431) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0ad expref: 18 pid: 9235 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746155552.726115:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5360 00000100:00100000:0.0:1746155552.726122:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094774700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123247744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155552.726133:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155552.726151:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a9577800/0x844e5faceb5e8802 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2834431) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0ad expref: 18 pid: 9235 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746155552.726162:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a9577800/0x844e5faceb5e8802 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2834431) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0ad expref: 18 pid: 9235 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746155552.726181:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9577800/0x844e5faceb5e8802 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2834431) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0ad expref: 18 pid: 9235 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746155552.726206:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155552.726208:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155552.726215:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da8f800/0x844e5faceb5e888e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f101 expref: 23 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.726221:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da8f800/0x844e5faceb5e888e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f101 expref: 23 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.726250:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012da8f800/0x844e5faceb5e888e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f101 expref: 23 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155552.726261:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124390528:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155552.726321:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155552.731687:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123247872 00000100:00100000:0.0:1746155552.731696:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123247872 00002000:00100000:0.0:1746155552.731962:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1896448->2097151) req@ffff880094775500 x1830976123247872/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:623/0 lens 488/0 e 0 to 0 dl 1746155563 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155552.731970:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094775500 with x1830976123247872 ext(1896448->2097151) 00010000:00010000:0.0:1746155552.731976:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094219a00/0x844e5faceb5e87df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f091 expref: 18 pid: 8438 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746155552.731990:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094219a00/0x844e5faceb5e87df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f091 expref: 18 pid: 8438 timeout: 781 lvb_type: 0 00002000:00010000:0.0:1746155552.731996:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094775500 00000100:00100000:0.0:1746155552.732010:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 550 00000100:00100000:0.0:1746155552.732015:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123247872:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155552.734337:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124390528:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155552.734352:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155552.734381:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094774700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123247744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8259us (8476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155552.734387:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5360 00000100:00100000:0.0:1746155552.735163:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123248384 00000100:00100000:0.0:1746155552.735168:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123248384 00000100:00100000:0.0:1746155552.735193:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9749 00000100:00100000:0.0:1746155552.735199:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:28532:x1830976123248384:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155552.735213:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155552.735229:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da8fe00/0x844e5faceb5e889c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f10f expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.735305:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da8fa00/0x844e5faceb5e88a3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.735318:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903d2600/0x844e5faceb5e87d8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f08a expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.735324:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131346800/0x844e5faceb5e881e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0b4 expref: 21 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.735335:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ded4200/0x844e5faceb5e8856 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0d0 expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.735340:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da8fa00/0x844e5faceb5e88a3 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155552.735363:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ded4200/0x844e5faceb5e8856 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0d0 expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.735372:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ded4200/0x844e5faceb5e8856 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0d0 expref: 298 pid: 15474 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746155552.735381:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124390656:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155552.735436:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131346800/0x844e5faceb5e881e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0b4 expref: 21 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.735443:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131346800/0x844e5faceb5e881e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0b4 expref: 21 pid: 15474 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746155552.735449:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124390784:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155552.735470:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800903d2600/0x844e5faceb5e87d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f08a expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.735476:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903d2600/0x844e5faceb5e87d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f08a expref: 12 pid: 27374 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746155552.735483:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b2f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124390912:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155552.735498:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155552.740426:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124390656:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155552.740437:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124390784:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155552.740445:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124390912:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155552.740467:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012da8fa00/0x844e5faceb5e88a3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155552.743210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.751333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.751413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.756555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.765793:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.766582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.782747:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.783138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.783192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.783220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.783243:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10890 00000100:00100000:0.0:1746155552.783251:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123250688:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155552.783259:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155552.783268:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009355d400/0x844e5faceb5e88c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f12b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.783279:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155552.783280:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155552.783284:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009355d400/0x844e5faceb5e88c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f12b expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155552.783299:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009355d400/0x844e5faceb5e88c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f12b expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155552.783307:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009355d400, rc 0) 00000100:00100000:0.0:1746155552.783326:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123250688:12345-192.168.202.51@tcp:101:cat.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155552.783330:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10890 00000100:00100000:0.0:1746155552.783432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.786349:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10894 00000100:00100000:0.0:1746155552.786355:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+21:28524:x1830976123251328:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155552.786360:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155552.786364:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009355cc00/0x844e5faceb5e88e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f147 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.786380:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e679000/0x844e5faceb5e88b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f11d expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155552.786478:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155552.786480:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155552.786483:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009355cc00/0x844e5faceb5e88e2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4194304->4603903] (req 4194304->4603903) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f147 expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155552.790953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.790995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.794049:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.796266:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.799114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.804454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.806290:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.823468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.825557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.826262:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.831775:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.839437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.846939:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.864754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.868269:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123254784:12345-192.168.202.51@tcp:3:cat.0 Request processed in 3024us (3516us total) trans 0 rc 409600/409600 00000100:00100000:0.0:1746155552.868280:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3977 00002000:00100000:0.0:1746155552.868289:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4603903) req@ffff880091008380 x1830976123254784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:623/0 lens 488/440 e 0 to 0 dl 1746155563 ref 1 fl Complete:/200/0 rc 409600/409600 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155552.868298:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091008380 with x1830976123254784 ext(4194304->4603903) 00002000:00010000:0.0:1746155552.868302:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091008380 00000100:00100000:0.0:1746155552.939544:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.943404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.943452:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.955001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.973317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.988836:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.989644:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.989675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.989699:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.989736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155552.989763:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123256448 00000100:00100000:0.0:1746155552.989766:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123256448 00002000:00100000:0.0:1746155552.989783:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009a6d8000 x1830976123256448/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:623/0 lens 488/0 e 0 to 0 dl 1746155563 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155552.989790:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d8000 with x1830976123256448 ext(3145728->4194303) 00002000:00010000:0.0:1746155552.989793:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6d8000 00000100:00100000:0.0:1746155552.989804:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123256704 00000100:00100000:0.0:1746155552.992522:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123256704 00002000:00100000:0.0:1746155552.992557:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009a6dad80 x1830976123256704/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:623/0 lens 488/0 e 0 to 0 dl 1746155563 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155552.992565:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dad80 with x1830976123256704 ext(2097152->3145727) 00002000:00010000:0.0:1746155552.992570:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dad80 00000100:00100000:0.0:1746155552.992591:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3982 00000100:00100000:0.0:1746155552.992597:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1961:x1830976123256704:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155552.995360:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123256192 00000100:00100000:0.0:1746155552.995370:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123256192 00000100:00100000:0.0:1746155553.006737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.006753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.009050:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123256064:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19102us (19402us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155553.009058:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3980 00002000:00100000:0.0:1746155553.009067:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009a6d9880 x1830976123256064/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:623/0 lens 488/440 e 0 to 0 dl 1746155563 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.009074:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d9880 with x1830976123256064 ext(2097152->3145727) 00002000:00010000:0.0:1746155553.009079:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6d9880 00000100:00100000:0.0:1746155553.013946:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123257344 00000100:00100000:0.0:1746155553.013960:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123257344 00010000:00010000:0.0:1746155553.013994:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e7b400/0x844e5faceb5e86dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f01a expref: 26 pid: 8438 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746155553.014687:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5373 00000100:00100000:0.0:1746155553.014695:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123257344:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.014716:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.014735:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e7b400/0x844e5faceb5e86dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f01a expref: 26 pid: 8438 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.014745:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e7b400/0x844e5faceb5e86dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f01a expref: 26 pid: 8438 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.014762:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e7b400/0x844e5faceb5e86dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f01a expref: 26 pid: 8438 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.014787:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.014789:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.014795:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f767200/0x844e5faceb5e8936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f171 expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.014803:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f767200/0x844e5faceb5e8936 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f171 expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.014831:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f767200/0x844e5faceb5e8936 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f171 expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.014847:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124393088:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155553.015023:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155553.018968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.025688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.025783:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.027698:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.027986:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.028028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.028729:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123258112 00000100:00100000:0.0:1746155553.028732:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123258112 00010000:00010000:0.0:1746155553.028747:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da8e600/0x844e5faceb5e8768 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f044 expref: 35 pid: 8438 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746155553.028763:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5376 00000100:00100000:0.0:1746155553.028767:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123258112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.028782:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.028796:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da8e600/0x844e5faceb5e8768 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f044 expref: 35 pid: 8438 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.028805:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da8e600/0x844e5faceb5e8768 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f044 expref: 35 pid: 8438 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.028817:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da8e600/0x844e5faceb5e8768 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f044 expref: 35 pid: 8438 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.028831:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.028833:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.028838:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130382400/0x844e5faceb5e893d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f178 expref: 34 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.028845:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130382400/0x844e5faceb5e893d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f178 expref: 34 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.028864:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130382400/0x844e5faceb5e893d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f178 expref: 34 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.028872:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124393728:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155553.028891:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155553.032050:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124393728:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155553.032069:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155553.032120:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123258112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3350us (4090us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.032129:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5376 00000100:00100000:0.0:1746155553.035804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.037976:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.039179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.039314:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.041238:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.042849:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.050311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.050492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.059569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.060301:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3873 00000100:00100000:0.0:1746155553.060311:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:28539:x1830976123259776:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155553.062361:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+26:28539:x1830976123259776:12345-192.168.202.51@tcp:35:cat.0 Request processed in 2043us (2787us total) trans 8589943636 rc 0/0 00000100:00100000:0.0:1746155553.062370:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3873 00000100:00100000:0.0:1746155553.105435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.105470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.105561:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.110157:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123260544 00000100:00100000:0.0:1746155553.110163:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123260544 00010000:00010000:0.0:1746155553.110189:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009355ce00/0x844e5faceb5e886b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0de expref: 36 pid: 8438 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746155553.110223:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5377 00000100:00100000:0.0:1746155553.110229:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976123260544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.110239:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.110257:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009355ce00/0x844e5faceb5e886b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0de expref: 36 pid: 8438 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.110267:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009355ce00/0x844e5faceb5e886b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0de expref: 36 pid: 8438 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.110288:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009355ce00/0x844e5faceb5e886b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f0de expref: 36 pid: 8438 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.110312:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155553.110330:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123260544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 101us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.110335:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5377 00000100:00100000:0.0:1746155553.112892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.118897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.123945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.126700:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124394752:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155553.126729:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130382a00/0x844e5faceb5e8998 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1b7 expref: 34 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.126739:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130382a00, rc 0) 00000100:00100000:0.0:1746155553.126830:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:28549:x1830976123261056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2482us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.126837:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10907 00000100:00100000:0.0:1746155553.129801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.143220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.144294:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5379 00000100:00100000:0.0:1746155553.144304:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123261696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.144317:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.144342:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130382800/0x844e5faceb5e8991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1b0 expref: 25 pid: 18270 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.144353:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130382800/0x844e5faceb5e8991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->1830911) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1b0 expref: 25 pid: 18270 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.144373:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130382800/0x844e5faceb5e8991 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1323008->1830911) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1b0 expref: 25 pid: 18270 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.144438:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.144440:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.144447:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130382a00/0x844e5faceb5e8998 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1b7 expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.144460:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130382a00/0x844e5faceb5e8998 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1b7 expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.144497:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130382a00/0x844e5faceb5e8998 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1b7 expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.144519:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137120380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124394880:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155553.144625:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155553.147810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.195194:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.196457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155553.197138:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155553.200575:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.200603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.200624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.200639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.200733:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10909 00000100:00100000:0.0:1746155553.200739:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123262720:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.200745:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.200752:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090177c00/0x844e5faceb5e89e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f1da expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.200767:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.200768:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.200774:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090177c00/0x844e5faceb5e89e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1da expref: 26 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.200786:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090177c00/0x844e5faceb5e89e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1da expref: 26 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.200794:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090177c00, rc 0) 00000100:00100000:0.0:1746155553.200822:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123262720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.200827:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10909 00000100:00100000:0.0:1746155553.200842:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10910 00000100:00100000:0.0:1746155553.200846:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123262592:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.200851:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.200857:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090177400/0x844e5faceb5e89ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f1d3 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.200875:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124395392:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155553.200892:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155553.200926:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124395008:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155553.200935:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124395136:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155553.200953:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012da8f400/0x844e5faceb5e89d7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155553.204397:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123263360 00000100:00100000:0.0:1746155553.204402:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123263360 00000100:00100000:0.0:1746155553.204481:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3875 00000100:00100000:0.0:1746155553.204487:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+27:13789:x1830976123263360:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746155553.212799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.212829:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.212842:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.212850:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.212869:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.212879:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.212892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.213457:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10914 00000100:00100000:0.0:1746155553.213464:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123264640:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155553.213472:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.213480:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb7400/0x844e5faceb5e8a01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f20b expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.213492:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.213493:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.213498:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb7400/0x844e5faceb5e8a01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f20b expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.213523:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb7400/0x844e5faceb5e8a01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f20b expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.213534:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb7400, rc 0) 00000100:00100000:0.0:1746155553.213554:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123264640:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 92us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.213559:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10914 00000100:00100000:0.0:1746155553.213571:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10917 00000100:00100000:0.0:1746155553.213575:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123264512:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155553.213580:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.213587:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da8fe00/0x844e5faceb5e8a16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f204 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.213596:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.213598:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.213602:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da8fe00/0x844e5faceb5e8a16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f204 expref: 13 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.213611:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da8fe00/0x844e5faceb5e8a16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f204 expref: 13 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.213618:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da8fe00, rc 0) 00000100:00100000:0.0:1746155553.219466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.219538:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.227444:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.229870:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.236736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.249692:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.249747:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.254876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.256344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.260223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.261002:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.261021:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.261032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.261048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.261061:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.261095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.268030:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123267328 00000100:00100000:0.0:1746155553.268035:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123267328 00010000:00010000:0.0:1746155553.268060:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fef5e00/0x844e5faceb5e89fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1fd expref: 15 pid: 20200 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746155553.268078:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123267456 00000100:00100000:0.0:1746155553.268080:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123267456 00010000:00010000:0.0:1746155553.268088:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131347a00/0x844e5faceb5e88cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f132 expref: 22 pid: 4461 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746155553.268449:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5385 00000100:00100000:0.0:1746155553.268456:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094776300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1963:x1830976123267328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.268468:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.268484:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fef5e00/0x844e5faceb5e89fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1fd expref: 15 pid: 20200 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.268493:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fef5e00/0x844e5faceb5e89fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1fd expref: 15 pid: 20200 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.268539:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fef5e00/0x844e5faceb5e89fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1fd expref: 15 pid: 20200 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.268557:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155553.268586:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094776300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1963:x1830976123267328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 132us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.268592:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5385 00000100:00100000:0.0:1746155553.268604:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5386 00000100:00100000:0.0:1746155553.268608:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094774000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123267456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.268614:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.268620:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131347a00/0x844e5faceb5e88cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f132 expref: 22 pid: 4461 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.268627:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131347a00/0x844e5faceb5e88cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f132 expref: 22 pid: 4461 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.268636:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131347a00/0x844e5faceb5e88cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f132 expref: 22 pid: 4461 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.268642:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155553.268652:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094774000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123267456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 44us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.268657:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5386 00000100:00100000:0.0:1746155553.272595:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f245880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124397568:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155553.272615:0:9235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012da8ea00/0x844e5faceb5e8a8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.278540:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.278572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.278591:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123268352 00000100:00100000:0.0:1746155553.278597:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123268352 00010000:00010000:0.0:1746155553.278629:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130382a00/0x844e5faceb5e8998 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1b7 expref: 36 pid: 18270 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746155553.278661:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123267584 00000100:00100000:0.0:1746155553.278663:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123267584 00010000:00010000:0.0:1746155553.279915:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4bca00/0x844e5faceb5e8a4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f220 expref: 14 pid: 8437 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746155553.279939:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123268480 00000100:00100000:0.0:1746155553.279942:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123268480 00010000:00010000:0.0:1746155553.279951:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da8fe00/0x844e5faceb5e8a16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f204 expref: 15 pid: 10591 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746155553.279962:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123267968 00000100:00100000:0.0:1746155553.279963:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123267968 00010000:00010000:0.0:1746155553.279971:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e679000/0x844e5faceb5e89f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1e1 expref: 21 pid: 8438 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746155553.279982:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5392 00000100:00100000:0.0:1746155553.279987:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123267584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.279993:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.280005:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4bca00/0x844e5faceb5e8a4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f220 expref: 15 pid: 8437 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.280013:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4bca00/0x844e5faceb5e8a4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f220 expref: 15 pid: 8437 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.280025:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4bca00/0x844e5faceb5e8a4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f220 expref: 15 pid: 8437 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.280044:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155553.280067:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123267584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.280072:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5392 00000100:00100000:0.0:1746155553.280082:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5393 00000100:00100000:0.0:1746155553.280086:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1963:x1830976123268480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.280091:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.280099:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da8fe00/0x844e5faceb5e8a16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f204 expref: 13 pid: 10591 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.280105:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da8fe00/0x844e5faceb5e8a16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f204 expref: 13 pid: 10591 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.280113:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da8fe00/0x844e5faceb5e8a16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f204 expref: 13 pid: 10591 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.280120:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155553.280131:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123268480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 45us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.280136:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5393 00000100:00100000:0.0:1746155553.280144:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5394 00000100:00100000:0.0:1746155553.280147:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123267968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.280151:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.280157:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e679000/0x844e5faceb5e89f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1e1 expref: 21 pid: 8438 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.280163:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e679000/0x844e5faceb5e89f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1e1 expref: 21 pid: 8438 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.280171:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e679000/0x844e5faceb5e89f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f1e1 expref: 21 pid: 8438 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.280177:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.280178:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.280182:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4bd800/0x844e5faceb5e8a86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.280188:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4bd800/0x844e5faceb5e8a86 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.280200:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155553.280211:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123267968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 64us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.280215:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5394 00000100:00100000:0.0:1746155553.283361:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.285718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.288776:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.289024:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.289955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.290447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.291970:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.291993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155553.292969:0:19959:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093bca800/0x844e5faceb5e8a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.292975:0:19959:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bca800/0x844e5faceb5e8a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.292986:0:19959:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093bca800/0x844e5faceb5e8a94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.292992:0:19959:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093bca800/0x844e5faceb5e8a94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.292997:0:19959:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093bca800/0x844e5faceb5e8a94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.293002:0:19959:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bca800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155553.293005:0:19959:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bca800/0x844e5faceb5e8a94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.293010:0:19959:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093bca800/0x844e5faceb5e8a94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.293022:0:19959:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093bca800/0x844e5faceb5e8a94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.293028:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bca800/0x844e5faceb5e8a94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.293065:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123266944:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 31134us (32003us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.293071:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10926 00000100:00100000:0.0:1746155553.301616:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.302180:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.309642:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.313317:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.320009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.329809:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.329855:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.335695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.344003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.344939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.356443:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.359927:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.383700:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.383753:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.389072:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.389124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.398872:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.398912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.398939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.398967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.398994:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.399026:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123273216 00000100:00100000:0.0:1746155553.399034:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123273216 00000100:00100000:0.0:1746155553.399069:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123273472 00000100:00100000:0.0:1746155553.399071:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123273472 00000100:00100000:0.0:1746155553.399083:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123273728 00000100:00100000:0.0:1746155553.399085:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123273728 00000100:00100000:0.0:1746155553.399095:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123273344 00000100:00100000:0.0:1746155553.399097:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123273344 00000100:00100000:0.0:1746155553.399104:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123273600 00000100:00100000:0.0:1746155553.399106:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123273600 00000100:00100000:0.0:1746155553.399125:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10934 00000100:00100000:0.0:1746155553.399137:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1962:x1830976123273216:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.399152:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.399167:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fef4200/0x844e5faceb5e8b04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f27b expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.399187:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.399189:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.399196:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fef4200/0x844e5faceb5e8b04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f27b expref: 36 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.399210:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fef4200/0x844e5faceb5e8b04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f27b expref: 36 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.399220:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fef4200, rc 0) 00000100:00100000:0.0:1746155553.399253:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123273216:12345-192.168.202.51@tcp:101:cat.0 Request processed in 121us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.399259:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10934 00000100:00100000:0.0:1746155553.399272:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10935 00000100:00100000:0.0:1746155553.399278:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123273472:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.399284:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.399291:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fef5200/0x844e5faceb5e8b0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f289 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.399300:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.399301:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.399305:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fef5200/0x844e5faceb5e8b0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f289 expref: 27 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.399314:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fef5200/0x844e5faceb5e8b0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f289 expref: 27 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.399321:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fef5200, rc 0) 00000100:00100000:0.0:1746155553.399333:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123273472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 56us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.399337:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10935 00000100:00100000:0.0:1746155553.399346:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10936 00000100:00100000:0.0:1746155553.399350:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1962:x1830976123273728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.399356:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.399361:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fef5800/0x844e5faceb5e8b12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f297 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.399369:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.399371:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.399374:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fef5800/0x844e5faceb5e8b12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f297 expref: 36 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.399381:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fef5800/0x844e5faceb5e8b12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f297 expref: 36 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.399387:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fef5800, rc 0) 00000100:00100000:0.0:1746155553.399400:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123273728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 50us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.399405:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10936 00000100:00100000:0.0:1746155553.399413:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10937 00000100:00100000:0.0:1746155553.399417:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1962:x1830976123273344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.399422:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.399427:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fef5e00/0x844e5faceb5e8b19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f282 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.399435:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.399436:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.399440:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fef5e00/0x844e5faceb5e8b19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f282 expref: 36 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.399448:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fef5e00/0x844e5faceb5e8b19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f282 expref: 36 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.399454:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fef5e00, rc 0) 00000100:00100000:0.0:1746155553.399466:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123273344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 48us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.399472:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10937 00000100:00100000:0.0:1746155553.399480:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10938 00000100:00100000:0.0:1746155553.399485:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123273600:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.399490:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.399495:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fef5c00/0x844e5faceb5e8b20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f290 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.399530:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.399532:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.399536:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fef5c00/0x844e5faceb5e8b20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f290 expref: 27 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.399544:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fef5c00/0x844e5faceb5e8b20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f290 expref: 27 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.399550:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fef5c00, rc 0) 00000100:00100000:0.0:1746155553.399563:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123273600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 78us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.399567:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10938 00000100:00100000:0.0:1746155553.406311:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.406347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.406374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.406407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.406440:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123274240 00000100:00100000:0.0:1746155553.406447:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123274240 00002000:00100000:0.0:1746155553.406480:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012bdf7800 x1830976123274240/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:624/0 lens 488/0 e 0 to 0 dl 1746155564 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.406495:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7800 with x1830976123274240 ext(3145728->4194303) 00002000:00010000:0.0:1746155553.406500:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf7800 00000100:00100000:0.0:1746155553.406531:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123274112 00000100:00100000:0.0:1746155553.406532:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123274112 00002000:00100000:0.0:1746155553.406541:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012bdf4e00 x1830976123274112/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:624/0 lens 488/0 e 0 to 0 dl 1746155564 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.406547:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4e00 with x1830976123274112 ext(2097152->3145727) 00002000:00010000:0.0:1746155553.406549:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf4e00 00000100:00100000:0.0:1746155553.406554:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123274496 00000100:00100000:0.0:1746155553.406556:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123274496 00002000:00100000:0.0:1746155553.406563:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012bdf5180 x1830976123274496/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:624/0 lens 488/0 e 0 to 0 dl 1746155564 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.406568:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5180 with x1830976123274496 ext(2097152->3145727) 00002000:00010000:0.0:1746155553.406571:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5180 00000100:00100000:0.0:1746155553.406576:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123274624 00000100:00100000:0.0:1746155553.406578:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123274624 00002000:00100000:0.0:1746155553.406583:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012bdf7b80 x1830976123274624/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:624/0 lens 488/0 e 0 to 0 dl 1746155564 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.406588:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7b80 with x1830976123274624 ext(3145728->4194303) 00002000:00010000:0.0:1746155553.406590:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf7b80 00000100:00100000:0.0:1746155553.406597:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3993 00000100:00100000:0.0:1746155553.406603:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123274240:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155553.407647:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3994 00000100:00100000:0.0:1746155553.407654:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123274112:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155553.408585:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3995 00000100:00100000:0.0:1746155553.408592:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123274496:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155553.429711:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123274240:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23089us (23388us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155553.429723:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3993 00002000:00100000:0.0:1746155553.429734:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012bdf7800 x1830976123274240/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:624/0 lens 488/440 e 0 to 0 dl 1746155564 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.429742:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7800 with x1830976123274240 ext(3145728->4194303) 00002000:00010000:0.0:1746155553.429748:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf7800 00000100:00100000:0.0:1746155553.447275:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976123275264:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25458us (25643us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155553.447284:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3998 00002000:00100000:0.0:1746155553.447291:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094776300 x1830976123275264/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:624/0 lens 488/440 e 0 to 0 dl 1746155564 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.447299:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094776300 with x1830976123275264 ext(1048576->2097151) 00002000:00010000:0.0:1746155553.447303:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094776300 00000100:00100000:0.0:1746155553.458361:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.465806:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.479408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.479488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.480661:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123277056 00000100:00100000:0.0:1746155553.480664:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123277056 00002000:00100000:0.0:1746155553.480681:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009f247480 x1830976123277056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:624/0 lens 488/0 e 0 to 0 dl 1746155564 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.480693:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f247480 with x1830976123277056 ext(2097152->3145727) 00002000:00010000:0.0:1746155553.480696:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f247480 00000100:00100000:0.0:1746155553.480716:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4002 00000100:00100000:0.0:1746155553.480722:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123276544:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155553.502690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.513661:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.515968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.533554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.537183:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123277952:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17703us (21205us total) trans 0 rc 409600/409600 00000100:00100000:0.0:1746155553.537193:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4006 00002000:00100000:0.0:1746155553.537202:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4603903) req@ffff88009451c700 x1830976123277952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:624/0 lens 488/440 e 0 to 0 dl 1746155564 ref 1 fl Complete:/200/0 rc 409600/409600 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.537211:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451c700 with x1830976123277952 ext(4194304->4603903) 00002000:00010000:0.0:1746155553.537217:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451c700 00000100:00100000:0.0:1746155553.545634:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.546310:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.546346:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123278464 00000100:00100000:0.0:1746155553.546349:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123278464 00010000:00010000:0.0:1746155553.546366:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fef5800/0x844e5faceb5e8b12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f297 expref: 37 pid: 4461 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746155553.546399:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5403 00000100:00100000:0.0:1746155553.546406:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1963:x1830976123278464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.546469:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.546488:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fef5800/0x844e5faceb5e8b12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f297 expref: 37 pid: 4461 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.546497:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fef5800/0x844e5faceb5e8b12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f297 expref: 37 pid: 4461 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.546538:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fef5800/0x844e5faceb5e8b12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f297 expref: 37 pid: 4461 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.546552:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155553.546582:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1963:x1830976123278464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 177us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.546587:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5403 00000100:00100000:0.0:1746155553.546654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.546664:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123278336 00000100:00100000:0.0:1746155553.546667:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123278336 00010000:00010000:0.0:1746155553.546676:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd50e00/0x844e5faceb5e8afd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f274 expref: 27 pid: 10591 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746155553.546853:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5404 00000100:00100000:0.0:1746155553.546858:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123278336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.546865:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.546872:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50e00/0x844e5faceb5e8afd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f274 expref: 27 pid: 10591 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.546883:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd50e00/0x844e5faceb5e8afd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f274 expref: 27 pid: 10591 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.546893:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50e00/0x844e5faceb5e8afd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f274 expref: 27 pid: 10591 timeout: 782 lvb_type: 1 00010000:00010000:0.0:1746155553.546900:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.546902:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.546907:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7fc00/0x844e5faceb5e8b3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f2b3 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.546914:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7fc00/0x844e5faceb5e8b3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f2b3 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.546981:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7fc00/0x844e5faceb5e8b3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f2b3 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.546991:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124399616:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155553.547024:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155553.549306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.555600:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.568081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.570967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.582069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.582640:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.583007:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123279616 00000100:00100000:0.0:1746155553.583011:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123279616 00010000:00010000:0.0:1746155553.583027:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef5400/0x844e5faceb5e8aa2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f23c expref: 303 pid: 15474 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746155553.583084:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5407 00000100:00100000:0.0:1746155553.583091:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:1960:x1830976123279616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.583100:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.583105:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef5400/0x844e5faceb5e8aa2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f23c expref: 303 pid: 15474 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.583114:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef5400/0x844e5faceb5e8aa2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f23c expref: 303 pid: 15474 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.583128:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef5400/0x844e5faceb5e8aa2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f23c expref: 303 pid: 15474 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.583141:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155553.583145:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e679200/0x844e5faceb5e8b66 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155553.583153:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e679200/0x844e5faceb5e8b66 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155553.583158:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e679200/0x844e5faceb5e8b66 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155553.583172:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155553.583201:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:1960:x1830976123279616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 110us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.583206:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5407 00000100:00100000:0.0:1746155553.584521:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.585808:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.585863:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.585885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.586548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.594847:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.597591:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.597609:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123281024 00000100:00100000:0.0:1746155553.597613:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123281024 00010000:00010000:0.0:1746155553.597634:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e679200/0x844e5faceb5e8b66 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f2c8 expref: 19 pid: 15474 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746155553.597664:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5408 00000100:00100000:0.0:1746155553.597669:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+19:1963:x1830976123281024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155553.597678:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155553.597682:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e679200/0x844e5faceb5e8b66 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f2c8 expref: 19 pid: 15474 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.597691:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e679200/0x844e5faceb5e8b66 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f2c8 expref: 19 pid: 15474 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.597720:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e679200/0x844e5faceb5e8b66 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f2c8 expref: 19 pid: 15474 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746155553.597734:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155553.597737:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x844e5faceb5e8b9e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155553.597746:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x844e5faceb5e8b9e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155553.597753:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x844e5faceb5e8b9e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155553.597765:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155553.597800:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1963:x1830976123281024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 130us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.597806:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5408 00000100:00100000:0.0:1746155553.599840:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.602324:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.640785:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.645977:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.648677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.648717:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.653647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.665587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.669564:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.707151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.721429:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.736759:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.736795:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.736822:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.736844:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.736890:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123283328 00000100:00100000:0.0:1746155553.736897:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123283328 00000100:00100000:0.0:1746155553.736927:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123283456 00000100:00100000:0.0:1746155553.736928:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123283456 00000100:00100000:0.0:1746155553.736936:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123283584 00000100:00100000:0.0:1746155553.736938:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123283584 00000100:00100000:0.0:1746155553.736945:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123283712 00000100:00100000:0.0:1746155553.736947:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123283712 00000100:00100000:0.0:1746155553.736957:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10952 00000100:00100000:0.0:1746155553.736963:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123283328:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155553.736977:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.736991:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013686f800/0x844e5faceb5e8c00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f31c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.737031:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124401280:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155553.737101:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155553.737116:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10954 00000100:00100000:0.0:1746155553.737120:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976123283584:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155553.737126:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.737132:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013686ea00/0x844e5faceb5e8c0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f32a expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.737149:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124401536:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155553.738960:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155553.745176:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124401536:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155553.745190:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013686ea00/0x844e5faceb5e8c0e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f32a expref: 11 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.745198:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013686ea00/0x844e5faceb5e8c0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f32a expref: 11 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.745214:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013686ea00, rc 0) 00000100:00100000:0.0:1746155553.745232:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123283584:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 8112us (8410us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155553.745237:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10954 00000100:00100000:0.0:1746155553.745320:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f244700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124401664:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155553.745335:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093801800/0x844e5faceb5e8c15 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f331 expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.745343:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093801800/0x844e5faceb5e8c15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f331 expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.745350:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093801800, rc 0) 00000100:00100000:0.0:1746155553.745369:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123283712:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 8220us (8523us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155553.745374:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10955 00002000:00010000:0.0:1746155553.745400:0:9235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155553 -> 1746155554 00002000:00010000:0.0:1746155553.745403:0:9235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155553 -> 1746155554 00002000:00010000:0.0:1746155553.745405:0:9235:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155553 -> 1746155554 00000100:00100000:0.0:1746155553.745413:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f245c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124401408:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155553.745426:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093801400/0x844e5faceb5e8c07 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f323 expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.745434:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093801400/0x844e5faceb5e8c07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f323 expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.745440:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093801400, rc 0) 00000100:00100000:0.0:1746155553.745454:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123283456:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 8395us (8658us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155553.745459:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10953 00000100:00100000:0.0:1746155553.748449:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.749579:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.749596:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123284352 00000100:00100000:0.0:1746155553.749598:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123284352 00000100:00100000:0.0:1746155553.749617:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10956 00000100:00100000:0.0:1746155553.749622:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123284352:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.749630:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.749638:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013686f400/0x844e5faceb5e8c3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f346 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.749666:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124401920:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155553.750943:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155553.751304:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123284480 00000100:00100000:0.0:1746155553.751310:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123284480 00000100:00100000:0.0:1746155553.751344:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10957 00000100:00100000:0.0:1746155553.751352:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123284480:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.751363:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.751375:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013686e400/0x844e5faceb5e8c46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f34d expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.751410:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124402176:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155553.751447:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155553.753100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.754404:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124401920:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155553.754426:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013686f400/0x844e5faceb5e8c3f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f346 expref: 22 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.754436:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013686f400/0x844e5faceb5e8c3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f346 expref: 22 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.754458:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013686f400, rc 0) 00000100:00100000:0.0:1746155553.754481:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123284352:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4858us (4902us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155553.754487:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10956 00000100:00100000:0.0:1746155553.754909:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124402176:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155553.755305:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013686e400/0x844e5faceb5e8c46 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f34d expref: 26 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.755316:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013686e400/0x844e5faceb5e8c46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f34d expref: 26 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.755323:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013686e400, rc 0) 00000100:00100000:0.0:1746155553.755533:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123284480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4150us (4416us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155553.755540:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10957 00000100:00100000:0.0:1746155553.756447:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123284736 00000100:00100000:0.0:1746155553.756451:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123284736 00000100:00100000:0.0:1746155553.761227:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.762078:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.764895:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.770635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.790435:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.790529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.790544:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.790560:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123285760 00000100:00100000:0.0:1746155553.790565:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123285760 00000100:00100000:0.0:1746155553.790605:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123285888 00000100:00100000:0.0:1746155553.790607:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123285888 00000100:00100000:0.0:1746155553.790619:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10959 00000100:00100000:0.0:1746155553.790625:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123285760:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.790640:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.790652:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013686f000/0x844e5faceb5e8c69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f362 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.790668:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.790670:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.790676:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013686f000/0x844e5faceb5e8c69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f362 expref: 30 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.790689:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013686f000/0x844e5faceb5e8c69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f362 expref: 30 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.790697:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013686f000, rc 0) 00000100:00100000:0.0:1746155553.790738:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123285760:12345-192.168.202.51@tcp:101:cat.0 Request processed in 113us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.790743:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10959 00000100:00100000:0.0:1746155553.790755:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10960 00000100:00100000:0.0:1746155553.790759:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123285888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.790765:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.790771:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013686fe00/0x844e5faceb5e8c70 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f369 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.790798:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124402560:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155553.790838:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155553.790858:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.790916:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f244700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124402432:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155553.790928:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155553.790941:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123285632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 20130us (20314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.790947:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5414 00000100:00100000:0.0:1746155553.790984:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.791016:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123286016 00000100:00100000:0.0:1746155553.791018:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123286016 00000100:00100000:0.0:1746155553.791032:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10961 00000100:00100000:0.0:1746155553.791036:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1963:x1830976123286016:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.791042:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.791050:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013686fc00/0x844e5faceb5e8c77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f370 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155553.791071:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124402688:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155553.791091:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155553.791142:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123286528 00000100:00100000:0.0:1746155553.791145:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123286528 00002000:00100000:0.0:1746155553.791164:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880094c31c00 x1830976123286528/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:624/0 lens 488/0 e 0 to 0 dl 1746155564 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.791172:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c31c00 with x1830976123286528 ext(0->1048575) 00002000:00010000:0.0:1746155553.791176:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c31c00 00000100:00100000:0.0:1746155553.791185:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4011 00000100:00100000:0.0:1746155553.791189:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123286528:12345-192.168.202.51@tcp:3:cat.0 00002000:00010000:0.0:1746155553.800728:0:9235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155553 -> 1746155554 00000100:00100000:0.0:1746155553.800738:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124402560:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155553.800751:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013686fe00/0x844e5faceb5e8c70 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f369 expref: 29 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.800759:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013686fe00/0x844e5faceb5e8c70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f369 expref: 29 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155553.800769:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013686fe00, rc 0) 00000100:00100000:0.0:1746155553.800785:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123285888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10025us (10240us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155553.800790:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10960 00000100:00100000:0.0:1746155553.811673:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.813392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.813741:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.814343:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4012 00000100:00100000:0.0:1746155553.814351:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123287040:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155553.821647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.840946:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.845378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.845464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.845499:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123287808 00000100:00100000:0.0:1746155553.845532:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123287808 00002000:00100000:0.0:1746155553.845569:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094868a80 x1830976123287808/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:624/0 lens 488/0 e 0 to 0 dl 1746155564 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.845577:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094868a80 with x1830976123287808 ext(1048576->2097151) 00002000:00010000:0.0:1746155553.845581:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094868a80 00000100:00100000:0.0:1746155553.845594:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4013 00000100:00100000:0.0:1746155553.845600:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123287808:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155553.846911:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123287552 00000100:00100000:0.0:1746155553.846918:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123287552 00000100:00100000:0.0:1746155553.846951:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10963 00000100:00100000:0.0:1746155553.846958:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:28583:x1830976123287552:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155553.846971:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.846987:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013686e800/0x844e5faceb5e8c9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f385 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.847008:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.847010:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.847018:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013686e800/0x844e5faceb5e8c9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f385 expref: 38 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.847031:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013686e800/0x844e5faceb5e8c9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f385 expref: 38 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.847041:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013686e800, rc 0) 00000100:00100000:0.0:1746155553.847066:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:28583:x1830976123287552:12345-192.168.202.51@tcp:101:cat.0 Request processed in 109us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155553.847071:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10963 00000100:00100000:0.0:1746155553.866041:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.879351:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.879394:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.879948:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1963:x1830976123288192:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13745us (13912us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155553.879957:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4014 00002000:00100000:0.0:1746155553.879965:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009486a680 x1830976123288192/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:624/0 lens 488/440 e 0 to 0 dl 1746155564 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.879974:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486a680 with x1830976123288192 ext(1048576->2097151) 00002000:00010000:0.0:1746155553.879979:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486a680 00000100:00100000:0.0:1746155553.912435:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123290240 00000100:00100000:0.0:1746155553.912442:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123290240 00000100:00100000:0.0:1746155553.912485:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10968 00000100:00100000:0.0:1746155553.912492:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+26:28574:x1830976123290240:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155553.912520:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155553.912534:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130382800/0x844e5faceb5e8cbd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f3a8 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.912558:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fef4e00/0x844e5faceb5e8c93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f37e expref: 27 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.912565:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013686e800/0x844e5faceb5e8c9a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f385 expref: 36 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.912575:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.912577:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155553.912579:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130382800/0x844e5faceb5e8cbd lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f3a8 expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.912602:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013686e800/0x844e5faceb5e8c9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f385 expref: 36 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.912612:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013686e800/0x844e5faceb5e8c9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f385 expref: 36 pid: 9235 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746155553.912622:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009486aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124403840:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155553.914200:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fef4e00/0x844e5faceb5e8c93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f37e expref: 27 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155553.914212:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fef4e00/0x844e5faceb5e8c93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f37e expref: 27 pid: 9235 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746155553.914220:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124403968:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155553.914493:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155553.916405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.919124:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.921721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.921906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.921995:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.924683:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.926657:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123291264 00000100:00100000:0.0:1746155553.926662:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123291264 00002000:00100000:0.0:1746155553.926693:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1110016->1114111) req@ffff88009f245880 x1830976123291264/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:624/0 lens 488/0 e 0 to 0 dl 1746155564 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.926713:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f245880 with x1830976123291264 ext(1110016->1114111) 00002000:00010000:0.0:1746155553.926717:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f245880 00000100:00100000:0.0:1746155553.926731:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4020 00000100:00100000:0.0:1746155553.926737:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123291264:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155553.928088:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123291264:12345-192.168.202.51@tcp:3:cat.0 Request processed in 1345us (1555us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155553.928096:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4020 00002000:00100000:0.0:1746155553.928104:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1110016->1114111) req@ffff88009f245880 x1830976123291264/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:624/0 lens 488/4536 e 0 to 0 dl 1746155564 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.928112:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f245880 with x1830976123291264 ext(1110016->1114111) 00002000:00010000:0.0:1746155553.928115:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f245880 00000100:00100000:0.0:1746155553.934068:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123291520 00000100:00100000:0.0:1746155553.934076:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123291520 00000100:00100000:0.0:1746155553.934120:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3883 00000100:00100000:0.0:1746155553.934129:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+33:28574:x1830976123291520:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155553.934356:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+34:28574:x1830976123291520:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 226us (390us total) trans 8589943656 rc 0/0 00000100:00100000:0.0:1746155553.934363:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3883 00000100:00100000:0.0:1746155553.944611:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.947911:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.959789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.966963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.976375:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.985266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.985982:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155553.985999:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123293056 00000100:00100000:0.0:1746155553.986002:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123293056 00002000:00100000:0.0:1746155553.986017:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8801368ec000 x1830976123293056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:624/0 lens 488/0 e 0 to 0 dl 1746155564 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155553.986024:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ec000 with x1830976123293056 ext(3145728->4194303) 00002000:00010000:0.0:1746155553.986026:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368ec000 00000100:00100000:0.0:1746155553.986038:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4024 00000100:00100000:0.0:1746155553.986043:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976123293056:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155553.990556:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.004528:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.010980:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.011006:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.011044:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155554.011082:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155554.012176:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.012247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.012268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.012632:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10976 00000100:00100000:0.0:1746155554.012639:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123294208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155554.012644:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155554.012650:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fef4e00/0x844e5faceb5e8cf5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f3e0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155554.012667:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124405632:192.168.202.51@tcp:106: 00000100:00080000:0.0:1746155554.012688:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155554.013129:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155554.015550:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.022716:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.027645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.032232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.034678:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.034727:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.038950:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124406400:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155554.038970:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd50a00/0x844e5faceb5e8d11 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [4599808->5242879] (req 4599808->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f3fc expref: 29 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.038983:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd50a00, rc 0) 00000100:00100000:0.0:1746155554.039044:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:28583:x1830976123295360:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3368us (4371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155554.039051:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10980 00000100:00100000:0.0:1746155554.041462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.045540:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.057427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.062408:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10982 00000100:00100000:0.0:1746155554.062416:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976123296384:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155554.062427:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155554.062435:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fef4a00/0x844e5faceb5e8d1f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f40a expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155554.062458:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124406784:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155554.062481:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155554.071008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.075343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.075376:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.075411:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.082423:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.082651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.105258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.110947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.150310:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.153911:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.162754:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4034 00000100:00100000:0.0:1746155554.162763:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1962:x1830976123298944:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155554.181737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.203275:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.237078:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.239692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.242772:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.244674:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.246356:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.252456:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.253727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.257815:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.264668:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.294758:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.294791:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.294827:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.304758:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.309877:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.324288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.330175:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.330205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.330238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.357323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.357375:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.360449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.362873:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.362956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.372910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.378308:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.379768:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.388573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.404450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.406680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.406720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.406748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155554.407179:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155554.407457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.409332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.409581:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.413290:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.413710:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.414465:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.427678:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.428168:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.440940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.447630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.467191:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.479413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.479455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.481908:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.490213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.490258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.490278:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123308288 00000100:00100000:0.0:1746155554.490284:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123308288 00010000:00010000:0.0:1746155554.490311:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136a69e00/0x844e5faceb5e8d7a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f457 expref: 33 pid: 20796 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746155554.490330:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123308416 00000100:00100000:0.0:1746155554.490332:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123308416 00010000:00010000:0.0:1746155554.490339:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d9fe00/0x844e5faceb5e8d88 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f45e expref: 34 pid: 20796 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746155554.490362:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5439 00000100:00100000:0.0:1746155554.490368:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123308288:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155554.490377:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155554.490393:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136a69e00/0x844e5faceb5e8d7a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f457 expref: 33 pid: 20796 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746155554.490403:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136a69e00/0x844e5faceb5e8d7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f457 expref: 33 pid: 20796 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746155554.490424:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155554.490748:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123308288:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155554.490754:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5439 00000100:00100000:0.0:1746155554.490768:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5440 00000100:00100000:0.0:1746155554.490773:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1962:x1830976123308416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155554.490779:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155554.490787:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d9fe00/0x844e5faceb5e8d88 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f45e expref: 34 pid: 20796 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746155554.490795:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d9fe00/0x844e5faceb5e8d88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f45e expref: 34 pid: 20796 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746155554.490806:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.490808:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.490813:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012def2c00/0x844e5faceb5e8dc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 479232->598015) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f4a4 expref: 34 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.490821:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012def2c00/0x844e5faceb5e8dc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 479232->598015) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f4a4 expref: 34 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.490846:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012def2c00/0x844e5faceb5e8dc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 479232->598015) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f4a4 expref: 34 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155554.490857:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124410368:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155554.490906:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155554.495209:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124410368:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155554.495227:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155554.495257:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1962:x1830976123308416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4483us (4997us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155554.495264:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5440 00000100:00100000:0.0:1746155554.499941:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.504072:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.527184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.530938:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.531742:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123309824 00000100:00100000:0.0:1746155554.531745:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123309824 00000100:00100000:0.0:1746155554.531767:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3885 00000100:00100000:0.0:1746155554.531772:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:13789:x1830976123309824:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746155554.531838:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:13789:x1830976123309824:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 65us (215us total) trans 8589943659 rc 0/0 00000100:00100000:0.0:1746155554.531843:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3885 00000100:00100000:0.0:1746155554.531862:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b2f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124410624:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155554.531879:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4600/0x844e5faceb5e8de3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155554.533273:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.533311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.536458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.536484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.536531:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.536550:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123310208 00000100:00100000:0.0:1746155554.536556:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123310208 00000100:00100000:0.0:1746155554.536686:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11005 00000100:00100000:0.0:1746155554.536703:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123310208:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155554.536712:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155554.536719:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcba400/0x844e5faceb5e8df1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f4b2 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155554.536752:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124410752:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155554.536807:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155554.536861:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123310592 00000100:00100000:0.0:1746155554.536864:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123310592 00000100:00100000:0.0:1746155554.536881:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11008 00000100:00100000:0.0:1746155554.536885:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123310592:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155554.536891:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155554.536897:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcbb200/0x844e5faceb5e8e06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f4c7 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.536907:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.536908:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.536913:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbb200/0x844e5faceb5e8e06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f4c7 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.536921:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbb200/0x844e5faceb5e8e06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f4c7 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.536928:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbb200, rc 0) 00000100:00100000:0.0:1746155554.536943:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123310592:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 57us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155554.536948:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11008 00000100:00100000:0.0:1746155554.547951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.549954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.551490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.553020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.554150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.554227:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.554254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.554268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.554300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564365:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564422:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564445:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564518:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564533:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564540:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.564556:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.567899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155554.568231:0:29728:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.568239:0:29728:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.568253:0:29728:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.568258:0:29728:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.568263:0:29728:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8e45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.568268:0:29728:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a08e5a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155554.568270:0:29728:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8e45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.568276:0:29728:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8e45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.568284:0:29728:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8e45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.568288:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8e45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155554.568441:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123311744:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 15211us (15426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155554.568448:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11010 00000100:00100000:0.0:1746155554.569759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.575557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.575585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.575608:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.575838:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123315456 00000100:00100000:0.0:1746155554.575841:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123315456 00000100:00100000:0.0:1746155554.575860:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3887 00000100:00100000:0.0:1746155554.575866:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:23568:x1830976123315456:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746155554.575942:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+307:23568:x1830976123315456:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 75us (332us total) trans 8589943663 rc 0/0 00000100:00100000:0.0:1746155554.575948:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3887 00000100:00100000:0.0:1746155554.575997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.576070:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.581130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.581270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155554.581811:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013686f400/0x844e5faceb5e8e6f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155554.581817:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013686f400/0x844e5faceb5e8e6f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000040:00080000:0.0:1746155554.582758:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2763, 88 off230520 00000004:00080000:0.0:1746155554.582767:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 683732263268ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155554.582812:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2720, 88 off226464 00000004:00080000:0.0:1746155554.582816:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 683732313551ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155554.583484:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2721, 88 off226552 00000004:00080000:0.0:1746155554.583490:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 683732986489ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155554.583498:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2764, 88 off230608 00000004:00080000:0.0:1746155554.583501:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 683732997659ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155554.583536:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2765, 88 off230696 00000004:00080000:0.0:1746155554.583539:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 683733036459ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155554.583545:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2722, 88 off226640 00000004:00080000:0.0:1746155554.583549:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 683733045716ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155554.583554:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2723, 88 off226728 00000004:00080000:0.0:1746155554.583556:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 683733053031ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155554.583561:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2724, 88 off226816 00000004:00080000:0.0:1746155554.583564:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 683733060889ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155554.583570:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2766, 88 off230784 00000004:00080000:0.0:1746155554.583572:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 683733069055ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155554.583577:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2725, 88 off226904 00000004:00080000:0.0:1746155554.583580:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 683733077165ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155554.583586:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2767, 88 off230872 00000004:00080000:0.0:1746155554.583588:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 683733085424ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155554.583594:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2726, 88 off226992 00000004:00080000:0.0:1746155554.583597:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 683733093859ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155554.583603:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2768, 88 off230960 00000004:00080000:0.0:1746155554.583605:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 683733102624ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155554.583611:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2769, 88 off231048 00000004:00080000:0.0:1746155554.583614:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 683733110800ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155554.583619:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2770, 88 off231136 00000004:00080000:0.0:1746155554.583622:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 683733118734ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155554.583630:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2771, 88 off231224 00000004:00080000:0.0:1746155554.583632:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 683733129010ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155554.583639:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2727, 88 off227080 00000004:00080000:0.0:1746155554.583641:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 683733138541ns, next at 645866785986ns, rc = 0 00000100:00100000:0.0:1746155554.607181:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11024 00000100:00100000:0.0:1746155554.607187:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+63:3298:x1830976124415616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155554.607267:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+63:3298:x1830976124415616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (311us total) trans 17179873009 rc 0/0 00000100:00100000:0.0:1746155554.607271:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11024 00000100:00100000:0.0:1746155554.607279:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124414848 00000100:00100000:0.0:1746155554.607281:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124414848 00000100:00100000:0.0:1746155554.607291:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124415360 00000100:00100000:0.0:1746155554.607292:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124415360 00000100:00100000:0.0:1746155554.607301:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124414720 00000100:00100000:0.0:1746155554.607302:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124414720 00000100:00100000:0.0:1746155554.607311:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11025 00000100:00100000:0.0:1746155554.607315:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3296:x1830976124414848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155554.607393:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3296:x1830976124414848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (164us total) trans 17179873010 rc 0/0 00000100:00100000:0.0:1746155554.607398:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11025 00000100:00100000:0.0:1746155554.607408:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11028 00000100:00100000:0.0:1746155554.607412:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3296:x1830976124415232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155554.607476:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3296:x1830976124415232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (157us total) trans 17179873012 rc 0/0 00000100:00100000:0.0:1746155554.607481:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11028 00000100:00100000:0.0:1746155554.611160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.613661:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.615982:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.634727:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.639783:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.639813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.639831:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.639885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.639913:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123317120 00000100:00100000:0.0:1746155554.639920:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123317120 00000100:00100000:0.0:1746155554.639948:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123317376 00000100:00100000:0.0:1746155554.639950:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123317376 00000100:00100000:0.0:1746155554.639958:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123317248 00000100:00100000:0.0:1746155554.639960:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123317248 00000100:00100000:0.0:1746155554.639966:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123317504 00000100:00100000:0.0:1746155554.639967:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123317504 00000100:00100000:0.0:1746155554.639977:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11033 00000100:00100000:0.0:1746155554.639982:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976123317120:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155554.639997:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155554.640011:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcbbc00/0x844e5faceb5e8ea0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f4ff expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155554.640030:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x68143822, atime: 0x68143822, ctime: 0x68143822, blocks: 0x767 00010000:00010000:0.0:1746155554.640043:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.640045:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.640051:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbbc00/0x844e5faceb5e8ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f4ff expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.640063:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbbc00/0x844e5faceb5e8ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f4ff expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.640071:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbbc00, rc 0) 00000100:00100000:0.0:1746155554.640105:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976123317120:12345-192.168.202.51@tcp:101:cat.0 Request processed in 123us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155554.640112:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11033 00000100:00100000:0.0:1746155554.640124:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11035 00000100:00100000:0.0:1746155554.640128:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1962:x1830976123317248:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155554.640132:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155554.640138:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcba200/0x844e5faceb5e8eae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f506 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155554.640148:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3da:0x0] initial LVB size: 2097152, mtime: 0x68143822, atime: 0x68143822, ctime: 0x68143822, blocks: 0x821 00010000:00010000:0.0:1746155554.640153:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.640154:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.640158:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcba200/0x844e5faceb5e8eae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f506 expref: 42 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.640165:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcba200/0x844e5faceb5e8eae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f506 expref: 42 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.640170:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcba200, rc 0) 00000100:00100000:0.0:1746155554.640181:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1962:x1830976123317248:12345-192.168.202.51@tcp:101:cat.0 Request processed in 53us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155554.640185:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11035 00000100:00100000:0.0:1746155554.641032:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11036 00000100:00100000:0.0:1746155554.641040:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976123317504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155554.641048:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155554.641108:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcbb600/0x844e5faceb5e8eb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f514 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155554.641126:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x68143822, atime: 0x68143822, ctime: 0x68143822, blocks: 0x821 00010000:00010000:0.0:1746155554.641136:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.641137:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.641141:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbb600/0x844e5faceb5e8eb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f514 expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.641151:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbb600/0x844e5faceb5e8eb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f514 expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.641158:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbb600, rc 0) 00000100:00100000:0.0:1746155554.641177:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976123317504:12345-192.168.202.51@tcp:101:cat.0 Request processed in 139us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155554.641181:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11036 00000100:00100000:0.0:1746155554.641216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.641273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.641416:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11038 00000100:00100000:0.0:1746155554.641421:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123317632:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155554.641427:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155554.641433:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcbb800/0x844e5faceb5e8ebc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f51b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155554.641444:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d9:0x0] initial LVB size: 4603200, mtime: 0x68143822, atime: 0x68143822, ctime: 0x68143822, blocks: 0x135d 00010000:00010000:0.0:1746155554.641452:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.641453:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.641457:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbb800/0x844e5faceb5e8ebc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f51b expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.641466:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbb800/0x844e5faceb5e8ebc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f51b expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.641472:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbb800, rc 0) 00000100:00100000:0.0:1746155554.641498:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123317632:12345-192.168.202.51@tcp:101:cat.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155554.641516:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11038 00000100:00100000:0.0:1746155554.649380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.657474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.657581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.657618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.657976:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.658348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.658372:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4060 00000100:00100000:0.0:1746155554.658379:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123319040:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155554.684089:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.688046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.690951:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.691824:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.694028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.714877:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124416640 00000100:00100000:0.0:1746155554.714881:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124416640 00000100:00100000:0.0:1746155554.714958:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124417152 00000100:00100000:0.0:1746155554.714961:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124417152 00000100:00100000:0.0:1746155554.714971:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124416256 00000100:00100000:0.0:1746155554.714973:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124416256 00000100:00100000:0.0:1746155554.714982:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124416512 00000100:00100000:0.0:1746155554.714983:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124416512 00000100:00100000:0.0:1746155554.714998:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11040 00000100:00100000:0.0:1746155554.715003:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+71:3295:x1830976124417152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155554.715297:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3295:x1830976124417152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 293us (401us total) trans 21474840387 rc 0/0 00000100:00100000:0.0:1746155554.715303:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11040 00000100:00100000:0.0:1746155554.716019:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124416768 00000100:00100000:0.0:1746155554.716022:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124416768 00000100:00100000:0.0:1746155554.716034:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124417280 00000100:00100000:0.0:1746155554.716036:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124417280 00000100:00100000:0.0:1746155554.716044:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11050 00000100:00100000:0.0:1746155554.716048:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3295:x1830976124416768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155554.716076:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124417664 00000100:00100000:0.0:1746155554.716078:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124417664 00000100:00100000:0.0:1746155554.716085:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124418176 00000100:00100000:0.0:1746155554.716086:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124418176 00000100:00100000:0.0:1746155554.716093:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11051 00000100:00100000:0.0:1746155554.716096:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+75:3295:x1830976124417280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155554.716158:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155554.716160:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155554 -> 1746155554 00002000:00010000:0.0:1746155554.716161:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155554 -> 1746155554 00002000:00010000:0.0:1746155554.716163:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155554 -> 1746155554 00002000:00010000:0.0:1746155554.716164:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155554.716182:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3295:x1830976124417280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (173us total) trans 17179873019 rc 0/0 00000100:00100000:0.0:1746155554.716186:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11051 00000100:00100000:0.0:1746155554.716195:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11053 00000100:00100000:0.0:1746155554.716198:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3295:x1830976124418176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155554.716257:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3295:x1830976124418176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (184us total) trans 17179873021 rc 0/0 00000100:00100000:0.0:1746155554.716261:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11053 00002000:00010000:0.0:1746155554.716817:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:0.0:1746155554.716820:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155554.716822:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155554.716823:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155554.716825:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:0.0:1746155554.716853:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3295:x1830976124416640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1854us (1994us total) trans 21474840392 rc 0/0 00000100:00100000:0.0:1746155554.716858:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11039 00000100:00100000:0.0:1746155554.717105:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3295:x1830976124416768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1056us (1130us total) trans 21474840395 rc 0/0 00000100:00100000:0.0:1746155554.717110:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11050 00000100:00100000:0.0:1746155554.717892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.720672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.720728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.725625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.726585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.733583:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.740034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.742193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.746741:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.748364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.748420:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.749291:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123322112 00000100:00100000:0.0:1746155554.749294:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123322112 00000100:00100000:0.0:1746155554.749316:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123321984 00000100:00100000:0.0:1746155554.749318:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123321984 00010000:00010000:0.0:1746155554.749327:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcba200/0x844e5faceb5e8eae lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f506 expref: 44 pid: 8437 timeout: 783 lvb_type: 1 00000100:00100000:0.0:1746155554.749488:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5468 00000100:00100000:0.0:1746155554.749493:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1963:x1830976123321984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155554.749515:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155554.749532:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcba200/0x844e5faceb5e8eae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f506 expref: 44 pid: 8437 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746155554.749540:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcba200/0x844e5faceb5e8eae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f506 expref: 44 pid: 8437 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746155554.749551:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcba200/0x844e5faceb5e8eae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f506 expref: 44 pid: 8437 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746155554.749796:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.749798:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.749803:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1da6a00/0x844e5faceb5e8f4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f561 expref: 42 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.749810:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1da6a00/0x844e5faceb5e8f4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f561 expref: 42 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.749827:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1da6a00/0x844e5faceb5e8f4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f561 expref: 42 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155554.749835:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124418944:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155554.749875:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155554.750307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.751027:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.751081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.752038:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.752098:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.752111:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123323008 00000100:00100000:0.0:1746155554.752114:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123323008 00002000:00100000:0.0:1746155554.752131:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8801366b4000 x1830976123323008/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:625/0 lens 488/0 e 0 to 0 dl 1746155565 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155554.752139:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b4000 with x1830976123323008 ext(2097152->3145727) 00002000:00010000:0.0:1746155554.752142:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801366b4000 00000100:00100000:0.0:1746155554.752152:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123323264 00000100:00100000:0.0:1746155554.752154:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123323264 00002000:00100000:0.0:1746155554.752163:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8801366b6d80 x1830976123323264/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:625/0 lens 488/0 e 0 to 0 dl 1746155565 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155554.752170:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b6d80 with x1830976123323264 ext(3145728->4194303) 00002000:00010000:0.0:1746155554.752172:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801366b6d80 00000100:00100000:0.0:1746155554.752181:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4065 00000100:00100000:0.0:1746155554.752186:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976123323008:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155554.752245:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4066 00000100:00100000:0.0:1746155554.752249:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1960:x1830976123323264:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155554.752285:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.752299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.752318:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.752330:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123323392 00000100:00100000:0.0:1746155554.752333:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123323392 00000100:00100000:0.0:1746155554.752349:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123323520 00000100:00100000:0.0:1746155554.752351:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123323520 00000100:00100000:0.0:1746155554.752360:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123323648 00000100:00100000:0.0:1746155554.752361:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123323648 00000100:00100000:0.0:1746155554.752373:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11061 00000100:00100000:0.0:1746155554.752378:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1962:x1830976123323392:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155554.752386:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155554.752395:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10400/0x844e5faceb5e8f6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f57d expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.752409:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.752411:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.752417:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10400/0x844e5faceb5e8f6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f57d expref: 30 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.752428:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10400/0x844e5faceb5e8f6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f57d expref: 30 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.752435:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:0.0:1746155554.752456:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1962:x1830976123323392:12345-192.168.202.51@tcp:101:cat.0 Request processed in 77us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155554.752461:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11061 00000100:00100000:0.0:1746155554.752474:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11063 00000100:00100000:0.0:1746155554.752479:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1962:x1830976123323648:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155554.752484:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155554.752491:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x844e5faceb5e8f79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f58b expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.752500:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.752642:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155554.752646:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x844e5faceb5e8f79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f58b expref: 29 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.752655:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x844e5faceb5e8f79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f58b expref: 29 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155554.752661:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:0.0:1746155554.752757:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1962:x1830976123323648:12345-192.168.202.51@tcp:101:cat.0 Request processed in 277us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155554.752761:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11063 00000100:00100000:0.0:1746155554.752859:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124418944:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155554.752871:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155554.752888:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1963:x1830976123321984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3395us (3710us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155554.752893:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5468 00000100:00100000:0.0:1746155554.758200:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.779023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.780480:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976123323264:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28228us (28381us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155554.780487:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4066 00002000:00100000:0.0:1746155554.780493:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8801366b6d80 x1830976123323264/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:625/0 lens 488/440 e 0 to 0 dl 1746155565 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155554.780499:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b6d80 with x1830976123323264 ext(3145728->4194303) 00002000:00010000:0.0:1746155554.780516:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801366b6d80 00000100:00100000:0.0:1746155554.788384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.788472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.793586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.795528:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123324672 00000100:00100000:0.0:1746155554.795536:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123324672 00002000:00100000:0.0:1746155554.795564:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4603903) req@ffff880093a47b80 x1830976123324672/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:625/0 lens 488/0 e 0 to 0 dl 1746155565 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155554.795576:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a47b80 with x1830976123324672 ext(4194304->4603903) 00002000:00010000:0.0:1746155554.795580:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a47b80 00000100:00100000:0.0:1746155554.795598:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4068 00000100:00100000:0.0:1746155554.795604:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123324672:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155554.809735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.814566:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.825830:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123325184 00000100:00100000:0.0:1746155554.825840:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123325184 00000100:00100000:0.0:1746155554.825967:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11067 00000100:00100000:0.0:1746155554.825979:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+29:28628:x1830976123325184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155554.825997:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155554.826014:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d9e800/0x844e5faceb5e8f95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f5a7 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.826042:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1da6a00/0x844e5faceb5e8f4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f561 expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.826050:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155554.826052:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155554.826055:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d9e800/0x844e5faceb5e8f95 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f5a7 expref: 30 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.826087:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1da6a00/0x844e5faceb5e8f4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f561 expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155554.826098:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1da6a00/0x844e5faceb5e8f4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f561 expref: 41 pid: 8437 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746155554.826110:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124419456:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155554.831247:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.841709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.848120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.852172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.861897:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.861931:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.861962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.885033:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.890697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.893743:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.896845:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.900843:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.904845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.904893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.909786:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.911323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.923064:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.923138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.923175:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123328512 00000100:00100000:0.0:1746155554.923179:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123328512 00002000:00100000:0.0:1746155554.923210:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1753088->1757183) req@ffff8800a62a0380 x1830976123328512/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:625/0 lens 488/0 e 0 to 0 dl 1746155565 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155554.923218:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a0380 with x1830976123328512 ext(1753088->1757183) 00002000:00010000:0.0:1746155554.923222:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a0380 00000100:00100000:0.0:1746155554.923245:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123328768 00000100:00100000:0.0:1746155554.923248:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123328768 00002000:00100000:0.0:1746155554.923260:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009a6d9f80 x1830976123328768/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:625/0 lens 488/0 e 0 to 0 dl 1746155565 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155554.923266:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d9f80 with x1830976123328768 ext(1048576->2097151) 00002000:00010000:0.0:1746155554.923269:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6d9f80 00000100:00100000:0.0:1746155554.923286:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4072 00000100:00100000:0.0:1746155554.923291:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1963:x1830976123328768:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155554.928256:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.938470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.963273:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.963324:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.963382:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.965110:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.965527:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123330048 00000100:00100000:0.0:1746155554.965530:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123330048 00002000:00100000:0.0:1746155554.965549:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009a6d8a80 x1830976123330048/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:625/0 lens 488/0 e 0 to 0 dl 1746155565 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155554.965558:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d8a80 with x1830976123330048 ext(2097152->3145727) 00002000:00010000:0.0:1746155554.965563:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6d8a80 00000100:00100000:0.0:1746155554.987128:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1962:x1830976123330048:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21525us (23746us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155554.987134:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4074 00002000:00100000:0.0:1746155554.987140:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009a6d8a80 x1830976123330048/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:625/0 lens 488/440 e 0 to 0 dl 1746155565 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155554.987147:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d8a80 with x1830976123330048 ext(2097152->3145727) 00010000:00010000:0.0:1746155554.987151:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130cb4c00/0x844e5faceb5e8f72 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f584 expref: 30 pid: 8437 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155554.987158:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130cb4c00/0x844e5faceb5e8f72 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f584 expref: 30 pid: 8437 timeout: 784 lvb_type: 1 00002000:00010000:0.0:1746155554.987163:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6d8a80 00000100:00100000:0.0:1746155554.992434:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.993225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.996393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155554.997845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.005019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.010637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.025643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.035638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.042554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.042577:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123332224 00000100:00100000:0.0:1746155555.042585:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123332224 00000100:00100000:0.0:1746155555.042622:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9786 00000100:00100000:0.0:1746155555.042629:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:28638:x1830976123332224:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155555.042650:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155555.042665:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01a00/0x844e5faceb5e8fe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f5d8 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.052959:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01600/0x844e5faceb5e8fe9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.052978:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01600/0x844e5faceb5e8fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.052988:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01600/0x844e5faceb5e8fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.052999:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01400/0x844e5faceb5e8ff0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.053004:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01400/0x844e5faceb5e8ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.053009:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01400/0x844e5faceb5e8ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055342:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01200/0x844e5faceb5e8ff7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055359:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01200/0x844e5faceb5e8ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055367:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01200/0x844e5faceb5e8ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155555.055377:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 8797504 00010000:00010000:0.0:1746155555.055443:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01600/0x844e5faceb5e8fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055448:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01600/0x844e5faceb5e8fe9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055453:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01600/0x844e5faceb5e8fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055458:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc01600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155555.055461:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01600/0x844e5faceb5e8fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055466:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01600/0x844e5faceb5e8fe9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055474:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155555.055476:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155555.055479:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01600/0x844e5faceb5e8fe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055483:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01600/0x844e5faceb5e8fe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055516:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01400/0x844e5faceb5e8ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055521:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01400/0x844e5faceb5e8ff0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055525:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01400/0x844e5faceb5e8ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055532:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc01400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155555.055534:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01400/0x844e5faceb5e8ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055539:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01400/0x844e5faceb5e8ff0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055544:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d55ac00) 00010000:00010000:0.0:1746155555.055546:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155555.055548:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01400/0x844e5faceb5e8ff0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055552:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01400/0x844e5faceb5e8ff0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.055591:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01a00/0x844e5faceb5e8fe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f5d8 expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.055601:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc01200/0x844e5faceb5e8ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f5d8 expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.055606:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155555.055608:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155555.055610:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc01200, rc 0) 00000100:00100000:0.0:1746155555.055657:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:28638:x1830976123332224:12345-192.168.202.51@tcp:101:cat.0 Request processed in 13027us (13108us total) trans 8589943676 rc 0/0 00000100:00100000:0.0:1746155555.055664:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9786 00000100:00100000:0.0:1746155555.062401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.063545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.063565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.063578:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.063615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.074040:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.085900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.085931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.085966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.086112:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1962:x1830976123333120:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11715us (12073us total) trans 0 rc 409600/409600 00000100:00100000:0.0:1746155555.086122:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4079 00002000:00100000:0.0:1746155555.086130:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4603903) req@ffff88009c211500 x1830976123333120/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:626/0 lens 488/440 e 0 to 0 dl 1746155566 ref 1 fl Complete:/200/0 rc 409600/409600 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.086138:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211500 with x1830976123333120 ext(4194304->4603903) 00002000:00010000:0.0:1746155555.086143:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c211500 00000100:00100000:0.0:1746155555.086163:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123333504 00000100:00100000:0.0:1746155555.086169:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123333504 00002000:00100000:0.0:1746155555.086197:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009c210e00 x1830976123333504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:626/0 lens 488/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.086204:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210e00 with x1830976123333504 ext(0->1048575) 00002000:00010000:0.0:1746155555.086207:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c210e00 00000100:00100000:0.0:1746155555.086219:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123333760 00000100:00100000:0.0:1746155555.086221:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123333760 00002000:00100000:0.0:1746155555.086233:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009c210700 x1830976123333760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:626/0 lens 488/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.086239:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210700 with x1830976123333760 ext(1048576->2097151) 00002000:00010000:0.0:1746155555.086241:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c210700 00000100:00100000:0.0:1746155555.086250:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123333632 00000100:00100000:0.0:1746155555.086252:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123333632 00002000:00100000:0.0:1746155555.086262:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009c211880 x1830976123333632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:626/0 lens 488/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.086268:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211880 with x1830976123333632 ext(1048576->2097151) 00002000:00010000:0.0:1746155555.086270:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c211880 00000100:00100000:0.0:1746155555.086280:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4080 00000100:00100000:0.0:1746155555.086286:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976123333504:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155555.122164:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123334400 00000100:00100000:0.0:1746155555.122169:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123334400 00002000:00100000:0.0:1746155555.122198:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1757183) req@ffff880093a44e00 x1830976123334400/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:626/0 lens 488/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.122207:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a44e00 with x1830976123334400 ext(1048576->1757183) 00010000:00010000:0.0:1746155555.122213:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5400/0x844e5faceb5e8fcd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f5c3 expref: 30 pid: 10591 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746155555.122224:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5400/0x844e5faceb5e8fcd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1757183) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f5c3 expref: 30 pid: 10591 timeout: 784 lvb_type: 0 00002000:00010000:0.0:1746155555.122230:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093a44e00 00000100:00100000:0.0:1746155555.122243:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 583 00000100:00100000:0.0:1746155555.122250:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123334400:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155555.128778:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123334656 00000100:00100000:0.0:1746155555.128786:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123334656 00000100:00100000:0.0:1746155555.128818:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9787 00000100:00100000:0.0:1746155555.128825:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:28642:x1830976123334656:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155555.128842:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155555.128856:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01aec00/0x844e5faceb5e9028 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f602 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.128925:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01af400/0x844e5faceb5e902f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.128935:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01af400/0x844e5faceb5e902f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.128943:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01af400/0x844e5faceb5e902f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.128953:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afa00/0x844e5faceb5e9036 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.128958:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afa00/0x844e5faceb5e9036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.128962:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afa00/0x844e5faceb5e9036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129034:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afc00/0x844e5faceb5e903d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129041:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afc00/0x844e5faceb5e903d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129046:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afc00/0x844e5faceb5e903d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155555.129052:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 8797504 00010000:00010000:0.0:1746155555.129104:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01af400/0x844e5faceb5e902f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129113:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01af400/0x844e5faceb5e902f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129117:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01af400/0x844e5faceb5e902f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129121:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01af400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155555.129124:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01af400/0x844e5faceb5e902f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129129:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01af400/0x844e5faceb5e902f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129137:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155555.129139:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155555.129142:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01af400/0x844e5faceb5e902f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129146:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01af400/0x844e5faceb5e902f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129154:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afa00/0x844e5faceb5e9036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129158:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afa00/0x844e5faceb5e9036 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129162:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afa00/0x844e5faceb5e9036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129165:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01afa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155555.129167:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afa00/0x844e5faceb5e9036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129173:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afa00/0x844e5faceb5e9036 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129178:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d55a400) 00010000:00010000:0.0:1746155555.129180:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155555.129181:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afa00/0x844e5faceb5e9036 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129185:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afa00/0x844e5faceb5e9036 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.129211:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01aec00/0x844e5faceb5e9028 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f602 expref: 296 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.129220:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01afc00/0x844e5faceb5e903d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f602 expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.129225:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155555.129226:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155555.129228:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01afc00, rc 0) 00000100:00100000:0.0:1746155555.129769:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:28642:x1830976123334656:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 943us (1337us total) trans 8589943678 rc 0/0 00000100:00100000:0.0:1746155555.129774:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9787 00000100:00100000:0.0:1746155555.132482:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.132589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.133864:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.144231:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.155244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.155447:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123335680 00000100:00100000:0.0:1746155555.155453:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123335680 00000100:00100000:0.0:1746155555.155545:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9788 00000100:00100000:0.0:1746155555.155569:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+11:28644:x1830976123335680:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155555.155586:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155555.155600:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583c00/0x844e5faceb5e904b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f609 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.155706:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5e9052 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155724:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5e9052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155733:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5e9052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155742:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583000/0x844e5faceb5e9059 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155746:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583000/0x844e5faceb5e9059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155751:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583000/0x844e5faceb5e9059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155822:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583400/0x844e5faceb5e9060 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155829:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583400/0x844e5faceb5e9060 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155833:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583400/0x844e5faceb5e9060 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155555.155842:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 8797504 00010000:00010000:0.0:1746155555.155896:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5e9052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155901:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5e9052 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155905:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5e9052 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155909:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d582800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155555.155912:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5e9052 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155917:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5e9052 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155924:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155555.155926:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155555.155929:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5e9052 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155933:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5e9052 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155943:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583000/0x844e5faceb5e9059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155947:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583000/0x844e5faceb5e9059 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155951:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583000/0x844e5faceb5e9059 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155957:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d583000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155555.155959:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583000/0x844e5faceb5e9059 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155963:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583000/0x844e5faceb5e9059 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155967:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d55ac00) 00010000:00010000:0.0:1746155555.155968:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155555.155970:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583000/0x844e5faceb5e9059 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155973:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583000/0x844e5faceb5e9059 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.155997:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583c00/0x844e5faceb5e904b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f609 expref: 14 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.156005:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583400/0x844e5faceb5e9060 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f609 expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.156009:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155555.156010:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155555.156012:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d583400, rc 0) 00000100:00100000:0.0:1746155555.156042:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+13:28644:x1830976123335680:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 491us (804us total) trans 8589943680 rc 0/0 00000100:00100000:0.0:1746155555.156048:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9788 00000100:00100000:0.0:1746155555.169939:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.169982:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.182022:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123336704 00000100:00100000:0.0:1746155555.182030:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123336704 00010000:00010000:0.0:1746155555.182056:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a08e4400/0x844e5faceb5e8f8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f5a0 expref: 41 pid: 4461 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746155555.182082:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5480 00000100:00100000:0.0:1746155555.182089:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1960:x1830976123336704:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155555.182099:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155555.182116:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a08e4400/0x844e5faceb5e8f8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f5a0 expref: 41 pid: 4461 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.182126:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a08e4400/0x844e5faceb5e8f8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f5a0 expref: 41 pid: 4461 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.182144:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a08e4400/0x844e5faceb5e8f8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f5a0 expref: 41 pid: 4461 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.182155:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155555.182186:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976123336704:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 97us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.182191:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5480 00000100:00100000:0.0:1746155555.184154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.184177:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123336576 00000100:00100000:0.0:1746155555.184183:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123336576 00010000:00010000:0.0:1746155555.184205:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8f80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f592 expref: 32 pid: 4461 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746155555.184224:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5481 00000100:00100000:0.0:1746155555.184232:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1960:x1830976123336576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155555.184383:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155555.184402:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8f80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f592 expref: 32 pid: 4461 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746155555.184414:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8f80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f592 expref: 32 pid: 4461 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746155555.184431:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a08e5a00/0x844e5faceb5e8f80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f592 expref: 32 pid: 4461 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746155555.184449:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.184451:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.184457:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5e906e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->954367) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f610 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.184465:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5e906e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->954367) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f610 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.184492:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5e906e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->954367) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f610 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155555.184519:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a8b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124422016:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155555.188480:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155555.191466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.191532:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124422016:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155555.191548:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155555.191576:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1960:x1830976123336576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7343us (7425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.191584:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5481 00000100:00100000:0.0:1746155555.198092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.211730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.231527:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123337728 00000100:00100000:0.0:1746155555.231535:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123337728 00000100:00100000:0.0:1746155555.231579:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11080 00000100:00100000:0.0:1746155555.231586:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976123337728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155555.231601:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155555.231614:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d583c00/0x844e5faceb5e907c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f61e expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155555.231652:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124422272:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155555.231741:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155555.231772:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123337984 00000100:00100000:0.0:1746155555.231775:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123337984 00000100:00100000:0.0:1746155555.231798:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9789 00000100:00100000:0.0:1746155555.231802:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+13:28648:x1830976123337984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155555.231812:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155555.231822:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583a00/0x844e5faceb5e9083 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f625 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.231897:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582c00/0x844e5faceb5e908a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.231907:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582c00/0x844e5faceb5e908a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.231919:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582c00/0x844e5faceb5e908a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.231929:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e9091 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.231933:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e9091 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.231937:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e9091 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232018:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583e00/0x844e5faceb5e9098 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232026:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583e00/0x844e5faceb5e9098 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232031:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583e00/0x844e5faceb5e9098 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155555.232037:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 8797504 00010000:00010000:0.0:1746155555.232099:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582c00/0x844e5faceb5e908a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232105:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582c00/0x844e5faceb5e908a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232110:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582c00/0x844e5faceb5e908a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232115:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d582c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155555.232118:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582c00/0x844e5faceb5e908a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232153:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582c00/0x844e5faceb5e908a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232165:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155555.232167:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155555.232170:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582c00/0x844e5faceb5e908a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232174:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582c00/0x844e5faceb5e908a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232184:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e9091 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232188:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e9091 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232193:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e9091 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232196:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d583600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155555.232198:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e9091 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232203:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e9091 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232207:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d55a400) 00010000:00010000:0.0:1746155555.232209:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155555.232211:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e9091 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232216:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5e9091 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.232257:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583a00/0x844e5faceb5e9083 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f625 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.232267:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583e00/0x844e5faceb5e9098 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f625 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.232272:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155555.232273:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155555.232275:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d583e00, rc 0) 00000100:00100000:0.0:1746155555.232310:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28648:x1830976123337984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 507us (822us total) trans 8589943682 rc 0/0 00000100:00100000:0.0:1746155555.232316:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9789 00000100:00100000:0.0:1746155555.233571:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124422272:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155555.233590:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d583c00/0x844e5faceb5e907c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f61e expref: 37 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155555.233599:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d583c00/0x844e5faceb5e907c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f61e expref: 37 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155555.233607:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d583c00, rc 0) 00000100:00100000:0.0:1746155555.233629:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976123337728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2043us (2186us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155555.233634:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11080 00000100:00100000:0.0:1746155555.240478:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123338240 00000100:00100000:0.0:1746155555.240490:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123338240 00000100:00100000:0.0:1746155555.240563:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 566 00000100:00100000:0.0:1746155555.240571:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123338240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155555.240583:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155555.240602:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583e00/0x844e5faceb5e9098 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f625 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.240616:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155555.240620:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155555.240664:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976123338240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 93us (5104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.240669:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 566 00000100:00100000:0.0:1746155555.250810:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.283487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.287337:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.287377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.292027:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.295734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.295783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.296316:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11085 00000100:00100000:0.0:1746155555.296323:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+7:28648:x1830976123340288:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155555.296330:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155555.296338:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5e90c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f648 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.296352:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093801c00/0x844e5faceb5e90b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f63a expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.296362:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155555.296363:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155555.296366:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5e90c2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f648 expref: 8 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.296380:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093801c00/0x844e5faceb5e90b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f63a expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.296391:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093801c00/0x844e5faceb5e90b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f63a expref: 19 pid: 20796 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746155555.296401:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a89f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124423040:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155555.296663:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155555.298957:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.301919:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.301960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.308983:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a44380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124423296:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155555.308998:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155555.309016:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+7:1961:x1830976123340672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6941us (7104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.309023:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5484 00000100:00100000:0.0:1746155555.314649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.316160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.319568:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.332969:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.336119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.337529:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.339814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155555.340243:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094128600/0x844e5faceb5e90de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340249:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094128600/0x844e5faceb5e90de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155555.340283:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 8797504 00000004:00200000:0.0:1746155555.340287:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155555.340299:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094128600/0x844e5faceb5e90de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340307:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094128600/0x844e5faceb5e90de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340314:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5e90d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340319:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5e90d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340324:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5e90d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340328:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801369b9400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155555.340331:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5e90d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340337:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5e90d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340344:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155555.340346:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155555.340349:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5e90d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340353:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5e90d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340624:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5e90d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340629:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5e90d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340634:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5e90d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340637:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801369b9c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155555.340640:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5e90d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340644:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5e90d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340656:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008d58ce00) 00010000:00010000:0.0:1746155555.340657:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155555.340660:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5e90d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340663:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5e90d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.340701:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5e90c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f64f expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.340714:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094128600/0x844e5faceb5e90de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f64f expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.340720:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155555.340722:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155555.340724:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094128600, rc 0) 00000100:00100000:0.0:1746155555.340746:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:28651:x1830976123341440:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 7260us (7786us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.340752:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9790 00000100:00100000:0.0:1746155555.344016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.345199:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.345227:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.347765:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.347777:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123342848 00000100:00100000:0.0:1746155555.347780:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123342848 00000100:00100000:0.0:1746155555.347801:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11092 00000100:00100000:0.0:1746155555.347806:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123342848:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155555.347811:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155555.347818:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5e910f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f680 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.347828:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.347829:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.347833:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5e910f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f680 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155555.347842:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5e910f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f680 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155555.347849:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d582c00, rc 0) 00000100:00100000:0.0:1746155555.347865:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123342848:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 60us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.347870:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11092 00000100:00100000:0.0:1746155555.356060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.359490:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155555.360399:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bcb200/0x844e5faceb5e911d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155555.360405:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bcb200/0x844e5faceb5e911d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155555.360419:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 8797504 00010000:00010000:0.0:1746155555.360665:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bca800/0x844e5faceb5e9116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f687 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.360704:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bcb200/0x844e5faceb5e911d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f687 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.360711:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155555.360713:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155555.360715:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bcb200, rc 0) 00000100:00100000:0.0:1746155555.360744:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28651:x1830976123343104:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 4409us (4691us total) trans 8589943685 rc 0/0 00000100:00100000:0.0:1746155555.360750:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9791 00000100:00100000:0.0:1746155555.363386:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.367204:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.368748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.368836:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.373083:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.373117:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.373858:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.373872:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123345024 00000100:00100000:0.0:1746155555.373876:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123345024 00000100:00100000:0.0:1746155555.373901:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11095 00000100:00100000:0.0:1746155555.373907:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123345024:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155555.373923:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800913f1c00/0x844e5faceb5e9155 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.373932:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5e90c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f648 expref: 9 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.373939:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5e910f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f680 expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155555.373944:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.373945:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.373947:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913f1c00/0x844e5faceb5e9155 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.374202:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5e910f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f680 expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155555.374210:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5e910f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f680 expref: 9 pid: 4461 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746155555.374221:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124424576:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155555.374517:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5e90c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f648 expref: 9 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.374524:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5e90c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f648 expref: 9 pid: 19959 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746155555.374532:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124425088:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155555.374717:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155555.374746:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.375133:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.375660:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.383270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.383294:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.383312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.383330:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.383351:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123345280 00000100:00100000:0.0:1746155555.383354:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123345280 00010000:00010000:0.0:1746155555.383375:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094128e00/0x844e5faceb5e9101 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f664 expref: 12 pid: 1625 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746155555.383408:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5490 00000100:00100000:0.0:1746155555.383414:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123345408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155555.383425:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155555.383445:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094a4a400/0x844e5faceb5e90a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f62c expref: 8 pid: 20796 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.383454:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094a4a400/0x844e5faceb5e90a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f62c expref: 8 pid: 20796 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.383471:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094a4a400/0x844e5faceb5e90a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f62c expref: 8 pid: 20796 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.383487:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155555.383643:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+7:1961:x1830976123345408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 229us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.383648:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5490 00000100:00100000:0.0:1746155555.384033:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124425856:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155555.384048:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094129800/0x844e5faceb5e9163 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155555.384228:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5496 00000100:00100000:0.0:1746155555.384235:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123346176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155555.384242:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155555.384251:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5e900c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f5e6 expref: 21 pid: 4461 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.384258:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5e900c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f5e6 expref: 21 pid: 4461 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.384273:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5e900c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f5e6 expref: 21 pid: 4461 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.384281:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155555.384295:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123346176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 62us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.384300:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5496 00000100:00100000:0.0:1746155555.385656:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.386936:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123346688 00000100:00100000:0.0:1746155555.386939:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123346688 00010000:00010000:0.0:1746155555.386953:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b81b000/0x844e5faceb5e90e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f656 expref: 9 pid: 10591 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746155555.386966:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5500 00000100:00100000:0.0:1746155555.386971:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123346688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155555.386977:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155555.386986:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b81b000/0x844e5faceb5e90e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f656 expref: 9 pid: 10591 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746155555.386993:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b81b000/0x844e5faceb5e90e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f656 expref: 9 pid: 10591 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746155555.387004:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b81b000/0x844e5faceb5e90e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f656 expref: 9 pid: 10591 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746155555.387016:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.387017:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.387020:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f9b400/0x844e5faceb5e916a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.387025:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f9b400/0x844e5faceb5e916a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.387037:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155555.387141:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123346688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 170us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.387146:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5500 00010000:00010000:0.0:1746155555.387162:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094129800/0x844e5faceb5e9163 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.387169:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094129800/0x844e5faceb5e9163 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.387180:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094129800/0x844e5faceb5e9163 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.387185:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094129800/0x844e5faceb5e9163 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.387190:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094129800/0x844e5faceb5e9163 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.387199:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094129800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155555.387201:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094129800/0x844e5faceb5e9163 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.387207:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094129800/0x844e5faceb5e9163 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.387216:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094129800/0x844e5faceb5e9163 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.387220:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094129800/0x844e5faceb5e9163 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155555.387247:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1960:x1830976123344640:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 11489us (12114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.387252:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11097 00000100:00100000:0.0:1746155555.387642:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1960:x1830976123345792:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3686us (3787us total) trans 21474840400 rc 0/0 00000100:00100000:0.0:1746155555.387648:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 586 00002000:00100000:0.0:1746155555.387655:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (925696->954367) req@ffff880131495880 x1830976123345792/t21474840400(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:626/0 lens 488/448 e 0 to 0 dl 1746155566 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.387663:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495880 with x1830976123345792 ext(925696->954367) 00010000:00010000:0.0:1746155555.387669:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5e906e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->954367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f610 expref: 8 pid: 4461 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746155555.387682:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5e906e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 925696->954367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f610 expref: 8 pid: 4461 timeout: 784 lvb_type: 0 00002000:00010000:0.0:1746155555.387697:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131495880 00000100:00100000:0.0:1746155555.390936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.391414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.398179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.398207:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.398269:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.398444:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000001:00080000:0.0:1746155555.418006:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943685 is committed 00000001:00080000:0.0:1746155555.418015:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943682 is committed 00000001:00080000:0.0:1746155555.418021:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943678 is committed 00000001:00080000:0.0:1746155555.418029:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943684 is committed 00000001:00080000:0.0:1746155555.418038:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943686 is committed 00000001:00080000:0.0:1746155555.418062:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943687 is committed 00000004:00080000:0.0:1746155555.418065:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1937 committed 00000004:00080000:0.0:1746155555.418070:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1989 committed 00000004:00080000:0.0:1746155555.418075:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1988 committed 00000004:00080000:0.0:1746155555.418076:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1987 committed 00000004:00080000:0.0:1746155555.418077:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1986 committed 00000004:00080000:0.0:1746155555.418079:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1936 committed 00000004:00080000:0.0:1746155555.418080:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1985 committed 00000004:00080000:0.0:1746155555.418081:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1935 committed 00000004:00080000:0.0:1746155555.418082:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1984 committed 00000004:00080000:0.0:1746155555.418084:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1934 committed 00000004:00080000:0.0:1746155555.418085:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1933 committed 00000004:00080000:0.0:1746155555.418087:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1932 committed 00000004:00080000:0.0:1746155555.418088:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1983 committed 00000004:00080000:0.0:1746155555.418090:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1982 committed 00000004:00080000:0.0:1746155555.418091:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1931 committed 00000004:00080000:0.0:1746155555.418093:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1930 committed 00000004:00080000:0.0:1746155555.418094:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1981 committed 00000100:00100000:0.0:1746155555.419105:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11101 00000100:00100000:0.0:1746155555.419112:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976124427136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155555.419201:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3297:x1830976124427136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (824us total) trans 17179873028 rc 0/0 00000100:00100000:0.0:1746155555.419206:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11101 00000100:00100000:0.0:1746155555.419216:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11102 00000100:00100000:0.0:1746155555.419220:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976124426752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155555.419289:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11104 00000100:00100000:0.0:1746155555.419295:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3295:x1830976124426880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155555.419304:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11105 00000100:00100000:0.0:1746155555.419308:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3295:x1830976124427392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155555.419317:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11106 00000100:00100000:0.0:1746155555.419320:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3295:x1830976124427008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155555.419588:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155555.419591:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155555 -> 1746155555 00002000:00010000:0.0:1746155555.419593:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155554 -> 1746155554 00002000:00010000:0.0:1746155555.419594:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155555 -> 1746155555 00002000:00010000:0.0:1746155555.419596:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155555.419618:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3295:x1830976124426880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 323us (1165us total) trans 17179873031 rc 0/0 00000100:00100000:0.0:1746155555.419625:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11104 00000100:00100000:0.0:1746155555.419635:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11110 00000100:00100000:0.0:1746155555.419640:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3295:x1830976124428160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155555.419728:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:0.0:1746155555.419730:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155555.419732:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155555.419734:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155555.419735:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:0.0:1746155555.419752:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3295:x1830976124428160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (292us total) trans 21474840402 rc 0/0 00000100:00100000:0.0:1746155555.419758:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11110 00000100:00100000:0.0:1746155555.419879:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3295:x1830976124427392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 570us (1406us total) trans 17179873032 rc 0/0 00000100:00100000:0.0:1746155555.419883:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11105 00000100:00100000:0.0:1746155555.421738:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9797 00000100:00100000:0.0:1746155555.421745:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28651:x1830976123348480:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155555.421754:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155555.421761:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bdfa800/0x844e5faceb5e919b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f6b1 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.421788:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bdfa800/0x844e5faceb5e919b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f6b1 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.421797:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bdfa800/0x844e5faceb5e919b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f6b1 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.421815:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155555.421818:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155555.421820:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bdfa800, rc 0) 00000100:00100000:0.0:1746155555.421847:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:28651:x1830976123348480:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 103us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.421852:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9797 00000100:00100000:0.0:1746155555.422874:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3295:x1830976124427008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3552us (4347us total) trans 17179873033 rc 0/0 00000100:00100000:0.0:1746155555.422879:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11106 00000100:00100000:0.0:1746155555.426753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.426834:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.428979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.431608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.431652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.433871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.433897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.433950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.436936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.439940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.448426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.480254:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.480904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.483114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.483528:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.483735:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.483788:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.483800:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123351552 00000100:00100000:0.0:1746155555.483803:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123351552 00010000:00010000:0.0:1746155555.483815:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131005400/0x844e5faceb5e917f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f6a3 expref: 9 pid: 15474 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746155555.483835:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123351680 00000100:00100000:0.0:1746155555.483837:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123351680 00010000:00010000:0.0:1746155555.483844:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094129a00/0x844e5faceb5e91fd lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f6e2 expref: 292 pid: 15474 timeout: 784 lvb_type: 0 00000001:00080000:0.0:1746155555.508928:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943694 is committed 00000004:00080000:0.0:1746155555.508936:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1945 committed 00000004:00080000:0.0:1746155555.508949:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1998 committed 00000004:00080000:0.0:1746155555.508955:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1997 committed 00000004:00080000:0.0:1746155555.508956:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1996 committed 00000004:00080000:0.0:1746155555.508958:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1995 committed 00000004:00080000:0.0:1746155555.508959:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1944 committed 00000004:00080000:0.0:1746155555.508961:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1994 committed 00000004:00080000:0.0:1746155555.508962:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1943 committed 00000004:00080000:0.0:1746155555.508964:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1993 committed 00000004:00080000:0.0:1746155555.508965:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1942 committed 00000004:00080000:0.0:1746155555.508967:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1941 committed 00000004:00080000:0.0:1746155555.508969:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1940 committed 00000004:00080000:0.0:1746155555.508970:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1992 committed 00000004:00080000:0.0:1746155555.508972:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1991 committed 00000004:00080000:0.0:1746155555.508973:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1939 committed 00000004:00080000:0.0:1746155555.508974:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1938 committed 00000004:00080000:0.0:1746155555.508976:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1990 committed 00000001:00080000:0.0:1746155555.508986:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943688 is committed 00000001:00080000:0.0:1746155555.508994:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943692 is committed 00000001:00080000:0.0:1746155555.508998:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943690 is committed 00000100:00100000:0.0:1746155555.509125:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124429568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155555.509175:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155555.509197:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124430080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155555.509210:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155555.509224:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746155555.509229:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124429696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155555.509242:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155555.509251:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124430208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155555.509261:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155555.509278:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124429568 00000100:00100000:0.0:1746155555.509284:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124429568 00000100:00100000:0.0:1746155555.509310:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124430080 00000100:00100000:0.0:1746155555.509312:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124430080 00000100:00100000:0.0:1746155555.509320:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124429696 00000100:00100000:0.0:1746155555.509321:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124429696 00000100:00100000:0.0:1746155555.509329:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124430208 00000100:00100000:0.0:1746155555.509331:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124430208 00000100:00100000:0.0:1746155555.509342:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11122 00000100:00100000:0.0:1746155555.509348:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976124429568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155555.509481:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155555.509483:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155555 -> 1746155555 00002000:00010000:0.0:1746155555.509485:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155555 -> 1746155555 00002000:00010000:0.0:1746155555.509487:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155555 -> 1746155555 00002000:00010000:0.0:1746155555.509488:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155555.509538:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3295:x1830976124429568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 189us (363us total) trans 21474840410 rc 0/0 00000100:00100000:0.0:1746155555.509543:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11122 00000100:00100000:0.0:1746155555.509560:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11123 00000100:00100000:0.0:1746155555.509564:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976124430080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155555.509636:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3295:x1830976124430080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (425us total) trans 21474840411 rc 0/0 00000100:00100000:0.0:1746155555.509641:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11123 00000100:00100000:0.0:1746155555.509651:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11124 00000100:00100000:0.0:1746155555.509654:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976124429696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155555.509733:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4603200 -> 4603200 00002000:00010000:0.0:1746155555.509736:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155555 -> 1746155555 00002000:00010000:0.0:1746155555.509737:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155554 -> 1746155554 00002000:00010000:0.0:1746155555.509739:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155555 -> 1746155555 00002000:00010000:0.0:1746155555.509741:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 4959 -> 4959 00000100:00100000:0.0:1746155555.509763:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3295:x1830976124429696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (519us total) trans 21474840412 rc 0/0 00000100:00100000:0.0:1746155555.509768:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11124 00000100:00100000:0.0:1746155555.509777:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11125 00000100:00100000:0.0:1746155555.509781:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976124430208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155555.511980:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976124430208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2197us (2716us total) trans 21474840418 rc 0/0 00000100:00100000:0.0:1746155555.511985:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11125 00000100:00100000:0.0:1746155555.514047:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123351936 00000100:00100000:0.0:1746155555.514051:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123351936 00000100:00100000:0.0:1746155555.514074:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3904 00000100:00100000:0.0:1746155555.514078:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+7:28653:x1830976123351936:12345-192.168.202.51@tcp:49:multiop.0 00000100:00100000:0.0:1746155555.514144:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+7:28653:x1830976123351936:12345-192.168.202.51@tcp:49:multiop.0 Request processed in 65us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.514150:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3904 00000100:00100000:0.0:1746155555.514535:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.515769:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.518072:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.518096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.518115:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.518132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.518524:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11145 00000100:00100000:0.0:1746155555.518530:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123353088:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155555.518536:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155555.518542:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5e925f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f72f expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.518550:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.518551:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.518555:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5e925f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f72f expref: 16 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155555.518563:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5e925f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f72f expref: 16 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155555.518570:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd50c00, rc 0) 00000100:00100000:0.0:1746155555.518581:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123353088:12345-192.168.202.51@tcp:101:cat.0 Request processed in 53us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.518585:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11145 00000100:00100000:0.0:1746155555.519179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.520740:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123353472 00000100:00100000:0.0:1746155555.520744:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123353472 00010000:00010000:0.0:1746155555.520758:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f13ea00/0x844e5faceb5e9243 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f70c expref: 15 pid: 18270 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746155555.521027:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123353728 00000100:00100000:0.0:1746155555.521030:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123353728 00010000:00010000:0.0:1746155555.521041:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5faa200/0x844e5faceb5e91b7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f6bf expref: 12 pid: 18270 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746155555.521058:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5512 00000100:00100000:0.0:1746155555.521063:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123353472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155555.521071:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155555.521080:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f13ea00/0x844e5faceb5e9243 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f70c expref: 15 pid: 18270 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.521088:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f13ea00/0x844e5faceb5e9243 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f70c expref: 15 pid: 18270 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.521100:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f13ea00/0x844e5faceb5e9243 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f70c expref: 15 pid: 18270 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.521109:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155555.521140:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123353472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 76us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.521145:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5512 00000100:00100000:0.0:1746155555.521157:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5513 00000100:00100000:0.0:1746155555.521161:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123353728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155555.521167:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155555.521173:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5faa200/0x844e5faceb5e91b7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f6bf expref: 12 pid: 18270 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.521180:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5faa200/0x844e5faceb5e91b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f6bf expref: 12 pid: 18270 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.521189:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.521190:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.521194:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c71800/0x844e5faceb5e923c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f713 expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.521200:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c71800/0x844e5faceb5e923c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f713 expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.521214:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c71800/0x844e5faceb5e923c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 626688->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f713 expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155555.521221:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124432256:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155555.521244:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155555.522882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.522917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.524927:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.532077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.532172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.532369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.534988:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.535007:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.535027:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.542640:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123355776 00000100:00100000:0.0:1746155555.542646:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123355776 00002000:00100000:0.0:1746155555.542677:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1310720->1314815) req@ffff880131497b80 x1830976123355776/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:626/0 lens 488/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.542695:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497b80 with x1830976123355776 ext(1310720->1314815) 00002000:00010000:0.0:1746155555.542700:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131497b80 00000100:00100000:0.0:1746155555.542879:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4100 00000100:00100000:0.0:1746155555.542886:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123355776:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155555.543065:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123355776:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 179us (510us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155555.543070:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4100 00002000:00100000:0.0:1746155555.543075:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1310720->1314815) req@ffff880131497b80 x1830976123355776/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:626/0 lens 488/4536 e 0 to 0 dl 1746155566 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.543082:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497b80 with x1830976123355776 ext(1310720->1314815) 00002000:00010000:0.0:1746155555.543085:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131497b80 00000100:00100000:0.0:1746155555.570739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.573179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.579367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.592850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.592903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.593620:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.593634:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123357568 00000100:00100000:0.0:1746155555.593637:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123357568 00002000:00100000:0.0:1746155555.593652:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009fb6b800 x1830976123357568/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:626/0 lens 504/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.593661:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b800 with x1830976123357568 ext(1048576->2097151) 00002000:00010000:0.0:1746155555.593665:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb6b800 00000100:00100000:0.0:1746155555.593675:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4104 00000100:00100000:0.0:1746155555.593679:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123357568:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155555.622572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.622601:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.622627:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.622653:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.623179:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123358464 00000100:00100000:0.0:1746155555.623183:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123358464 00002000:00100000:0.0:1746155555.623201:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009fb69500 x1830976123358464/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:626/0 lens 488/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.623210:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69500 with x1830976123358464 ext(3145728->4194303) 00002000:00010000:0.0:1746155555.623213:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb69500 00000100:00100000:0.0:1746155555.623226:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4106 00000100:00100000:0.0:1746155555.623232:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123358080:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155555.644272:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123358464:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19701us (21608us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155555.644281:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4108 00002000:00100000:0.0:1746155555.644291:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009fb69500 x1830976123358464/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:626/0 lens 488/440 e 0 to 0 dl 1746155566 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.644299:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69500 with x1830976123358464 ext(3145728->4194303) 00002000:00010000:0.0:1746155555.644304:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb69500 00000100:00100000:0.0:1746155555.673730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.673771:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.673801:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123359104 00000100:00100000:0.0:1746155555.673810:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123359104 00002000:00100000:0.0:1746155555.673847:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4603903) req@ffff88009fb68a80 x1830976123359104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:626/0 lens 488/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.673857:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68a80 with x1830976123359104 ext(4194304->4603903) 00002000:00010000:0.0:1746155555.673862:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb68a80 00000100:00100000:0.0:1746155555.677398:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4109 00000100:00100000:0.0:1746155555.677408:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976123359104:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155555.689602:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.717129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.717645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.719869:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.719888:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123360896 00000100:00100000:0.0:1746155555.719893:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123360896 00002000:00100000:0.0:1746155555.719919:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009fb68380 x1830976123360896/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:626/0 lens 488/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.719928:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68380 with x1830976123360896 ext(1048576->2097151) 00002000:00010000:0.0:1746155555.719933:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb68380 00000100:00100000:0.0:1746155555.719945:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123360768 00000100:00100000:0.0:1746155555.719947:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123360768 00002000:00100000:0.0:1746155555.719956:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009fb6aa00 x1830976123360768/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:626/0 lens 488/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.719962:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6aa00 with x1830976123360768 ext(1048576->2097151) 00002000:00010000:0.0:1746155555.719965:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6aa00 00000100:00100000:0.0:1746155555.719974:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4111 00000100:00100000:0.0:1746155555.719980:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123360896:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155555.757092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.763916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.779603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.790211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.795449:0:21354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124433792 00000100:00100000:0.0:1746155555.795455:0:21354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124433792 00000100:00100000:0.0:1746155555.795492:0:21354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124433664 00000100:00100000:0.0:1746155555.795494:0:21354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124433664 00000100:00100000:0.0:1746155555.795523:0:21354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1746155555.795529:0:21354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976124433792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746155555.795547:0:21354:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 345440256 pending 3407872 free 3850371072 avail 3823108096 00000100:00100000:0.0:1746155555.795581:0:21354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976124433792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.795586:0:21354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1746155555.795598:0:21354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1746155555.795603:0:21354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3296:x1830976124433664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746155555.795611:0:21354:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 354091008 pending 6815744 free 3847225344 avail 3819962368 00000100:00100000:0.0:1746155555.795627:0:21354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3296:x1830976124433664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 25us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155555.795631:0:21354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1746155555.809470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.810310:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.812752:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.816630:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5521 00000100:00100000:0.0:1746155555.816638:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123362432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155555.816649:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155555.816665:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5e925f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f72f expref: 16 pid: 9235 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.816675:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5e925f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f72f expref: 16 pid: 9235 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.816700:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5e925f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f72f expref: 16 pid: 9235 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746155555.816712:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.816713:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.816718:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1ddce00/0x844e5faceb5e92f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3575808->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f783 expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.816725:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1ddce00/0x844e5faceb5e92f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3575808->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f783 expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.816749:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1ddce00/0x844e5faceb5e92f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3575808->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f783 expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155555.816759:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976124434560:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155555.816833:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155555.820075:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.820112:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.820128:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123362816 00000100:00100000:0.0:1746155555.820133:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123362816 00002000:00100000:0.0:1746155555.820162:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (4063232->4067327) req@ffff880130c9d500 x1830976123362816/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:626/0 lens 488/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.820170:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9d500 with x1830976123362816 ext(4063232->4067327) 00002000:00010000:0.0:1746155555.820173:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9d500 00000100:00100000:0.0:1746155555.820184:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123362944 00000100:00100000:0.0:1746155555.820186:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123362944 00002000:00100000:0.0:1746155555.820195:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3575808->3579903) req@ffff880130c9f480 x1830976123362944/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:626/0 lens 488/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.820201:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9f480 with x1830976123362944 ext(3575808->3579903) 00002000:00010000:0.0:1746155555.820204:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9f480 00000100:00100000:0.0:1746155555.820213:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4114 00000100:00100000:0.0:1746155555.820219:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123362816:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155555.833830:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.833847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.848464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.850239:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123364736 00000100:00100000:0.0:1746155555.850243:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123364736 00010000:00010000:0.0:1746155555.850260:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bddba00/0x844e5faceb5e9300 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f78a expref: 24 pid: 20796 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746155555.850283:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5523 00000100:00100000:0.0:1746155555.850289:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123364736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155555.850296:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746155555.850309:0:7064:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155555 -> 1746155556 00002000:00010000:0.0:1746155555.850311:0:7064:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155555 -> 1746155556 00010000:00010000:0.0:1746155555.850316:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bddba00/0x844e5faceb5e9300 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f78a expref: 24 pid: 20796 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746155555.850324:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bddba00/0x844e5faceb5e9300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f78a expref: 24 pid: 20796 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746155555.850338:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bddba00/0x844e5faceb5e9300 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f78a expref: 24 pid: 20796 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746155555.850349:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.850351:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.850355:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bddb400/0x844e5faceb5e932a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7a6 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.850362:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bddb400/0x844e5faceb5e932a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7a6 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.850368:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.850369:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155555.850372:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801303bba00/0x844e5faceb5e9338 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7b4 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.850376:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801303bba00/0x844e5faceb5e9338 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7b4 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155555.850397:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801303bba00/0x844e5faceb5e9338 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7b4 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155555.850407:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124435072:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155555.850454:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bddb400/0x844e5faceb5e932a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7a6 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155555.850461:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124435200:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155555.850476:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155555.855307:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.855344:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.859840:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.861024:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.872278:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.872352:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.872937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.885942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.888978:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.889061:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.894325:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123367296 00000100:00100000:0.0:1746155555.894332:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123367296 00002000:00100000:0.0:1746155555.894364:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009f881500 x1830976123367296/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:626/0 lens 488/0 e 0 to 0 dl 1746155566 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.894372:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881500 with x1830976123367296 ext(3145728->4194303) 00002000:00010000:0.0:1746155555.894376:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f881500 00000100:00100000:0.0:1746155555.894837:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4122 00000100:00100000:0.0:1746155555.894842:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123367424:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155555.905848:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.907063:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123367424:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12219us (12805us total) trans 0 rc 892928/892928 00000100:00100000:0.0:1746155555.907069:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4122 00002000:00100000:0.0:1746155555.907073:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3301376->4194303) req@ffff88009f882300 x1830976123367424/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:626/0 lens 488/440 e 0 to 0 dl 1746155566 ref 1 fl Complete:/200/0 rc 892928/892928 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155555.907079:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882300 with x1830976123367424 ext(3301376->4194303) 00002000:00010000:0.0:1746155555.907083:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f882300 00000100:00100000:0.0:1746155555.910661:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.911169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.916560:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.921226:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.923666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.924495:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.927256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.934241:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.974013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.974056:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.985753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.994355:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.994624:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155555.998697:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.002537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.005065:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.007369:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.007401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.007420:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.007430:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.007440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.007462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155556.007689:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746155556.007693:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155556.018953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.018966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.019003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.019012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.019028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.019038:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.019050:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123372416 00000100:00100000:0.0:1746155556.019052:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123372416 00010000:00010000:0.0:1746155556.019076:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bddac00/0x844e5faceb5e931c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f798 expref: 19 pid: 10591 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746155556.019091:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123372672 00000100:00100000:0.0:1746155556.019093:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123372672 00010000:00010000:0.0:1746155556.019102:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009374da00/0x844e5faceb5e9346 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7c2 expref: 25 pid: 4461 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746155556.019113:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123373184 00000100:00100000:0.0:1746155556.019114:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123373184 00010000:00010000:0.0:1746155556.019121:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090012800/0x844e5faceb5e938c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7f3 expref: 13 pid: 4461 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746155556.019133:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5532 00000100:00100000:0.0:1746155556.019139:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123372416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155556.019149:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155556.019167:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bddac00/0x844e5faceb5e931c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f798 expref: 19 pid: 10591 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746155556.019181:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bddac00/0x844e5faceb5e931c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f798 expref: 19 pid: 10591 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746155556.019725:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bddac00/0x844e5faceb5e931c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f798 expref: 19 pid: 10591 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746155556.019736:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155556.019749:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976123372416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 611us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.019754:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5532 00000100:00080000:0.0:1746155556.019766:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746155556.019769:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155556.019792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.019802:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123372800 00000100:00100000:0.0:1746155556.019804:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123372800 00010000:00010000:0.0:1746155556.019812:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801303bba00/0x844e5faceb5e9338 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7b4 expref: 12 pid: 10591 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746155556.019826:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5538 00000100:00100000:0.0:1746155556.019830:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123372800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155556.019835:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155556.019841:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801303bba00/0x844e5faceb5e9338 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7b4 expref: 12 pid: 10591 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.019849:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801303bba00/0x844e5faceb5e9338 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7b4 expref: 12 pid: 10591 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.019863:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303bba00/0x844e5faceb5e9338 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7b4 expref: 12 pid: 10591 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.019871:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155556.019881:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123372800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.019885:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5538 00000100:00100000:0.0:1746155556.019913:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.019920:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123373056 00000100:00100000:0.0:1746155556.019922:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123373056 00010000:00010000:0.0:1746155556.019929:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1fff200/0x844e5faceb5e935b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7d7 expref: 23 pid: 4461 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746155556.019940:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5539 00000100:00100000:0.0:1746155556.019944:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123373056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155556.019949:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155556.019954:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1fff200/0x844e5faceb5e935b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7d7 expref: 23 pid: 4461 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.019961:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1fff200/0x844e5faceb5e935b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7d7 expref: 23 pid: 4461 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.019970:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1fff200/0x844e5faceb5e935b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7d7 expref: 23 pid: 4461 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.019981:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.019983:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.019987:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013135da00/0x844e5faceb5e93fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.019994:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013135da00/0x844e5faceb5e93fc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.020013:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155556.020025:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123373056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.020038:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5539 00000100:00100000:0.0:1746155556.020068:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.025557:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.025933:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123374592 00000100:00100000:0.0:1746155556.025937:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123374592 00010000:00010000:0.0:1746155556.025950:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0800/0x844e5faceb5e927b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f74b expref: 22 pid: 4461 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746155556.025979:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123374464 00000100:00100000:0.0:1746155556.025981:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123374464 00010000:00010000:0.0:1746155556.025990:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090013200/0x844e5faceb5e9393 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f7fa expref: 7 pid: 4461 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746155556.026002:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5548 00000100:00100000:0.0:1746155556.026007:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123374592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155556.026016:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155556.026023:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0800/0x844e5faceb5e927b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f74b expref: 22 pid: 4461 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.026030:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0800/0x844e5faceb5e927b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f74b expref: 22 pid: 4461 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.026042:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0800/0x844e5faceb5e927b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f74b expref: 22 pid: 4461 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.026241:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155556.026319:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123374592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 310us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.026325:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5548 00000100:00100000:0.0:1746155556.027837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.030423:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.032434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.032459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.032732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155556.032754:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155556.033837:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.115380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.124796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.126447:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123376512 00000100:00100000:0.0:1746155556.126451:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123376512 00000100:00100000:0.0:1746155556.126479:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11198 00000100:00100000:0.0:1746155556.126484:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1961:x1830976123376512:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155556.126493:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.126532:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e943b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f847 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155556.126549:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3da:0x0] initial LVB size: 2097152, mtime: 0x68143824, atime: 0x68143822, ctime: 0x68143824, blocks: 0x821 00010000:00010000:0.0:1746155556.126559:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.126560:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.126564:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e943b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f847 expref: 6 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.126575:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e943b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f847 expref: 6 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.126582:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009475b400, rc 0) 00000100:00100000:0.0:1746155556.126602:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976123376512:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 118us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.126607:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11198 00000100:00100000:0.0:1746155556.146246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.146281:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.146311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.146334:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123377536 00000100:00100000:0.0:1746155556.146341:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123377536 00000100:00100000:0.0:1746155556.146394:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123377792 00000100:00100000:0.0:1746155556.146396:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123377792 00000100:00100000:0.0:1746155556.146409:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123377408 00000100:00100000:0.0:1746155556.146411:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123377408 00000100:00100000:0.0:1746155556.146424:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4127 00000100:00100000:0.0:1746155556.146431:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123377536:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155556.146461:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009475a000/0x844e5faceb5e945e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.146473:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.146475:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.146479:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009475a000/0x844e5faceb5e945e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.146490:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009475a000/0x844e5faceb5e945e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155556.152926:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4134 00000100:00100000:0.0:1746155556.152934:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123377664:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155556.152952:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009475bc00/0x844e5faceb5e948f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.152959:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.152960:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.152964:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009475bc00/0x844e5faceb5e948f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.152971:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009475bc00/0x844e5faceb5e948f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155556.204765:0:14232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123378816 00000100:00100000:0.0:1746155556.204773:0:14232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123378816 00000100:00100000:0.0:1746155556.204816:0:14232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9815 00000100:00100000:0.0:1746155556.204823:0:14232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:28679:x1830976123378816:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:0.0:1746155556.204866:0:14232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155556.204887:0:14232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009355d200/0x844e5faceb5e942d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f839 expref: 9 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.204915:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155556.204919:0:14232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155556.204948:0:14232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5e9496 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.204958:0:14232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5e9496 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.204965:0:14232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5e9496 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00000004:00010000:0.0:1746155556.205112:0:14232:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a6da300 reply state ffff8800a090f000 transno 8589943709 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5e9496 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00000100:00100000:0.0:1746155556.205119:0:14232:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746155556.205186:0:14232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:28679:x1830976123378816:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 362us (707us total) trans 8589943709 rc 0/0 00000100:00100000:0.0:1746155556.205191:0:14232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9815 00000100:00100000:0.0:1746155556.210879:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.210906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.210916:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.210939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.210952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.210979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.220288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000001:00080000:0.0:1746155556.251532:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943709 is committed 00000001:00080000:0.0:1746155556.251544:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943710 is committed 00000004:00080000:0.0:1746155556.251550:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1961 committed 00000004:00080000:0.0:1746155556.251561:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2016 committed 00000004:00080000:0.0:1746155556.253916:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2015 committed 00000004:00080000:0.0:1746155556.253918:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2014 committed 00000004:00080000:0.0:1746155556.253919:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2013 committed 00000004:00080000:0.0:1746155556.253921:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1960 committed 00000004:00080000:0.0:1746155556.253922:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2012 committed 00000004:00080000:0.0:1746155556.253924:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1959 committed 00000004:00080000:0.0:1746155556.253925:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2011 committed 00000004:00080000:0.0:1746155556.253926:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1958 committed 00000004:00080000:0.0:1746155556.253927:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1957 committed 00000004:00080000:0.0:1746155556.253928:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1956 committed 00000004:00080000:0.0:1746155556.253929:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2010 committed 00000004:00080000:0.0:1746155556.253930:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2009 committed 00000004:00080000:0.0:1746155556.253932:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1955 committed 00000004:00080000:0.0:1746155556.253933:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1954 committed 00000004:00080000:0.0:1746155556.253935:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2008 committed 00000100:00100000:0.0:1746155556.253950:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124442880 00000100:00100000:0.0:1746155556.253953:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124442880 00000100:00100000:0.0:1746155556.253967:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11214 00000100:00100000:0.0:1746155556.253971:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3295:x1830976124442880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155556.254546:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3295:x1830976124442880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 574us (602us total) trans 17179873064 rc 0/0 00000100:00100000:0.0:1746155556.254550:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11214 00000100:00100000:0.0:1746155556.259344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.261160:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11225 00000100:00100000:0.0:1746155556.261193:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3298:x1830976124444288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155556.275912:0:14232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123380608 00000100:00100000:0.0:1746155556.275922:0:14232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123380608 00000100:00100000:0.0:1746155556.275961:0:14232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9817 00000100:00100000:0.0:1746155556.275971:0:14232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+6:28690:x1830976123380608:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155556.275998:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.276017:0:14232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50000/0x844e5faceb5e94ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f871 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.276111:0:14232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81b000/0x844e5faceb5e94b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276121:0:14232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81b000/0x844e5faceb5e94b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276132:0:14232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81b000/0x844e5faceb5e94b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276146:0:14232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5e94b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276151:0:14232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5e94b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276156:0:14232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5e94b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276295:0:14232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb37c00/0x844e5faceb5e94c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276302:0:14232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb37c00/0x844e5faceb5e94c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276308:0:14232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb37c00/0x844e5faceb5e94c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00000004:00200000:0.0:1746155556.276360:0:14232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00010000:00010000:0.0:1746155556.276436:0:14232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81b000/0x844e5faceb5e94b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276444:0:14232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81b000/0x844e5faceb5e94b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276450:0:14232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81b000/0x844e5faceb5e94b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276457:0:14232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b81b000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155556.276460:0:14232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81b000/0x844e5faceb5e94b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276466:0:14232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81b000/0x844e5faceb5e94b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276474:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155556.276477:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155556.276480:0:14232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81b000/0x844e5faceb5e94b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.276487:0:14232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81b000/0x844e5faceb5e94b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.278447:0:14232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5e94b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.278458:0:14232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5e94b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.278463:0:14232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5e94b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.278472:0:14232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c287000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155556.278475:0:14232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5e94b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.278480:0:14232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5e94b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.278490:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d55aa00) 00010000:00010000:0.0:1746155556.278492:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155556.278495:0:14232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5e94b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.278499:0:14232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5e94b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14232 initiator: MDT0 00000100:00100000:0.0:1746155556.279241:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.281164:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.282736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.286408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.286772:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123381632 00000100:00100000:0.0:1746155556.286779:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123381632 00010000:00010000:0.0:1746155556.286808:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009475aa00/0x844e5faceb5e94e3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f878 expref: 287 pid: 14232 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746155556.286833:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123381760 00000100:00100000:0.0:1746155556.286837:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123381760 00010000:00010000:0.0:1746155556.286850:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb37c00/0x844e5faceb5e94c0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f871 expref: 10 pid: 14232 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746155556.286870:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5556 00000100:00100000:0.0:1746155556.286881:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1963:x1830976123381632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155556.286894:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155556.286899:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009475aa00/0x844e5faceb5e94e3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f878 expref: 287 pid: 14232 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.286909:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009475aa00/0x844e5faceb5e94e3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f878 expref: 287 pid: 14232 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.286926:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155556.286930:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009475b600/0x844e5faceb5e94f8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.286941:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009475b600/0x844e5faceb5e94f8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.286945:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155556.286980:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1963:x1830976123381632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 98us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.286986:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5556 00000100:00100000:0.0:1746155556.286998:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5557 00000100:00100000:0.0:1746155556.287003:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123381760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155556.287008:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155556.287011:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb37c00/0x844e5faceb5e94c0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f871 expref: 10 pid: 14232 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.287019:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb37c00/0x844e5faceb5e94c0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f871 expref: 10 pid: 14232 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.287031:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155556.287034:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009475b600/0x844e5faceb5e94f8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.287040:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009475b600/0x844e5faceb5e94f8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.287046:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009475b600/0x844e5faceb5e94f8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.287058:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155556.287070:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123381760:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 67us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.287075:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5557 00000100:00100000:0.0:1746155556.316081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.316148:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124444672:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155556.317204:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009475bc00/0x844e5faceb5e9530 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155556.318194:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155556.319891:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009475bc00/0x844e5faceb5e9530 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155556.319899:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009475bc00/0x844e5faceb5e9530 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155556.319938:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00000004:00200000:0.0:1746155556.319944:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155556.319960:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009475bc00/0x844e5faceb5e9530 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155556.319997:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009475a000/0x844e5faceb5e9529 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f89b expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.320020:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009475bc00/0x844e5faceb5e9530 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f89b expref: 289 pid: 27374 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.320027:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009475bc00/0x844e5faceb5e9530 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f89b expref: 289 pid: 27374 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.320032:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009475bc00, rc 0) 00000100:00100000:0.0:1746155556.320069:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:28693:x1830976123382272:12345-192.168.202.51@tcp:101:cat.0 Request processed in 22295us (22402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.320076:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9822 00000100:00100000:0.0:1746155556.329375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.329984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.330001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.330019:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123382784 00000100:00100000:0.0:1746155556.330026:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123382784 00010000:00010000:0.0:1746155556.330053:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009355de00/0x844e5faceb5e950d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f88d expref: 289 pid: 15474 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746155556.330073:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123382912 00000100:00100000:0.0:1746155556.330074:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123382912 00010000:00010000:0.0:1746155556.330087:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c286a00/0x844e5faceb5e94a4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f86a expref: 8 pid: 15474 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746155556.330110:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123383040 00000100:00100000:0.0:1746155556.330112:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123383040 00010000:00010000:0.0:1746155556.330121:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009475bc00/0x844e5faceb5e9530 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f89b expref: 290 pid: 27374 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746155556.330133:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5559 00000100:00100000:0.0:1746155556.330139:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1960:x1830976123382784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155556.330150:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155556.330155:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009355de00/0x844e5faceb5e950d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f88d expref: 290 pid: 15474 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.330164:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009355de00/0x844e5faceb5e950d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f88d expref: 290 pid: 15474 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.330182:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009355de00/0x844e5faceb5e950d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f88d expref: 290 pid: 15474 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.330491:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155556.330496:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009475ae00/0x844e5faceb5e953e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.330519:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009475ae00/0x844e5faceb5e953e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.330524:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155556.330561:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1960:x1830976123382784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 421us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.330567:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5559 00000100:00100000:0.0:1746155556.330957:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.331045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.331067:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123383168 00000100:00100000:0.0:1746155556.331070:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123383168 00000100:00100000:0.0:1746155556.331089:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9824 00000100:00100000:0.0:1746155556.331094:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:28693:x1830976123383168:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155556.331106:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.331115:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8a00/0x844e5faceb5e9545 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f8a9 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.331150:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009475ae00/0x844e5faceb5e953e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.331156:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8a00/0x844e5faceb5e9545 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8a9 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.331167:0:27374:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009475ae00/0x844e5faceb5e953e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155556.331175:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8a00/0x844e5faceb5e9545 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8a9 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.331184:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155556.331186:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155556.331193:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8a00/0x844e5faceb5e9545 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8a9 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.331199:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8a00, rc 0) 00000100:00100000:0.0:1746155556.331215:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:28693:x1830976123383168:12345-192.168.202.51@tcp:101:cat.0 Request processed in 120us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.331220:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9824 00000100:00100000:0.0:1746155556.334627:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123383424 00000100:00100000:0.0:1746155556.334636:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123383424 00000100:00100000:0.0:1746155556.334687:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9825 00000100:00100000:0.0:1746155556.334695:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+11:28690:x1830976123383424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155556.334710:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.334724:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8c00/0x844e5faceb5e9553 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f8b7 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.334768:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8c00/0x844e5faceb5e9553 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8b7 expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.334777:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8c00/0x844e5faceb5e9553 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8b7 expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.334787:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155556.334789:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155556.334793:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8a00/0x844e5faceb5e9545 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8a9 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.334798:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8c00, rc 0) 00000100:00100000:0.0:1746155556.334835:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+12:28690:x1830976123383424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 141us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.334841:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9825 00000001:00080000:0.0:1746155556.360268:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943712 is committed 00000001:00080000:0.0:1746155556.360277:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943715 is committed 00000001:00080000:0.0:1746155556.360281:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943713 is committed 00000001:00080000:0.0:1746155556.360285:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943714 is committed 00000001:00080000:0.0:1746155556.360290:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943716 is committed 00000004:00080000:0.0:1746155556.360293:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1969 committed 00000004:00080000:0.0:1746155556.360298:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2025 committed 00000004:00080000:0.0:1746155556.360303:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2024 committed 00000004:00080000:0.0:1746155556.360305:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2023 committed 00000004:00080000:0.0:1746155556.360306:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2022 committed 00000004:00080000:0.0:1746155556.360308:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1968 committed 00000004:00080000:0.0:1746155556.360309:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2021 committed 00000004:00080000:0.0:1746155556.360311:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1967 committed 00000004:00080000:0.0:1746155556.360312:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2020 committed 00000004:00080000:0.0:1746155556.360314:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1966 committed 00000004:00080000:0.0:1746155556.360316:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1965 committed 00000004:00080000:0.0:1746155556.360317:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1964 committed 00000004:00080000:0.0:1746155556.360318:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2019 committed 00000004:00080000:0.0:1746155556.360320:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2018 committed 00000004:00080000:0.0:1746155556.360321:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1963 committed 00000004:00080000:0.0:1746155556.360323:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1962 committed 00000004:00080000:0.0:1746155556.360324:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2017 committed 00000001:00080000:0.0:1746155556.360328:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943711 is committed 00000100:00100000:0.0:1746155556.361327:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124445824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155556.364398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.364461:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.364513:0:14232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14232:1830976124445056:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155556.364523:0:14232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14232:1830976124445568:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155556.364555:0:14232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009475aa00/0x844e5faceb5e9537 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8a2 expref: 9 pid: 14232 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746155556.364572:0:14232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009475ae00/0x844e5faceb5e953e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8a2 expref: 8 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.364594:0:14232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009475ae00, rc 0) 00000100:00100000:0.0:1746155556.364623:0:14232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+8:28689:x1830976123382528:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 47771us (48551us total) trans 8589943716 rc 0/0 00000100:00100000:0.0:1746155556.364629:0:14232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9823 00000100:00100000:0.0:1746155556.367864:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155556.367882:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124446336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155556.367899:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155556.367907:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124446848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155556.367918:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155556.367940:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124447360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155556.367952:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155556.367977:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124445824 00000100:00100000:0.0:1746155556.367981:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124445824 00000100:00100000:0.0:1746155556.367994:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124446336 00000100:00100000:0.0:1746155556.367996:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124446336 00000100:00100000:0.0:1746155556.368005:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124446848 00000100:00100000:0.0:1746155556.368007:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124446848 00000100:00100000:0.0:1746155556.368014:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124447360 00000100:00100000:0.0:1746155556.368016:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124447360 00000100:00100000:0.0:1746155556.368024:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11241 00000100:00100000:0.0:1746155556.368029:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3295:x1830976124445824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155556.368125:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3295:x1830976124445824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (261us total) trans 17179873072 rc 0/0 00000100:00100000:0.0:1746155556.368130:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11241 00000100:00100000:0.0:1746155556.368140:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11242 00000100:00100000:0.0:1746155556.368144:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3295:x1830976124446336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155556.368211:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155556.368214:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155556 -> 1746155556 00002000:00010000:0.0:1746155556.368217:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155556 -> 1746155556 00002000:00010000:0.0:1746155556.368219:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155556 -> 1746155556 00002000:00010000:0.0:1746155556.368221:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:0.0:1746155556.368238:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3295:x1830976124446336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (337us total) trans 21474840450 rc 0/0 00000100:00100000:0.0:1746155556.368243:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11242 00000100:00100000:0.0:1746155556.368251:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11243 00000100:00100000:0.0:1746155556.368256:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3295:x1830976124446848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155556.368321:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3295:x1830976124446848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (401us total) trans 21474840451 rc 0/0 00000100:00100000:0.0:1746155556.368326:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11243 00000100:00100000:0.0:1746155556.368335:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11244 00000100:00100000:0.0:1746155556.368339:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3295:x1830976124447360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155556.368406:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3295:x1830976124447360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (452us total) trans 21474840452 rc 0/0 00000100:00100000:0.0:1746155556.368410:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11244 00000004:00080000:0.0:1746155556.368433:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136632a00/2, rc 0, transno 21474840452 00000100:00100000:0.0:1746155556.368437:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124447360:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155556.368444:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366df80/2, rc 0, transno 17179873072 00000100:00100000:0.0:1746155556.368446:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124445824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155556.368452:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136630e00/2, rc 0, transno 21474840450 00000100:00100000:0.0:1746155556.368454:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124446336:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155556.368459:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136631880/2, rc 0, transno 21474840451 00000100:00100000:0.0:1746155556.368462:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124446848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155556.370128:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.373596:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.378396:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.382574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.394737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.406334:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.406371:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.406411:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.411918:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.412075:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.419018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.422301:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.433274:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.442575:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.446047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.451868:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123386880 00000100:00100000:0.0:1746155556.451872:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123386880 00000100:00100000:0.0:1746155556.451905:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11250 00000100:00100000:0.0:1746155556.451912:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123386880:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155556.451927:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.451941:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5e957d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f8e8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.451960:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.451961:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.451970:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5e957d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8e8 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.451987:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5e957d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8e8 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.451996:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe3a00, rc 0) 00000100:00100000:0.0:1746155556.452030:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123386880:12345-192.168.202.51@tcp:101:cat.0 Request processed in 119us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.452036:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11250 00000100:00100000:0.0:1746155556.458409:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.464640:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.470792:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.476887:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123388544 00000100:00100000:0.0:1746155556.476895:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123388544 00000100:00100000:0.0:1746155556.476932:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11253 00000100:00100000:0.0:1746155556.476939:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:28688:x1830976123388544:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155556.476953:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.476968:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cc1d400/0x844e5faceb5e9592 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f8f6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.476994:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a27de00/0x844e5faceb5e9434 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f840 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.477002:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009475b200/0x844e5faceb5e955a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8be expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.477008:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cb5e00/0x844e5faceb5e94ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f886 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.477014:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.477016:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.477019:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cc1d400/0x844e5faceb5e9592 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [651264->1048575] (req 651264->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8f6 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.477040:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130cb5e00/0x844e5faceb5e94ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f886 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.477049:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130cb5e00/0x844e5faceb5e94ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f886 expref: 15 pid: 8436 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746155556.477058:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124448128:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155556.478811:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009475b200/0x844e5faceb5e955a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8be expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.478824:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009475b200/0x844e5faceb5e955a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8be expref: 18 pid: 8436 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746155556.478838:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124448256:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155556.479576:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a27de00/0x844e5faceb5e9434 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f840 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.479585:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a27de00/0x844e5faceb5e9434 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f840 expref: 11 pid: 8437 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746155556.479597:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124448384:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155556.479619:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155556.485040:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.485102:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.485148:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.485192:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.485297:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5564 00000100:00100000:0.0:1746155556.485309:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123388672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155556.485321:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155556.485340:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130cb5e00/0x844e5faceb5e94ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f886 expref: 16 pid: 8436 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.485350:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130cb5e00/0x844e5faceb5e94ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f886 expref: 16 pid: 8436 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.485370:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cb5e00/0x844e5faceb5e94ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f886 expref: 16 pid: 8436 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.485386:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155556.485417:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123388672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 114us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.485424:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5564 00000100:00100000:0.0:1746155556.485473:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123388800 00000100:00100000:0.0:1746155556.485476:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123388800 00000100:00100000:0.0:1746155556.485494:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11254 00000100:00100000:0.0:1746155556.485499:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:28693:x1830976123388800:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155556.485537:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.485547:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5e9599 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f8fd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.485602:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.485604:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.485610:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5e9599 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8fd expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.485621:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5e9599 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8fd expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.485627:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e123400, rc 0) 00000100:00100000:0.0:1746155556.485644:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:28693:x1830976123388800:12345-192.168.202.51@tcp:101:cat.0 Request processed in 144us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.485649:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11254 00000100:00100000:0.0:1746155556.491191:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.494264:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.495588:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.496306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.501099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.506174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.506234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.507039:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.507485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.510750:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.512620:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11259 00000100:00100000:0.0:1746155556.512628:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123390848:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155556.512636:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.512644:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5e95bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f920 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.512657:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.512659:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.512665:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5e95bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f920 expref: 19 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.512688:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5e95bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f920 expref: 19 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.512697:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136ab2800, rc 0) 00000100:00100000:0.0:1746155556.512721:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123390848:12345-192.168.202.51@tcp:101:cat.0 Request processed in 94us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.512726:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11259 00000100:00100000:0.0:1746155556.512736:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11260 00000100:00100000:0.0:1746155556.512741:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123390976:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155556.512746:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.512753:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5e95c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f927 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.512762:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.512763:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.512767:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5e95c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f927 expref: 26 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.512777:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5e95c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f927 expref: 26 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.512783:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136ab3600, rc 0) 00000100:00100000:0.0:1746155556.512797:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123390976:12345-192.168.202.51@tcp:101:cat.0 Request processed in 56us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.512802:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11260 00000100:00100000:0.0:1746155556.519492:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.519541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.519573:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.521241:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11262 00000100:00100000:0.0:1746155556.521249:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123391104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155556.521255:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.521268:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136ab2000/0x844e5faceb5e95d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f92e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155556.521290:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124449536:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155556.521312:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155556.530983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.531689:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.531761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.531776:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.531798:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.532433:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4154 00000100:00100000:0.0:1746155556.532440:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123392512:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155556.539737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.539777:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.543553:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.558313:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.559147:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123393536 00000100:00100000:0.0:1746155556.559155:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123393536 00000100:00100000:0.0:1746155556.559202:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3918 00000100:00100000:0.0:1746155556.559209:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:28690:x1830976123393536:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155556.559365:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:28690:x1830976123393536:12345-192.168.202.51@tcp:35:cat.0 Request processed in 156us (1061us total) trans 8589943720 rc 0/0 00000100:00100000:0.0:1746155556.559371:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3918 00000100:00100000:0.0:1746155556.569930:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.580582:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123393792:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10503us (10651us total) trans 0 rc 651264/651264 00000100:00100000:0.0:1746155556.580592:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4156 00002000:00100000:0.0:1746155556.580602:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4845567) req@ffff88009b883800 x1830976123393792/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:627/0 lens 488/440 e 0 to 0 dl 1746155567 ref 1 fl Complete:/200/0 rc 651264/651264 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155556.580609:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883800 with x1830976123393792 ext(4194304->4845567) 00002000:00010000:0.0:1746155556.580614:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b883800 00000100:00100000:0.0:1746155556.584757:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.620787:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.626272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.626304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.626372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.626390:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123394432 00000100:00100000:0.0:1746155556.626393:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123394432 00010000:00010000:0.0:1746155556.626408:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5e95c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f927 expref: 24 pid: 18270 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746155556.626426:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123394560 00000100:00100000:0.0:1746155556.626428:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123394560 00010000:00010000:0.0:1746155556.626435:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f9aa00/0x844e5faceb5e9457 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f863 expref: 9 pid: 8437 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746155556.626448:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5570 00000100:00100000:0.0:1746155556.626453:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123394432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155556.626463:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155556.626480:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5e95c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f927 expref: 24 pid: 18270 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746155556.626488:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5e95c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f927 expref: 24 pid: 18270 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746155556.626533:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155556.626567:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123394432:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 113us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.626573:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5570 00000100:00100000:0.0:1746155556.626587:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5572 00000100:00100000:0.0:1746155556.626592:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123394304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155556.626598:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155556.626606:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5e9584 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8ef expref: 15 pid: 19959 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746155556.626616:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5e9584 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8ef expref: 15 pid: 19959 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746155556.627195:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5e9584 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8ef expref: 15 pid: 19959 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746155556.627208:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.627210:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.627214:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e79400/0x844e5faceb5e9609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f951 expref: 14 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.627221:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e79400/0x844e5faceb5e9609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f951 expref: 14 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.627252:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130e79400/0x844e5faceb5e9609 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f951 expref: 14 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155556.627262:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124450304:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155556.627314:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155556.630890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.641546:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.642538:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.642597:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.656121:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.658720:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.659377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.682309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.690373:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.690408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.690435:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.690456:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.690536:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.690568:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123396352 00000100:00100000:0.0:1746155556.690575:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123396352 00000100:00100000:0.0:1746155556.690607:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123396608 00000100:00100000:0.0:1746155556.690609:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123396608 00000100:00100000:0.0:1746155556.690625:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123396864 00000100:00100000:0.0:1746155556.690627:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123396864 00000100:00100000:0.0:1746155556.690635:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123396480 00000100:00100000:0.0:1746155556.690636:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123396480 00000100:00100000:0.0:1746155556.690644:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123396736 00000100:00100000:0.0:1746155556.690646:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123396736 00000100:00100000:0.0:1746155556.690658:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11267 00000100:00100000:0.0:1746155556.690664:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123396352:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155556.690688:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.690702:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5e9656 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f96d expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155556.690744:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124450944:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155556.690807:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155556.690822:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11268 00000100:00100000:0.0:1746155556.690826:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123396608:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155556.690833:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.690840:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5e965d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f97b expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.690850:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.690852:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155556.690858:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5e965d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f97b expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.690869:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5e965d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f97b expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.690877:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bb000, rc 0) 00000100:00100000:0.0:1746155556.690894:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123396608:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 67us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.690899:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11268 00000100:00100000:0.0:1746155556.690910:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11269 00000100:00100000:0.0:1746155556.690914:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123396864:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155556.690918:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.690922:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903bba00/0x844e5faceb5e9664 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f989 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155556.690937:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124451072:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155556.690951:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155556.690961:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11270 00000100:00100000:0.0:1746155556.690965:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123396480:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155556.690969:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.690973:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903ba400/0x844e5faceb5e966b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f974 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155556.690988:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124451200:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155556.690999:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155556.691008:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11271 00000100:00100000:0.0:1746155556.691012:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123396736:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155556.691016:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.691026:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cb37c00/0x844e5faceb5e9672 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f982 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155556.691043:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124451328:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155556.691055:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155556.692721:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124451200:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155556.692742:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903ba400/0x844e5faceb5e966b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f974 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.692751:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903ba400/0x844e5faceb5e966b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f974 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.692762:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903ba400, rc 0) 00000100:00100000:0.0:1746155556.692785:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123396480:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 1818us (2327us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155556.692790:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11270 00002000:00010000:0.0:1746155556.696194:0:4461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime: 1746155556 -> 1746155557 00002000:00010000:0.0:1746155556.696201:0:4461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155556 -> 1746155557 00002000:00010000:0.0:1746155556.696203:0:4461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime: 1746155556 -> 1746155557 00000100:00100000:0.0:1746155556.696220:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124451328:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155556.696245:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cb37c00/0x844e5faceb5e9672 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f982 expref: 11 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.696256:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cb37c00/0x844e5faceb5e9672 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f982 expref: 11 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.696265:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb37c00, rc 0) 00000100:00100000:0.0:1746155556.696562:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123396736:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 5547us (6023us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155556.696568:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11271 00000100:00100000:0.0:1746155556.699715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.703605:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.703940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.703981:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.704365:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5578 00000100:00100000:0.0:1746155556.704463:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1960:x1830976123397376:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155556.704471:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155556.704474:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bdfb000/0x844e5faceb5e962c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f95f expref: 290 pid: 14232 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.704482:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bdfb000/0x844e5faceb5e962c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f95f expref: 290 pid: 14232 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.704493:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bdfb000/0x844e5faceb5e962c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f95f expref: 290 pid: 14232 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746155556.704530:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155556.704532:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5e9680 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155556.704538:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5e9680 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155556.704543:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5e9680 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155556.704557:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155556.704573:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1960:x1830976123397376:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 202us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.704578:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5578 00000100:00100000:0.0:1746155556.711655:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.719003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.744163:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.746569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.750716:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.754720:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830976124452480:0@lo:400:kworker.0 00000100:00100000:0.0:1746155556.754754:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155556.754801:0:14232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124452480 00000100:00100000:0.0:1746155556.754804:0:14232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124452480 00000100:00100000:0.0:1746155556.754827:0:14232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124452224 00000100:00100000:0.0:1746155556.754828:0:14232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124452224 00000100:00100000:0.0:1746155556.754844:0:14232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1746155556.754847:0:14232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830976124452224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746155556.754869:0:14232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830976124452224:12345-0@lo:400:kworker.0 Request processed in 22us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.754873:0:14232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1746155556.754892:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830976124452480:0@lo:400:kworker.0 00000100:00100000:0.0:1746155556.754961:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3296:1830976124452096:0@lo:400:kworker.0 00000100:00100000:0.0:1746155556.759282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.762766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.787055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.793720:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.796991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.798748:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123400064 00000100:00100000:0.0:1746155556.798752:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123400064 00000100:00100000:0.0:1746155556.798777:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11275 00000100:00100000:0.0:1746155556.798782:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123400064:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155556.798790:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.798797:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5fab200/0x844e5faceb5e96e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f9c1 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155556.798823:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124452992:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155556.798864:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155556.799579:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124452736:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155556.799595:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009355da00/0x844e5faceb5e96d4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155556.800563:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009355da00/0x844e5faceb5e96d4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155556.800570:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009355da00/0x844e5faceb5e96d4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155556.800586:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00010000:00010000:0.0:1746155556.800704:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009355d200/0x844e5faceb5e96cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9b3 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.800721:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009355da00/0x844e5faceb5e96d4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9b3 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.800726:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155556.800729:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155556.800730:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009355da00, rc 0) 00000100:00100000:0.0:1746155556.800752:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28709:x1830976123399808:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6167us (7039us total) trans 8589943728 rc 0/0 00000100:00100000:0.0:1746155556.800757:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9832 00000100:00100000:0.0:1746155556.804014:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124452864:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155556.804037:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009475b800/0x844e5faceb5e96db lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9ba expref: 17 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.804049:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009475b800/0x844e5faceb5e96db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9ba expref: 17 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.804056:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009475b800, rc 0) 00000100:00100000:0.0:1746155556.804087:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123399936:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6970us (7101us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155556.804093:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11274 00000100:00100000:0.0:1746155556.804181:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124452992:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155556.804200:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5fab200/0x844e5faceb5e96e2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9c1 expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.804208:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5fab200/0x844e5faceb5e96e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9c1 expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.804213:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fab200, rc 0) 00000100:00100000:0.0:1746155556.804227:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123400064:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5445us (6056us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155556.804231:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11275 00000100:00100000:0.0:1746155556.807795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.816399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155556.817066:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155556.817068:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155556.817070:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009475b200, rc 0) 00000100:00100000:1.0:1746155556.817104:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:28713:x1830976123400576:12345-192.168.202.51@tcp:101:cat.0 Request processed in 511us (713us total) trans 8589943729 rc 0/0 00000100:00100000:1.0:1746155556.817110:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9833 00000100:00100000:0.0:1746155556.818341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.822566:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123400832 00000100:00100000:0.0:1746155556.822574:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123400832 00000100:00100000:0.0:1746155556.822606:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123400960 00000100:00100000:0.0:1746155556.822608:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123400960 00000100:00100000:0.0:1746155556.822634:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11277 00000100:00100000:0.0:1746155556.822641:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123400832:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155556.822656:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.822669:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5faa200/0x844e5faceb5e971a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f9d6 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155556.822720:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124453248:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155556.822778:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155556.824741:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124453248:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155556.824755:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5faa200/0x844e5faceb5e971a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9d6 expref: 22 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155556.824762:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5faa200/0x844e5faceb5e971a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9d6 expref: 22 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155556.824776:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5faa200, rc 0) 00000100:00100000:1.0:1746155556.824972:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123400832:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2330us (3665us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155556.824978:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11277 00000100:00100000:0.0:1746155556.826897:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.829853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.836786:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.836832:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.836885:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123401472 00000100:00100000:1.0:1746155556.836891:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123401472 00002000:00100000:1.0:1746155556.836927:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012f1f0000 x1830976123401472/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:627/0 lens 488/0 e 0 to 0 dl 1746155567 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155556.836935:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0000 with x1830976123401472 ext(0->1048575) 00002000:00010000:1.0:1746155556.836939:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f0000 00000100:00100000:1.0:1746155556.836971:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4162 00000100:00100000:1.0:1746155556.836976:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976123401472:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155556.837724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.853462:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976123401472:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16481us (16676us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155556.853473:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4162 00002000:00100000:1.0:1746155556.853480:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012f1f0000 x1830976123401472/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:627/0 lens 488/440 e 0 to 0 dl 1746155567 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155556.853488:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0000 with x1830976123401472 ext(0->1048575) 00002000:00010000:1.0:1746155556.853492:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f0000 00000100:00100000:0.0:1746155556.866877:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.866926:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123402112 00000100:00100000:1.0:1746155556.866934:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123402112 00000100:00100000:1.0:1746155556.869516:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11280 00000100:00100000:1.0:1746155556.869533:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:28710:x1830976123402112:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155556.869555:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155556.869575:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e972f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f9eb expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.869604:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009355de00/0x844e5faceb5e95ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f912 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.869612:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155556.869613:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155556.869617:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e972f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9eb expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.869647:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009355de00/0x844e5faceb5e95ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f912 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.869684:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009355de00/0x844e5faceb5e95ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f912 expref: 23 pid: 8437 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155556.869705:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124453760:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155556.869804:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155556.876233:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124453760:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155556.876263:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e972f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9eb expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.876280:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009475b400, rc 0) 00000100:00100000:1.0:1746155556.876348:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28710:x1830976123402112:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6821us (9477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155556.876355:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11280 00000100:00100000:0.0:1746155556.879874:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.879924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.880817:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123402368 00000100:00100000:1.0:1746155556.880822:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123402368 00000100:00100000:1.0:1746155556.880857:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11281 00000100:00100000:1.0:1746155556.880862:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:28713:x1830976123402368:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155556.880871:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155556.880885:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f9f2 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.880909:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bdfbc00/0x844e5faceb5e9610 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f958 expref: 13 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.880916:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155556.880918:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155556.880920:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f2 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.880948:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bdfbc00/0x844e5faceb5e9610 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f958 expref: 13 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.880958:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bdfbc00/0x844e5faceb5e9610 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f958 expref: 13 pid: 18270 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155556.880968:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124453888:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155556.881018:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155556.886248:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124453888:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155556.886271:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f2 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.886287:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009475ac00, rc 0) 00000100:00100000:1.0:1746155556.886337:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:28713:x1830976123402368:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5474us (6412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155556.886345:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11281 00000100:00100000:1.0:1746155556.887788:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123402496 00000100:00100000:1.0:1746155556.887795:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123402496 00002000:00100000:1.0:1746155556.887827:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3735551) req@ffff880137120e00 x1830976123402496/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:627/0 lens 488/0 e 0 to 0 dl 1746155567 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155556.887835:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120e00 with x1830976123402496 ext(3145728->3735551) 00010000:00010000:1.0:1746155556.887842:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bdfbc00/0x844e5faceb5e9610 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f958 expref: 14 pid: 18270 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.887856:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bdfbc00/0x844e5faceb5e9610 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3735551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f958 expref: 14 pid: 18270 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746155556.887861:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880137120e00 00000100:00100000:0.0:1746155556.888198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.888215:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123402752 00000100:00100000:0.0:1746155556.888217:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123402752 00000100:00100000:0.0:1746155556.888241:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9834 00000100:00100000:0.0:1746155556.888247:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:28715:x1830976123402752:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155556.888265:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.888279:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5e973d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0f9f9 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.888367:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5e9744 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888378:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5e9744 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888388:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5e9744 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888398:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e974b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888402:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e974b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888406:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e974b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888488:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1200/0x844e5faceb5e9752 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888494:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1200/0x844e5faceb5e9752 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888499:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1200/0x844e5faceb5e9752 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155556.888522:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00010000:00010000:0.0:1746155556.888577:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5e9744 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888582:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5e9744 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888587:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5e9744 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888591:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb0400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155556.888594:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5e9744 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888599:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5e9744 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888607:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155556.888610:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155556.888613:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5e9744 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888616:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5e9744 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888631:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e974b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888635:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e974b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888639:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e974b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888642:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb1000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155556.888644:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e974b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888648:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e974b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888653:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9900) 00010000:00010000:0.0:1746155556.888654:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155556.888656:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e974b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888660:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e974b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155556.888703:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5e973d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f9 expref: 295 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.888712:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1200/0x844e5faceb5e9752 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f9 expref: 294 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.888717:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155556.888720:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155556.888721:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1200, rc 0) 00000100:00100000:0.0:1746155556.889191:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:28715:x1830976123402752:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 942us (991us total) trans 8589943730 rc 0/0 00000100:00100000:0.0:1746155556.889197:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9834 00000100:00100000:0.0:1746155556.893599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.903622:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123403136 00000100:00100000:0.0:1746155556.903626:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123403136 00000100:00100000:0.0:1746155556.903657:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11282 00000100:00100000:0.0:1746155556.903663:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:28715:x1830976123403136:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155556.903683:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155556.903694:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e9760 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fa00 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.903707:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155556.903710:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f2 expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.903715:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746155556.903718:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e9760 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2199552->2461695] (req 2199552->2461695) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa00 expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.903736:0:10591:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f2 expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.903746:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e9760 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2199552->2461695] (req 2199552->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa00 expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155556.903758:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1000, rc 0) 00000100:00100000:0.0:1746155556.903779:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:28715:x1830976123403136:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 116us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155556.903784:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11282 00000100:00100000:0.0:1746155556.908733:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.910547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.911108:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.927942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.927971:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.928005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.928429:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123404032 00000100:00100000:1.0:1746155556.928437:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123404032 00002000:00100000:1.0:1746155556.928472:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880094869c00 x1830976123404032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:627/0 lens 488/0 e 0 to 0 dl 1746155567 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155556.928480:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094869c00 with x1830976123404032 ext(2097152->3145727) 00010000:00010000:1.0:1746155556.928487:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f2 expref: 22 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.928499:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f2 expref: 22 pid: 10591 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746155556.928529:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094869c00 00000100:00100000:1.0:1746155556.928545:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123404160 00000100:00100000:1.0:1746155556.928547:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123404160 00002000:00100000:1.0:1746155556.928559:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009486b800 x1830976123404160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:627/0 lens 488/0 e 0 to 0 dl 1746155567 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155556.928565:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b800 with x1830976123404160 ext(3145728->4194303) 00010000:00010000:1.0:1746155556.928568:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f2 expref: 23 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.928576:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f2 expref: 23 pid: 10591 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746155556.928581:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009486b800 00000100:00100000:1.0:1746155556.928590:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123404544 00000100:00100000:1.0:1746155556.928592:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123404544 00002000:00100000:1.0:1746155556.928603:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3846143) req@ffff880094868e00 x1830976123404544/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:627/0 lens 504/0 e 0 to 0 dl 1746155567 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155556.928608:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094868e00 with x1830976123404544 ext(2097152->3846143) 00002000:00010000:1.0:1746155556.928611:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094868e00 00000100:00100000:1.0:1746155556.928621:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 601 00000100:00100000:1.0:1746155556.928627:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123404032:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155556.928948:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 602 00000100:00100000:0.0:1746155556.928956:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123404160:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155556.929796:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4166 00000100:00100000:1.0:1746155556.929802:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123404544:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155556.929985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.930001:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123404800 00000100:00100000:0.0:1746155556.930005:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123404800 00002000:00100000:0.0:1746155556.930022:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3846144->4194303) req@ffff88009486b100 x1830976123404800/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:627/0 lens 488/0 e 0 to 0 dl 1746155567 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155556.930028:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b100 with x1830976123404800 ext(3846144->4194303) 00002000:00010000:0.0:1746155556.930031:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486b100 00000100:00100000:0.0:1746155556.930043:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4167 00000100:00100000:0.0:1746155556.930049:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123404800:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155556.932863:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.932896:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123404928 00000100:00100000:1.0:1746155556.932902:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123404928 00000100:00100000:1.0:1746155556.932928:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11283 00000100:00100000:1.0:1746155556.932934:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:28709:x1830976123404928:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155556.932964:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155556.932978:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fa07 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.932999:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131004400/0x844e5faceb5e969c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->3002367) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f99e expref: 28 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.933005:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155556.933007:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155556.933010:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2912256->3145727] (req 2912256->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 18 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.933031:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131004400/0x844e5faceb5e969c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->3002367) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f99e expref: 28 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.933039:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131004400/0x844e5faceb5e969c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->3002367) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f99e expref: 28 pid: 4461 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155556.933048:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124454400:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155556.933088:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155556.938042:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124454400:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155556.938069:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2912256->3145727] (req 2912256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.938086:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009475ba00, rc 0) 00000100:00100000:1.0:1746155556.938142:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28709:x1830976123404928:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5206us (5284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155556.938149:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11283 00000100:00100000:0.0:1746155556.938530:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.942855:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123404800:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12798us (12863us total) trans 0 rc 348160/348160 00000100:00100000:1.0:1746155556.942864:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4167 00002000:00100000:1.0:1746155556.942873:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3846144->4194303) req@ffff88009486b100 x1830976123404800/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:627/0 lens 488/440 e 0 to 0 dl 1746155567 ref 1 fl Complete:/200/0 rc 348160/348160 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155556.942880:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b100 with x1830976123404800 ext(3846144->4194303) 00010000:00010000:1.0:1746155556.942890:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131004400/0x844e5faceb5e969c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f99e expref: 29 pid: 4461 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.942901:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131004400/0x844e5faceb5e969c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f99e expref: 29 pid: 4461 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746155556.942908:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009486b100 00000100:00100000:0.0:1746155556.945054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.945600:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123405184 00000100:00100000:1.0:1746155556.945611:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123405184 00000100:00100000:1.0:1746155556.945662:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123405312 00000100:00100000:1.0:1746155556.945665:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123405312 00000100:00100000:1.0:1746155556.945697:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11284 00000100:00100000:1.0:1746155556.945703:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1962:x1830976123405184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155556.945722:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155556.945740:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01f3600/0x844e5faceb5e976e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fa0e expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.945766:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155556.945851:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01f3600/0x844e5faceb5e976e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa0e expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155556.945860:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01f3600/0x844e5faceb5e976e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa0e expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155556.945880:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01f3600, rc 0) 00000100:00100000:1.0:1746155556.945979:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1962:x1830976123405184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 274us (929us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155556.945984:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11284 00000100:00100000:1.0:1746155556.946412:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123404544:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 16610us (18405us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155556.946417:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4166 00002000:00100000:1.0:1746155556.946423:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3846143) req@ffff880094868e00 x1830976123404544/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:627/0 lens 504/440 e 0 to 0 dl 1746155567 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155556.946428:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094868e00 with x1830976123404544 ext(2097152->3846143) 00010000:00010000:1.0:1746155556.946432:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131004400/0x844e5faceb5e969c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2301952->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f99e expref: 27 pid: 4461 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.946438:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131004400/0x844e5faceb5e969c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2301952->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f99e expref: 27 pid: 4461 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746155556.946442:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094868e00 00000100:00100000:0.0:1746155556.947004:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.947716:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123405440 00000100:00100000:1.0:1746155556.947720:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123405440 00000100:00100000:1.0:1746155556.947749:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11286 00000100:00100000:1.0:1746155556.947754:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:28713:x1830976123405440:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155556.947762:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155556.947769:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01f3800/0x844e5faceb5e977c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fa1c expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.947783:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155556.947788:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2912256->3145727] (req 2912256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.947793:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746155556.947796:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01f3800/0x844e5faceb5e977c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa1c expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.947819:0:10591:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2912256->3145727] (req 2912256->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.947829:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01f3800/0x844e5faceb5e977c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa1c expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.947837:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01f3800, rc 0) 00000100:00100000:1.0:1746155556.947866:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:28713:x1830976123405440:12345-192.168.202.51@tcp:101:cat.0 Request processed in 112us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155556.947871:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11286 00000100:00100000:1.0:1746155556.951265:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.951312:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123405568 00000100:00100000:1.0:1746155556.951318:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123405568 00010000:00010000:1.0:1746155556.951343:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f2 expref: 22 pid: 10591 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155556.951364:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5584 00000100:00100000:1.0:1746155556.951370:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123405568:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155556.951380:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155556.951397:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f2 expref: 22 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.951407:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f2 expref: 22 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.951428:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009475ac00/0x844e5faceb5e9736 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9f2 expref: 22 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.951440:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155556.951442:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155556.951447:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e9760 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2461695) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa00 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.951453:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e9760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2461695) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa00 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.951478:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e9760 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2199552->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa00 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155556.951487:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976124454784:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155556.952719:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124454528:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155556.952742:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f293c00/0x844e5faceb5e9775 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa15 expref: 17 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.952751:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f293c00/0x844e5faceb5e9775 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa15 expref: 17 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155556.952762:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f293c00, rc 0) 00000100:00100000:0.0:1746155556.952783:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123405312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6960us (7319us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155556.952789:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11285 00000100:00100000:1.0:1746155556.952863:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155556.956789:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976124454784:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155556.956805:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155556.957095:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123405568:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5723us (5834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155556.957104:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5584 00000100:00100000:0.0:1746155556.957224:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.957249:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.959210:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.959251:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123406080 00000100:00100000:1.0:1746155556.959255:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123406080 00010000:00010000:1.0:1746155556.959271:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131004400/0x844e5faceb5e969c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2301952->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f99e expref: 28 pid: 4461 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155556.959292:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5585 00000100:00100000:1.0:1746155556.959297:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123406080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155556.959306:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155556.959319:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131004400/0x844e5faceb5e969c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2301952->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f99e expref: 28 pid: 4461 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.959326:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131004400/0x844e5faceb5e969c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2301952->3002367) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f99e expref: 28 pid: 4461 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.959340:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131004400/0x844e5faceb5e969c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2301952->3002367) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f99e expref: 28 pid: 4461 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.959351:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155556.959352:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155556.959357:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.959364:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.959382:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.959389:0:7064:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 15 pid: 10591 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155556.959401:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124455040:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155556.959446:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155556.960561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.960844:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124455040:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155556.960854:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155556.961161:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123406080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1862us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155556.961167:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5585 00000100:00100000:0.0:1746155556.962917:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.962947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.966047:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123407488 00000100:00100000:0.0:1746155556.966050:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123407488 00002000:00100000:0.0:1746155556.966157:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (2912256->3145727) req@ffff8800a62a0a80 x1830976123407488/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:627/0 lens 488/0 e 0 to 0 dl 1746155567 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155556.966169:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a0a80 with x1830976123407488 ext(2912256->3145727) 00010000:00010000:0.0:1746155556.966176:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 16 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155556.966184:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 16 pid: 10591 timeout: 786 lvb_type: 0 00002000:00010000:0.0:1746155556.966190:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a62a0a80 00000100:00100000:0.0:1746155556.966212:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 607 00000100:00100000:0.0:1746155556.966217:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123407488:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155556.969340:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123407488:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3119us (3331us total) trans 17179873077 rc 0/0 00000100:00100000:0.0:1746155556.969347:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 607 00002000:00100000:0.0:1746155556.969353:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (2912256->3145727) req@ffff8800a62a0a80 x1830976123407488/t17179873077(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:627/0 lens 488/448 e 0 to 0 dl 1746155567 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155556.969360:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a0a80 with x1830976123407488 ext(2912256->3145727) 00010000:00010000:0.0:1746155556.969366:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 18 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155556.969375:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 18 pid: 10591 timeout: 786 lvb_type: 0 00002000:00010000:0.0:1746155556.969380:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a62a0a80 00000100:00100000:0.0:1746155556.971798:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155556.971842:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155556.971923:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123407744 00000100:00100000:1.0:1746155556.971930:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123407744 00010000:00010000:1.0:1746155556.971958:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 18 pid: 10591 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155556.971989:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123407616 00000100:00100000:1.0:1746155556.971992:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123407616 00010000:00010000:1.0:1746155556.972003:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1000/0x844e5faceb5e9760 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2199552->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa00 expref: 23 pid: 10591 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155556.972019:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5586 00000100:00100000:1.0:1746155556.972025:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123407744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155556.972037:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155556.972052:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 18 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.972062:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 18 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.972080:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009475ba00/0x844e5faceb5e9767 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa07 expref: 18 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155556.972095:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155556.972097:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155556.972102:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a01f3800/0x844e5faceb5e977c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa1c expref: 26 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.972109:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01f3800/0x844e5faceb5e977c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa1c expref: 26 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155556.972134:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a01f3800/0x844e5faceb5e977c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa1c expref: 26 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155556.972144:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124455168:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155556.972204:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155556.974620:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124455168:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155556.974635:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155556.974679:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123407744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2645us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155556.974687:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5586 00000100:00100000:0.0:1746155556.980034:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123408000 00000100:00100000:0.0:1746155556.980042:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123408000 00002000:00100000:0.0:1746155556.980078:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a62a2680 x1830976123408000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:627/0 lens 488/0 e 0 to 0 dl 1746155567 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155556.980088:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a2680 with x1830976123408000 ext(2097152->3145727) 00002000:00010000:0.0:1746155556.980092:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a2680 00000100:00100000:0.0:1746155556.980119:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123408256 00000100:00100000:0.0:1746155556.980122:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123408256 00002000:00100000:0.0:1746155556.980134:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a62a0700 x1830976123408256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:627/0 lens 488/0 e 0 to 0 dl 1746155567 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155556.980140:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a0700 with x1830976123408256 ext(2097152->3145727) 00002000:00010000:0.0:1746155556.980143:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a0700 00000100:00100000:0.0:1746155556.980196:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4170 00000100:00100000:0.0:1746155556.980202:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123408256:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155556.985086:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123408512 00000100:00100000:0.0:1746155556.985093:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123408512 00002000:00100000:0.0:1746155556.985127:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3813376->3817471) req@ffff88009a6d8000 x1830976123408512/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:627/0 lens 488/0 e 0 to 0 dl 1746155567 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155556.985135:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d8000 with x1830976123408512 ext(3813376->3817471) 00002000:00010000:0.0:1746155556.985140:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6d8000 00000100:00100000:0.0:1746155556.985169:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4171 00000100:00100000:0.0:1746155556.985175:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123408512:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155556.985308:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123408512:12345-192.168.202.51@tcp:3:cat.0 Request processed in 133us (302us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155556.985314:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4171 00002000:00100000:0.0:1746155556.985319:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3813376->3817471) req@ffff88009a6d8000 x1830976123408512/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:627/0 lens 488/4536 e 0 to 0 dl 1746155567 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155556.985325:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d8000 with x1830976123408512 ext(3813376->3817471) 00002000:00010000:0.0:1746155556.985327:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6d8000 00000100:00100000:0.0:1746155557.003855:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.005406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:1.0:1746155557.005712:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155557.011655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.011784:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155557.013320:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155557.036031:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.036071:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.036994:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123409536 00000100:00100000:1.0:1746155557.037014:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123409536 00000100:00100000:1.0:1746155557.037047:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9835 00000100:00100000:1.0:1746155557.037054:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28718:x1830976123409536:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155557.037065:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.037074:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76a00/0x844e5faceb5e97a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fa46 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.037115:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76c00/0x844e5faceb5e97ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.037125:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76c00/0x844e5faceb5e97ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.037133:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76c00/0x844e5faceb5e97ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.037143:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e97b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.037149:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e97b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.037154:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e97b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.037237:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.037245:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009355da00/0x844e5faceb5e96d4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9b3 expref: 14 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.037251:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.037272:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009355da00/0x844e5faceb5e96d4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9b3 expref: 14 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.037284:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009355da00/0x844e5faceb5e96d4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9b3 expref: 14 pid: 27374 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.037294:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124455680:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155557.037519:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.038619:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155557.044969:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6daa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124455808:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155557.044978:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124455936:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155557.044990:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155557.045161:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124455680:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155557.045174:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155557.046589:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123409408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8939us (9066us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.046597:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5588 00000100:00100000:1.0:1746155557.054297:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123410432 00000100:00100000:1.0:1746155557.054308:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123410432 00010000:00010000:1.0:1746155557.054339:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009355da00/0x844e5faceb5e96d4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9b3 expref: 16 pid: 27374 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.054371:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5589 00000100:00100000:1.0:1746155557.054378:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123410432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.054388:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.054393:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009355da00/0x844e5faceb5e96d4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9b3 expref: 16 pid: 27374 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.054404:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009355da00/0x844e5faceb5e96d4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9b3 expref: 16 pid: 27374 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.054423:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009355da00/0x844e5faceb5e96d4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9b3 expref: 16 pid: 27374 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.054443:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155557.054447:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.054454:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.054461:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.054477:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155557.054529:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123410432:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 152us (7289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.054535:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5589 00010000:00010000:1.0:1746155557.054556:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.054562:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155557.055220:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00000004:00200000:1.0:1746155557.055225:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155557.055241:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055250:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055260:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76c00/0x844e5faceb5e97ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055266:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76c00/0x844e5faceb5e97ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055272:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76c00/0x844e5faceb5e97ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055278:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093b76c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155557.055281:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76c00/0x844e5faceb5e97ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055287:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76c00/0x844e5faceb5e97ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055294:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155557.055297:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155557.055300:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76c00/0x844e5faceb5e97ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055304:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76c00/0x844e5faceb5e97ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055313:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e97b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055317:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e97b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055322:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e97b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055326:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093b76e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155557.055328:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e97b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055333:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e97b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055342:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008d58cc00) 00010000:00010000:1.0:1746155557.055344:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155557.055346:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e97b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055349:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e97b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.055389:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76a00/0x844e5faceb5e97a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa46 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.055400:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa46 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.055406:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155557.055408:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155557.055410:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b77000, rc 0) 00000100:00100000:1.0:1746155557.055435:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:28718:x1830976123409536:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 18382us (19363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.055441:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9835 00000100:00100000:0.0:1746155557.078319:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123410816:12345-192.168.202.51@tcp:3:cat.0 Request processed in 27265us (27425us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155557.078330:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4175 00002000:00100000:0.0:1746155557.078340:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800910c8a80 x1830976123410816/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/440 e 0 to 0 dl 1746155568 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.078348:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8a80 with x1830976123410816 ext(3145728->4194303) 00002000:00010000:0.0:1746155557.078353:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c8a80 00000100:00100000:1.0:1746155557.079161:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11292 00000100:00100000:1.0:1746155557.079169:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123411200:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155557.079188:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.079203:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b77600/0x844e5faceb5e97c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fa54 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.079220:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.079221:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.079228:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b77600/0x844e5faceb5e97c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa54 expref: 11 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.079241:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b77600/0x844e5faceb5e97c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa54 expref: 11 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.079249:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b77600, rc 0) 00000100:00100000:1.0:1746155557.079270:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123411200:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 101us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.079277:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11292 00010000:00010000:1.0:1746155557.079292:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.079298:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b77800/0x844e5faceb5e97d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fa62 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.079306:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.079307:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.079311:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b77800/0x844e5faceb5e97d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa62 expref: 11 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.079319:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b77800/0x844e5faceb5e97d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa62 expref: 11 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.079326:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b77800, rc 0) 00000100:00100000:1.0:1746155557.079338:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123411456:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 166us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.079342:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11293 00000100:00100000:0.0:1746155557.088759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.088799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.088833:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.091240:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123412096 00000100:00100000:0.0:1746155557.091247:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123412096 00002000:00100000:1.0:1746155557.091428:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4845567) req@ffff88009fe91880 x1830976123412096/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.091443:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe91880 with x1830976123412096 ext(4194304->4845567) 00002000:00010000:1.0:1746155557.091448:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe91880 00000100:00100000:1.0:1746155557.091462:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4177 00000100:00100000:1.0:1746155557.091468:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123412096:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155557.096236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.096273:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.096298:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123412480 00000100:00100000:1.0:1746155557.096303:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123412480 00010000:00010000:1.0:1746155557.096327:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa46 expref: 11 pid: 14234 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.096349:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5590 00000100:00100000:1.0:1746155557.096356:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123412480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.096367:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.096372:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa46 expref: 11 pid: 14234 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.096381:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa46 expref: 11 pid: 14234 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.096398:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b77000/0x844e5faceb5e97bb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa46 expref: 11 pid: 14234 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.096413:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155557.096418:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542ba00/0x844e5faceb5e97ec lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.096426:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542ba00/0x844e5faceb5e97ec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.096432:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542ba00/0x844e5faceb5e97ec lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.096457:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155557.096485:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123412480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 129us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.096490:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5590 00000100:00100000:1.0:1746155557.107022:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123412096:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15545us (18179us total) trans 0 rc 651264/651264 00000100:00100000:1.0:1746155557.107032:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4177 00002000:00100000:1.0:1746155557.107041:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4845567) req@ffff88009fe91880 x1830976123412096/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/440 e 0 to 0 dl 1746155568 ref 1 fl Complete:/200/0 rc 651264/651264 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.107050:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe91880 with x1830976123412096 ext(4194304->4845567) 00002000:00010000:1.0:1746155557.107055:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe91880 00000100:00100000:1.0:1746155557.108437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.108841:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123412352:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11623us (12605us total) trans 0 rc 651264/651264 00000100:00100000:1.0:1746155557.108847:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4178 00002000:00100000:1.0:1746155557.108853:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4845567) req@ffff88012fe8dc00 x1830976123412352/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/440 e 0 to 0 dl 1746155568 ref 1 fl Complete:/200/0 rc 651264/651264 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.108861:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8dc00 with x1830976123412352 ext(4194304->4845567) 00002000:00010000:1.0:1746155557.108864:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fe8dc00 00000100:00100000:0.0:1746155557.120926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.124535:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123412736 00000100:00100000:1.0:1746155557.124546:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123412736 00010000:00010000:1.0:1746155557.124580:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542ba00/0x844e5faceb5e97ec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa70 expref: 12 pid: 14234 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.124609:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5591 00000100:00100000:1.0:1746155557.124616:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123412736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.124627:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.124631:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542ba00/0x844e5faceb5e97ec lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa70 expref: 12 pid: 14234 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.124642:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542ba00/0x844e5faceb5e97ec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa70 expref: 12 pid: 14234 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.124662:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542ba00/0x844e5faceb5e97ec lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa70 expref: 12 pid: 14234 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.124699:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155557.124703:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425a00/0x844e5faceb5e9801 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.124711:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425a00/0x844e5faceb5e9801 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.124717:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425a00/0x844e5faceb5e9801 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.124733:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155557.124812:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425a00/0x844e5faceb5e9801 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155557.124818:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425a00/0x844e5faceb5e9801 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155557.124851:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00000004:00200000:0.0:1746155557.124855:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155557.124867:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425a00/0x844e5faceb5e9801 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155557.124893:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5e97fa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa77 expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.124908:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425a00/0x844e5faceb5e9801 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa77 expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.124914:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155557.124916:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155557.124918:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5425a00, rc 0) 00000100:00100000:1.0:1746155557.125832:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123412736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1213us (4910us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.125840:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5591 00000100:00100000:0.0:1746155557.125849:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:28718:x1830976123412608:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 17296us (17413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.125856:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9837 00000100:00100000:1.0:1746155557.125934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.126038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.126075:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123413248 00000100:00100000:1.0:1746155557.126078:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123413248 00000100:00100000:1.0:1746155557.126094:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3925 00000100:00100000:1.0:1746155557.126099:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28710:x1830976123413248:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155557.126229:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28710:x1830976123413248:12345-192.168.202.51@tcp:35:cat.0 Request processed in 128us (190us total) trans 8589943734 rc 0/0 00000100:00100000:1.0:1746155557.126235:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3925 00000100:00100000:0.0:1746155557.135882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.135922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.136028:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123413760 00000100:00100000:1.0:1746155557.136037:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123413760 00000100:00100000:1.0:1746155557.136073:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123413504 00000100:00100000:1.0:1746155557.136075:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123413504 00000100:00100000:1.0:1746155557.136710:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9838 00000100:00100000:1.0:1746155557.136718:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:28718:x1830976123413760:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155557.136735:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.136751:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76a00/0x844e5faceb5e9808 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fa85 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155557.136778:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9839 00000100:00100000:0.0:1746155557.136786:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28721:x1830976123413504:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155557.136797:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155557.136805:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3fb1600/0x844e5faceb5e980f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fa7e expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.136824:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e9816 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.136835:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e9816 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155557.136844:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e9816 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155557.136852:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00010000:00010000:0.0:1746155557.136869:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3fb1800/0x844e5faceb5e9824 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155557.136877:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3fb1800/0x844e5faceb5e9824 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155557.136883:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3fb1800/0x844e5faceb5e9824 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155557.136893:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3fb1a00/0x844e5faceb5e982b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155557.136898:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3fb1a00/0x844e5faceb5e982b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155557.136903:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3fb1a00/0x844e5faceb5e982b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155557.136933:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76a00/0x844e5faceb5e9808 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa85 expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.136951:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e9816 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa85 expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.136958:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155557.136960:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155557.136963:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b76e00, rc 0) 00010000:00010000:0.0:1746155557.136970:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3fb1c00/0x844e5faceb5e9832 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155557.136978:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e9816 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa85 expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.136983:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3fb1c00/0x844e5faceb5e9832 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00000100:00100000:1.0:1746155557.137001:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:28718:x1830976123413760:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 284us (1127us total) trans 8589943736 rc 0/0 00010000:00010000:0.0:1746155557.137005:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e9816 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa85 expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.137007:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9838 00010000:00010000:0.0:1746155557.137015:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e9816 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa85 expref: 12 pid: 14234 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.137030:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe90a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124456320:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155557.137071:0:19870:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155557.142420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.142453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.142475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.142495:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123414016 00000100:00100000:0.0:1746155557.142521:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123414016 00000100:00100000:0.0:1746155557.142563:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123414272 00000100:00100000:0.0:1746155557.142566:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123414272 00000100:00100000:0.0:1746155557.142576:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123414528 00000100:00100000:0.0:1746155557.142577:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123414528 00000100:00100000:0.0:1746155557.142588:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11297 00000100:00100000:0.0:1746155557.142595:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123414016:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155557.142627:0:9235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.142641:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e972f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9eb expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.142648:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5425200/0x844e5faceb5e97e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa69 expref: 27 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.142655:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b77600/0x844e5faceb5e97c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa54 expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.142660:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.142662:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.142665:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.142697:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093b77600/0x844e5faceb5e97c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa54 expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.142706:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093b77600/0x844e5faceb5e97c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa54 expref: 12 pid: 4461 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746155557.142717:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124456576:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155557.142949:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5425200/0x844e5faceb5e97e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa69 expref: 27 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.142957:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5425200/0x844e5faceb5e97e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa69 expref: 27 pid: 10591 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746155557.142964:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f244380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124457088:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155557.143021:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.143070:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.143080:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123414144 00000100:00100000:1.0:1746155557.143083:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123414144 00000100:00100000:1.0:1746155557.143097:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11301 00000100:00100000:1.0:1746155557.143101:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123414144:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155557.143113:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093b76400/0x844e5faceb5e9855 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.143120:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5e9576 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8da expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.143127:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5e965d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f97b expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.143133:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009355c200/0x844e5faceb5e95a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f90b expref: 17 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.143143:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.143144:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.143145:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b76400/0x844e5faceb5e9855 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.143157:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009355c200/0x844e5faceb5e95a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f90b expref: 17 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.143183:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e972f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9eb expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.143190:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e972f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9eb expref: 17 pid: 10591 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.143197:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f246d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124457472:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155557.143343:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009355c200/0x844e5faceb5e95a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f90b expref: 17 pid: 19959 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746155557.143353:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124457344:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155557.143372:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5e965d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f97b expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155557.143455:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155557.143476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.143513:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155557.143886:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5e965d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f97b expref: 13 pid: 9235 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746155557.143896:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124457984:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155557.143917:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123414656 00000100:00100000:1.0:1746155557.143919:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123414656 00010000:00010000:1.0:1746155557.143933:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e9816 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa85 expref: 12 pid: 14234 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.143948:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5592 00000100:00100000:1.0:1746155557.143952:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123414656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.143960:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.143965:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e9816 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa85 expref: 12 pid: 14234 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.143973:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e9816 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa85 expref: 12 pid: 14234 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.143989:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b76e00/0x844e5faceb5e9816 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa85 expref: 12 pid: 14234 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.144002:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155557.144006:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3fb1c00/0x844e5faceb5e9832 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155557.144014:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3fb1c00/0x844e5faceb5e9832 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155557.144019:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3fb1c00/0x844e5faceb5e9832 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155557.144031:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155557.144043:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123414656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 90us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.144049:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5592 00010000:00010000:1.0:1746155557.145103:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5e9576 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8da expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.145111:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5e9576 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8da expref: 27 pid: 8436 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.145123:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124458624:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155557.145137:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bf20a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155557.149011:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124456576:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155557.149136:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124456448:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155557.149143:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124456704:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155557.149627:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f246d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124457472:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155557.149692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.149711:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123415424 00000100:00100000:0.0:1746155557.149716:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123415424 00010000:00010000:0.0:1746155557.149743:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131004c00/0x844e5faceb5e9728 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9e4 expref: 23 pid: 4461 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.149766:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5593 00000100:00100000:0.0:1746155557.149772:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976123415424:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.149782:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.149799:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131004c00/0x844e5faceb5e9728 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9e4 expref: 23 pid: 4461 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.149809:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131004c00/0x844e5faceb5e9728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9e4 expref: 23 pid: 4461 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.149826:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131004c00/0x844e5faceb5e9728 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9e4 expref: 23 pid: 4461 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.149841:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.149870:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123415424:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 98us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.149875:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5593 00000100:00100000:1.0:1746155557.150282:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f244380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124457088:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155557.150298:0:9235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155557.157139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.157153:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.157172:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123415552 00000100:00100000:0.0:1746155557.157178:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123415552 00010000:00010000:0.0:1746155557.157205:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5e9599 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8fd expref: 22 pid: 8436 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.157227:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123416064 00000100:00100000:0.0:1746155557.157229:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123416064 00010000:00010000:0.0:1746155557.157238:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009355c200/0x844e5faceb5e95a7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f90b expref: 18 pid: 19959 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746155557.157253:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5594 00000100:00100000:0.0:1746155557.157260:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123415552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.157271:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.157289:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5e9599 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8fd expref: 22 pid: 8436 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.157298:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5e9599 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8fd expref: 22 pid: 8436 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.157316:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5e9599 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8fd expref: 22 pid: 8436 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.157331:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.157362:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123415552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 102us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.157368:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5594 00000100:00100000:0.0:1746155557.157382:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5595 00000100:00100000:0.0:1746155557.157386:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123416064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.157394:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.157404:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009355c200/0x844e5faceb5e95a7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f90b expref: 18 pid: 19959 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.157412:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009355c200/0x844e5faceb5e95a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f90b expref: 18 pid: 19959 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.157423:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.157436:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123416064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.157446:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5595 00000100:00100000:0.0:1746155557.157475:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.157486:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123415680 00000100:00100000:0.0:1746155557.157488:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123415680 00010000:00010000:0.0:1746155557.157498:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5424e00/0x844e5faceb5e97c9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa4d expref: 15 pid: 19959 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746155557.157536:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5596 00000100:00100000:0.0:1746155557.157541:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1962:x1830976123415680:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.157547:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.157555:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5424e00/0x844e5faceb5e97c9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa4d expref: 15 pid: 19959 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.157562:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5424e00/0x844e5faceb5e97c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa4d expref: 15 pid: 19959 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.157572:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.157584:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f247100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1962:x1830976123415680:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 44us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.157589:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5596 00000100:00100000:0.0:1746155557.157625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.157633:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123416448 00000100:00100000:0.0:1746155557.157636:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123416448 00010000:00010000:0.0:1746155557.157645:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01f3800/0x844e5faceb5e977c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa1c expref: 28 pid: 10591 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.157657:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5597 00000100:00100000:0.0:1746155557.157661:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f247800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123416448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.157667:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.157687:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a01f3800/0x844e5faceb5e977c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa1c expref: 28 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.157695:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a01f3800/0x844e5faceb5e977c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa1c expref: 28 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.157706:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.157718:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f247800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123416448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.157723:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5597 00000100:00100000:0.0:1746155557.157754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.157762:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123416704 00000100:00100000:0.0:1746155557.157765:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123416704 00010000:00010000:0.0:1746155557.157775:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5e96f0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9c8 expref: 19 pid: 9235 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.157788:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5598 00000100:00100000:0.0:1746155557.157792:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123416704:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.157798:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.157804:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5e96f0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9c8 expref: 19 pid: 9235 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.157812:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5e96f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9c8 expref: 19 pid: 9235 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.157822:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.157823:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.157827:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a542a800/0x844e5faceb5e984e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.157834:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a542a800/0x844e5faceb5e984e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.157850:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.157864:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123416704:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 71us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.157869:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5598 00000100:00100000:0.0:1746155557.157915:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.157923:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123414912 00000100:00100000:0.0:1746155557.157926:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123414912 00010000:00010000:0.0:1746155557.157935:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e972f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9eb expref: 18 pid: 10591 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.157946:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5599 00000100:00100000:0.0:1746155557.157951:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123414912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.157956:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.157963:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e972f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9eb expref: 18 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.158366:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009355c200/0x844e5faceb5e95a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f90b expref: 18 pid: 19959 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746155557.158380:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124457344:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155557.158389:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124457984:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155557.158395:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124458624:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155557.158408:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093b76400/0x844e5faceb5e9855 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.158650:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e972f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9eb expref: 17 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.158822:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009475b400/0x844e5faceb5e972f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f9eb expref: 17 pid: 10591 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.158831:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.158846:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123414912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 895us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.158850:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5599 00000100:00100000:0.0:1746155557.158900:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123415168 00000100:00100000:0.0:1746155557.158903:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123415168 00010000:00010000:0.0:1746155557.158912:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b77800/0x844e5faceb5e97d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa62 expref: 14 pid: 20200 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746155557.159204:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123416192 00000100:00100000:0.0:1746155557.159207:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123416192 00010000:00010000:0.0:1746155557.159217:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0939200/0x844e5faceb5e9791 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa31 expref: 21 pid: 9235 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.159233:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5600 00000100:00100000:0.0:1746155557.159237:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1960:x1830976123415168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.159242:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.159249:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b77800/0x844e5faceb5e97d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa62 expref: 15 pid: 20200 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.159256:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b77800/0x844e5faceb5e97d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa62 expref: 15 pid: 20200 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.159266:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b77800/0x844e5faceb5e97d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa62 expref: 15 pid: 20200 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.159272:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.160068:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976123415168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 828us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.160074:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5600 00000100:00100000:0.0:1746155557.160084:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123414784 00000100:00100000:0.0:1746155557.160087:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123414784 00010000:00010000:0.0:1746155557.160095:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b77600/0x844e5faceb5e97c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa54 expref: 12 pid: 4461 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746155557.160106:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5603 00000100:00100000:0.0:1746155557.160110:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123416832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.160116:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.160123:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cc1d600/0x844e5faceb5e9783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa23 expref: 18 pid: 9235 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.160130:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cc1d600/0x844e5faceb5e9783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 9 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa23 expref: 18 pid: 9235 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.160217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.160228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.160236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.160243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.160250:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.160266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155557.160646:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cc1d600/0x844e5faceb5e9783 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 8 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa23 expref: 20 pid: 9235 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.160745:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.160759:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123416832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 649us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.160763:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5603 00000100:00100000:0.0:1746155557.160773:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5606 00000100:00100000:0.0:1746155557.160777:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123415296:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.160783:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.160790:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5425200/0x844e5faceb5e97e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa69 expref: 28 pid: 10591 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.160798:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5425200/0x844e5faceb5e97e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa69 expref: 28 pid: 10591 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.160808:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5425200/0x844e5faceb5e97e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa69 expref: 28 pid: 10591 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.160816:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.160817:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.160821:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.160827:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.160861:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.160881:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123415296:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 103us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.160886:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5606 00000100:00100000:0.0:1746155557.160897:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5609 00000100:00100000:0.0:1746155557.160901:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123416960:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.160903:0:9235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.160907:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.160909:0:9235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.160924:0:9235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.160930:0:9235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.160936:0:9235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.160940:0:9235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3fb0c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155557.160943:0:9235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.160948:0:9235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.160956:0:9235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.160961:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3fb0c00/0x844e5faceb5e9839 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.160997:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123414016:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 18403us (18584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.161003:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11297 00010000:00010000:1.0:1746155557.161019:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093b76400/0x844e5faceb5e9855 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.161025:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b76400/0x844e5faceb5e9855 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.161035:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093b76400/0x844e5faceb5e9855 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.161039:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093b76400/0x844e5faceb5e9855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.161044:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093b76400/0x844e5faceb5e9855 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.161049:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093b76400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155557.161051:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093b76400/0x844e5faceb5e9855 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.161055:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093b76400/0x844e5faceb5e9855 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.161061:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093b76400/0x844e5faceb5e9855 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.161067:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b76400/0x844e5faceb5e9855 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.161084:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123414144:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 17983us (18014us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.161088:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11301 00010000:00010000:0.0:1746155557.161178:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009355d400/0x844e5faceb5e956f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8d3 expref: 16 pid: 19959 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.161186:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009355d400/0x844e5faceb5e956f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8d3 expref: 16 pid: 19959 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.161200:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009355d400/0x844e5faceb5e956f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8d3 expref: 16 pid: 19959 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.161208:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.161209:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.161211:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a542b800/0x844e5faceb5e9840 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.161217:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a542b800/0x844e5faceb5e9840 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.161231:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.161242:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123416960:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 341us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.161247:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5609 00000100:00100000:0.0:1746155557.162862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.166030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.168748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.171310:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123417856 00000100:00100000:1.0:1746155557.171317:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123417856 00000100:00100000:1.0:1746155557.171393:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3928 00000100:00100000:1.0:1746155557.171400:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:28718:x1830976123417856:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:1.0:1746155557.172011:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:28718:x1830976123417856:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 610us (813us total) trans 8589943739 rc 0/0 00000100:00100000:1.0:1746155557.172017:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3928 00000100:00100000:0.0:1746155557.180854:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123417984 00000100:00100000:0.0:1746155557.180858:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123417984 00000100:00100000:0.0:1746155557.180879:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11303 00000100:00100000:0.0:1746155557.180884:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28721:x1830976123417984:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155557.180892:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155557.180902:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f827a00/0x844e5faceb5e9871 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fa8c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155557.180920:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d9:0x0] initial LVB size: 4844352, mtime: 0x68143825, atime: 0x68143825, ctime: 0x68143825, blocks: 0x135f 00010000:00010000:0.0:1746155557.180933:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.180934:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.180940:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f827a00/0x844e5faceb5e9871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa8c expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.180951:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f827a00/0x844e5faceb5e9871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa8c expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.180959:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f827a00, rc 0) 00000100:00100000:0.0:1746155557.181270:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28721:x1830976123417984:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 383us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.181276:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11303 00000100:00100000:0.0:1746155557.182532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.182589:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123418496 00000100:00100000:1.0:1746155557.182593:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123418496 00002000:00100000:1.0:1746155557.182614:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2867200->2871295) req@ffff88009f247100 x1830976123418496/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.182622:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f247100 with x1830976123418496 ext(2867200->2871295) 00002000:00010000:1.0:1746155557.182626:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f247100 00000100:00100000:1.0:1746155557.182750:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4179 00000100:00100000:1.0:1746155557.182757:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123418496:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155557.183366:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123418496:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 608us (834us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155557.183376:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4179 00002000:00100000:1.0:1746155557.183381:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2867200->2871295) req@ffff88009f247100 x1830976123418496/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/4536 e 0 to 0 dl 1746155568 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.183388:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f247100 with x1830976123418496 ext(2867200->2871295) 00002000:00010000:1.0:1746155557.183391:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f247100 00000100:00100000:0.0:1746155557.186761:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.188932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.189022:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123418880 00000100:00100000:1.0:1746155557.189028:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123418880 00002000:00100000:1.0:1746155557.189052:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (192512->196607) req@ffff88009f247480 x1830976123418880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.189060:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f247480 with x1830976123418880 ext(192512->196607) 00002000:00010000:1.0:1746155557.189064:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f247480 00000100:00100000:1.0:1746155557.189230:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4180 00000100:00100000:1.0:1746155557.189240:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123418880:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155557.189362:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123418880:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 125us (433us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155557.189368:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4180 00002000:00100000:1.0:1746155557.189373:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (192512->196607) req@ffff88009f247480 x1830976123418880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/4536 e 0 to 0 dl 1746155568 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.189379:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f247480 with x1830976123418880 ext(192512->196607) 00002000:00010000:1.0:1746155557.189382:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f247480 00000100:00100000:0.0:1746155557.189654:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.189696:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123419008 00000100:00100000:0.0:1746155557.189699:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123419008 00000100:00100000:0.0:1746155557.189729:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11305 00000100:00100000:0.0:1746155557.189734:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28721:x1830976123419008:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155557.189744:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155557.189757:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f826a00/0x844e5faceb5e989b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0faa1 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155557.189772:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3dc:0x0] initial LVB size: 4194304, mtime: 0x68143825, atime: 0x68143825, ctime: 0x68143825, blocks: 0x1029 00010000:00010000:0.0:1746155557.189783:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.189785:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.189790:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f826a00/0x844e5faceb5e989b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faa1 expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.189802:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f826a00/0x844e5faceb5e989b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->2166783) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faa1 expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.189811:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f826a00, rc 0) 00000100:00100000:0.0:1746155557.189830:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28721:x1830976123419008:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 96us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.189835:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11305 00000100:00100000:0.0:1746155557.191618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.192444:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.194654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.195160:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123419776 00000100:00100000:1.0:1746155557.195165:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123419776 00000100:00100000:1.0:1746155557.195369:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3929 00000100:00100000:1.0:1746155557.195376:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:28725:x1830976123419776:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155557.195553:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:28725:x1830976123419776:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 176us (901us total) trans 8589943741 rc 0/0 00000100:00100000:1.0:1746155557.195559:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3929 00000100:00100000:0.0:1746155557.195913:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.257989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.260601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.260638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.261044:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11306 00000100:00100000:1.0:1746155557.261052:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123420416:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155557.261064:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.261078:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b76200/0x844e5faceb5e98b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0faaf expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155557.261096:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3da:0x0] initial LVB size: 2097152, mtime: 0x68143825, atime: 0x68143825, ctime: 0x68143825, blocks: 0x821 00010000:00010000:1.0:1746155557.261108:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.261110:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.261482:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b76200/0x844e5faceb5e98b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faaf expref: 27 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.261495:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b76200/0x844e5faceb5e98b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faaf expref: 27 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.261526:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b76200, rc 0) 00000100:00100000:1.0:1746155557.261544:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123420416:12345-192.168.202.51@tcp:101:cat.0 Request processed in 493us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.261549:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11306 00000100:00100000:0.0:1746155557.262661:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.264271:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.264578:0:14231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123421056 00000100:00100000:1.0:1746155557.264583:0:14231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123421056 00000100:00100000:1.0:1746155557.264616:0:14231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 163 00000100:00100000:1.0:1746155557.264622:0:14231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06793f43-a06c-4add-b66d-476e36bacde6+15:1961:x1830976123421056:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:1.0:1746155557.265039:0:14231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06793f43-a06c-4add-b66d-476e36bacde6+15:1961:x1830976123421056:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 415us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.265046:0:14231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 163 00000100:00100000:0.0:1746155557.266148:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.266184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.277435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.277537:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123421312 00000100:00100000:1.0:1746155557.277548:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123421312 00002000:00100000:1.0:1746155557.277587:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800944ac380 x1830976123421312/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 504/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.277595:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ac380 with x1830976123421312 ext(0->1048575) 00002000:00010000:1.0:1746155557.277600:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ac380 00000100:00100000:1.0:1746155557.277628:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4183 00000100:00100000:1.0:1746155557.277636:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123421312:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155557.278181:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.279009:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.279413:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.294360:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123421312:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16721us (16928us total) trans 0 rc 950272/950272 00000100:00100000:1.0:1746155557.294366:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4183 00002000:00100000:1.0:1746155557.294371:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800944ac380 x1830976123421312/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 504/440 e 0 to 0 dl 1746155568 ref 1 fl Complete:/200/0 rc 950272/950272 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.294377:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ac380 with x1830976123421312 ext(0->1048575) 00002000:00010000:1.0:1746155557.294380:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ac380 00000100:00100000:0.0:1746155557.310631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.310696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.310911:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9844 00000100:00100000:0.0:1746155557.310919:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:28734:x1830976123422336:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155557.310929:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155557.310969:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bba00/0x844e5faceb5e98e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fad2 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.311370:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e98ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311380:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e98ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311459:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e98ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311470:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e98f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311475:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e98f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311479:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e98f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311587:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903ba200/0x844e5faceb5e98fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311594:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800903ba200/0x844e5faceb5e98fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311599:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800903ba200/0x844e5faceb5e98fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155557.311605:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00010000:00010000:0.0:1746155557.311681:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e98ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311691:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e98ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311696:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e98ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311700:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800903baa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155557.311703:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e98ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311708:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e98ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311717:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155557.311720:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155557.311723:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e98ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311727:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e98ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311746:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e98f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311751:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e98f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311756:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e98f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311759:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800903bae00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155557.311761:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e98f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311765:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e98f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311770:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51800) 00010000:00010000:0.0:1746155557.311772:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155557.311773:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e98f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311777:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e98f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155557.311806:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bba00/0x844e5faceb5e98e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fad2 expref: 21 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.311815:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903ba200/0x844e5faceb5e98fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fad2 expref: 20 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.311820:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155557.311822:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155557.311823:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903ba200, rc 0) 00000100:00100000:1.0:1746155557.311893:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11312 00000100:00100000:1.0:1746155557.311901:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123422848:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155557.311908:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.311917:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b77c00/0x844e5faceb5e9912 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fae7 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.311942:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124459392:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155557.311965:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155557.312711:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:28734:x1830976123422336:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 931us (1224us total) trans 8589943744 rc 0/0 00000100:00100000:0.0:1746155557.312719:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9844 00000100:00100000:1.0:1746155557.312854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.313551:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124459392:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155557.313565:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b77c00/0x844e5faceb5e9912 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fae7 expref: 28 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.313574:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b77c00/0x844e5faceb5e9912 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fae7 expref: 28 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.313584:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b77c00, rc 0) 00000100:00100000:1.0:1746155557.313602:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123422848:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1702us (1824us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155557.313608:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11312 00000100:00100000:0.0:1746155557.317020:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.317111:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123423104 00000100:00100000:1.0:1746155557.317118:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123423104 00000100:00100000:1.0:1746155557.317244:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11313 00000100:00100000:1.0:1746155557.317252:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:28731:x1830976123423104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155557.317266:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.317279:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093b76a00/0x844e5faceb5e9920 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0faee expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.317302:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f827a00/0x844e5faceb5e9871 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa8c expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.317312:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155557.317314:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155557.317316:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093b76a00/0x844e5faceb5e9920 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faee expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.317339:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f827a00/0x844e5faceb5e9871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa8c expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.317349:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f827a00/0x844e5faceb5e9871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa8c expref: 15 pid: 8436 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.317358:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124459520:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155557.318008:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155557.323012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.323120:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123423232 00000100:00100000:0.0:1746155557.323126:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123423232 00002000:00100000:0.0:1746155557.323163:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2867200->3145727) req@ffff88012cdef800 x1830976123423232/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.323173:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdef800 with x1830976123423232 ext(2867200->3145727) 00010000:00010000:0.0:1746155557.323179:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f827a00/0x844e5faceb5e9871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa8c expref: 16 pid: 8436 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.323189:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f827a00/0x844e5faceb5e9871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2867200->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa8c expref: 16 pid: 8436 timeout: 786 lvb_type: 0 00002000:00010000:0.0:1746155557.323195:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdef800 00000100:00100000:0.0:1746155557.323398:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 609 00000100:00100000:0.0:1746155557.323406:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123423232:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155557.333197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.341582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.358117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.363129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.363163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.363302:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.364543:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123424640 00000100:00100000:0.0:1746155557.364547:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123424640 00000100:00100000:0.0:1746155557.364565:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11316 00000100:00100000:0.0:1746155557.364569:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123424384:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155557.364575:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155557.364583:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009355d400/0x844e5faceb5e9958 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fb0a expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.364593:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.364594:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.364601:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009355d400/0x844e5faceb5e9958 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb0a expref: 18 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.364611:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009355d400/0x844e5faceb5e9958 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb0a expref: 18 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.364618:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009355d400, rc 0) 00000100:00100000:1.0:1746155557.364675:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11317 00000100:00100000:1.0:1746155557.364682:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123424512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155557.364689:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.364695:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093b77600/0x844e5faceb5e995f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fb11 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.364703:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.364704:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.364709:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093b77600/0x844e5faceb5e995f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb11 expref: 19 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.364716:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093b77600/0x844e5faceb5e995f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb11 expref: 19 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.364724:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b77600, rc 0) 00000100:00100000:0.0:1746155557.365021:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123424384:12345-192.168.202.51@tcp:101:cat.0 Request processed in 450us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.365026:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11316 00000100:00100000:1.0:1746155557.365356:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123424512:12345-192.168.202.51@tcp:101:cat.0 Request processed in 673us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.366380:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.366956:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11317 00000100:00100000:0.0:1746155557.370419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.370596:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123425024 00000100:00100000:1.0:1746155557.370603:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123425024 00000100:00100000:1.0:1746155557.370636:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11320 00000100:00100000:1.0:1746155557.370642:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+19:28738:x1830976123425024:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155557.370658:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.370678:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093b76c00/0x844e5faceb5e9974 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fb26 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.370702:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0939600/0x844e5faceb5e9894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->290815) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa9a expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.370708:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155557.370710:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155557.370713:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093b76c00/0x844e5faceb5e9974 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb26 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.370743:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0939600/0x844e5faceb5e9894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->290815) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa9a expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.370751:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0939600/0x844e5faceb5e9894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->290815) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa9a expref: 22 pid: 8436 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.370765:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124460032:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155557.370821:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155557.374011:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124460032:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155557.374011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155557.374034:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093b76c00/0x844e5faceb5e9974 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb26 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.374048:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b76c00, rc 0) 00000100:00100000:1.0:1746155557.374092:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+21:28738:x1830976123425024:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3449us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.374342:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11320 00000100:00100000:0.0:1746155557.376270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.377387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.380246:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124460544:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155557.380256:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.380271:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123425664:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2721us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.380276:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5616 00000100:00100000:0.0:1746155557.380938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.384441:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.384476:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.384489:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.384533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.384551:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123426816 00000100:00100000:0.0:1746155557.384556:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123426816 00010000:00010000:0.0:1746155557.384579:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0939600/0x844e5faceb5e9894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->290815) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa9a expref: 24 pid: 8436 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.384600:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5617 00000100:00100000:0.0:1746155557.384606:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123426816:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.384616:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.384633:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0939600/0x844e5faceb5e9894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 192512->290815) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa9a expref: 24 pid: 8436 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.384644:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0939600/0x844e5faceb5e9894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 192512->290815) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa9a expref: 24 pid: 8436 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.384663:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0939600/0x844e5faceb5e9894 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 192512->290815) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fa9a expref: 24 pid: 8436 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.384696:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.384697:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.384703:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b76c00/0x844e5faceb5e9974 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb26 expref: 19 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.384711:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093b76c00/0x844e5faceb5e9974 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb26 expref: 19 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.384737:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093b76c00/0x844e5faceb5e9974 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb26 expref: 19 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155557.384747:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca96300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124460672:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155557.384805:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155557.393155:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca96300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124460672:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155557.393175:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155557.393208:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123426816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8600us (8673us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.393217:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5617 00000100:00100000:0.0:1746155557.404455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.405441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.405610:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123427072 00000100:00100000:1.0:1746155557.405613:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123427072 00010000:00010000:1.0:1746155557.405630:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5425400/0x844e5faceb5e996d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb1f expref: 21 pid: 8438 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746155557.405654:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5618 00000100:00100000:1.0:1746155557.405660:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123427072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.405677:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.405694:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5425400/0x844e5faceb5e996d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb1f expref: 21 pid: 8438 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746155557.405703:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5425400/0x844e5faceb5e996d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb1f expref: 21 pid: 8438 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746155557.405716:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5425400/0x844e5faceb5e996d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb1f expref: 21 pid: 8438 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746155557.405730:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155557.405746:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123427072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.405752:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5618 00000100:00100000:0.0:1746155557.408900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.408933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.408956:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.408977:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.409017:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123427712 00000100:00100000:1.0:1746155557.409021:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123427712 00002000:00100000:1.0:1746155557.409039:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009ca95c00 x1830976123427712/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.409046:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95c00 with x1830976123427712 ext(1048576->2097151) 00002000:00010000:1.0:1746155557.409049:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca95c00 00000100:00100000:1.0:1746155557.409061:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123428224 00000100:00100000:1.0:1746155557.409063:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123428224 00002000:00100000:1.0:1746155557.409073:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1576959) req@ffff88009ca95f80 x1830976123428224/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.409080:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95f80 with x1830976123428224 ext(1048576->1576959) 00002000:00010000:1.0:1746155557.409083:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca95f80 00000100:00100000:1.0:1746155557.409186:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4193 00000100:00100000:0.0:1746155557.409192:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4194 00000100:00100000:1.0:1746155557.409193:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123427712:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155557.409199:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123427968:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155557.411406:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.412082:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123428352 00000100:00100000:1.0:1746155557.412088:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123428352 00010000:00010000:1.0:1746155557.412108:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093b76a00/0x844e5faceb5e9920 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faee expref: 24 pid: 18270 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.412127:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5619 00000100:00100000:1.0:1746155557.412131:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123428352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.412139:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.412151:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093b76a00/0x844e5faceb5e9920 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faee expref: 24 pid: 18270 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.412161:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093b76a00/0x844e5faceb5e9920 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faee expref: 24 pid: 18270 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.412177:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b76a00/0x844e5faceb5e9920 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faee expref: 24 pid: 18270 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.412193:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.412195:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.412200:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7aa00/0x844e5faceb5e9982 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb34 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.412206:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7aa00/0x844e5faceb5e9982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb34 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.412230:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff7aa00/0x844e5faceb5e9982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb34 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.412244:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124461056:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155557.412293:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155557.412335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.412498:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123428608 00000100:00100000:1.0:1746155557.412575:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123428608 00002000:00100000:1.0:1746155557.412594:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012cded180 x1830976123428608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.412602:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded180 with x1830976123428608 ext(3145728->4194303) 00002000:00010000:1.0:1746155557.412605:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cded180 00000100:00100000:1.0:1746155557.412616:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4196 00000100:00100000:1.0:1746155557.412621:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123428608:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155557.420027:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.420882:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123427712:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11688us (11946us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155557.420889:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4193 00002000:00100000:1.0:1746155557.420894:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009ca95c00 x1830976123427712/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/440 e 0 to 0 dl 1746155568 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.420902:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95c00 with x1830976123427712 ext(1048576->2097151) 00002000:00010000:1.0:1746155557.420906:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca95c00 00000100:00100000:0.0:1746155557.433427:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.433492:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123429120 00000100:00100000:1.0:1746155557.433498:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123429120 00000100:00100000:1.0:1746155557.433543:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3931 00000100:00100000:1.0:1746155557.433548:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:28734:x1830976123429120:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155557.433716:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:28734:x1830976123429120:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 167us (289us total) trans 8589943747 rc 0/0 00000100:00100000:1.0:1746155557.433722:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3931 00000100:00100000:0.0:1746155557.438779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.438814:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.438847:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.438941:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11325 00000100:00100000:1.0:1746155557.438952:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123429376:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155557.438959:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.438967:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cec9800/0x844e5faceb5e9997 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fb49 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.439002:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124461184:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155557.439193:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155557.446302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.447053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:1.0:1746155557.447123:0:20200:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155556 -> 1746155557 00002000:00010000:1.0:1746155557.447126:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155556 -> 1746155557 00002000:00010000:1.0:1746155557.447128:0:20200:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155556 -> 1746155557 00000100:00100000:1.0:1746155557.447142:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124461184:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155557.447161:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cec9800/0x844e5faceb5e9997 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb49 expref: 25 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.447168:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cec9800/0x844e5faceb5e9997 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb49 expref: 25 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.447179:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cec9800, rc 0) 00000100:00100000:1.0:1746155557.447197:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123429376:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8249us (8348us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155557.447201:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11325 00000100:00100000:0.0:1746155557.452099:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.452134:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.452170:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.452587:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4200 00000100:00100000:0.0:1746155557.452594:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123430528:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155557.465217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.476165:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.477024:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.477052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.477071:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.477421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.477723:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123430528:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25129us (25551us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155557.477730:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4200 00002000:00100000:0.0:1746155557.477736:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880090189f80 x1830976123430528/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/440 e 0 to 0 dl 1746155568 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.477744:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189f80 with x1830976123430528 ext(2097152->3145727) 00010000:00010000:0.0:1746155557.477750:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff7b800/0x844e5faceb5e99ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb5e expref: 20 pid: 8436 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.477764:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff7b800/0x844e5faceb5e99ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb5e expref: 20 pid: 8436 timeout: 786 lvb_type: 1 00002000:00010000:0.0:1746155557.477769:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090189f80 00000100:00100000:0.0:1746155557.480858:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.482019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.482049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.482069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.482366:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11334 00000100:00100000:0.0:1746155557.482374:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123431680:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155557.482384:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155557.482394:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb76a00/0x844e5faceb5e99d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fb8f expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.482410:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb76a00/0x844e5faceb5e99d6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb8f expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.482418:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb76a00/0x844e5faceb5e99d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb8f expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.482434:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb76a00, rc 0) 00000100:00100000:0.0:1746155557.482452:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123431680:12345-192.168.202.51@tcp:101:cat.0 Request processed in 80us (435us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155557.482458:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11334 00000100:00100000:0.0:1746155557.482469:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11336 00000100:00100000:0.0:1746155557.482474:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123431808:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155557.482479:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155557.482485:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb76c00/0x844e5faceb5e99e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fb96 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155557.482521:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124462080:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155557.482546:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155557.484414:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124462080:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155557.484429:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb76c00/0x844e5faceb5e99e4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb96 expref: 29 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.484438:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb76c00/0x844e5faceb5e99e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb96 expref: 29 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.484448:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb76c00, rc 0) 00000100:00100000:1.0:1746155557.484468:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123431808:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1994us (2398us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155557.484473:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11336 00000100:00100000:0.0:1746155557.485420:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.491777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.493037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.511922:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123432960 00000100:00100000:1.0:1746155557.511926:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123432960 00010000:00010000:1.0:1746155557.511944:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013107a000/0x844e5faceb5e99b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb65 expref: 30 pid: 18270 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.511964:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5623 00000100:00100000:1.0:1746155557.511969:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123432960:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.511978:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.511992:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013107a000/0x844e5faceb5e99b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb65 expref: 30 pid: 18270 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.512003:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013107a000/0x844e5faceb5e99b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb65 expref: 30 pid: 18270 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.512026:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013107a000/0x844e5faceb5e99b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2342912->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb65 expref: 30 pid: 18270 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746155557.512041:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.512043:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.512049:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff7b600/0x844e5faceb5e99cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb81 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.512056:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff7b600/0x844e5faceb5e99cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb81 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.512087:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff7b600/0x844e5faceb5e99cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb81 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.512097:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124462464:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155557.512148:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155557.512609:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124462336:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155557.512623:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.512650:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123432576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 12375us (12796us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.512655:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5622 00000100:00100000:1.0:1746155557.520861:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124462464:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155557.520879:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155557.520981:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123432960:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9010us (9695us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.520991:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5623 00000100:00100000:0.0:1746155557.523047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.555692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.556567:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123433600 00000100:00100000:0.0:1746155557.556571:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123433600 00000100:00100000:0.0:1746155557.556605:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9846 00000100:00100000:0.0:1746155557.556610:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+22:28744:x1830976123433600:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155557.556622:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155557.556632:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bba00/0x844e5faceb5e99f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fbab expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.556730:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e9a00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.556741:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e9a00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.556750:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e9a00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.556762:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bb000/0x844e5faceb5e9a07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.556767:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bb000/0x844e5faceb5e9a07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.556772:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bb000/0x844e5faceb5e9a07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.558344:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e9a0e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.558356:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e9a0e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.558365:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e9a0e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155557.558373:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00010000:00010000:0.0:1746155557.558447:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e9a00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.558453:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e9a00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.558459:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e9a00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.558464:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800903bae00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155557.558467:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e9a00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.558472:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e9a00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.558482:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155557.558484:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155557.558487:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e9a00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.558492:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bae00/0x844e5faceb5e9a00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.558533:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bb000/0x844e5faceb5e9a07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.558538:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bb000/0x844e5faceb5e9a07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.559025:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bb000/0x844e5faceb5e9a07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.559030:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800903bb000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155557.559032:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bb000/0x844e5faceb5e9a07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.559037:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bb000/0x844e5faceb5e9a07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.559043:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fca6f00) 00010000:00010000:0.0:1746155557.559045:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155557.559047:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bb000/0x844e5faceb5e9a07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.559051:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bb000/0x844e5faceb5e9a07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.559093:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bba00/0x844e5faceb5e99f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbab expref: 25 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.559103:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e9a0e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbab expref: 24 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.559109:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155557.559110:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155557.559112:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903baa00, rc 0) 00000100:00100000:0.0:1746155557.559153:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+24:28744:x1830976123433600:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2542us (3060us total) trans 8589943748 rc 0/0 00000100:00100000:0.0:1746155557.559161:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9846 00000100:00100000:0.0:1746155557.565971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.566835:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123433856 00000100:00100000:1.0:1746155557.566842:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123433856 00000100:00100000:1.0:1746155557.566873:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 570 00000100:00100000:1.0:1746155557.566879:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123433856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.566896:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.566914:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903baa00/0x844e5faceb5e9a0e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbab expref: 24 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.566928:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155557.566932:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155557.566953:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123433856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 75us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.566959:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 570 00000100:00100000:0.0:1746155557.571231:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.571292:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.585594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.585637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.587441:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4204 00000100:00100000:0.0:1746155557.587449:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123434752:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155557.593871:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.600206:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.603781:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.609979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.610767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.611679:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123435520 00000100:00100000:1.0:1746155557.611683:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123435520 00000100:00100000:1.0:1746155557.612233:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11340 00000100:00100000:1.0:1746155557.612240:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123435520:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155557.612247:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.612256:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cec9c00/0x844e5faceb5e9a3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fbc0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.612268:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.612269:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.612276:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cec9c00/0x844e5faceb5e9a3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbc0 expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.612288:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cec9c00/0x844e5faceb5e9a3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbc0 expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.612296:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cec9c00, rc 0) 00000100:00100000:0.0:1746155557.612434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.612466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.612490:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.612518:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.612544:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.612629:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123435520:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 389us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.612635:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11340 00000100:00100000:1.0:1746155557.612645:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123435648 00000100:00100000:1.0:1746155557.612647:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123435648 00000100:00100000:0.0:1746155557.613088:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11343 00000100:00100000:0.0:1746155557.613095:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123435648:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155557.614212:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155557.614221:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903ba000/0x844e5faceb5e9a62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fbc7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.614232:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.614234:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.614239:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903ba000/0x844e5faceb5e9a62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbc7 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.614248:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903ba000/0x844e5faceb5e9a62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbc7 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.614255:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903ba000, rc 0) 00000100:00100000:0.0:1746155557.614276:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123435648:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 1182us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.614282:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11343 00000100:00100000:0.0:1746155557.617036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.622475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.628234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.630440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.635971:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.636033:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123437056 00000100:00100000:1.0:1746155557.636042:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123437056 00000100:00100000:1.0:1746155557.636089:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11347 00000100:00100000:1.0:1746155557.636096:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123437056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155557.636111:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.636125:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cec9600/0x844e5faceb5e9a85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fbf8 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.636149:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cec9600/0x844e5faceb5e9a85 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbf8 expref: 22 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.636158:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cec9600/0x844e5faceb5e9a85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbf8 expref: 22 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.636177:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cec9600, rc 0) 00000100:00100000:1.0:1746155557.636215:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123437056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 119us (256us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155557.636220:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11347 00000100:00100000:0.0:1746155557.638827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.641309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.641564:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123437568 00000100:00100000:1.0:1746155557.641570:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123437568 00000100:00100000:1.0:1746155557.642091:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3934 00000100:00100000:1.0:1746155557.642099:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:28738:x1830976123437568:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155557.642392:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:28738:x1830976123437568:12345-192.168.202.51@tcp:35:cat.0 Request processed in 293us (1085us total) trans 8589943753 rc 0/0 00000100:00100000:1.0:1746155557.642400:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3934 00000100:00100000:0.0:1746155557.645069:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.645934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.647819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.647856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.647880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.647902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.648861:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.648876:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123438592 00000100:00100000:0.0:1746155557.648879:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123438592 00000100:00100000:0.0:1746155557.648896:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11349 00000100:00100000:0.0:1746155557.648901:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123438336:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155557.648918:0:19959:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.648928:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b76200/0x844e5faceb5e98b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faaf expref: 28 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.648936:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903ba000/0x844e5faceb5e9a62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbc7 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.648942:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009355d400/0x844e5faceb5e9958 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb0a expref: 19 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.648947:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.648949:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.648951:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.648969:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009355d400/0x844e5faceb5e9958 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb0a expref: 19 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.648977:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009355d400/0x844e5faceb5e9958 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb0a expref: 19 pid: 9235 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746155557.648986:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094087800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124463488:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155557.649011:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800903ba000/0x844e5faceb5e9a62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbc7 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.649018:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800903ba000/0x844e5faceb5e9a62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbc7 expref: 12 pid: 8437 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746155557.649025:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124463744:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155557.649050:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093b76200/0x844e5faceb5e98b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faaf expref: 28 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.649057:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093b76200/0x844e5faceb5e98b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faaf expref: 28 pid: 18270 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746155557.649063:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124464000:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155557.649075:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155557.649088:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11351 00000100:00100000:0.0:1746155557.649093:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123438592:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155557.649106:0:20796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5e9acb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.649114:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013107b400/0x844e5faceb5e997b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb2d expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.649118:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155557.649119:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155557.649121:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5e9acb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.649776:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013107b400/0x844e5faceb5e997b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb2d expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.649785:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013107b400/0x844e5faceb5e997b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb2d expref: 20 pid: 1625 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.649792:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124464512:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155557.649823:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155557.649844:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.649866:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.650096:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11352 00000100:00100000:1.0:1746155557.650102:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123438720:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:1.0:1746155557.650119:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.650128:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7aa00/0x844e5faceb5e9982 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb34 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.650135:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7ac00/0x844e5faceb5e99f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fba4 expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.650140:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746155557.650142:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746155557.650144:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.650156:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff7ac00/0x844e5faceb5e99f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fba4 expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.650164:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7ac00/0x844e5faceb5e99f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fba4 expref: 20 pid: 18270 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.650171:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124464640:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155557.650199:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff7aa00/0x844e5faceb5e9982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2203647) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb34 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.650210:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7aa00/0x844e5faceb5e9982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2203647) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb34 expref: 20 pid: 1625 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.650217:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124464896:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155557.650229:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155557.658358:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094087800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124463488:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155557.658366:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124463744:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155557.658372:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124464000:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155557.658386:0:19959:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.659489:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123439104 00000100:00100000:1.0:1746155557.659492:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123439104 00010000:00010000:1.0:1746155557.659520:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013107b800/0x844e5faceb5e9a46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fbce expref: 15 pid: 4461 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746155557.661305:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.661318:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123440512 00000100:00100000:0.0:1746155557.661321:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123440512 00010000:00010000:0.0:1746155557.661335:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7ac00/0x844e5faceb5e99f2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fba4 expref: 21 pid: 18270 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.661350:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5634 00000100:00100000:0.0:1746155557.661355:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123440512:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.661362:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.661373:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff7ac00/0x844e5faceb5e99f2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fba4 expref: 21 pid: 18270 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.661381:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff7ac00/0x844e5faceb5e99f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fba4 expref: 21 pid: 18270 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.661393:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.661407:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123440512:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 52us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.661412:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5634 00000100:00100000:0.0:1746155557.661437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.661445:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123439744 00000100:00100000:0.0:1746155557.661447:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123439744 00010000:00010000:0.0:1746155557.661456:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0939200/0x844e5faceb5e98be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fab6 expref: 29 pid: 4461 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746155557.661468:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5635 00000100:00100000:0.0:1746155557.661472:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123439744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.661478:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.661487:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0939200/0x844e5faceb5e98be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fab6 expref: 29 pid: 4461 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.661494:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0939200/0x844e5faceb5e98be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fab6 expref: 29 pid: 4461 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.661528:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0939200/0x844e5faceb5e98be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fab6 expref: 29 pid: 4461 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746155557.661539:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155557.661554:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123439744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 81us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.661559:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5635 00000100:00100000:0.0:1746155557.661582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.661591:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123440256 00000100:00100000:0.0:1746155557.661594:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123440256 00010000:00010000:0.0:1746155557.661603:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff7b600/0x844e5faceb5e99cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb81 expref: 19 pid: 18270 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.661615:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5636 00000100:00100000:0.0:1746155557.661620:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976123440256:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.661626:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155557.661634:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff7b600/0x844e5faceb5e99cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb81 expref: 19 pid: 18270 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.661641:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff7b600/0x844e5faceb5e99cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb81 expref: 19 pid: 18270 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.661651:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff7b600/0x844e5faceb5e99cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb81 expref: 19 pid: 18270 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.661662:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155557.661904:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7ac00/0x844e5faceb5e99f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fba4 expref: 21 pid: 18270 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746155557.661918:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124464640:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155557.661927:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124464896:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155557.661940:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155557.662280:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123440256:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 658us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.662286:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5636 00000100:00100000:0.0:1746155557.662348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.662453:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.662967:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123440640 00000100:00100000:1.0:1746155557.662970:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123440640 00010000:00010000:1.0:1746155557.662983:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b76200/0x844e5faceb5e98b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faaf expref: 28 pid: 18270 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746155557.663003:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5639 00000100:00100000:1.0:1746155557.663007:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123440640:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.663014:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.663024:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b76200/0x844e5faceb5e98b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faaf expref: 28 pid: 18270 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746155557.663032:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b76200/0x844e5faceb5e98b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faaf expref: 28 pid: 18270 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746155557.663043:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b76200/0x844e5faceb5e98b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0faaf expref: 28 pid: 18270 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746155557.663052:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.663054:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.663056:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.663062:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.663075:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155557.663085:0:19959:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.663091:0:19959:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.663104:0:19959:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.663111:0:19959:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.663116:0:19959:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.663122:0:19959:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800903ba800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155557.663124:0:19959:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.663129:0:19959:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.663137:0:19959:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.663142:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903ba800/0x844e5faceb5e9abd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.663181:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123438336:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 14280us (15324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.663187:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11349 00000100:00100000:1.0:1746155557.663299:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123440640:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 291us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.663305:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5639 00000100:00100000:0.0:1746155557.673575:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123440768 00000100:00100000:0.0:1746155557.673582:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123440768 00010000:00010000:0.0:1746155557.673607:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7aa00/0x844e5faceb5e9982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb34 expref: 23 pid: 1625 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746155557.673637:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5640 00000100:00100000:0.0:1746155557.673644:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123440768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155557.673655:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746155557.673678:0:15879:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155557 -> 1746155558 00010000:00010000:0.0:1746155557.673684:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff7aa00/0x844e5faceb5e9982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb34 expref: 23 pid: 1625 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.673693:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff7aa00/0x844e5faceb5e9982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2203647) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb34 expref: 23 pid: 1625 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.673710:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7aa00/0x844e5faceb5e9982 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2203647) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fb34 expref: 23 pid: 1625 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746155557.674493:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.674496:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.674500:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.674522:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.674551:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155557.674574:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155557.674582:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123440768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 938us (1035us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155557.674583:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155557.674587:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5640 00010000:00010000:1.0:1746155557.674598:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.674605:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.674611:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.674616:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cec9e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155557.674619:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.674625:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.674635:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.674640:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cec9e00/0x844e5faceb5e9ad9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.675169:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123438720:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 25065us (25322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.675177:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11352 00000100:00100000:0.0:1746155557.683629:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.688052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.689214:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.689428:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123441408 00000100:00100000:1.0:1746155557.689432:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123441408 00000100:00100000:1.0:1746155557.689462:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3935 00000100:00100000:1.0:1746155557.689468:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:28746:x1830976123441408:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:1.0:1746155557.689631:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:28746:x1830976123441408:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 162us (416us total) trans 8589943755 rc 0/0 00000100:00100000:1.0:1746155557.689636:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3935 00000100:00100000:0.0:1746155557.691284:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.726794:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.726828:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.727087:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123441792 00000100:00100000:1.0:1746155557.727095:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123441792 00000100:00100000:1.0:1746155557.727128:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123441920 00000100:00100000:1.0:1746155557.727130:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123441920 00000100:00100000:1.0:1746155557.727468:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11354 00000100:00100000:1.0:1746155557.727476:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976123441792:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155557.727491:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.727527:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cec9200/0x844e5faceb5e9ae7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fc14 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155557.727549:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x68143825, atime: 0x68143825, ctime: 0x68143825, blocks: 0x767 00010000:00010000:1.0:1746155557.727562:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.727563:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.727570:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cec9200/0x844e5faceb5e9ae7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc14 expref: 25 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.727582:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cec9200/0x844e5faceb5e9ae7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc14 expref: 25 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.727590:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cec9200, rc 0) 00000100:00100000:0.0:1746155557.727939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.728376:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123441792:12345-192.168.202.51@tcp:101:cat.0 Request processed in 900us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.728382:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11354 00000100:00100000:1.0:1746155557.728392:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11356 00000100:00100000:1.0:1746155557.728396:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123442048:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155557.728402:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.728409:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cec9e00/0x844e5faceb5e9af5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fc22 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155557.728419:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3db:0x0] initial LVB size: 2097152, mtime: 0x68143824, atime: 0x68143824, ctime: 0x68143824, blocks: 0x81f 00010000:00010000:1.0:1746155557.728425:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.728426:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.728429:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cec9e00/0x844e5faceb5e9af5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc22 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.728437:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cec9e00/0x844e5faceb5e9af5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc22 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.728444:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cec9e00, rc 0) 00000100:00100000:0.0:1746155557.728904:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.729566:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123442048:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1169us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.729571:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11356 00000100:00100000:0.0:1746155557.751129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.751166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.751204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.751240:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123442688 00000100:00100000:0.0:1746155557.751248:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123442688 00002000:00100000:0.0:1746155557.751284:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88008e26ea00 x1830976123442688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.751292:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26ea00 with x1830976123442688 ext(0->1048575) 00002000:00010000:0.0:1746155557.751296:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26ea00 00000100:00100000:0.0:1746155557.751309:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123442944 00000100:00100000:0.0:1746155557.751312:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123442944 00002000:00100000:0.0:1746155557.751321:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88008e26e680 x1830976123442944/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.751327:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26e680 with x1830976123442944 ext(1048576->2097151) 00002000:00010000:0.0:1746155557.751329:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26e680 00000100:00100000:0.0:1746155557.751336:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123443328 00000100:00100000:0.0:1746155557.751338:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123443328 00002000:00100000:0.0:1746155557.751346:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88008e26c700 x1830976123443328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.751414:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26c700 with x1830976123443328 ext(1048576->2097151) 00002000:00010000:0.0:1746155557.751417:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26c700 00000100:00100000:0.0:1746155557.751430:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4206 00000100:00100000:0.0:1746155557.751436:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123442688:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155557.752740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.789235:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.789268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.789303:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.789337:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123443712 00000100:00100000:0.0:1746155557.789343:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123443712 00002000:00100000:0.0:1746155557.789379:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012b6c0700 x1830976123443712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.789388:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c0700 with x1830976123443712 ext(2097152->3145727) 00002000:00010000:0.0:1746155557.789393:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c0700 00000100:00100000:0.0:1746155557.789405:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123443968 00000100:00100000:0.0:1746155557.789407:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123443968 00002000:00100000:0.0:1746155557.789417:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012b6c1f80 x1830976123443968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.789424:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c1f80 with x1830976123443968 ext(3145728->4194303) 00002000:00010000:0.0:1746155557.789426:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c1f80 00000100:00100000:0.0:1746155557.789433:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123444224 00000100:00100000:0.0:1746155557.789435:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123444224 00002000:00100000:0.0:1746155557.789444:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012b6c1c00 x1830976123444224/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.789450:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c1c00 with x1830976123444224 ext(2097152->3145727) 00002000:00010000:0.0:1746155557.789453:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b6c1c00 00000100:00100000:0.0:1746155557.789462:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4210 00000100:00100000:0.0:1746155557.789468:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123443712:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155557.790604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.793606:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4213 00000100:00100000:1.0:1746155557.793613:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976123444480:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155557.813068:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.813172:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123444736 00000100:00100000:0.0:1746155557.813179:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123444736 00000100:00100000:0.0:1746155557.813218:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9853 00000100:00100000:0.0:1746155557.813225:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+25:28755:x1830976123444736:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155557.813245:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155557.813260:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cec9600/0x844e5faceb5e9b11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fc3e expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.813340:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cec9a00/0x844e5faceb5e9b18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.813351:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cec9a00/0x844e5faceb5e9b18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.813363:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cec9a00/0x844e5faceb5e9b18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.813374:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cec9800/0x844e5faceb5e9b1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.813379:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cec9800/0x844e5faceb5e9b1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155557.813384:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cec9800/0x844e5faceb5e9b1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155557.813583:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123444480:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19970us (22980us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155557.813590:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4213 00002000:00100000:1.0:1746155557.813595:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012b6c3100 x1830976123444480/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/440 e 0 to 0 dl 1746155568 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.813601:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c3100 with x1830976123444480 ext(3145728->4194303) 00002000:00010000:1.0:1746155557.813603:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b6c3100 00000100:00100000:0.0:1746155557.816039:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.816732:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123444864 00000100:00100000:1.0:1746155557.816739:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123444864 00000100:00100000:1.0:1746155557.816782:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 571 00000100:00100000:1.0:1746155557.816940:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123444864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.816955:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.816973:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094165e00/0x844e5faceb5e9b26 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc3e expref: 27 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.817000:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155557.817003:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155557.817046:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123444864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 257us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.817051:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 571 00000100:00100000:1.0:1746155557.824157:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123445120 00000100:00100000:1.0:1746155557.824165:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123445120 00002000:00100000:1.0:1746155557.824205:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4845567) req@ffff8800a62a0e00 x1830976123445120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.824215:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a0e00 with x1830976123445120 ext(4194304->4845567) 00002000:00010000:1.0:1746155557.824220:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a0e00 00000100:00100000:1.0:1746155557.824243:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4214 00000100:00100000:1.0:1746155557.824252:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123445120:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155557.833963:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123445120:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9704us (10050us total) trans 0 rc 651264/651264 00000100:00100000:1.0:1746155557.833974:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4214 00002000:00100000:1.0:1746155557.833983:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4845567) req@ffff8800a62a0e00 x1830976123445120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:628/0 lens 488/440 e 0 to 0 dl 1746155568 ref 1 fl Complete:/200/0 rc 651264/651264 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155557.833991:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a0e00 with x1830976123445120 ext(4194304->4845567) 00002000:00010000:1.0:1746155557.833996:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a0e00 00000100:00100000:0.0:1746155557.836638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.840918:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.840993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.841459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.841640:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123445504 00000100:00100000:1.0:1746155557.841644:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123445504 00010000:00010000:1.0:1746155557.841659:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cec9e00/0x844e5faceb5e9af5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc22 expref: 31 pid: 8438 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746155557.841688:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5642 00000100:00100000:1.0:1746155557.841693:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123445504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.841703:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.841720:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cec9e00/0x844e5faceb5e9af5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc22 expref: 31 pid: 8438 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746155557.841728:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cec9e00/0x844e5faceb5e9af5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc22 expref: 31 pid: 8438 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746155557.841740:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cec9e00/0x844e5faceb5e9af5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc22 expref: 31 pid: 8438 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746155557.841762:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.841763:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.841768:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013577b800/0x844e5faceb5e9b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc45 expref: 30 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.841775:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013577b800/0x844e5faceb5e9b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc45 expref: 30 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.841793:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013577b800/0x844e5faceb5e9b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc45 expref: 30 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.841802:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124465408:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155557.841822:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155557.843605:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.843688:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124465408:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155557.843697:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155557.843715:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123445504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2023us (2723us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.843723:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5642 00000100:00100000:0.0:1746155557.847216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.847259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.847939:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123446144 00000100:00100000:1.0:1746155557.847943:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123446144 00010000:00010000:1.0:1746155557.847961:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013577bc00/0x844e5faceb5e9b03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc30 expref: 29 pid: 19959 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746155557.848127:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5643 00000100:00100000:1.0:1746155557.848171:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123446144:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.848180:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.848197:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013577bc00/0x844e5faceb5e9b03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc30 expref: 29 pid: 19959 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746155557.848207:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013577bc00/0x844e5faceb5e9b03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc30 expref: 29 pid: 19959 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746155557.848222:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013577bc00/0x844e5faceb5e9b03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc30 expref: 29 pid: 19959 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746155557.848232:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.848233:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.848238:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9b42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4014079) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc53 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.848245:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4014079) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc53 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.848263:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc53 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.848271:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124465664:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155557.848319:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155557.850896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.851957:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124465664:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155557.851968:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155557.851989:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123446144:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3856us (4730us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.851995:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5643 00000100:00100000:0.0:1746155557.856220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.858697:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.862461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.862521:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123447296 00000100:00100000:1.0:1746155557.862527:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123447296 00000100:00100000:1.0:1746155557.862552:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3937 00000100:00100000:1.0:1746155557.862557:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+26:28755:x1830976123447296:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155557.862717:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+27:28755:x1830976123447296:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 159us (257us total) trans 8589943758 rc 0/0 00000100:00100000:1.0:1746155557.862724:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3937 00000100:00100000:0.0:1746155557.872734:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.878179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.879786:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.879814:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.879827:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.879841:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123447808 00000100:00100000:0.0:1746155557.879848:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123447808 00000100:00100000:0.0:1746155557.879883:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123448064 00000100:00100000:0.0:1746155557.879885:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123448064 00000100:00100000:0.0:1746155557.879896:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123447936 00000100:00100000:0.0:1746155557.879897:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123447936 00000100:00100000:0.0:1746155557.879908:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11364 00000100:00100000:0.0:1746155557.879916:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123447808:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155557.879931:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155557.879934:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11365 00000100:00100000:1.0:1746155557.879942:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123448064:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155557.879943:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cec8000/0x844e5faceb5e9b73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fc68 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.879950:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.879960:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0699200/0x844e5faceb5e9b7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fc76 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.879961:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.879963:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.879970:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cec8000/0x844e5faceb5e9b73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc68 expref: 23 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.879984:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cec8000/0x844e5faceb5e9b73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc68 expref: 23 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.879993:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cec8000, rc 0) 00000100:00100000:1.0:1746155557.879996:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124465920:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155557.880027:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123447808:12345-192.168.202.51@tcp:101:cat.0 Request processed in 112us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.880033:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11364 00000100:00100000:1.0:1746155557.880043:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155557.880045:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11366 00000100:00100000:0.0:1746155557.880050:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976123447936:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155557.880055:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155557.880061:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cec9600/0x844e5faceb5e9b81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fc6f expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155557.880071:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.880072:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155557.880076:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cec9600/0x844e5faceb5e9b81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc6f expref: 20 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.880087:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cec9600/0x844e5faceb5e9b81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc6f expref: 20 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.880093:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cec9600, rc 0) 00000100:00100000:1.0:1746155557.880097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.880107:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123447936:12345-192.168.202.51@tcp:101:cat.0 Request processed in 57us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155557.880156:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11366 00000100:00100000:0.0:1746155557.880166:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123448192 00000100:00100000:0.0:1746155557.880168:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123448192 00000100:00100000:0.0:1746155557.880181:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11367 00000100:00100000:0.0:1746155557.880186:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123448192:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155557.880190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155557.880192:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155557.880198:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cec9000/0x844e5faceb5e9b88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fc7d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.880212:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123448320 00000100:00100000:1.0:1746155557.880215:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123448320 00000100:00100000:0.0:1746155557.880220:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091009f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124466048:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155557.880234:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11368 00000100:00100000:1.0:1746155557.880240:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123448320:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155557.880243:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337480 going to sleep for 11 seconds 00010000:00010000:1.0:1746155557.880246:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155557.880252:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0698800/0x844e5faceb5e9b8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fc84 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.880263:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.880265:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.880269:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0698800/0x844e5faceb5e9b8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc84 expref: 21 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.880279:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0698800/0x844e5faceb5e9b8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc84 expref: 21 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155557.880286:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0698800, rc 0) 00000100:00100000:1.0:1746155557.880307:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123448320:12345-192.168.202.51@tcp:101:cat.0 Request processed in 67us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.880312:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11368 00002000:00010000:0.0:1746155557.882499:0:8438:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155557 -> 1746155558 00002000:00010000:0.0:1746155557.882522:0:8438:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155557 -> 1746155558 00002000:00010000:0.0:1746155557.882523:0:8438:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155557 -> 1746155558 00000100:00100000:0.0:1746155557.882535:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091009f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124466048:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155557.882553:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cec9000/0x844e5faceb5e9b88 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc7d expref: 24 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.882562:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cec9000/0x844e5faceb5e9b88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc7d expref: 24 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155557.882585:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cec9000, rc 0) 00000100:00100000:0.0:1746155557.883072:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123448192:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2883us (2973us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155557.883078:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11367 00000100:00100000:0.0:1746155557.887929:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.887962:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.888523:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4220 00000100:00100000:0.0:1746155557.888528:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976123448832:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155557.905763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.910735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.923308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.924100:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123449216 00000100:00100000:1.0:1746155557.924108:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123449216 00010000:00010000:1.0:1746155557.924140:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013577b800/0x844e5faceb5e9b34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc45 expref: 32 pid: 20200 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155557.924175:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5645 00000100:00100000:1.0:1746155557.924182:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009100b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123449216:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.924193:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.924212:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013577b800/0x844e5faceb5e9b34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc45 expref: 32 pid: 20200 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155557.924222:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013577b800/0x844e5faceb5e9b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc45 expref: 32 pid: 20200 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155557.924240:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013577b800/0x844e5faceb5e9b34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc45 expref: 32 pid: 20200 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155557.924267:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.924269:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.924275:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009355c200/0x844e5faceb5e9b96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc8b expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.924282:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009355c200/0x844e5faceb5e9b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc8b expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.924309:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009355c200/0x844e5faceb5e9b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc8b expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.924320:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124466304:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155557.924391:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155557.925790:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124466304:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155557.925803:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155557.925840:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009100b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123449216:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1658us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155557.925847:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5645 00000100:00100000:0.0:1746155557.928031:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.940418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.943821:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.961894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155557.962484:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123449856 00000100:00100000:1.0:1746155557.962493:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123449856 00010000:00010000:1.0:1746155557.962555:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094165200/0x844e5faceb5e9b49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc5a expref: 28 pid: 1625 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155557.962588:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5646 00000100:00100000:1.0:1746155557.962595:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009100b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123449856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155557.962606:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155557.962623:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094165200/0x844e5faceb5e9b49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc5a expref: 28 pid: 1625 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155557.962634:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094165200/0x844e5faceb5e9b49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc5a expref: 28 pid: 1625 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155557.962651:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094165200/0x844e5faceb5e9b49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1875967) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc5a expref: 28 pid: 1625 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155557.962687:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.962690:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155557.962696:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009361d600/0x844e5faceb5e9b9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc92 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.962703:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009361d600/0x844e5faceb5e9b9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc92 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155557.962729:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009361d600/0x844e5faceb5e9b9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc92 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155557.962740:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124466560:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155557.962807:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155557.968236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.994724:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.994763:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.994788:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.994823:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155557.994856:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123450368 00000100:00100000:0.0:1746155557.994862:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123450368 00002000:00100000:0.0:1746155557.994897:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880091009500 x1830976123450368/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.994906:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091009500 with x1830976123450368 ext(2097152->3145727) 00002000:00010000:0.0:1746155557.994911:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091009500 00000100:00100000:0.0:1746155557.994922:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123450624 00000100:00100000:0.0:1746155557.994924:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123450624 00002000:00100000:0.0:1746155557.994933:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009100a680 x1830976123450624/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 504/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.994938:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009100a680 with x1830976123450624 ext(3145728->4194303) 00002000:00010000:0.0:1746155557.994941:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009100a680 00000100:00100000:0.0:1746155557.994946:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123450880 00000100:00100000:0.0:1746155557.994948:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123450880 00002000:00100000:0.0:1746155557.994957:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009100aa00 x1830976123450880/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.994964:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009100aa00 with x1830976123450880 ext(2097152->3145727) 00002000:00010000:0.0:1746155557.994967:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009100aa00 00000100:00100000:0.0:1746155557.994979:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123451136 00000100:00100000:0.0:1746155557.994981:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123451136 00002000:00100000:0.0:1746155557.994990:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009526a680 x1830976123451136/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/0 e 0 to 0 dl 1746155568 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155557.994996:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526a680 with x1830976123451136 ext(3145728->4194303) 00002000:00010000:0.0:1746155557.994998:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526a680 00000100:00100000:0.0:1746155557.995008:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4223 00000100:00100000:0.0:1746155557.995013:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123450368:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155557.996005:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4225 00000100:00100000:0.0:1746155557.996012:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123450880:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155557.999961:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.007355:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123450368:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12332us (12629us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155558.007365:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4223 00002000:00100000:1.0:1746155558.007375:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880091009500 x1830976123450368/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:628/0 lens 488/440 e 0 to 0 dl 1746155568 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.007382:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091009500 with x1830976123450368 ext(2097152->3145727) 00002000:00010000:1.0:1746155558.007388:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091009500 00000100:00100000:1.0:1746155558.014801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.015943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.023630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.024298:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123451776 00000100:00100000:1.0:1746155558.024304:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123451776 00010000:00010000:1.0:1746155558.024325:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009361d600/0x844e5faceb5e9b9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc92 expref: 25 pid: 4461 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.024357:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5647 00000100:00100000:1.0:1746155558.024364:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123451776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.024374:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.024391:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009361d600/0x844e5faceb5e9b9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc92 expref: 25 pid: 4461 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.024400:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009361d600/0x844e5faceb5e9b9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc92 expref: 25 pid: 4461 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.024422:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009361d600/0x844e5faceb5e9b9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc92 expref: 25 pid: 4461 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.024434:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.024436:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.024441:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa00a00/0x844e5faceb5e9bc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2015231) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fca0 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.024448:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa00a00/0x844e5faceb5e9bc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2015231) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fca0 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.024473:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa00a00/0x844e5faceb5e9bc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fca0 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.024482:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124466816:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155558.024554:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155558.024910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.027234:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124466816:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155558.027248:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.027285:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123451776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2921us (3655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.027292:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5647 00000100:00100000:0.0:1746155558.027688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.031544:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.033083:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.033653:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.046463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.046640:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123453184 00000100:00100000:1.0:1746155558.046648:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123453184 00000100:00100000:1.0:1746155558.046704:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3939 00000100:00100000:1.0:1746155558.046711:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+30:28760:x1830976123453184:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155558.046879:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+31:28760:x1830976123453184:12345-192.168.202.51@tcp:35:cat.0 Request processed in 168us (422us total) trans 8589943762 rc 0/0 00000100:00100000:1.0:1746155558.046885:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3939 00000100:00100000:0.0:1746155558.063025:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.063076:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.063100:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123453312 00000100:00100000:0.0:1746155558.063107:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123453312 00000100:00100000:0.0:1746155558.063766:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11373 00000100:00100000:0.0:1746155558.063774:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123453312:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155558.063788:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155558.063802:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ffc6c00/0x844e5faceb5e9bd5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fcae expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.063820:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.063821:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.063828:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc6c00/0x844e5faceb5e9bd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcae expref: 32 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.063841:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc6c00/0x844e5faceb5e9bd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcae expref: 32 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.063851:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc6c00, rc 0) 00000100:00100000:0.0:1746155558.064782:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123453312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1009us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.064788:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11373 00000100:00100000:0.0:1746155558.086612:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.087945:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.091730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.092221:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123454080 00000100:00100000:1.0:1746155558.092227:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123454080 00010000:00010000:1.0:1746155558.092256:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0698800/0x844e5faceb5e9b8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc84 expref: 20 pid: 9235 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.092293:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5648 00000100:00100000:1.0:1746155558.092300:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123454080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.092312:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.092330:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0698800/0x844e5faceb5e9b8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc84 expref: 20 pid: 9235 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.092339:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0698800/0x844e5faceb5e9b8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc84 expref: 20 pid: 9235 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.092356:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0698800/0x844e5faceb5e9b8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc84 expref: 20 pid: 9235 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.092372:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.092403:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123454080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 103us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.092409:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5648 00000100:00100000:0.0:1746155558.095784:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.102586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.104119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.105204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.107933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.116841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.118915:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.121704:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.125983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.126043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155558.126963:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093332a00/0x844e5faceb5e9c0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.126970:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093332a00/0x844e5faceb5e9c0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155558.127003:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00000004:00200000:0.0:1746155558.127006:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155558.127018:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093332a00/0x844e5faceb5e9c0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127026:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093332a00/0x844e5faceb5e9c0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127033:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093332600/0x844e5faceb5e9bff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127039:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093332600/0x844e5faceb5e9bff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127044:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093332600/0x844e5faceb5e9bff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127049:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093332600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155558.127051:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093332600/0x844e5faceb5e9bff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127057:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093332600/0x844e5faceb5e9bff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127064:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155558.127066:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155558.127068:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093332600/0x844e5faceb5e9bff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127073:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093332600/0x844e5faceb5e9bff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127094:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093332800/0x844e5faceb5e9c06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127099:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093332800/0x844e5faceb5e9c06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127104:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093332800/0x844e5faceb5e9c06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127107:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093332800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155558.127110:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093332800/0x844e5faceb5e9c06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127114:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093332800/0x844e5faceb5e9c06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127120:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fff0d00) 00010000:00010000:0.0:1746155558.127122:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155558.127124:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093332800/0x844e5faceb5e9c06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127128:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093332800/0x844e5faceb5e9c06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.127153:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093332200/0x844e5faceb5e9bf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcd1 expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.127162:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093332a00/0x844e5faceb5e9c0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcd1 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.127168:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155558.127170:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155558.127171:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093332a00, rc 0) 00000100:00100000:0.0:1746155558.127785:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:28772:x1830976123455104:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 10097us (10948us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.127791:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9856 00000100:00100000:1.0:1746155558.130918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.130949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.130960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.130976:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123456128 00000100:00100000:1.0:1746155558.130984:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123456128 00000100:00100000:1.0:1746155558.131022:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123456384 00000100:00100000:1.0:1746155558.131024:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123456384 00000100:00100000:1.0:1746155558.131036:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123456640 00000100:00100000:1.0:1746155558.131038:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123456640 00000100:00100000:1.0:1746155558.131061:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11378 00000100:00100000:1.0:1746155558.131068:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123456128:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155558.131086:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.131100:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130385600/0x844e5faceb5e9c14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fcdf expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.131116:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.131118:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.131125:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130385600/0x844e5faceb5e9c14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcdf expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.131137:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130385600/0x844e5faceb5e9c14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcdf expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.131145:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130385600, rc 0) 00000100:00100000:1.0:1746155558.131175:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123456128:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 108us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.131180:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11378 00000100:00100000:1.0:1746155558.131190:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11379 00000100:00100000:1.0:1746155558.131194:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123456384:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155558.131202:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.131209:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130385000/0x844e5faceb5e9c1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fced expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.131217:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.131218:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.131221:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130385000/0x844e5faceb5e9c1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fced expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.131229:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130385000/0x844e5faceb5e9c1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fced expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.131235:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130385000, rc 0) 00000100:00100000:1.0:1746155558.131245:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123456384:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 51us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.131249:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11379 00000100:00100000:1.0:1746155558.131255:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11380 00000100:00100000:1.0:1746155558.131259:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123456640:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155558.131263:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.131267:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130385200/0x844e5faceb5e9c22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fcfb expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.131291:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124468096:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155558.131330:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:1.0:1746155558.131354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.131367:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123456000 00000100:00100000:1.0:1746155558.131370:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123456000 00000100:00100000:1.0:1746155558.131386:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11381 00000100:00100000:1.0:1746155558.131390:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123456000:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155558.131395:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.131402:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130384e00/0x844e5faceb5e9c29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fcd8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.131411:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.131412:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.131416:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130384e00/0x844e5faceb5e9c29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcd8 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.131424:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130384e00/0x844e5faceb5e9c29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcd8 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.131429:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130384e00, rc 0) 00000100:00100000:1.0:1746155558.131441:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123456000:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 51us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.131445:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11381 00000100:00100000:1.0:1746155558.131484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.131495:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123456256 00000100:00100000:1.0:1746155558.131497:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123456256 00000100:00100000:1.0:1746155558.131525:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11382 00000100:00100000:1.0:1746155558.131530:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123456256:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155558.131535:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.131541:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130384a00/0x844e5faceb5e9c30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fce6 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.131553:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.131554:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.131558:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130384a00/0x844e5faceb5e9c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fce6 expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.131566:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130384a00/0x844e5faceb5e9c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fce6 expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.131572:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130384a00, rc 0) 00000100:00100000:1.0:1746155558.131584:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123456256:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 54us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.131589:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11382 00000100:00100000:1.0:1746155558.131631:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.131641:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123456512 00000100:00100000:1.0:1746155558.131644:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123456512 00000100:00100000:1.0:1746155558.131654:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11383 00000100:00100000:1.0:1746155558.131658:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123456512:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155558.131677:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.131683:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130384800/0x844e5faceb5e9c37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fcf4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.131702:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124468224:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155558.131720:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332e40 going to sleep for 11 seconds 00002000:00010000:1.0:1746155558.137550:0:8438:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime: 1746155557 -> 1746155558 00002000:00010000:1.0:1746155558.137557:0:8438:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime: 1746155557 -> 1746155558 00002000:00010000:1.0:1746155558.137559:0:8438:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime: 1746155557 -> 1746155558 00000100:00100000:1.0:1746155558.137572:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124468096:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155558.137591:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130385200/0x844e5faceb5e9c22 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcfb expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.137603:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130385200/0x844e5faceb5e9c22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcfb expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.137615:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130385200, rc 0) 00000100:00100000:1.0:1746155558.137653:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123456640:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 6392us (6690us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155558.137673:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11380 00000100:00100000:0.0:1746155558.141809:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.147354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.147871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.148138:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123457152 00000100:00100000:0.0:1746155558.148141:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123457152 00000100:00100000:0.0:1746155558.148209:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11384 00000100:00100000:0.0:1746155558.148215:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:28768:x1830976123457152:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155558.148227:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155558.148237:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffc6800/0x844e5faceb5e9c4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fd09 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.148254:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9b42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4014079) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc53 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.148260:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155558.148261:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155558.148264:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc6800/0x844e5faceb5e9c4c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd09 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.148284:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4014079) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc53 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.148294:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4014079) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc53 expref: 24 pid: 1625 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746155558.148303:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124468480:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155558.148366:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155558.151536:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124468480:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155558.151560:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc6800/0x844e5faceb5e9c4c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd09 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.151574:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc6800, rc 0) 00000100:00100000:0.0:1746155558.151618:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:28768:x1830976123457152:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3402us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.151624:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11384 00000100:00100000:0.0:1746155558.159185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.163287:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.163353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.174092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.174154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.174249:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123458176 00000100:00100000:1.0:1746155558.174254:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123458176 00010000:00010000:1.0:1746155558.174277:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc53 expref: 27 pid: 1625 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.174296:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5654 00000100:00100000:1.0:1746155558.174301:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123458176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.174310:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.174317:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3559424->4014079) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc53 expref: 27 pid: 1625 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.174326:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3559424->4014079) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc53 expref: 27 pid: 1625 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.174340:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9b42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3559424->4014079) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc53 expref: 27 pid: 1625 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.174358:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.174360:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.174366:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc6800/0x844e5faceb5e9c4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd09 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.174373:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc6800/0x844e5faceb5e9c4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd09 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.174395:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffc6800/0x844e5faceb5e9c4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd09 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.174403:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124468992:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155558.174705:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155558.177117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.177145:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.177158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.177190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.177247:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123458560 00000100:00100000:1.0:1746155558.177251:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123458560 00000100:00100000:1.0:1746155558.177272:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123458816 00000100:00100000:1.0:1746155558.177274:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123458816 00000100:00100000:1.0:1746155558.177287:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11387 00000100:00100000:1.0:1746155558.177292:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1962:x1830976123458560:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155558.177302:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.177311:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9c99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fd33 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.177325:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.177327:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.177332:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9c99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd33 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.177347:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9c99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd33 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.177355:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130385200, rc 0) 00000100:00100000:1.0:1746155558.177374:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1962:x1830976123458560:12345-192.168.202.51@tcp:101:cat.0 Request processed in 82us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.177379:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11387 00000100:00100000:1.0:1746155558.177390:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11389 00000100:00100000:1.0:1746155558.177394:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1962:x1830976123458688:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155558.177399:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.177405:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130385c00/0x844e5faceb5e9ca7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fd3a expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.177413:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.177415:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.177418:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130385c00/0x844e5faceb5e9ca7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd3a expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.177425:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130385c00/0x844e5faceb5e9ca7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd3a expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.177431:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130385c00, rc 0) 00000100:00100000:1.0:1746155558.177443:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1962:x1830976123458688:12345-192.168.202.51@tcp:101:cat.0 Request processed in 49us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.177448:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11389 00000100:00100000:1.0:1746155558.188497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.188547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.188566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.188590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.188609:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123459328 00000100:00100000:1.0:1746155558.188615:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123459328 00002000:00100000:1.0:1746155558.188653:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (3170304->4194303) req@ffff8800a3fc4e00 x1830976123459328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/0 e 0 to 0 dl 1746155569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.188670:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4e00 with x1830976123459328 ext(3170304->4194303) 00002000:00010000:1.0:1746155558.188675:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc4e00 00000100:00100000:1.0:1746155558.188688:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123459200 00000100:00100000:1.0:1746155558.188690:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123459200 00002000:00100000:1.0:1746155558.188699:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3170303) req@ffff8800a3fc5f80 x1830976123459200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 504/0 e 0 to 0 dl 1746155569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.188705:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5f80 with x1830976123459200 ext(2097152->3170303) 00002000:00010000:1.0:1746155558.188708:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc5f80 00000100:00100000:1.0:1746155558.188714:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123459584 00000100:00100000:1.0:1746155558.188716:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123459584 00002000:00100000:1.0:1746155558.188725:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012cdec700 x1830976123459584/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/0 e 0 to 0 dl 1746155569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.188731:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec700 with x1830976123459584 ext(2097152->3145727) 00002000:00010000:1.0:1746155558.188733:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdec700 00000100:00100000:1.0:1746155558.188740:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123459712 00000100:00100000:1.0:1746155558.188742:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123459712 00002000:00100000:1.0:1746155558.188753:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094087100 x1830976123459712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/0 e 0 to 0 dl 1746155569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.188758:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087100 with x1830976123459712 ext(3145728->4194303) 00002000:00010000:1.0:1746155558.188761:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094087100 00000100:00100000:1.0:1746155558.188770:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4234 00000100:00100000:1.0:1746155558.188775:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123459328:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155558.188784:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4235 00000100:00100000:0.0:1746155558.188793:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123459200:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155558.188984:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4236 00000100:00100000:1.0:1746155558.188990:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123459584:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155558.197669:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123460224 00000100:00100000:0.0:1746155558.197676:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123460224 00000100:00100000:0.0:1746155558.197707:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11390 00000100:00100000:0.0:1746155558.197713:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123460224:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155558.197744:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc7000/0x844e5faceb5e9cc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.197757:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cec9200/0x844e5faceb5e9ae7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc14 expref: 32 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.197764:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130384e00/0x844e5faceb5e9c29 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcd8 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.197774:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cec8000/0x844e5faceb5e9b73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc68 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.197780:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.197781:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.197783:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc7000/0x844e5faceb5e9cc3 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.197804:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cec8000/0x844e5faceb5e9b73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc68 expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.197813:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cec8000/0x844e5faceb5e9b73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc68 expref: 29 pid: 8438 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746155558.197822:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124469248:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155558.197873:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130384e00/0x844e5faceb5e9c29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcd8 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.197880:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130384e00/0x844e5faceb5e9c29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcd8 expref: 11 pid: 8436 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746155558.197886:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124469376:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155558.197901:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cec9200/0x844e5faceb5e9ae7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc14 expref: 32 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.197915:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cec9200/0x844e5faceb5e9ae7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc14 expref: 32 pid: 8438 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746155558.197922:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124469504:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155558.197937:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155558.199199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.199303:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123460352 00000100:00100000:1.0:1746155558.199308:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123460352 00000100:00100000:1.0:1746155558.199344:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11391 00000100:00100000:1.0:1746155558.199350:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123460352:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155558.199384:0:19959:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130384800/0x844e5faceb5e9cca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.199397:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ccb3c00/0x844e5faceb5e9aee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc1b expref: 35 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.199406:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130385600/0x844e5faceb5e9c14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcdf expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.199413:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cec9600/0x844e5faceb5e9b81 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc6f expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.199419:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.199420:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.199422:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130384800/0x844e5faceb5e9cca lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.199446:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cec9600/0x844e5faceb5e9b81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc6f expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.199455:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cec9600/0x844e5faceb5e9b81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc6f expref: 18 pid: 8438 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.199465:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124469632:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155558.199535:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130385600/0x844e5faceb5e9c14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcdf expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.199543:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130385600/0x844e5faceb5e9c14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcdf expref: 10 pid: 8438 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.199551:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124469760:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155558.199577:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ccb3c00/0x844e5faceb5e9aee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc1b expref: 35 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.199585:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ccb3c00/0x844e5faceb5e9aee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc1b expref: 35 pid: 20796 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.199592:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094086d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124469888:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155558.199608:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155558.208879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.208912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.208940:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.208954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.209207:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123459200:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20414us (20657us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155558.209215:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4235 00002000:00100000:0.0:1746155558.209223:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3170303) req@ffff8800a3fc5f80 x1830976123459200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 504/440 e 0 to 0 dl 1746155569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155558.209231:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5f80 with x1830976123459200 ext(2097152->3170303) 00002000:00010000:0.0:1746155558.209236:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc5f80 00000100:00100000:1.0:1746155558.209494:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11393 00000100:00100000:1.0:1746155558.209522:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123460736:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155558.209543:0:20796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9cd8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.209552:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc6800/0x844e5faceb5e9c4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd09 expref: 32 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.209559:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130385c00/0x844e5faceb5e9ca7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd3a expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.209564:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.209565:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.209567:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9cd8 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.209583:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130385c00/0x844e5faceb5e9ca7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd3a expref: 29 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.209591:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130385c00/0x844e5faceb5e9ca7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd3a expref: 29 pid: 8438 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.209599:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124470144:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155558.210604:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11395 00000100:00100000:0.0:1746155558.210609:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123460864:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155558.210623:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009364bc00/0x844e5faceb5e9cdf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.210633:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132b99800/0x844e5faceb5e9bea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2162687) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcc3 expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.210643:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155558.210644:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155558.210646:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009364bc00/0x844e5faceb5e9cdf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.210669:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132b99800/0x844e5faceb5e9bea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2162687) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcc3 expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.210676:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132b99800/0x844e5faceb5e9bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2162687) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcc3 expref: 33 pid: 4461 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746155558.210684:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124470400:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155558.210703:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155558.210728:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124469248:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155558.210772:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124469376:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155558.210840:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123459584:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21849us (22271us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155558.210847:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4236 00002000:00100000:1.0:1746155558.210853:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012cdec700 x1830976123459584/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/440 e 0 to 0 dl 1746155569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.210866:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec700 with x1830976123459584 ext(2097152->3145727) 00010000:00010000:1.0:1746155558.210871:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc6800/0x844e5faceb5e9c4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd09 expref: 31 pid: 8436 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.210880:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ffc6800/0x844e5faceb5e9c4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd09 expref: 31 pid: 8436 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746155558.210886:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdec700 00000100:00100000:0.0:1746155558.211552:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124469504:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155558.211569:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ffc7000/0x844e5faceb5e9cc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.219081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.219116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.219129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.219141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.219206:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.219234:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123461120 00000100:00100000:1.0:1746155558.219238:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123461120 00010000:00010000:1.0:1746155558.219262:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130384e00/0x844e5faceb5e9c29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcd8 expref: 14 pid: 8436 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746155558.219439:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5658 00000100:00100000:0.0:1746155558.219444:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123461376:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155558.219451:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155558.219458:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cec9200/0x844e5faceb5e9ae7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc14 expref: 31 pid: 8438 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746155558.219466:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cec9200/0x844e5faceb5e9ae7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc14 expref: 31 pid: 8438 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746155558.219476:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cec9200/0x844e5faceb5e9ae7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fc14 expref: 31 pid: 8438 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746155558.219487:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.219489:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.219492:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc7000/0x844e5faceb5e9cc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.219517:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc7000/0x844e5faceb5e9cc3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.219534:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.220795:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123459712:12345-192.168.202.51@tcp:3:cat.0 Request processed in 31730us (32203us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155558.220802:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4237 00002000:00100000:1.0:1746155558.220809:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094087100 x1830976123459712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/440 e 0 to 0 dl 1746155569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.220816:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087100 with x1830976123459712 ext(3145728->4194303) 00010000:00010000:1.0:1746155558.220822:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc6800/0x844e5faceb5e9c4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd09 expref: 29 pid: 8436 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.220830:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ffc6800/0x844e5faceb5e9c4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd09 expref: 29 pid: 8436 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746155558.220835:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094087100 00000100:00100000:1.0:1746155558.220843:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123461888 00000100:00100000:1.0:1746155558.220846:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123461888 00002000:00100000:1.0:1746155558.220858:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2138112->2162687) req@ffff8800a62a3b80 x1830976123461888/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/0 e 0 to 0 dl 1746155569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.220863:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a3b80 with x1830976123461888 ext(2138112->2162687) 00010000:00010000:1.0:1746155558.220867:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132b99800/0x844e5faceb5e9bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2162687) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcc3 expref: 33 pid: 4461 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.220873:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132b99800/0x844e5faceb5e9bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2162687) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcc3 expref: 33 pid: 4461 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746155558.220877:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a62a3b80 00000100:00100000:1.0:1746155558.220886:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 621 00000100:00100000:1.0:1746155558.220890:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123461888:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155558.221014:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123461376:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1569us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.221019:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5658 00000100:00100000:0.0:1746155558.222472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.222489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.222557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.222593:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.224367:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.226683:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123461888:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5787us (6199us total) trans 17179873081 rc 0/0 00000100:00100000:1.0:1746155558.226692:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 621 00002000:00100000:1.0:1746155558.226699:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2138112->2162687) req@ffff8800a62a3b80 x1830976123461888/t17179873081(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/448 e 0 to 0 dl 1746155569 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.226707:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a3b80 with x1830976123461888 ext(2138112->2162687) 00010000:00010000:1.0:1746155558.226716:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880132b99800/0x844e5faceb5e9bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2162687) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcc3 expref: 32 pid: 4461 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.226727:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880132b99800/0x844e5faceb5e9bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2162687) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fcc3 expref: 32 pid: 4461 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746155558.226734:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a62a3b80 00000100:00100000:0.0:1746155558.228929:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.228976:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155558.229186:0:20796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9cd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.229198:0:20796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9cd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.229214:0:20796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9cd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.229221:0:20796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9cd8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.229227:0:20796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9cd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.229232:0:20796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094165400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155558.229236:0:20796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9cd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.229242:0:20796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9cd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.229251:0:20796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9cd8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.229257:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5e9cd8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155558.229291:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123460736:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 19790us (20376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.229297:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11393 00000100:00100000:0.0:1746155558.229460:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11396 00000100:00100000:0.0:1746155558.229467:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:28768:x1830976123462656:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155558.229478:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155558.229488:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009364a600/0x844e5faceb5e9ced lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fd48 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.229537:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155558.229540:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009364bc00/0x844e5faceb5e9cdf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.229546:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746155558.229549:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009364a600/0x844e5faceb5e9ced lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd48 expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.229560:0:20796:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88009364bc00/0x844e5faceb5e9cdf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.230346:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009364a600/0x844e5faceb5e9ced lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd48 expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.230358:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009364a600, rc 0) 00000100:00100000:0.0:1746155558.231081:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:28768:x1830976123462656:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1613us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.231087:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11396 00000100:00100000:0.0:1746155558.235332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.236792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.236821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.236852:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.236879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.236905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.236940:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.239960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.240236:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123463808 00000100:00100000:1.0:1746155558.240241:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123463808 00010000:00010000:1.0:1746155558.240264:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9c99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd33 expref: 28 pid: 8438 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.240859:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5669 00000100:00100000:1.0:1746155558.240867:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123463808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.240876:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.240888:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9c99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd33 expref: 28 pid: 8438 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.240898:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9c99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd33 expref: 28 pid: 8438 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.240911:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9c99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd33 expref: 28 pid: 8438 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.240923:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.240924:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.240927:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938a0400/0x844e5faceb5e9ce6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.240939:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938a0400/0x844e5faceb5e9ce6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.240964:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.240979:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123463808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 114us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.240984:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5669 00000100:00100000:0.0:1746155558.243388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.243458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.248214:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.264648:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.268646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.268686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.268708:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.268736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.272402:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.272417:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.272475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.272527:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123465472 00000100:00100000:0.0:1746155558.272534:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123465472 00010000:00010000:0.0:1746155558.272561:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8c00/0x844e5faceb5e9553 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8b7 expref: 33 pid: 19870 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746155558.272580:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123465728 00000100:00100000:0.0:1746155558.272582:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123465728 00010000:00010000:0.0:1746155558.272590:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009475ae00/0x844e5faceb5e953e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8a2 expref: 34 pid: 14232 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746155558.272600:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123465600 00000100:00100000:0.0:1746155558.272602:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123465600 00010000:00010000:0.0:1746155558.272610:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8a00/0x844e5faceb5e9545 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8a9 expref: 301 pid: 27374 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746155558.272627:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5674 00000100:00100000:0.0:1746155558.272633:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1963:x1830976123465472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155558.272644:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155558.272648:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8c00/0x844e5faceb5e9553 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8b7 expref: 34 pid: 19870 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746155558.272668:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8c00/0x844e5faceb5e9553 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8b7 expref: 34 pid: 19870 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746155558.272688:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155558.272692:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.272699:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155558.272731:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1963:x1830976123465472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 98us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.272737:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5674 00000100:00100000:0.0:1746155558.272751:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5675 00000100:00100000:0.0:1746155558.272755:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1963:x1830976123465728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155558.272762:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155558.272766:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009475ae00/0x844e5faceb5e953e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8a2 expref: 33 pid: 14232 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746155558.272772:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009475ae00/0x844e5faceb5e953e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8a2 expref: 33 pid: 14232 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746155558.272785:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155558.272788:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.272793:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155558.272806:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1963:x1830976123465728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.272811:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5675 00000100:00100000:0.0:1746155558.272819:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5676 00000100:00100000:0.0:1746155558.272824:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1963:x1830976123465600:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155558.272830:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155558.272833:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8a00/0x844e5faceb5e9545 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8a9 expref: 301 pid: 27374 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746155558.272841:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe8a00/0x844e5faceb5e9545 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0f8a9 expref: 301 pid: 27374 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746155558.272849:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155558.272852:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.272859:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.272864:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.272878:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155558.272891:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1963:x1830976123465600:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 66us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.272895:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5676 00000100:00100000:0.0:1746155558.276680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.282913:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.283119:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123465984 00000100:00100000:1.0:1746155558.283126:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123465984 00000100:00100000:1.0:1746155558.283158:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9863 00000100:00100000:1.0:1746155558.283165:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:28768:x1830976123465984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155558.283184:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.283197:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ac00/0x844e5faceb5e9d41 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fd87 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.283237:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155558.283245:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ac00/0x844e5faceb5e9d41 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd87 expref: 301 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.283258:0:14234:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155558.283267:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ac00/0x844e5faceb5e9d41 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd87 expref: 301 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.283278:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155558.283281:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155558.283283:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ac00/0x844e5faceb5e9d41 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd87 expref: 301 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.283289:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009364ac00, rc 0) 00000100:00100000:1.0:1746155558.283306:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:28768:x1830976123465984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 142us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.283311:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9863 00000100:00100000:1.0:1746155558.293675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000001:00080000:1.0:1746155558.302170:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943748 is committed 00000001:00080000:1.0:1746155558.302187:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943730 is committed 00000001:00080000:1.0:1746155558.302195:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943762 is committed 00000001:00080000:1.0:1746155558.302200:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943755 is committed 00000001:00080000:1.0:1746155558.302206:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943741 is committed 00000001:00080000:1.0:1746155558.302226:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943767 is committed 00000004:00080000:1.0:1746155558.302229:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1977 committed 00000004:00080000:1.0:1746155558.302693:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2034 committed 00000004:00080000:1.0:1746155558.302698:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2033 committed 00000004:00080000:1.0:1746155558.302701:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2032 committed 00000004:00080000:1.0:1746155558.302702:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2031 committed 00000004:00080000:1.0:1746155558.302703:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1976 committed 00000004:00080000:1.0:1746155558.302705:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2030 committed 00000004:00080000:1.0:1746155558.302706:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1975 committed 00000004:00080000:1.0:1746155558.302707:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2029 committed 00000004:00080000:1.0:1746155558.302708:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1974 committed 00000004:00080000:1.0:1746155558.302710:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1973 committed 00000004:00080000:1.0:1746155558.302712:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1972 committed 00000004:00080000:1.0:1746155558.302713:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2028 committed 00000004:00080000:1.0:1746155558.302715:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2027 committed 00000004:00080000:1.0:1746155558.302716:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1971 committed 00000004:00080000:1.0:1746155558.302717:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1970 committed 00000004:00080000:1.0:1746155558.302719:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2026 committed 00000001:00080000:1.0:1746155558.302724:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943765 is committed 00000001:00080000:1.0:1746155558.302728:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943763 is committed 00010000:00010000:1.0:1746155558.302785:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155558.302791:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155558.302797:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155558.302802:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938a0800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155558.302805:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155558.302810:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155558.302822:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155558.302825:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155558.302829:0:3282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ac00/0x844e5faceb5e9d41 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd87 expref: 285 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.302837:0:3282:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ac00/0x844e5faceb5e9d41 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd87 expref: 285 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.302843:0:3282:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ac00/0x844e5faceb5e9d41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd87 expref: 285 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.302851:0:3282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76e00/0x844e5faceb5e9d4f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd95 expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.302857:0:3282:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76e00/0x844e5faceb5e9d4f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd95 expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.302863:0:3282:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76e00/0x844e5faceb5e9d4f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd95 expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.302881:0:3282:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76e00/0x844e5faceb5e9d4f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd95 expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.302889:0:3282:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3282:1830976124472448:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155558.302914:0:3282:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ac00/0x844e5faceb5e9d41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd87 expref: 285 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.302921:0:3282:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3282:1830976124472576:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155558.302933:0:3282:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155558.303193:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124473088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.303226:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303242:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124473600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.303255:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303263:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124474112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.303276:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303286:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124474624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.303296:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303308:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746155558.303312:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124472704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.303322:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303331:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124473216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.303342:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303351:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124473728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.303361:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303370:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124474240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.303381:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303395:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124472832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.303407:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303417:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124473344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.303428:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303438:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124473856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.303448:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303456:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124474368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.303467:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303476:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746155558.303480:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124472960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.303491:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303496:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124473472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.303530:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303537:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124473984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.303549:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303555:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124474496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.303565:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.303580:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124473088 00000100:00100000:0.0:1746155558.303585:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124473088 00000100:00100000:0.0:1746155558.303612:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124473600 00000100:00100000:0.0:1746155558.303614:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124473600 00000100:00100000:0.0:1746155558.303620:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124474112 00000100:00100000:0.0:1746155558.303621:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124474112 00000100:00100000:0.0:1746155558.303630:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124474624 00000100:00100000:0.0:1746155558.303631:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124474624 00000100:00100000:0.0:1746155558.303637:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124472704 00000100:00100000:0.0:1746155558.303638:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124472704 00000100:00100000:0.0:1746155558.303645:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124473216 00000100:00100000:0.0:1746155558.303646:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124473216 00000100:00100000:0.0:1746155558.303652:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124473728 00000100:00100000:0.0:1746155558.303653:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124473728 00000100:00100000:0.0:1746155558.303672:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124474240 00000100:00100000:0.0:1746155558.303674:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124474240 00000100:00100000:0.0:1746155558.303680:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124472832 00000100:00100000:0.0:1746155558.303681:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124472832 00000100:00100000:0.0:1746155558.303687:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124473344 00000100:00100000:0.0:1746155558.303688:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124473344 00000100:00100000:0.0:1746155558.303693:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124473856 00000100:00100000:0.0:1746155558.303695:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124473856 00000100:00100000:0.0:1746155558.303700:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124474368 00000100:00100000:0.0:1746155558.303702:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124474368 00000100:00100000:0.0:1746155558.303708:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124472960 00000100:00100000:0.0:1746155558.303709:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124472960 00000100:00100000:0.0:1746155558.303715:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124473472 00000100:00100000:0.0:1746155558.303716:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124473472 00000100:00100000:0.0:1746155558.303722:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124473984 00000100:00100000:0.0:1746155558.303723:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124473984 00000100:00100000:0.0:1746155558.303728:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124474496 00000100:00100000:0.0:1746155558.303730:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124474496 00000100:00100000:0.0:1746155558.303738:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11405 00000100:00100000:0.0:1746155558.303744:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3295:x1830976124473088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.303915:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3295:x1830976124473088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (688us total) trans 17179873082 rc 0/0 00000100:00100000:0.0:1746155558.303921:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11405 00000100:00100000:0.0:1746155558.303932:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11406 00000100:00100000:0.0:1746155558.303937:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3295:x1830976124473600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.304009:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3295:x1830976124473600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (752us total) trans 17179873083 rc 0/0 00000100:00100000:0.0:1746155558.304014:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11406 00000100:00100000:0.0:1746155558.304023:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11407 00000100:00100000:0.0:1746155558.304027:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3295:x1830976124474112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155558.304112:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:0.0:1746155558.304115:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155558.304118:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155558.304119:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155558.304121:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:0.0:1746155558.304138:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976124474112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (861us total) trans 21474840465 rc 0/0 00000100:00100000:0.0:1746155558.304143:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11407 00000100:00100000:0.0:1746155558.304151:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11408 00000100:00100000:0.0:1746155558.304155:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3295:x1830976124474624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.304224:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976124474624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (926us total) trans 21474840466 rc 0/0 00000100:00100000:0.0:1746155558.304229:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11408 00000100:00100000:0.0:1746155558.304238:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11409 00000100:00100000:0.0:1746155558.304242:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3295:x1830976124472704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155558.304306:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155558.304308:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155557 -> 1746155557 00002000:00010000:0.0:1746155558.304310:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155557 -> 1746155557 00002000:00010000:0.0:1746155558.304312:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155557 -> 1746155557 00002000:00010000:0.0:1746155558.304314:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155558.304330:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3295:x1830976124472704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (1006us total) trans 17179873084 rc 0/0 00000100:00100000:0.0:1746155558.304335:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11409 00000100:00100000:0.0:1746155558.304344:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11410 00000100:00100000:0.0:1746155558.304348:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3295:x1830976124473216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.304419:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3295:x1830976124473216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1075us total) trans 17179873085 rc 0/0 00000100:00100000:0.0:1746155558.304424:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11410 00000100:00100000:0.0:1746155558.304432:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11411 00000100:00100000:0.0:1746155558.304436:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3295:x1830976124473728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155558.304497:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155558.304500:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155557 -> 1746155557 00002000:00010000:0.0:1746155558.304522:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155557 -> 1746155557 00002000:00010000:0.0:1746155558.304524:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155557 -> 1746155557 00002000:00010000:0.0:1746155558.304525:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:0.0:1746155558.304543:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976124473728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (1181us total) trans 21474840467 rc 0/0 00000100:00100000:0.0:1746155558.304549:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11411 00000100:00100000:0.0:1746155558.304557:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11412 00000100:00100000:0.0:1746155558.304562:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3295:x1830976124474240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.304628:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976124474240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1246us total) trans 21474840468 rc 0/0 00000100:00100000:0.0:1746155558.304633:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11412 00000100:00100000:0.0:1746155558.304641:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11413 00000100:00100000:0.0:1746155558.304645:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3297:x1830976124472832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155558.304725:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155558.304728:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.304730:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155556 -> 1746155556 00002000:00010000:0.0:1746155558.304731:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.304734:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155558.304755:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976124472832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (1347us total) trans 17179873086 rc 0/0 00000100:00100000:0.0:1746155558.304760:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11413 00000100:00100000:0.0:1746155558.304769:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11414 00000100:00100000:0.0:1746155558.304773:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3297:x1830976124473344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.304840:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976124473344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1411us total) trans 17179873087 rc 0/0 00000100:00100000:0.0:1746155558.304845:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11414 00000100:00100000:0.0:1746155558.304854:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11415 00000100:00100000:0.0:1746155558.304858:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3297:x1830976124473856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.304930:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3297:x1830976124473856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (1481us total) trans 21474840469 rc 0/0 00000100:00100000:0.0:1746155558.304935:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11415 00000100:00100000:0.0:1746155558.304944:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11416 00000100:00100000:0.0:1746155558.304948:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3297:x1830976124474368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.305013:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3297:x1830976124474368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (1545us total) trans 21474840470 rc 0/0 00000100:00100000:0.0:1746155558.305018:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11416 00000100:00100000:0.0:1746155558.305026:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11417 00000100:00100000:0.0:1746155558.305030:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3297:x1830976124472960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155558.305091:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155558.305093:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.305095:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155558 -> 1746155557 00002000:00010000:0.0:1746155558.305096:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.305098:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155558.305115:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976124472960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (1623us total) trans 17179873088 rc 0/0 00000100:00100000:0.0:1746155558.305120:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11417 00000100:00100000:0.0:1746155558.305128:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11418 00000100:00100000:0.0:1746155558.305132:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3297:x1830976124473472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.305200:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976124473472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1669us total) trans 17179873089 rc 0/0 00000100:00100000:0.0:1746155558.305205:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11418 00000100:00100000:0.0:1746155558.305213:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11419 00000100:00100000:0.0:1746155558.305218:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3297:x1830976124473984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155558.305278:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4844352 -> 4844352 00002000:00010000:0.0:1746155558.305281:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.305282:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.305283:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.305285:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 4959 -> 4959 00000100:00100000:0.0:1746155558.305301:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3297:x1830976124473984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1752us total) trans 21474840471 rc 0/0 00000100:00100000:0.0:1746155558.305305:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11419 00000100:00100000:0.0:1746155558.305323:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11420 00000100:00100000:0.0:1746155558.305327:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3297:x1830976124474496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.305403:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3297:x1830976124474496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (1836us total) trans 21474840472 rc 0/0 00000100:00100000:0.0:1746155558.305407:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11420 00000100:00080000:0.0:1746155558.305448:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746155558.305452:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746155558.305479:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb69180/2, rc 0, transno 17179873088 00000100:00100000:0.0:1746155558.305484:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124472960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155558.305492:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131495500/2, rc 0, transno 17179873089 00000100:00100000:0.0:1746155558.305494:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124473472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155558.305521:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800948e4380/2, rc 0, transno 21474840471 00000100:00100000:0.0:1746155558.305529:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124473984:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155558.305537:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800948e4700/2, rc 0, transno 21474840472 00000100:00100000:0.0:1746155558.305539:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124474496:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155558.305544:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b880e00/2, rc 0, transno 17179873086 00000100:00100000:0.0:1746155558.305547:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124472832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155558.305551:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131495180/2, rc 0, transno 17179873087 00000100:00100000:0.0:1746155558.305554:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124473344:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155558.305558:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800948e5180/2, rc 0, transno 21474840469 00000100:00100000:0.0:1746155558.305560:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124473856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155558.305565:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800948e6300/2, rc 0, transno 21474840470 00000100:00100000:0.0:1746155558.305567:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124474368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155558.305605:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b882d80/2, rc 0, transno 17179873084 00000100:00100000:0.0:1746155558.305608:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124472704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155558.305612:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb68000/2, rc 0, transno 17179873085 00000100:00100000:0.0:1746155558.305614:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124473216:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155558.305619:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800948e6a00/2, rc 0, transno 21474840467 00000100:00100000:0.0:1746155558.305621:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124473728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155558.305627:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800948e5f80/2, rc 0, transno 21474840468 00000100:00100000:0.0:1746155558.305629:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124474240:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155558.305634:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb6bb80/2, rc 0, transno 17179873082 00000100:00100000:0.0:1746155558.305636:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124473088:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155558.305641:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131495f80/2, rc 0, transno 17179873083 00000100:00100000:0.0:1746155558.305643:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124473600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155558.305647:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800948e7800/2, rc 0, transno 21474840465 00000100:00100000:0.0:1746155558.305649:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124474112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155558.305653:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800948e5500/2, rc 0, transno 21474840466 00000100:00100000:0.0:1746155558.305655:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124474624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.305670:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746155558.305675:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124474752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.305695:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.305713:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124474752 00000100:00100000:0.0:1746155558.305717:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124474752 00000100:00100000:0.0:1746155558.305732:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11421 00000100:00100000:0.0:1746155558.305736:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976124474752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.305812:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3295:x1830976124474752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (115us total) trans 21474840473 rc 0/0 00000100:00100000:0.0:1746155558.305817:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11421 00000004:00080000:0.0:1746155558.305836:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910db100/2, rc 0, transno 21474840473 00000100:00100000:0.0:1746155558.305839:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124474752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.310202:0:3282:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3282:1830976124472448:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155558.310286:0:3282:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3282:1830976124472576:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155558.310305:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155558.310313:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0800/0x844e5faceb5e9d1e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155558.310594:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.310700:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.311249:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123466368 00000100:00100000:1.0:1746155558.311255:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123466368 00010000:00010000:1.0:1746155558.311279:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093333800/0x844e5faceb5e9cb5 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd2c expref: 7 pid: 15474 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.312332:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5677 00000100:00100000:1.0:1746155558.312339:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123466368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.312351:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.312357:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093333800/0x844e5faceb5e9cb5 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd2c expref: 7 pid: 15474 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.312366:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093333800/0x844e5faceb5e9cb5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd2c expref: 7 pid: 15474 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.312382:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093333800/0x844e5faceb5e9cb5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd2c expref: 7 pid: 15474 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.312392:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155558.312396:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0698e00/0x844e5faceb5e9d56 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155558.312403:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0698e00/0x844e5faceb5e9d56 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155558.312407:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0698e00/0x844e5faceb5e9d56 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155558.312703:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.312721:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123466368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 383us (2128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.312726:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5677 00000100:00100000:0.0:1746155558.312956:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.312994:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.313064:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123466624 00000100:00100000:1.0:1746155558.313068:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123466624 00000100:00100000:1.0:1746155558.313086:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123466752 00000100:00100000:1.0:1746155558.313087:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123466752 00000100:00100000:1.0:1746155558.313099:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3941 00000100:00100000:1.0:1746155558.313103:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:28768:x1830976123466624:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:1.0:1746155558.313153:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:28768:x1830976123466624:12345-192.168.202.51@tcp:49:cat.0 Request processed in 49us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.313494:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3941 00000100:00100000:0.0:1746155558.317902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.317968:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123467008 00000100:00100000:1.0:1746155558.317976:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123467008 00000100:00100000:1.0:1746155558.318008:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3943 00000100:00100000:1.0:1746155558.318015:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:28772:x1830976123467008:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:1.0:1746155558.318171:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28772:x1830976123467008:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 156us (274us total) trans 8589943769 rc 0/0 00000100:00100000:1.0:1746155558.318177:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3943 00000100:00100000:0.0:1746155558.323380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.327689:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.327729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.327952:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4241 00000100:00100000:0.0:1746155558.327960:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123467648:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155558.344159:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.347735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.347771:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.350461:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123467648:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22498us (22773us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155558.350470:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4241 00002000:00100000:0.0:1746155558.350477:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800910d8700 x1830976123467648/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/440 e 0 to 0 dl 1746155569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155558.350485:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8700 with x1830976123467648 ext(3145728->4194303) 00002000:00010000:0.0:1746155558.350490:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910d8700 00000100:00100000:0.0:1746155558.364005:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.364054:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.364093:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.364104:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.364162:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.364176:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123469056 00000100:00100000:0.0:1746155558.364179:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123469056 00000100:00100000:0.0:1746155558.364195:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123469312 00000100:00100000:0.0:1746155558.364197:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123469312 00000100:00100000:0.0:1746155558.364205:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123468928 00000100:00100000:0.0:1746155558.364207:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123468928 00000100:00100000:0.0:1746155558.364214:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123469184 00000100:00100000:0.0:1746155558.364216:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123469184 00000100:00100000:0.0:1746155558.364225:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11422 00000100:00100000:0.0:1746155558.364229:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123469056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155558.364236:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155558.364244:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130384800/0x844e5faceb5e9d79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fdb1 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.364257:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.364259:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.364264:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130384800/0x844e5faceb5e9d79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdb1 expref: 34 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.364275:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130384800/0x844e5faceb5e9d79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdb1 expref: 34 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.364284:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130384800, rc 0) 00000100:00100000:0.0:1746155558.364315:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123469056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.364320:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11422 00000100:00100000:0.0:1746155558.364332:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11423 00000100:00100000:0.0:1746155558.364336:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123469312:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155558.364342:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155558.364350:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130384a00/0x844e5faceb5e9d8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fdbf expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155558.364363:0:10591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x68143826, atime: 0x68143826, ctime: 0x68143826, blocks: 0x821 00010000:00010000:0.0:1746155558.364372:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.364373:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.364376:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130384a00/0x844e5faceb5e9d8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdbf expref: 29 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.364384:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130384a00/0x844e5faceb5e9d8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdbf expref: 29 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.364390:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130384a00, rc 0) 00000100:00100000:0.0:1746155558.364403:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123469312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 67us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.364407:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11423 00000100:00100000:0.0:1746155558.364416:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11424 00000100:00100000:0.0:1746155558.364420:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123468928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155558.364424:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155558.364430:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9d9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fdaa expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.364438:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.364439:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.364442:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdaa expref: 29 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.364450:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdaa expref: 29 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.364456:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130385200, rc 0) 00000100:00100000:0.0:1746155558.364467:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123468928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 46us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.364471:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11424 00000100:00100000:0.0:1746155558.364479:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11425 00000100:00100000:0.0:1746155558.364483:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123469184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155558.364487:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155558.364492:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9da3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fdb8 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.364499:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.364523:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155558.364527:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9da3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdb8 expref: 34 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.364536:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9da3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdb8 expref: 34 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155558.364547:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130385000, rc 0) 00000100:00100000:0.0:1746155558.364560:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123469184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 77us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.364564:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11425 00000100:00100000:0.0:1746155558.372113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.372159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.372174:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123469440 00000100:00100000:1.0:1746155558.372182:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123469440 00000100:00100000:1.0:1746155558.372224:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11426 00000100:00100000:1.0:1746155558.372231:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123469440:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155558.372244:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.372256:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093333c00/0x844e5faceb5e9daa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fdc6 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.372274:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.372275:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.372282:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093333c00/0x844e5faceb5e9daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdc6 expref: 28 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.372293:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093333c00/0x844e5faceb5e9daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdc6 expref: 28 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.372301:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093333c00, rc 0) 00000100:00100000:1.0:1746155558.372345:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123469440:12345-192.168.202.51@tcp:101:cat.0 Request processed in 114us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.372350:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11426 00000100:00100000:0.0:1746155558.376260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.388791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.388927:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123470208 00000100:00100000:1.0:1746155558.388936:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123470208 00000100:00100000:1.0:1746155558.388987:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3945 00000100:00100000:1.0:1746155558.388995:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:28768:x1830976123470208:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155558.389186:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:28768:x1830976123470208:12345-192.168.202.51@tcp:35:cat.0 Request processed in 191us (402us total) trans 8589943772 rc 0/0 00000100:00100000:1.0:1746155558.389192:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3945 00000100:00100000:0.0:1746155558.391019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.415543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.424223:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.425342:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123470848 00000100:00100000:1.0:1746155558.425350:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123470848 00010000:00010000:1.0:1746155558.425379:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76600/0x844e5faceb5e9d87 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fda3 expref: 289 pid: 15474 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.425415:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5678 00000100:00100000:1.0:1746155558.425422:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1960:x1830976123470848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.425436:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.425441:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76600/0x844e5faceb5e9d87 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fda3 expref: 289 pid: 15474 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.425449:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76600/0x844e5faceb5e9d87 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fda3 expref: 289 pid: 15474 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.425468:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76600/0x844e5faceb5e9d87 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fda3 expref: 289 pid: 15474 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.425483:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155558.425488:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.425494:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.425499:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.425567:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1960:x1830976123470848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 144us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.425574:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5678 00000100:00100000:1.0:1746155558.425630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.425729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.425744:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123471104 00000100:00100000:1.0:1746155558.425747:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123471104 00010000:00010000:1.0:1746155558.425758:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ac00/0x844e5faceb5e9d41 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd87 expref: 288 pid: 14234 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.425770:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123470976 00000100:00100000:1.0:1746155558.425772:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123470976 00010000:00010000:1.0:1746155558.425779:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77200/0x844e5faceb5e9d5d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd9c expref: 9 pid: 27374 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.425791:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5679 00000100:00100000:1.0:1746155558.425796:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1960:x1830976123471104:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.425801:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.425804:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ac00/0x844e5faceb5e9d41 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd87 expref: 288 pid: 14234 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.425811:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ac00/0x844e5faceb5e9d41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd87 expref: 288 pid: 14234 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.425820:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ac00/0x844e5faceb5e9d41 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd87 expref: 288 pid: 14234 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.425828:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155558.425830:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.425835:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.425839:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.425856:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1960:x1830976123471104:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 60us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.425861:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5679 00000100:00100000:1.0:1746155558.425871:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5680 00000100:00100000:1.0:1746155558.425875:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123470976:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.425881:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.425884:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77200/0x844e5faceb5e9d5d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd9c expref: 9 pid: 27374 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.425891:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77200/0x844e5faceb5e9d5d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd9c expref: 9 pid: 27374 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.425901:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77200/0x844e5faceb5e9d5d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd9c expref: 9 pid: 27374 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.425913:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155558.425916:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.425921:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.425927:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.425942:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.425967:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123470976:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 92us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.425972:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5680 00010000:00010000:1.0:1746155558.426037:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.426042:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000040:00080000:1.0:1746155558.427360:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2835, 88 off236856 00000004:00080000:1.0:1746155558.427367:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687576863623ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155558.428131:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2785, 88 off232192 00000004:00080000:1.0:1746155558.428137:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687577633986ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155558.429197:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2786, 88 off232280 00000004:00080000:1.0:1746155558.429202:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687578699075ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155558.430585:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2836, 88 off236944 00000004:00080000:1.0:1746155558.430592:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687580088836ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155558.430607:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2837, 88 off237032 00000004:00080000:1.0:1746155558.430610:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687580107261ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155558.430619:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2787, 88 off232368 00000004:00080000:1.0:1746155558.430622:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687580119024ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155558.430629:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2788, 88 off232456 00000004:00080000:1.0:1746155558.430631:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687580128052ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155558.430637:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2789, 88 off232544 00000004:00080000:1.0:1746155558.430639:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687580136059ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155558.430645:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2838, 88 off237120 00000004:00080000:1.0:1746155558.430647:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687580144459ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155558.430654:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2790, 88 off232632 00000004:00080000:1.0:1746155558.430656:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687580153254ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155558.430678:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2839, 88 off237208 00000004:00080000:1.0:1746155558.430681:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687580178129ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155558.430688:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2791, 88 off232720 00000004:00080000:1.0:1746155558.430690:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687580187022ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155558.430696:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2840, 88 off237296 00000004:00080000:1.0:1746155558.430698:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687580195421ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155558.430704:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2841, 88 off237384 00000004:00080000:1.0:1746155558.430706:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687580203549ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155558.430886:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2842, 88 off237472 00000004:00080000:1.0:1746155558.430890:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687580387306ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155558.430951:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2844, 88 off237656 00000004:00080000:1.0:1746155558.430955:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687580452354ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155558.430964:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2792, 88 off232808 00000004:00080000:1.0:1746155558.430966:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687580463444ns, next at 645866785986ns, rc = 0 00000100:00100000:1.0:1746155558.448720:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.448776:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123471232 00000100:00100000:0.0:1746155558.448784:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123471232 00000100:00100000:0.0:1746155558.448871:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9868 00000100:00100000:0.0:1746155558.448880:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28784:x1830976123471232:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155558.448899:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155558.448915:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68e00/0x844e5faceb5e9dbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fdd4 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.448966:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69200/0x844e5faceb5e9dc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.448977:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69200/0x844e5faceb5e9dc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.448985:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69200/0x844e5faceb5e9dc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.449000:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69600/0x844e5faceb5e9dcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.449005:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69600/0x844e5faceb5e9dcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.449009:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69600/0x844e5faceb5e9dcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.449099:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69400/0x844e5faceb5e9dd4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.449106:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.449111:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69400/0x844e5faceb5e9dd4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x40 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.449123:0:15474:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.449131:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69400/0x844e5faceb5e9dd4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x40 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155558.453770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155558.461421:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdcd expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.462139:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155558.462142:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746155558.462145:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69400/0x844e5faceb5e9dd4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155558.462156:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69400/0x844e5faceb5e9dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155558.462161:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69400/0x844e5faceb5e9dd4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155558.462167:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0200/0x844e5faceb5e9ddb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fddb expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.462174:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0200/0x844e5faceb5e9ddb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fddb expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.462179:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0200/0x844e5faceb5e9ddb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fddb expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.462210:0:14234:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0200/0x844e5faceb5e9ddb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fddb expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.462222:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124475264:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155558.462303:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155558.462479:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124475392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155558.462523:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124475776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155558.462550:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155558.462566:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124476288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155558.462579:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155558.462588:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124476800:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746155558.462616:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69400/0x844e5faceb5e9dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.462623:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69400/0x844e5faceb5e9dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155558.462655:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00000004:00200000:0.0:1746155558.462669:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1746155558.462683:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1746155558.462684:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69400/0x844e5faceb5e9dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.462693:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69400/0x844e5faceb5e9dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155558.462695:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124477312:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746155558.462701:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69200/0x844e5faceb5e9dc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155558.462705:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746155558.462707:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69200/0x844e5faceb5e9dc6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.462713:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69200/0x844e5faceb5e9dc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155558.462718:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00010000:00010000:0.0:1746155558.462718:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ce69200 already unused, calling callback (ffffffffa135a690) 00000100:00100000:1.0:1746155558.462721:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124475648:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746155558.462721:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69200/0x844e5faceb5e9dc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.462727:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69200/0x844e5faceb5e9dc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155558.462732:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746155558.462736:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155558.462738:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746155558.462739:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124476032:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746155558.462741:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69200/0x844e5faceb5e9dc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155558.462750:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746155558.462750:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69200/0x844e5faceb5e9dc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155558.462759:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124476672:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746155558.462760:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69600/0x844e5faceb5e9dcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.462764:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69600/0x844e5faceb5e9dcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.462769:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69600/0x844e5faceb5e9dcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155558.462770:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746155558.462773:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ce69600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155558.462775:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69600/0x844e5faceb5e9dcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155558.462777:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124477184:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746155558.462780:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69600/0x844e5faceb5e9dcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.462786:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fca6b00) 00000100:00100000:1.0:1746155558.462787:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746155558.462788:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155558.462790:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69600/0x844e5faceb5e9dcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155558.462795:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69600/0x844e5faceb5e9dcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155558.462805:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124475520 00000100:00100000:1.0:1746155558.462809:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124475520 00010000:00010000:0.0:1746155558.462822:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68e00/0x844e5faceb5e9dbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdd4 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.462832:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69400/0x844e5faceb5e9dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdd4 expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.462833:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124475776 00000100:00100000:1.0:1746155558.462835:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124475776 00010000:00010000:0.0:1746155558.462838:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155558.462840:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746155558.462841:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce69400, rc 0) 00000100:00100000:1.0:1746155558.462844:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124476288 00000100:00100000:1.0:1746155558.462845:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124476288 00000100:00100000:1.0:1746155558.462852:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124476800 00000100:00100000:1.0:1746155558.462853:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124476800 00000100:00100000:1.0:1746155558.462859:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124477312 00000100:00100000:1.0:1746155558.462860:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124477312 00000100:00100000:1.0:1746155558.462865:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124475648 00000100:00100000:1.0:1746155558.462866:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124475648 00000100:00100000:0.0:1746155558.462867:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:28784:x1830976123471232:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 13989us (14152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.462871:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124476032 00000100:00100000:1.0:1746155558.462873:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124476032 00000100:00100000:0.0:1746155558.462873:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9868 00000100:00100000:1.0:1746155558.462878:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124476672 00000100:00100000:1.0:1746155558.462879:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124476672 00000100:00100000:1.0:1746155558.462883:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124477184 00000100:00100000:1.0:1746155558.462884:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124477184 00000100:00100000:1.0:1746155558.462891:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11427 00000100:00100000:1.0:1746155558.462896:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3298:x1830976124475520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.462899:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11428 00000100:00100000:0.0:1746155558.462904:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3296:x1830976124475776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155558.463026:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155558.463026:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155558.463029:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155557 -> 1746155557 00002000:00010000:0.0:1746155558.463029:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155558 -> 1746155558 00002000:00010000:1.0:1746155558.463031:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155557 -> 1746155557 00002000:00010000:0.0:1746155558.463031:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155558 -> 1746155558 00002000:00010000:1.0:1746155558.463033:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155557 -> 1746155557 00002000:00010000:0.0:1746155558.463033:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155558 -> 1746155558 00002000:00010000:1.0:1746155558.463035:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746155558.463035:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155558.463054:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3298:x1830976124475520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (530us total) trans 17179873090 rc 0/0 00000100:00100000:0.0:1746155558.463057:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3296:x1830976124475776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (506us total) trans 21474840474 rc 0/0 00000100:00100000:1.0:1746155558.463059:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11427 00000100:00100000:0.0:1746155558.463061:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11428 00000100:00100000:1.0:1746155558.463068:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11429 00000100:00100000:1.0:1746155558.463072:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+62:3296:x1830976124476288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.463655:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11430 00000100:00100000:0.0:1746155558.463681:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3296:x1830976124476800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.463778:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976124476800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (1094us total) trans 17179873091 rc 0/0 00000100:00100000:0.0:1746155558.463784:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11430 00000100:00100000:0.0:1746155558.463794:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11431 00000100:00100000:0.0:1746155558.463798:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3296:x1830976124477312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.463872:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976124477312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1165us total) trans 17179873092 rc 0/0 00000100:00100000:0.0:1746155558.463877:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11431 00000100:00100000:0.0:1746155558.463886:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11432 00000100:00100000:0.0:1746155558.463890:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3296:x1830976124475648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155558.463960:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155558.463963:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.463964:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155556 -> 1746155556 00002000:00010000:0.0:1746155558.463966:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.463968:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155558.463987:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976124475648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (1253us total) trans 17179873093 rc 0/0 00000100:00100000:0.0:1746155558.463991:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11432 00000100:00100000:0.0:1746155558.464001:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11433 00000100:00100000:0.0:1746155558.464005:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3296:x1830976124476032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155558.464070:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155558.464073:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.464075:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155557 -> 1746155557 00002000:00010000:0.0:1746155558.464076:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.464078:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155558.464097:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976124476032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (1345us total) trans 17179873094 rc 0/0 00000100:00100000:0.0:1746155558.464101:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11433 00000100:00100000:0.0:1746155558.464109:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11434 00000100:00100000:0.0:1746155558.464113:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3296:x1830976124476672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.464191:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3296:x1830976124476672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (1419us total) trans 21474840475 rc 0/0 00000100:00100000:0.0:1746155558.464195:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11434 00000100:00100000:0.0:1746155558.464204:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11435 00000100:00100000:0.0:1746155558.464208:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3296:x1830976124477184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.464279:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3296:x1830976124477184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1490us total) trans 21474840476 rc 0/0 00000100:00100000:0.0:1746155558.464284:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11435 00000004:00080000:0.0:1746155558.464332:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451c000/2, rc 0, transno 17179873093 00000100:00100000:0.0:1746155558.464337:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124475648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155558.464345:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451f480/2, rc 0, transno 17179873094 00000100:00100000:0.0:1746155558.464347:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124476032:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155558.464354:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dad80/2, rc 0, transno 21474840475 00000100:00100000:0.0:1746155558.464367:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124476672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155558.464374:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6daa00/2, rc 0, transno 21474840476 00000100:00100000:0.0:1746155558.464377:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124477184:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155558.464382:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ec380/2, rc 0, transno 21474840474 00000100:00100000:0.0:1746155558.464384:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124475776:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155558.464389:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451ed80/2, rc 0, transno 17179873091 00000100:00100000:0.0:1746155558.464392:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124476800:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155558.464399:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451ea00/2, rc 0, transno 17179873092 00000100:00100000:0.0:1746155558.464401:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124477312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155558.465463:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:3296:x1830976124476288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2389us (2882us total) trans 21474840479 rc 0/0 00000100:00100000:1.0:1746155558.465469:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11429 00000004:00080000:0.0:1746155558.465713:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6d9500/2, rc 0, transno 21474840479 00000100:00100000:0.0:1746155558.465716:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124476288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155558.465938:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155558.465966:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124475904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155558.465985:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155558.466810:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124476416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155558.466829:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155558.466978:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124476928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155558.466997:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155558.467160:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11441 00000100:00100000:0.0:1746155558.467167:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+67:3297:x1830976124475904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155558.467237:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4844352 -> 4844352 00002000:00010000:0.0:1746155558.467239:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.467241:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.467243:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155558 -> 1746155558 00002000:00010000:0.0:1746155558.467244:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 4959 -> 4959 00000100:00100000:0.0:1746155558.467261:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+67:3297:x1830976124475904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1275us total) trans 21474840481 rc 0/0 00000100:00100000:0.0:1746155558.467266:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11441 00000100:00100000:0.0:1746155558.467275:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11442 00000100:00100000:0.0:1746155558.467279:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+60:3297:x1830976124476416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155558.467362:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3297:x1830976124476416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (532us total) trans 17179873097 rc 0/0 00000100:00100000:0.0:1746155558.467367:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11442 00000100:00100000:0.0:1746155558.467379:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123471616 00000100:00100000:0.0:1746155558.467381:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123471616 00000100:00100000:0.0:1746155558.467398:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9870 00000100:00100000:0.0:1746155558.467402:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:28784:x1830976123471616:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155558.467410:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155558.467424:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3e00/0x844e5faceb5e9de2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fde2 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.467450:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3e00/0x844e5faceb5e9de2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fde2 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.467461:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3e00/0x844e5faceb5e9de2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fde2 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.467473:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155558.467476:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155558.467479:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe3e00, rc 0) 00000100:00100000:0.0:1746155558.467492:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28784:x1830976123471616:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 89us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.467497:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9870 00000004:00080000:1.0:1746155558.467603:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800944ae680/2, rc 0, transno 21474840480 00000100:00100000:1.0:1746155558.467607:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124475392:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155558.467614:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3eea00/2, rc 0, transno 21474840481 00000100:00100000:1.0:1746155558.467617:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124475904:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155558.467622:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451ce00/2, rc 0, transno 17179873097 00000100:00100000:1.0:1746155558.467624:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124476416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155558.467636:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124476928 00000100:00100000:1.0:1746155558.467638:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124476928 00000100:00100000:1.0:1746155558.467653:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11443 00000100:00100000:1.0:1746155558.467666:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3297:x1830976124476928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155558.467757:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3297:x1830976124476928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (758us total) trans 21474840482 rc 0/0 00000100:00100000:1.0:1746155558.467762:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11443 00000100:00100000:1.0:1746155558.468036:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124475264:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155558.468058:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76000/0x844e5faceb5e9db1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdcd expref: 8 pid: 14234 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746155558.468068:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdcd expref: 7 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.468081:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f77000, rc 0) 00000100:00100000:1.0:1746155558.468298:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+7:28778:x1830976123470720:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 51518us (52798us total) trans 8589943774 rc 0/0 00000100:00100000:1.0:1746155558.468303:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9867 00000004:00080000:1.0:1746155558.468328:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6d9180/2, rc 0, transno 21474840482 00000100:00100000:1.0:1746155558.468332:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124476928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155558.470027:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.470091:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.472389:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.472419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.472440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.472468:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.474590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.476715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.477393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.477428:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123472896 00000100:00100000:1.0:1746155558.477431:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123472896 00000100:00100000:1.0:1746155558.477454:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11451 00000100:00100000:1.0:1746155558.477458:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+28:28778:x1830976123472896:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155558.477466:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.477473:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093332a00/0x844e5faceb5e9e28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fe21 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.477491:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9cf4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd4f expref: 29 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.477499:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938a1c00/0x844e5faceb5e9de9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fde9 expref: 11 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.477533:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9d9c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdaa expref: 28 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.477538:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.477539:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.477541:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093332a00/0x844e5faceb5e9e28 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [520192->1048575] (req 520192->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe21 expref: 29 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.477556:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdaa expref: 28 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.477566:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9d9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdaa expref: 28 pid: 10591 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.477573:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124478080:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155558.477627:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938a1c00/0x844e5faceb5e9de9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fde9 expref: 11 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.477638:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938a1c00/0x844e5faceb5e9de9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fde9 expref: 11 pid: 29728 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.477646:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124478208:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155558.477680:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9cf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd4f expref: 29 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.477687:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9cf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd4f expref: 29 pid: 20796 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.477694:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124478336:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155558.477709:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155558.479969:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124478080:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155558.479980:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124478208:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155558.479988:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124478336:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155558.479991:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155558.480007:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093332a00/0x844e5faceb5e9e28 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [520192->1048575] (req 520192->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe21 expref: 29 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.480018:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093332a00, rc 0) 00000100:00100000:1.0:1746155558.480323:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+29:28778:x1830976123472896:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2863us (2930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.480330:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11451 00000100:00100000:1.0:1746155558.481984:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5686 00000100:00100000:1.0:1746155558.481990:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123473280:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.481998:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.482006:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9d9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdaa expref: 29 pid: 10591 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.482013:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdaa expref: 29 pid: 10591 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.482024:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130385200/0x844e5faceb5e9d9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdaa expref: 29 pid: 10591 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.482037:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.482053:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123473280:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 63us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.482058:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5686 00000100:00100000:1.0:1746155558.482071:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5687 00000100:00100000:1.0:1746155558.482076:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1962:x1830976123473792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.482084:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.482091:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9cf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd4f expref: 29 pid: 20796 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.482097:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9cf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd4f expref: 29 pid: 20796 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.482107:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9cf4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd4f expref: 29 pid: 20796 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.482113:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.482115:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.482119:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093332a00/0x844e5faceb5e9e28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe21 expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.482126:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093332a00/0x844e5faceb5e9e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe21 expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.482275:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093332a00/0x844e5faceb5e9e28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe21 expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.482282:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124478592:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155558.482563:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155558.485160:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.486221:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124478592:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155558.486231:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.486259:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1962:x1830976123473792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4182us (5252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.486267:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5687 00000100:00100000:0.0:1746155558.491253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.491282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.491317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.492397:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123474944 00000100:00100000:1.0:1746155558.492404:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123474944 00000100:00100000:1.0:1746155558.492432:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11452 00000100:00100000:1.0:1746155558.492437:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:28780:x1830976123474944:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155558.492450:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.492463:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093332000/0x844e5faceb5e9e44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fe2f expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.492484:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f76c00/0x844e5faceb5e9cfb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd5d expref: 19 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.492492:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0698e00/0x844e5faceb5e9df7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdf7 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.492498:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9da3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdb8 expref: 35 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.492520:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.492522:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.492526:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093332000/0x844e5faceb5e9e44 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->1130495] (req 1048576->1130495) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe2f expref: 35 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.492548:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9da3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdb8 expref: 35 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.492557:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9da3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdb8 expref: 35 pid: 10591 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.492567:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124478720:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155558.492841:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0698e00/0x844e5faceb5e9df7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdf7 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.492848:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0698e00/0x844e5faceb5e9df7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdf7 expref: 9 pid: 20200 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.492856:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124478976:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155558.492883:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135f76c00/0x844e5faceb5e9cfb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd5d expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.492890:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135f76c00/0x844e5faceb5e9cfb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd5d expref: 20 pid: 9235 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.492897:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124479104:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155558.492915:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155558.496327:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.496381:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123475200 00000100:00100000:1.0:1746155558.496387:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123475200 00010000:00010000:1.0:1746155558.496417:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9da3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdb8 expref: 36 pid: 10591 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.496458:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5688 00000100:00100000:1.0:1746155558.496465:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123475200:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.496481:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.496519:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9da3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdb8 expref: 36 pid: 10591 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.496528:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9da3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdb8 expref: 36 pid: 10591 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746155558.496549:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.496829:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123475200:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 363us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.496835:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5688 00010000:00010000:1.0:1746155558.496860:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9da3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdb8 expref: 35 pid: 10591 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746155558.496872:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124478720:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155558.496879:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124478976:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155558.496886:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124479104:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155558.496900:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093332000/0x844e5faceb5e9e44 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1130495] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe2f expref: 34 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.496907:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093332000, rc 0) 00000100:00100000:1.0:1746155558.496921:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:28780:x1830976123474944:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4484us (5638us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.496926:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11452 00000100:00100000:0.0:1746155558.496985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.497018:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.497960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.501968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.501989:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123475840 00000100:00100000:0.0:1746155558.501996:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123475840 00002000:00100000:0.0:1746155558.502027:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3db:0x0] (1126400->1130495) req@ffff8800a6062d80 x1830976123475840/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/0 e 0 to 0 dl 1746155569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155558.502036:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6062d80 with x1830976123475840 ext(1126400->1130495) 00002000:00010000:0.0:1746155558.502163:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6062d80 00000100:00100000:0.0:1746155558.502183:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4250 00000100:00100000:0.0:1746155558.502190:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976123475840:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155558.502331:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976123475840:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 140us (372us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155558.502338:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4250 00002000:00100000:0.0:1746155558.502344:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3db:0x0] (1126400->1130495) req@ffff8800a6062d80 x1830976123475840/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/4536 e 0 to 0 dl 1746155569 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155558.502350:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6062d80 with x1830976123475840 ext(1126400->1130495) 00002000:00010000:0.0:1746155558.502353:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6062d80 00000100:00100000:0.0:1746155558.505201:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.508679:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.512548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.514294:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.618134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.619616:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.619634:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123477248 00000100:00100000:0.0:1746155558.619637:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123477248 00000100:00100000:0.0:1746155558.619671:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9874 00000100:00100000:0.0:1746155558.619677:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:28793:x1830976123477248:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155558.619687:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155558.619694:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69800/0x844e5faceb5e9e75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fe44 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.619736:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69c00/0x844e5faceb5e9e7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619743:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69c00/0x844e5faceb5e9e7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619749:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69c00/0x844e5faceb5e9e7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619760:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69000/0x844e5faceb5e9e83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619765:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69000/0x844e5faceb5e9e83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619769:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69000/0x844e5faceb5e9e83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619820:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68a00/0x844e5faceb5e9e8a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619827:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68a00/0x844e5faceb5e9e8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619833:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68a00/0x844e5faceb5e9e8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155558.619839:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00010000:00010000:0.0:1746155558.619894:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69c00/0x844e5faceb5e9e7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619900:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69c00/0x844e5faceb5e9e7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619905:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69c00/0x844e5faceb5e9e7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619909:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ce69c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155558.619912:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69c00/0x844e5faceb5e9e7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619916:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69c00/0x844e5faceb5e9e7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619924:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155558.619926:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155558.619929:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69c00/0x844e5faceb5e9e7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619933:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69c00/0x844e5faceb5e9e7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619960:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69000/0x844e5faceb5e9e83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619965:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69000/0x844e5faceb5e9e83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619969:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69000/0x844e5faceb5e9e83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619978:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ce69000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155558.619980:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69000/0x844e5faceb5e9e83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619985:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69000/0x844e5faceb5e9e83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.619991:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fff0200) 00010000:00010000:0.0:1746155558.619993:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155558.619995:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69000/0x844e5faceb5e9e83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.620000:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69000/0x844e5faceb5e9e83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155558.620023:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce69800/0x844e5faceb5e9e75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe44 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.620033:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68a00/0x844e5faceb5e9e8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe44 expref: 289 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155558.620038:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155558.620040:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155558.620042:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce68a00, rc 0) 00000100:00100000:0.0:1746155558.620061:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:28793:x1830976123477248:12345-192.168.202.51@tcp:101:cat.0 Request processed in 384us (446us total) trans 8589943780 rc 0/0 00000100:00100000:0.0:1746155558.620067:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9874 00000100:00100000:0.0:1746155558.624787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.624837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.624934:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123477504 00000100:00100000:1.0:1746155558.624942:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123477504 00000100:00100000:1.0:1746155558.624982:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123477376 00000100:00100000:1.0:1746155558.624984:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123477376 00000100:00100000:1.0:1746155558.625000:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11454 00000100:00100000:1.0:1746155558.625007:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1963:x1830976123477504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155558.625023:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.625036:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093333000/0x844e5faceb5e9e98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fe52 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.625076:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124479488:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155558.625140:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155558.626205:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:1.0:1746155558.626446:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155557 -> 1746155558 00000100:00100000:1.0:1746155558.626464:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124479488:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155558.626481:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093333000/0x844e5faceb5e9e98 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe52 expref: 36 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.626490:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093333000/0x844e5faceb5e9e98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe52 expref: 36 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.626522:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093333000, rc 0) 00000100:00100000:1.0:1746155558.626806:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1963:x1830976123477504:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1798us (2026us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155558.626811:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11454 00002000:00010000:1.0:1746155558.626884:0:10591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime: 1746155557 -> 1746155558 00002000:00010000:1.0:1746155558.626887:0:10591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime: 1746155557 -> 1746155558 00002000:00010000:1.0:1746155558.626888:0:10591:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime: 1746155557 -> 1746155558 00000100:00100000:1.0:1746155558.626899:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124479616:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155558.626913:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090acd000/0x844e5faceb5e9e9f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe4b expref: 29 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.626922:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090acd000/0x844e5faceb5e9e9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe4b expref: 29 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.626929:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090acd000, rc 0) 00000100:00100000:1.0:1746155558.626948:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123477376:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1665us (2111us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155558.626953:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11455 00000100:00100000:0.0:1746155558.630346:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.633581:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.633665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.633688:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123478144 00000100:00100000:0.0:1746155558.633692:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123478144 00002000:00100000:0.0:1746155558.633721:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (520192->1048575) req@ffff8800a6060a80 x1830976123478144/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:629/0 lens 488/0 e 0 to 0 dl 1746155569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155558.633729:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060a80 with x1830976123478144 ext(520192->1048575) 00010000:00010000:0.0:1746155558.633735:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093332a00/0x844e5faceb5e9e28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe21 expref: 28 pid: 1625 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746155558.633745:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093332a00/0x844e5faceb5e9e28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe21 expref: 28 pid: 1625 timeout: 787 lvb_type: 0 00002000:00010000:0.0:1746155558.633752:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6060a80 00000100:00100000:0.0:1746155558.633764:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 623 00000100:00100000:0.0:1746155558.633770:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123478144:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155558.634249:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.634282:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123478016 00000100:00100000:1.0:1746155558.634285:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123478016 00000100:00100000:1.0:1746155558.634308:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9875 00000100:00100000:1.0:1746155558.634313:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+10:28795:x1830976123478016:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155558.634327:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.634338:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093333800/0x844e5faceb5e9eb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fe67 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.634409:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093333600/0x844e5faceb5e9ebb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155558.634419:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0e00/0x844e5faceb5e9e67 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe3d expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.634426:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68a00/0x844e5faceb5e9e8a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe44 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.634436:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093333600/0x844e5faceb5e9ebb lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155558.634459:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68a00/0x844e5faceb5e9e8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe44 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.634468:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68a00/0x844e5faceb5e9e8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe44 expref: 288 pid: 14234 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.634478:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124480000:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155558.634551:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0e00/0x844e5faceb5e9e67 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe3d expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.634559:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0e00/0x844e5faceb5e9e67 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe3d expref: 11 pid: 27374 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.634566:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124480128:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155558.634585:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155558.637447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.637476:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.637492:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123478400 00000100:00100000:0.0:1746155558.637497:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123478400 00010000:00010000:0.0:1746155558.637537:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68a00/0x844e5faceb5e9e8a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe44 expref: 289 pid: 14234 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746155558.637555:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123478528 00000100:00100000:0.0:1746155558.637557:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123478528 00010000:00010000:0.0:1746155558.637563:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0e00/0x844e5faceb5e9e67 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe3d expref: 12 pid: 27374 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746155558.637573:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5692 00000100:00100000:0.0:1746155558.637578:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1961:x1830976123478400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155558.637588:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155558.637592:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68a00/0x844e5faceb5e9e8a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe44 expref: 289 pid: 14234 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746155558.637600:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68a00/0x844e5faceb5e9e8a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe44 expref: 289 pid: 14234 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.637811:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5693 00000100:00100000:1.0:1746155558.637818:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123478528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.637824:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.637828:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0e00/0x844e5faceb5e9e67 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe3d expref: 12 pid: 27374 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746155558.638604:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce68a00/0x844e5faceb5e9e8a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe44 expref: 289 pid: 14234 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.638730:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0e00/0x844e5faceb5e9e67 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe3d expref: 12 pid: 27374 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.638747:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0e00/0x844e5faceb5e9e67 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe3d expref: 12 pid: 27374 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.638761:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155558.638764:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093333600/0x844e5faceb5e9ebb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155558.638771:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093333600/0x844e5faceb5e9ebb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155558.638777:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093333600/0x844e5faceb5e9ebb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155558.638788:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.638820:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123478528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1002us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.638827:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5693 00010000:00010000:0.0:1746155558.640046:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155558.640050:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155558.640074:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1961:x1830976123478400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2495us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155558.640081:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5692 00000100:00100000:1.0:1746155558.644377:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1961:x1830976123478144:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10599us (10713us total) trans 21474840483 rc 0/0 00000100:00100000:1.0:1746155558.644388:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 623 00002000:00100000:1.0:1746155558.644397:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (520192->1048575) req@ffff8800a6060a80 x1830976123478144/t21474840483(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:629/0 lens 488/448 e 0 to 0 dl 1746155569 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.644406:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060a80 with x1830976123478144 ext(520192->1048575) 00010000:00010000:1.0:1746155558.644414:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093332a00/0x844e5faceb5e9e28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe21 expref: 31 pid: 1625 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.644428:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093332a00/0x844e5faceb5e9e28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 520192->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe21 expref: 31 pid: 1625 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746155558.644435:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a6060a80 00000100:00100000:0.0:1746155558.648147:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.661385:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.661547:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123478912 00000100:00100000:1.0:1746155558.661555:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123478912 00002000:00100000:1.0:1746155558.661588:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012cdcc380 x1830976123478912/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/0 e 0 to 0 dl 1746155569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.661597:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcc380 with x1830976123478912 ext(0->1048575) 00002000:00010000:1.0:1746155558.661602:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcc380 00000100:00100000:1.0:1746155558.661627:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4252 00000100:00100000:1.0:1746155558.661633:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123478912:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155558.663385:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123479296 00000100:00100000:0.0:1746155558.663391:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123479296 00002000:00100000:0.0:1746155558.663415:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880093a45500 x1830976123479296/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:629/0 lens 488/0 e 0 to 0 dl 1746155569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155558.663423:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a45500 with x1830976123479296 ext(0->1048575) 00002000:00010000:0.0:1746155558.663427:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a45500 00000100:00100000:0.0:1746155558.663442:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4254 00000100:00100000:0.0:1746155558.663448:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123479296:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155558.672602:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123478912:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10960us (11215us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155558.672612:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4252 00002000:00100000:1.0:1746155558.672622:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012cdcc380 x1830976123478912/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/440 e 0 to 0 dl 1746155569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.672630:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcc380 with x1830976123478912 ext(0->1048575) 00002000:00010000:1.0:1746155558.672635:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcc380 00000100:00100000:1.0:1746155558.676146:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123479296:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12691us (13385us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155558.676156:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4254 00002000:00100000:1.0:1746155558.676165:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880093a45500 x1830976123479296/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:629/0 lens 488/440 e 0 to 0 dl 1746155569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.676173:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a45500 with x1830976123479296 ext(0->1048575) 00002000:00010000:1.0:1746155558.676178:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a45500 00000100:00100000:0.0:1746155558.687827:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.689748:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.690762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.690942:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123479808 00000100:00100000:1.0:1746155558.690946:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123479808 00002000:00100000:1.0:1746155558.690968:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1130495) req@ffff88012cdcea00 x1830976123479808/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/0 e 0 to 0 dl 1746155569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.690976:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcea00 with x1830976123479808 ext(1048576->1130495) 00010000:00010000:1.0:1746155558.690983:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093332000/0x844e5faceb5e9e44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe2f expref: 37 pid: 1625 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.690993:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093332000/0x844e5faceb5e9e44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe2f expref: 37 pid: 1625 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746155558.690999:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdcea00 00000100:00100000:1.0:1746155558.691071:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 624 00000100:00100000:1.0:1746155558.691078:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1963:x1830976123479808:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155558.692592:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.693227:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1963:x1830976123479808:12345-192.168.202.51@tcp:4:cat.0 Request processed in 2149us (2465us total) trans 17179873099 rc 0/0 00000100:00100000:1.0:1746155558.693234:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 624 00002000:00100000:1.0:1746155558.693240:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1130495) req@ffff88012cdcea00 x1830976123479808/t17179873099(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/448 e 0 to 0 dl 1746155569 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.693247:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcea00 with x1830976123479808 ext(1048576->1130495) 00010000:00010000:1.0:1746155558.693253:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093332000/0x844e5faceb5e9e44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe2f expref: 39 pid: 1625 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.693263:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093332000/0x844e5faceb5e9e44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe2f expref: 39 pid: 1625 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746155558.693269:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdcea00 00000100:00100000:1.0:1746155558.693280:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123479936 00000100:00100000:1.0:1746155558.693283:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123479936 00002000:00100000:1.0:1746155558.693298:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1196031) req@ffff88012cdcf800 x1830976123479936/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:629/0 lens 488/0 e 0 to 0 dl 1746155569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.693304:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcf800 with x1830976123479936 ext(1048576->1196031) 00010000:00010000:1.0:1746155558.693307:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800938a1400/0x844e5faceb5e9e4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe36 expref: 20 pid: 8437 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.693315:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800938a1400/0x844e5faceb5e9e4b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe36 expref: 20 pid: 8437 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746155558.693320:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdcf800 00000100:00100000:1.0:1746155558.693332:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 625 00000100:00100000:1.0:1746155558.693337:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123479936:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155558.697754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.699810:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123479936:12345-192.168.202.51@tcp:4:cat.0 Request processed in 6467us (7214us total) trans 17179873100 rc 0/0 00000100:00100000:1.0:1746155558.699818:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 625 00002000:00100000:1.0:1746155558.699827:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1196031) req@ffff88012cdcf800 x1830976123479936/t17179873100(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:629/0 lens 488/448 e 0 to 0 dl 1746155569 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.699835:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcf800 with x1830976123479936 ext(1048576->1196031) 00010000:00010000:1.0:1746155558.699842:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800938a1400/0x844e5faceb5e9e4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe36 expref: 22 pid: 8437 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.699859:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800938a1400/0x844e5faceb5e9e4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe36 expref: 22 pid: 8437 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746155558.699865:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdcf800 00000100:00100000:0.0:1746155558.711441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.714816:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.714912:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.716234:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4256 00000100:00100000:1.0:1746155558.716240:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123480704:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155558.723775:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.733002:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123480704:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16760us (18088us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155558.733008:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4256 00002000:00100000:0.0:1746155558.733014:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012cdcfb80 x1830976123480704/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:629/0 lens 488/440 e 0 to 0 dl 1746155569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155558.733021:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcfb80 with x1830976123480704 ext(1048576->2097151) 00002000:00010000:0.0:1746155558.733025:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcfb80 00000100:00100000:0.0:1746155558.746034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.755812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.764472:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.764550:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.765567:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4259 00000100:00100000:0.0:1746155558.765574:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123481856:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155558.767293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.767321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.767446:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4260 00000100:00100000:1.0:1746155558.767453:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1963:x1830976123482112:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155558.771594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.773918:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.773957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.774245:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976123481728:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9565us (9778us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155558.774254:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4258 00002000:00100000:1.0:1746155558.774262:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880094f09c00 x1830976123481728/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/440 e 0 to 0 dl 1746155569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.774271:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09c00 with x1830976123481728 ext(1048576->2097151) 00002000:00010000:1.0:1746155558.774275:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f09c00 00000100:00100000:1.0:1746155558.774291:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123482880 00000100:00100000:1.0:1746155558.774294:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123482880 00002000:00100000:1.0:1746155558.774311:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012fef2680 x1830976123482880/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:629/0 lens 488/0 e 0 to 0 dl 1746155569 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.774324:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef2680 with x1830976123482880 ext(3145728->4194303) 00002000:00010000:1.0:1746155558.774327:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef2680 00000100:00100000:1.0:1746155558.774344:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4263 00000100:00100000:1.0:1746155558.774349:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976123482880:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155558.775540:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123483008 00000100:00100000:0.0:1746155558.775547:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123483008 00000100:00100000:1.0:1746155558.777721:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11462 00000100:00100000:1.0:1746155558.777730:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+25:28795:x1830976123483008:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155558.777745:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.777760:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ffc6c00/0x844e5faceb5e9f08 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fe91 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.777785:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c14d400/0x844e5faceb5e9ed7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe7c expref: 37 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.777792:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.777793:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.777796:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc6c00/0x844e5faceb5e9f08 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1646592->2097151] (req 1646592->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe91 expref: 26 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.777823:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c14d400/0x844e5faceb5e9ed7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe7c expref: 37 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.777832:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c14d400/0x844e5faceb5e9ed7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe7c expref: 37 pid: 1625 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.777842:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124481024:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155558.779805:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155558.780542:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123481856:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14963us (15987us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155558.780550:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4259 00002000:00100000:1.0:1746155558.780558:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880094f08000 x1830976123481856/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:629/0 lens 488/440 e 0 to 0 dl 1746155569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.780567:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08000 with x1830976123481856 ext(1048576->2097151) 00002000:00010000:1.0:1746155558.780572:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f08000 00000100:00100000:1.0:1746155558.793386:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1963:x1830976123482112:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25932us (26097us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155558.793394:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4260 00002000:00100000:1.0:1746155558.793402:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012fef1c00 x1830976123482112/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:629/0 lens 488/440 e 0 to 0 dl 1746155569 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155558.793411:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef1c00 with x1830976123482112 ext(2097152->3145727) 00002000:00010000:1.0:1746155558.793416:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef1c00 00000100:00100000:0.0:1746155558.800793:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.800819:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.804853:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.804871:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.804882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.804907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.813021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.814889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.814937:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a46300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124481280:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155558.814958:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155558.814982:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123484928 00000100:00100000:1.0:1746155558.814988:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123484928 00010000:00010000:1.0:1746155558.815015:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093333600/0x844e5faceb5e9ebb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe67 expref: 11 pid: 27374 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.815055:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5698 00000100:00100000:1.0:1746155558.815063:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123484928:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.815073:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.815078:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093333600/0x844e5faceb5e9ebb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe67 expref: 11 pid: 27374 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.815089:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093333600/0x844e5faceb5e9ebb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe67 expref: 11 pid: 27374 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.815107:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093333600/0x844e5faceb5e9ebb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe67 expref: 11 pid: 27374 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.815123:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155558.815127:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815135:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815140:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815165:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155558.815173:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815178:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155558.815213:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00000004:00200000:1.0:1746155558.815218:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155558.815230:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815238:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815245:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130385e00/0x844e5faceb5e9f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815250:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130385e00/0x844e5faceb5e9f16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815256:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130385e00/0x844e5faceb5e9f16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815260:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130385e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155558.815263:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130385e00/0x844e5faceb5e9f16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815268:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130385e00/0x844e5faceb5e9f16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815275:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155558.815277:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155558.815279:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130385e00/0x844e5faceb5e9f16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815283:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130385e00/0x844e5faceb5e9f16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815290:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130385a00/0x844e5faceb5e9f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815294:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130385a00/0x844e5faceb5e9f1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815299:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130385a00/0x844e5faceb5e9f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815303:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130385a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155558.815304:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130385a00/0x844e5faceb5e9f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815309:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130385a00/0x844e5faceb5e9f1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815314:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800942dc900) 00010000:00010000:1.0:1746155558.815316:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155558.815318:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130385a00/0x844e5faceb5e9f1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815323:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130385a00/0x844e5faceb5e9f1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.815350:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130385c00/0x844e5faceb5e9f0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe98 expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.815360:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe98 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.815365:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155558.815366:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155558.815368:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130384000, rc 0) 00000100:00100000:1.0:1746155558.815391:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:28799:x1830976123483904:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 10399us (10518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.815398:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9877 00000100:00100000:1.0:1746155558.815425:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123484928:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 364us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.815431:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5698 00000100:00100000:0.0:1746155558.821564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.822069:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.822112:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123485184 00000100:00100000:1.0:1746155558.822117:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123485184 00000100:00100000:1.0:1746155558.822151:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11464 00000100:00100000:1.0:1746155558.822157:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123485184:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155558.822164:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.822172:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c14ca00/0x844e5faceb5e9f32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fea6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.822183:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.822184:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.822190:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c14ca00/0x844e5faceb5e9f32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fea6 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.822201:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c14ca00/0x844e5faceb5e9f32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fea6 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.822209:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c14ca00, rc 0) 00000100:00100000:1.0:1746155558.822235:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123485184:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 78us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.822240:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11464 00000100:00100000:0.0:1746155558.823001:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.823983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.824000:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123485440 00000100:00100000:1.0:1746155558.824004:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123485440 00000100:00100000:1.0:1746155558.824021:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11466 00000100:00100000:1.0:1746155558.824026:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123485440:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155558.824035:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.824041:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c14c600/0x844e5faceb5e9f40 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0feb4 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.824051:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.824058:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c14c600/0x844e5faceb5e9f40 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0feb4 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.824067:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c14c600/0x844e5faceb5e9f40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0feb4 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.824075:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c14c600, rc 0) 00000100:00100000:1.0:1746155558.824104:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123485440:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 77us (120us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155558.824109:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11466 00000100:00100000:0.0:1746155558.825428:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.825457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.825474:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123485568 00000100:00100000:1.0:1746155558.825478:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123485568 00010000:00010000:1.0:1746155558.825492:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938a0400/0x844e5faceb5e9f01 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe8a expref: 37 pid: 1625 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.825531:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123485696 00000100:00100000:1.0:1746155558.825534:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123485696 00010000:00010000:1.0:1746155558.825542:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938a1800/0x844e5faceb5e9ed0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe75 expref: 24 pid: 8437 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.825558:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5700 00000100:00100000:1.0:1746155558.825563:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123485696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.825572:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.825585:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938a1800/0x844e5faceb5e9ed0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe75 expref: 24 pid: 8437 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.825593:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938a1800/0x844e5faceb5e9ed0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe75 expref: 24 pid: 8437 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.825937:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938a1800/0x844e5faceb5e9ed0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe75 expref: 23 pid: 8437 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.825946:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.825948:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155558.825953:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130385400/0x844e5faceb5e9f2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe9f expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.825960:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130385400/0x844e5faceb5e9f2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe9f expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.825978:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130385400/0x844e5faceb5e9f2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe9f expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.825987:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124481792:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155558.826017:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155558.830172:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.830219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.834556:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.834640:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.834852:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124481792:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155558.834863:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.834881:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123485696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9317us (9423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.834888:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5700 00000100:00100000:0.0:1746155558.837076:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.839272:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.839299:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.839707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.839768:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123487104 00000100:00100000:1.0:1746155558.839772:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123487104 00010000:00010000:1.0:1746155558.839790:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe98 expref: 12 pid: 14234 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746155558.839807:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5701 00000100:00100000:1.0:1746155558.839817:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009100ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123487104:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155558.839825:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155558.839829:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe98 expref: 12 pid: 14234 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.839839:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe98 expref: 12 pid: 14234 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.839853:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130384000/0x844e5faceb5e9f24 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe98 expref: 12 pid: 14234 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746155558.839875:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155558.839879:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130384400/0x844e5faceb5e9f5c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.839886:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130384400/0x844e5faceb5e9f5c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.839891:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130384400/0x844e5faceb5e9f5c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155558.839906:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155558.839922:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009100ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123487104:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 110us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.839928:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5701 00000100:00100000:0.0:1746155558.847818:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.850018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.851191:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.851221:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.851842:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123487872 00000100:00100000:1.0:1746155558.851846:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123487872 00000100:00100000:1.0:1746155558.851863:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11470 00000100:00100000:1.0:1746155558.851868:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976123487872:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155558.851875:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.851883:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c14d400/0x844e5faceb5e9f7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fede expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.851907:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124482560:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155558.851946:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155558.853942:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124482560:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155558.853959:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c14d400/0x844e5faceb5e9f7f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fede expref: 37 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.853968:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c14d400/0x844e5faceb5e9f7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fede expref: 37 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.854027:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c14d400, rc 0) 00000100:00100000:1.0:1746155558.856747:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123487872:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4870us (5517us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155558.856756:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11470 00000100:00100000:0.0:1746155558.857026:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.857116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.857165:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123488000 00000100:00100000:1.0:1746155558.857173:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123488000 00000100:00100000:1.0:1746155558.857197:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123488128 00000100:00100000:1.0:1746155558.857200:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123488128 00000100:00100000:1.0:1746155558.857215:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11471 00000100:00100000:1.0:1746155558.857222:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123488000:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155558.857234:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.857247:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c14ce00/0x844e5faceb5e9f86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fee5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.857287:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124482688:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155558.857346:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155558.857358:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11472 00000100:00100000:1.0:1746155558.857363:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123488128:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155558.857369:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.857375:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c14c200/0x844e5faceb5e9f8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0feec expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.857399:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124482816:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155558.857416:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155558.858751:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124482688:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155558.858768:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c14ce00/0x844e5faceb5e9f86 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fee5 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.858777:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c14ce00/0x844e5faceb5e9f86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fee5 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.858784:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c14ce00, rc 0) 00000100:00100000:1.0:1746155558.858808:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123488000:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1587us (1782us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155558.858814:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11471 00000100:00100000:0.0:1746155558.859522:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.859550:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.859854:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123488256 00000100:00100000:1.0:1746155558.859860:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123488256 00000100:00100000:1.0:1746155558.859887:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123488384 00000100:00100000:1.0:1746155558.859889:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123488384 00000100:00100000:1.0:1746155558.859900:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11473 00000100:00100000:1.0:1746155558.859905:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976123488256:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155558.859915:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.859923:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c14c400/0x844e5faceb5e9f94 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fef3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.859949:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124482944:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155558.859990:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155558.860456:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.862781:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124482944:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155558.862803:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c14c400/0x844e5faceb5e9f94 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fef3 expref: 39 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.862813:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c14c400/0x844e5faceb5e9f94 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fef3 expref: 39 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.862822:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c14c400, rc 0) 00000100:00100000:1.0:1746155558.862849:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976123488256:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2943us (3349us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155558.862854:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11473 00000100:00100000:0.0:1746155558.865603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.873085:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.925090:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.931888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.931916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.932697:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.939235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.947996:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.952234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.956992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.960404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.960442:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.960527:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.960579:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123490560 00000100:00100000:1.0:1746155558.960586:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123490560 00000100:00100000:1.0:1746155558.960609:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123490816 00000100:00100000:1.0:1746155558.960611:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123490816 00000100:00100000:1.0:1746155558.960623:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11477 00000100:00100000:1.0:1746155558.960629:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123490560:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155558.960642:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.960662:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c14c000/0x844e5faceb5e9fe1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ff1d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155558.960703:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124483840:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155558.960757:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746155558.964428:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime: 1746155558 -> 1746155559 00002000:00010000:1.0:1746155558.964432:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime: 1746155558 -> 1746155559 00002000:00010000:1.0:1746155558.964434:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime: 1746155558 -> 1746155559 00000100:00100000:1.0:1746155558.964446:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124483840:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155558.964462:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c14c000/0x844e5faceb5e9fe1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff1d expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.964472:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c14c000/0x844e5faceb5e9fe1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff1d expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155558.964493:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c14c000, rc 0) 00000100:00100000:1.0:1746155558.964528:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123490560:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3899us (4129us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155558.964534:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11477 00000100:00100000:0.0:1746155558.965111:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.968287:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.968376:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155558.969607:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123491200 00000100:00100000:1.0:1746155558.969612:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123491200 00000100:00100000:1.0:1746155558.969636:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11479 00000100:00100000:1.0:1746155558.969641:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+29:28806:x1830976123491200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155558.969650:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155558.969677:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c14d800/0x844e5faceb5e9fef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ff2b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.969696:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130385a00/0x844e5faceb5e9fb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff08 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.969703:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155558.969705:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155558.969707:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c14d800/0x844e5faceb5e9fef lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff2b expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.969732:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130385a00/0x844e5faceb5e9fb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff08 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.969742:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130385a00/0x844e5faceb5e9fb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff08 expref: 28 pid: 10591 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155558.969750:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124484224:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155558.969792:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155558.971550:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124484224:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155558.971569:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c14d800/0x844e5faceb5e9fef lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff2b expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155558.971586:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c14d800, rc 0) 00000100:00100000:1.0:1746155558.971611:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+30:28806:x1830976123491200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1970us (3330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155558.971618:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11479 00000100:00100000:0.0:1746155558.972327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.989059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.994378:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155558.995664:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.002013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.002049:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.002257:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11481 00000100:00100000:1.0:1746155559.002264:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976123492480:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.002272:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.002282:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c14dc00/0x844e5faceb5ea020 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ff40 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155559.002316:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124484480:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155559.002546:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155559.004280:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124484480:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155559.004301:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c14dc00/0x844e5faceb5ea020 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff40 expref: 38 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.004310:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c14dc00/0x844e5faceb5ea020 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff40 expref: 38 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.004333:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c14dc00, rc 0) 00000100:00100000:1.0:1746155559.004636:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976123492480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2371us (2584us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155559.004646:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11481 00000100:00100000:0.0:1746155559.009845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.010944:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.011037:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123492608 00000100:00100000:1.0:1746155559.011044:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123492608 00000100:00100000:1.0:1746155559.011105:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11482 00000100:00100000:1.0:1746155559.011114:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+23:28806:x1830976123492608:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.011128:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.011147:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c14de00/0x844e5faceb5ea027 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ff47 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.011170:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff0f expref: 36 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.011177:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155559.011179:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155559.011182:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c14de00/0x844e5faceb5ea027 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff47 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746155559.011222:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155559.011281:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155559.012217:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff0f expref: 38 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.012233:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130385000/0x844e5faceb5e9fb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff0f expref: 38 pid: 10591 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.012244:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124484608:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155559.012297:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155559.020748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.020867:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124484608:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155559.020891:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c14de00/0x844e5faceb5ea027 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff47 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.020905:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c14de00, rc 0) 00000100:00100000:1.0:1746155559.020942:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:28806:x1830976123492608:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9830us (11105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.020949:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11482 00000100:00100000:0.0:1746155559.030564:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.030625:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123493376 00000100:00100000:1.0:1746155559.030632:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123493376 00000100:00100000:1.0:1746155559.030694:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11483 00000100:00100000:1.0:1746155559.030700:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:28810:x1830976123493376:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.030711:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.030722:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c14c200/0x844e5faceb5ea02e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ff4e expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.030741:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155559.030745:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c14c200/0x844e5faceb5ea02e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff4e expref: 41 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.030754:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c14c200/0x844e5faceb5ea02e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff4e expref: 41 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.030761:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c14c200, rc 0) 00000100:00100000:1.0:1746155559.030777:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:28810:x1830976123493376:12345-192.168.202.51@tcp:101:cat.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.030781:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11483 00000100:00100000:0.0:1746155559.035246:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.041087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.042560:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.046743:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.047265:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123494272 00000100:00100000:0.0:1746155559.047273:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123494272 00002000:00100000:0.0:1746155559.047309:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1499136->2097151) req@ffff88012fef2d80 x1830976123494272/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155559.047318:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef2d80 with x1830976123494272 ext(1499136->2097151) 00002000:00010000:0.0:1746155559.047324:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef2d80 00000100:00100000:0.0:1746155559.047355:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4278 00000100:00100000:0.0:1746155559.047363:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123494272:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155559.066279:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.066872:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123494400 00000100:00100000:1.0:1746155559.066880:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123494400 00000100:00100000:1.0:1746155559.066930:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11484 00000100:00100000:1.0:1746155559.066937:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:28810:x1830976123494400:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.066952:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.066965:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094705800/0x844e5faceb5ea035 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ff55 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.066990:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130385400/0x844e5faceb5e9f2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe9f expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.066997:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155559.066998:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155559.067001:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094705800/0x844e5faceb5ea035 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff55 expref: 40 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.067350:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130385400/0x844e5faceb5e9f2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe9f expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.067365:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130385400/0x844e5faceb5e9f2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe9f expref: 23 pid: 1625 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.067376:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124484992:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155559.067458:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155559.071008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.071257:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124484992:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155559.071283:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094705800/0x844e5faceb5ea035 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff55 expref: 40 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.071301:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094705800, rc 0) 00000100:00100000:1.0:1746155559.071337:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:28810:x1830976123494400:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4401us (5066us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.071344:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11484 00000100:00100000:1.0:1746155559.071543:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.071594:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123494656 00000100:00100000:0.0:1746155559.071598:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123494656 00000100:00100000:0.0:1746155559.071632:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11485 00000100:00100000:0.0:1746155559.071639:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123494656:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155559.071650:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155559.071669:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938a1600/0x844e5faceb5ea03c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ff5c expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155559.071702:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124485120:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155559.071754:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155559.075471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.075500:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123494912 00000100:00100000:1.0:1746155559.075519:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123494912 00000100:00080000:0.0:1746155559.075582:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155559.075959:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9883 00000100:00100000:1.0:1746155559.075967:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+14:28812:x1830976123494912:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155559.075983:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.075995:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094705600/0x844e5faceb5ea043 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ff63 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.076061:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094705e00/0x844e5faceb5ea04a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.076072:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130384200/0x844e5faceb5e9f71 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fed0 expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.076079:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130384c00/0x844e5faceb5e9fd3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff16 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.076085:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009361dc00/0x844e5faceb5ea00b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff32 expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.076090:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094705e00/0x844e5faceb5ea04a lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.076113:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009361dc00/0x844e5faceb5ea00b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff32 expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.076122:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009361dc00/0x844e5faceb5ea00b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff32 expref: 293 pid: 27374 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.076131:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124485248:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155559.076178:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130384c00/0x844e5faceb5e9fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff16 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.076185:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130384c00/0x844e5faceb5e9fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff16 expref: 15 pid: 27374 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.076191:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124485376:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155559.076207:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130384200/0x844e5faceb5e9f71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fed0 expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.076213:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130384200/0x844e5faceb5e9f71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fed0 expref: 11 pid: 14234 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.076219:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124485504:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155559.076229:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155559.082472:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.082499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.082528:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123495040 00000100:00100000:0.0:1746155559.082534:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123495040 00010000:00010000:0.0:1746155559.082560:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130384c00/0x844e5faceb5e9fd3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff16 expref: 16 pid: 27374 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746155559.082589:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5710 00000100:00100000:0.0:1746155559.082594:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123495040:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.082601:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.082606:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130384c00/0x844e5faceb5e9fd3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff16 expref: 16 pid: 27374 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.082615:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130384c00/0x844e5faceb5e9fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff16 expref: 16 pid: 27374 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.082743:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124485376:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155559.082753:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130384200/0x844e5faceb5e9f71 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fed0 expref: 12 pid: 14234 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.082771:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124485504:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155559.082839:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130384c00/0x844e5faceb5e9fd3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff16 expref: 16 pid: 27374 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.082852:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155559.082856:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094705e00/0x844e5faceb5ea04a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.082862:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094705e00/0x844e5faceb5ea04a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.082866:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155559.082896:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123495040:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 302us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.082901:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5710 00000100:00100000:0.0:1746155559.082998:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.083044:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.083055:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123495424 00000100:00100000:0.0:1746155559.083058:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123495424 00010000:00010000:0.0:1746155559.083070:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009361dc00/0x844e5faceb5ea00b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff32 expref: 294 pid: 27374 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746155559.083085:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5711 00000100:00100000:0.0:1746155559.083090:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1963:x1830976123495424:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.083096:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.083100:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009361dc00/0x844e5faceb5ea00b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff32 expref: 294 pid: 27374 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.083108:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009361dc00/0x844e5faceb5ea00b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff32 expref: 294 pid: 27374 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.083118:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155559.083207:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009361dc00/0x844e5faceb5ea00b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff32 expref: 294 pid: 27374 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.083216:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124485248:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155559.084315:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094705e00/0x844e5faceb5ea04a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.084327:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094705e00/0x844e5faceb5ea04a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.084332:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094705e00/0x844e5faceb5ea04a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.084666:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155559.084719:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094705e00/0x844e5faceb5ea04a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.084726:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094705e00/0x844e5faceb5ea04a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.084731:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094705e00/0x844e5faceb5ea04a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155559.084745:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00010000:00010000:1.0:1746155559.084851:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094705600/0x844e5faceb5ea043 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff63 expref: 16 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.084864:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094705e00/0x844e5faceb5ea04a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff63 expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.084871:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155559.084873:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155559.084875:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094705e00, rc 0) 00000100:00100000:1.0:1746155559.084894:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28812:x1830976123494912:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8928us (9423us total) trans 8589943791 rc 0/0 00000100:00100000:1.0:1746155559.084899:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9883 00000100:00100000:0.0:1746155559.084948:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1963:x1830976123495424:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1599us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.084956:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5711 00000100:00100000:0.0:1746155559.088005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.093743:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.093821:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.093869:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123496192 00000100:00100000:1.0:1746155559.093877:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123496192 00000100:00100000:1.0:1746155559.093922:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3956 00000100:00100000:1.0:1746155559.093929:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28806:x1830976123496192:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155559.094439:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28806:x1830976123496192:12345-192.168.202.51@tcp:35:cat.0 Request processed in 510us (617us total) trans 8589943792 rc 0/0 00000100:00100000:1.0:1746155559.094446:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3956 00000100:00100000:1.0:1746155559.094993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.095399:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123496320 00000100:00100000:0.0:1746155559.095403:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123496320 00000100:00100000:0.0:1746155559.095440:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11488 00000100:00100000:0.0:1746155559.095446:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+30:28812:x1830976123496320:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155559.095455:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155559.095468:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938a1000/0x844e5faceb5ea066 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ff78 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.095488:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c14d800/0x844e5faceb5e9fef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff2b expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.095495:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5ea019 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff39 expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155559.095501:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155559.095517:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155559.095520:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938a1000/0x844e5faceb5ea066 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [421888->729087] (req 421888->729087) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff78 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.095544:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5ea019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff39 expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155559.095553:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5ea019 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff39 expref: 30 pid: 8437 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746155559.095563:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124485888:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155559.095669:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c14d800/0x844e5faceb5e9fef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff2b expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.095677:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c14d800/0x844e5faceb5e9fef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff2b expref: 31 pid: 8437 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746155559.095685:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124486016:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155559.095702:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155559.103963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.104042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.104058:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123496448 00000100:00100000:1.0:1746155559.104062:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123496448 00010000:00010000:1.0:1746155559.104083:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5ea019 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff39 expref: 31 pid: 8437 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746155559.104100:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123496576 00000100:00100000:1.0:1746155559.104103:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123496576 00010000:00010000:1.0:1746155559.104110:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c14d800/0x844e5faceb5e9fef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff2b expref: 31 pid: 8437 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.104579:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5713 00000100:00100000:1.0:1746155559.104587:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123496448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155559.104597:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155559.104616:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5ea019 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff39 expref: 31 pid: 8437 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746155559.104625:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5ea019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff39 expref: 31 pid: 8437 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746155559.104644:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094165400/0x844e5faceb5ea019 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff39 expref: 31 pid: 8437 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746155559.104668:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155559.104689:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123496448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 103us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.104694:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5713 00000100:00100000:1.0:1746155559.104706:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5714 00000100:00100000:1.0:1746155559.104710:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1962:x1830976123496576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155559.104718:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155559.104725:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c14d800/0x844e5faceb5e9fef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff2b expref: 31 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746155559.104732:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c14d800/0x844e5faceb5e9fef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff2b expref: 31 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746155559.104743:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c14d800/0x844e5faceb5e9fef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff2b expref: 31 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746155559.104750:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.104752:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.104757:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938a1000/0x844e5faceb5ea066 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 421888->729087) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff78 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.104765:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938a1000/0x844e5faceb5ea066 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 421888->729087) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff78 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.104970:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800938a1000/0x844e5faceb5ea066 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 421888->729087) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff78 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155559.104983:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124486144:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155559.105367:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155559.108616:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.108787:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124486144:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155559.108801:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155559.108837:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1962:x1830976123496576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4121us (4790us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.108844:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5714 00000100:00100000:0.0:1746155559.117267:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.117540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.123206:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.127195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.133565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.133588:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123497728 00000100:00100000:1.0:1746155559.133595:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123497728 00000100:00100000:1.0:1746155559.133636:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3957 00000100:00100000:1.0:1746155559.133643:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:28810:x1830976123497728:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155559.133828:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:28810:x1830976123497728:12345-192.168.202.51@tcp:35:cat.0 Request processed in 184us (268us total) trans 8589943793 rc 0/0 00000100:00100000:1.0:1746155559.133834:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3957 00000100:00100000:0.0:1746155559.186757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.187154:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123497984 00000100:00100000:1.0:1746155559.187162:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123497984 00000100:00100000:1.0:1746155559.187467:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9884 00000100:00100000:1.0:1746155559.187476:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:28818:x1830976123497984:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155559.187494:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.187541:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39000/0x844e5faceb5ea082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ff94 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.187630:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea089 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187640:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187649:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187672:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187677:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187683:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187777:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea097 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187784:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea097 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187790:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea097 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155559.187797:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00010000:00010000:1.0:1746155559.187861:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187867:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea089 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187874:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187879:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb39200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155559.187882:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187887:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea089 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187896:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155559.187899:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155559.187902:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.187905:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.188711:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.188718:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea090 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.188722:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.188726:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb39400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155559.188728:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.188732:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea090 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.188742:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ca89e00) 00010000:00010000:1.0:1746155559.188744:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155559.188746:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea090 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.188750:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.188785:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39000/0x844e5faceb5ea082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff94 expref: 297 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.188794:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea097 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff94 expref: 296 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.188799:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155559.188801:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155559.188803:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb39600, rc 0) 00000100:00100000:1.0:1746155559.188859:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:28818:x1830976123497984:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1384us (2107us total) trans 8589943794 rc 0/0 00000100:00100000:1.0:1746155559.188866:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9884 00000100:00100000:0.0:1746155559.190915:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.190999:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123498112 00000100:00100000:1.0:1746155559.191006:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123498112 00000100:00100000:1.0:1746155559.191057:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 574 00000100:00100000:1.0:1746155559.191065:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:1960:x1830976123498112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155559.191079:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155559.191096:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea097 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff94 expref: 296 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.191112:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155559.191116:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155559.191160:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1960:x1830976123498112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.191166:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 574 00000100:00100000:0.0:1746155559.191185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.195681:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124486656:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155559.195693:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124486784:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155559.195781:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124486912:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155559.195808:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a093b400/0x844e5faceb5ea0a5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3903488->3936255] (req 3903488->3936255) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff9b expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.195822:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a093b400, rc 0) 00000100:00100000:1.0:1746155559.195927:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:28818:x1830976123498240:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4657us (4741us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.195935:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11492 00000100:00100000:0.0:1746155559.196479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.196521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.196551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.196572:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123498496 00000100:00100000:0.0:1746155559.196577:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123498496 00010000:00010000:0.0:1746155559.196597:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0698c00/0x844e5faceb5e9d48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd8e expref: 26 pid: 8436 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746155559.196796:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123498624 00000100:00100000:0.0:1746155559.196799:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123498624 00010000:00010000:0.0:1746155559.196808:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009364a600/0x844e5faceb5e9ced lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd48 expref: 41 pid: 20796 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746155559.196820:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5716 00000100:00100000:0.0:1746155559.196824:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123498368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.196830:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.196836:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0699600/0x844e5faceb5e9e0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe0c expref: 9 pid: 20200 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.196849:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0699600/0x844e5faceb5e9e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe0c expref: 9 pid: 20200 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.197010:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0699600/0x844e5faceb5e9e0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe0c expref: 9 pid: 20200 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.197021:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155559.197273:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123498368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 446us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.197279:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5716 00000100:00100000:0.0:1746155559.199466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.201554:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.213787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.213871:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123499392 00000100:00100000:1.0:1746155559.213878:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123499392 00000100:00100000:1.0:1746155559.213920:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9885 00000100:00100000:1.0:1746155559.213927:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28822:x1830976123499392:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.213950:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.213965:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39a00/0x844e5faceb5ea0ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ffa2 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.214048:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea0b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214064:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea0b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214072:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea0b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214086:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea0ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214091:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea0ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214095:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea0ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214183:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea0c1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214191:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214196:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155559.214203:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00010000:00010000:1.0:1746155559.214270:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea0b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214276:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea0b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214281:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea0b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214285:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb39c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155559.214288:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea0b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214293:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea0b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214303:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155559.214305:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155559.214308:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea0b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214313:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea0b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214409:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea0ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214414:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea0ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214418:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea0ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214422:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb39e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155559.214424:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea0ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214428:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea0ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214434:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ca89f00) 00010000:00010000:1.0:1746155559.214436:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155559.214438:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea0ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214441:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea0ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.214470:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39a00/0x844e5faceb5ea0ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffa2 expref: 19 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.214480:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea0c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffa2 expref: 18 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.214485:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155559.214486:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155559.214488:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb39600, rc 0) 00000100:00100000:1.0:1746155559.214695:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:28822:x1830976123499392:12345-192.168.202.51@tcp:101:cat.0 Request processed in 768us (914us total) trans 8589943796 rc 0/0 00000100:00100000:1.0:1746155559.214702:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9885 00000100:00100000:0.0:1746155559.218882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.219270:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123499520 00000100:00100000:1.0:1746155559.219283:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123499520 00000100:00100000:1.0:1746155559.219332:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11493 00000100:00100000:1.0:1746155559.219344:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123499520:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.219359:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.219375:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb39800/0x844e5faceb5ea0cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ffa9 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155559.219423:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124487168:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155559.220312:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00002000:00010000:1.0:1746155559.221143:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime: 1746155558 -> 1746155559 00002000:00010000:1.0:1746155559.221146:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime: 1746155557 -> 1746155559 00002000:00010000:1.0:1746155559.221148:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime: 1746155558 -> 1746155559 00000100:00100000:1.0:1746155559.221163:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124487168:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155559.221183:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb39800/0x844e5faceb5ea0cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffa9 expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.221200:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb39800/0x844e5faceb5ea0cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffa9 expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.221224:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb39800, rc 0) 00000100:00100000:1.0:1746155559.221251:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123499520:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1909us (2375us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155559.221258:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11493 00000100:00100000:0.0:1746155559.232009:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.232057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.232147:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123499904 00000100:00100000:1.0:1746155559.232154:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123499904 00002000:00100000:1.0:1746155559.232189:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009486aa00 x1830976123499904/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 504/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.232198:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486aa00 with x1830976123499904 ext(0->1048575) 00002000:00010000:1.0:1746155559.232202:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486aa00 00000100:00100000:1.0:1746155559.232231:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123500032 00000100:00100000:1.0:1746155559.232234:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123500032 00002000:00100000:1.0:1746155559.232246:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009486ad80 x1830976123500032/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.232253:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486ad80 with x1830976123500032 ext(1048576->2097151) 00002000:00010000:1.0:1746155559.232255:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486ad80 00000100:00100000:1.0:1746155559.232266:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4283 00000100:00100000:1.0:1746155559.232273:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123499904:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155559.232566:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4284 00000100:00100000:0.0:1746155559.232573:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123500032:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155559.247618:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.247699:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123500288 00000100:00100000:0.0:1746155559.247707:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123500288 00000100:00100000:0.0:1746155559.247753:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9886 00000100:00100000:0.0:1746155559.247760:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:28824:x1830976123500288:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155559.247778:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155559.247792:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009364b800/0x844e5faceb5ea0d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ffb0 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.247872:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ba00/0x844e5faceb5ea0dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.247883:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ba00/0x844e5faceb5ea0dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.247891:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ba00/0x844e5faceb5ea0dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.247899:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009364bc00/0x844e5faceb5ea0e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.247904:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009364bc00/0x844e5faceb5ea0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.247908:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009364bc00/0x844e5faceb5ea0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.247992:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009364a800/0x844e5faceb5ea0eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.247998:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009364a800/0x844e5faceb5ea0eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.248003:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009364a800/0x844e5faceb5ea0eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155559.248010:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00010000:00010000:1.0:1746155559.249332:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ba00/0x844e5faceb5ea0dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249341:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ba00/0x844e5faceb5ea0dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249348:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ba00/0x844e5faceb5ea0dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249353:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009364ba00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155559.249356:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ba00/0x844e5faceb5ea0dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249362:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ba00/0x844e5faceb5ea0dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249373:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155559.249375:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155559.249378:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ba00/0x844e5faceb5ea0dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249383:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009364ba00/0x844e5faceb5ea0dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249410:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009364bc00/0x844e5faceb5ea0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249415:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009364bc00/0x844e5faceb5ea0e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249421:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009364bc00/0x844e5faceb5ea0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249426:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009364bc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155559.249428:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009364bc00/0x844e5faceb5ea0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249433:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009364bc00/0x844e5faceb5ea0e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249442:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008e62d700) 00010000:00010000:1.0:1746155559.249444:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155559.249446:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009364bc00/0x844e5faceb5ea0e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249451:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009364bc00/0x844e5faceb5ea0e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.249484:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009364b800/0x844e5faceb5ea0d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffb0 expref: 21 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.249494:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009364a800/0x844e5faceb5ea0eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffb0 expref: 20 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.249513:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155559.249516:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155559.249518:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009364a800, rc 0) 00000100:00100000:1.0:1746155559.249558:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:28824:x1830976123500288:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1798us (1947us total) trans 8589943797 rc 0/0 00000100:00100000:1.0:1746155559.249564:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9886 00000100:00100000:1.0:1746155559.250529:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123499904:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18216us (18487us total) trans 0 rc 741376/741376 00000100:00100000:1.0:1746155559.250537:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4283 00002000:00100000:1.0:1746155559.250545:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009486aa00 x1830976123499904/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 504/440 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.250553:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486aa00 with x1830976123499904 ext(0->1048575) 00002000:00010000:1.0:1746155559.250557:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486aa00 00000100:00100000:0.0:1746155559.253257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.253303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.254601:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123500672 00000100:00100000:1.0:1746155559.254605:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123500672 00000100:00100000:1.0:1746155559.254628:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3959 00000100:00100000:1.0:1746155559.254633:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+19:28824:x1830976123500672:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155559.254790:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+20:28824:x1830976123500672:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 156us (1486us total) trans 8589943798 rc 0/0 00000100:00100000:1.0:1746155559.254796:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3959 00000100:00100000:0.0:1746155559.257578:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.257665:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123500928 00000100:00100000:1.0:1746155559.257672:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123500928 00000100:00100000:1.0:1746155559.257714:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9887 00000100:00100000:1.0:1746155559.257720:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:28827:x1830976123500928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.257738:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.257752:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38600/0x844e5faceb5ea0f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ffb7 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.257836:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38a00/0x844e5faceb5ea100 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.257846:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38a00/0x844e5faceb5ea100 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.257855:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38a00/0x844e5faceb5ea100 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.257865:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38800/0x844e5faceb5ea107 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.257870:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38800/0x844e5faceb5ea107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.257874:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38800/0x844e5faceb5ea107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.257955:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38400/0x844e5faceb5ea10e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.257962:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38400/0x844e5faceb5ea10e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.257967:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38400/0x844e5faceb5ea10e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155559.257974:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00010000:00010000:1.0:1746155559.258037:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38a00/0x844e5faceb5ea100 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258042:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38a00/0x844e5faceb5ea100 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258046:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38a00/0x844e5faceb5ea100 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258051:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb38a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155559.258054:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38a00/0x844e5faceb5ea100 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258060:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38a00/0x844e5faceb5ea100 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258069:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155559.258072:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155559.258075:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38a00/0x844e5faceb5ea100 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258079:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38a00/0x844e5faceb5ea100 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258091:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38800/0x844e5faceb5ea107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258095:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38800/0x844e5faceb5ea107 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258099:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38800/0x844e5faceb5ea107 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258102:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb38800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155559.258104:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38800/0x844e5faceb5ea107 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258107:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38800/0x844e5faceb5ea107 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258112:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ca89e00) 00010000:00010000:1.0:1746155559.258113:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155559.258115:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38800/0x844e5faceb5ea107 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258119:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38800/0x844e5faceb5ea107 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.258147:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38600/0x844e5faceb5ea0f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffb7 expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.258156:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38400/0x844e5faceb5ea10e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffb7 expref: 298 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.258161:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155559.258163:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155559.258166:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb38400, rc 0) 00000100:00100000:1.0:1746155559.258203:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:28827:x1830976123500928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 483us (632us total) trans 8589943799 rc 0/0 00000100:00100000:1.0:1746155559.258208:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9887 00000100:00100000:0.0:1746155559.263910:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123501056 00000100:00100000:0.0:1746155559.263918:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123501056 00000100:00100000:0.0:1746155559.263971:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 576 00000100:00100000:0.0:1746155559.263979:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1960:x1830976123501056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.263996:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155559.264019:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123501184 00010000:00010000:0.0:1746155559.264020:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38400/0x844e5faceb5ea10e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffb7 expref: 298 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155559.264023:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123501184 00000100:00100000:1.0:1746155559.264046:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11494 00010000:00010000:0.0:1746155559.264050:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00000100:00100000:1.0:1746155559.264052:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123501184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155559.264054:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155559.264063:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.264075:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb38200/0x844e5faceb5ea11c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ffbe expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155559.264093:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1960:x1830976123501056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.264099:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 576 00000100:00100000:1.0:1746155559.264114:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124487296:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155559.264170:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155559.271850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.273254:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124487296:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155559.273281:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb38200/0x844e5faceb5ea11c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffbe expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.273294:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb38200/0x844e5faceb5ea11c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffbe expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.273312:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb38200, rc 0) 00000100:00100000:1.0:1746155559.274390:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123501184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10333us (10563us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155559.274398:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11494 00000100:00100000:1.0:1746155559.276965:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.277013:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.277042:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123501440 00000100:00100000:1.0:1746155559.277048:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123501440 00000100:00100000:1.0:1746155559.277087:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11496 00000100:00100000:1.0:1746155559.277096:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:28827:x1830976123501440:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.277111:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.277125:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb38000/0x844e5faceb5ea12a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ffcc expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.277150:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938a1000/0x844e5faceb5ea066 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 421888->729087) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff78 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.277157:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155559.277159:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155559.277162:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb38000/0x844e5faceb5ea12a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffcc expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.277189:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938a1000/0x844e5faceb5ea066 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 421888->729087) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff78 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.277200:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938a1000/0x844e5faceb5ea066 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 421888->729087) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff78 expref: 29 pid: 8437 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.277211:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124487552:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155559.277261:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155559.277281:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123501568 00000100:00100000:1.0:1746155559.277286:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123501568 00002000:00100000:1.0:1746155559.277315:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (3903488->3936255) req@ffff88012fef0a80 x1830976123501568/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.277323:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0a80 with x1830976123501568 ext(3903488->3936255) 00010000:00010000:1.0:1746155559.277329:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a093b400/0x844e5faceb5ea0a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->3936255) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff9b expref: 40 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746155559.277338:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a093b400/0x844e5faceb5ea0a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->3936255) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff9b expref: 40 pid: 8437 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746155559.277343:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fef0a80 00000100:00100000:1.0:1746155559.278468:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 631 00000100:00100000:1.0:1746155559.278477:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1963:x1830976123501568:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155559.280122:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124487552:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155559.280147:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb38000/0x844e5faceb5ea12a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffcc expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.280161:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb38000, rc 0) 00000100:00100000:1.0:1746155559.280203:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:28827:x1830976123501440:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3108us (3245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.280209:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11496 00000100:00100000:0.0:1746155559.280545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.284905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.289851:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.294899:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4285 00000100:00100000:0.0:1746155559.294908:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1963:x1830976123502208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155559.302396:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123502720 00000100:00100000:1.0:1746155559.302410:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123502720 00002000:00100000:1.0:1746155559.302457:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012b6c0000 x1830976123502720/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.302466:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c0000 with x1830976123502720 ext(0->1048575) 00002000:00010000:1.0:1746155559.302472:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c0000 00000100:00100000:1.0:1746155559.302522:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4287 00000100:00100000:1.0:1746155559.302530:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123502720:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155559.319579:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123502208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24665us (25572us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155559.319589:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4285 00002000:00100000:1.0:1746155559.319599:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012b6c2680 x1830976123502208/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/440 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.319607:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c2680 with x1830976123502208 ext(2097152->3145727) 00002000:00010000:1.0:1746155559.319612:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b6c2680 00000100:00100000:0.0:1746155559.330332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.330639:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123502848 00000100:00100000:1.0:1746155559.330647:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123502848 00000100:00100000:1.0:1746155559.330710:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11497 00000100:00100000:1.0:1746155559.330718:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1962:x1830976123502848:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.330734:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.330749:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093332000/0x844e5faceb5ea131 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ffd3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.330770:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.330772:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.330782:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093332000/0x844e5faceb5ea131 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffd3 expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.330796:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093332000/0x844e5faceb5ea131 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffd3 expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.330812:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093332000, rc 0) 00000100:00100000:1.0:1746155559.330864:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1962:x1830976123502848:12345-192.168.202.51@tcp:101:cat.0 Request processed in 145us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.330871:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11497 00000100:00100000:0.0:1746155559.331019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.336811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.336939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.336970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.337031:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.338365:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123503360 00000100:00100000:1.0:1746155559.338372:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123503360 00002000:00100000:1.0:1746155559.338403:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009fe90380 x1830976123503360/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.338412:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe90380 with x1830976123503360 ext(3145728->4194303) 00002000:00010000:1.0:1746155559.338416:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe90380 00000100:00100000:1.0:1746155559.338432:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123503232 00000100:00100000:1.0:1746155559.338436:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123503232 00002000:00100000:1.0:1746155559.338453:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009fe92680 x1830976123503232/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.338459:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe92680 with x1830976123503232 ext(2097152->3145727) 00002000:00010000:1.0:1746155559.338462:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe92680 00000100:00100000:1.0:1746155559.338477:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4288 00000100:00100000:1.0:1746155559.338484:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1960:x1830976123503360:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155559.347497:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.359718:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1960:x1830976123503360:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21225us (22909us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155559.359729:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4288 00002000:00100000:1.0:1746155559.359738:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009fe90380 x1830976123503360/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/440 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.359753:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe90380 with x1830976123503360 ext(3145728->4194303) 00002000:00010000:1.0:1746155559.359758:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe90380 00000100:00100000:0.0:1746155559.382378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.394359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.394449:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123504512 00000100:00100000:1.0:1746155559.394458:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123504512 00000100:00100000:1.0:1746155559.394535:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11499 00000100:00100000:1.0:1746155559.394543:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+32:28824:x1830976123504512:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155559.394559:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.394688:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093333600/0x844e5faceb5ea162 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ffe8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.394897:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130384a00/0x844e5faceb5e9d8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdbf expref: 30 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.394908:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0698200/0x844e5faceb5e9dfe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdfe expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.394915:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093333c00/0x844e5faceb5e9daa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdc6 expref: 33 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.394920:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.394922:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.394925:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093333600/0x844e5faceb5ea162 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1994752->2097151] (req 1994752->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffe8 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.394951:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093333c00/0x844e5faceb5e9daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdc6 expref: 33 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.394966:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093333c00/0x844e5faceb5e9daa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdc6 expref: 33 pid: 4461 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746155559.394977:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124487936:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155559.395606:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0698200/0x844e5faceb5e9dfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdfe expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.395614:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0698200/0x844e5faceb5e9dfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdfe expref: 10 pid: 20200 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746155559.395623:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124488064:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155559.395646:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130384a00/0x844e5faceb5e9d8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdbf expref: 30 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.395666:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130384a00/0x844e5faceb5e9d8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdbf expref: 30 pid: 10591 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746155559.395674:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124488192:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155559.395691:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155559.398296:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124487936:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155559.398305:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124488064:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155559.398316:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124488192:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155559.398346:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093333600/0x844e5faceb5ea162 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1994752->2097151] (req 1994752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffe8 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.398359:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093333600, rc 0) 00000100:00100000:1.0:1746155559.398391:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+33:28824:x1830976123504512:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3848us (4038us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.398399:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11499 00000100:00100000:0.0:1746155559.400185:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.400224:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.400482:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5721 00000100:00100000:0.0:1746155559.400489:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123504768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.400495:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.400597:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0698200/0x844e5faceb5e9dfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdfe expref: 11 pid: 20200 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.400605:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0698200/0x844e5faceb5e9dfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdfe expref: 11 pid: 20200 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.400616:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0698200/0x844e5faceb5e9dfe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdfe expref: 11 pid: 20200 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.400639:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155559.400668:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123504768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 180us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.400674:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5721 00000100:00100000:0.0:1746155559.401633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.407875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.410557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.410589:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123505280 00000100:00100000:1.0:1746155559.410596:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123505280 00000100:00100000:1.0:1746155559.410643:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11500 00000100:00100000:1.0:1746155559.410660:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+32:28824:x1830976123505280:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155559.410673:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.410688:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0698200/0x844e5faceb5ea169 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0ffef expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.410711:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f77400/0x844e5faceb5e9d02 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd6b expref: 33 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.410719:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0698800/0x844e5faceb5e9e05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe05 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.410725:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f76a00/0x844e5faceb5e9d3a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd80 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.410730:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.410732:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.410735:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0698200/0x844e5faceb5ea169 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->2793471] (req 2097152->2793471) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffef expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.410762:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135f76a00/0x844e5faceb5e9d3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd80 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.410771:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135f76a00/0x844e5faceb5e9d3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd80 expref: 29 pid: 8437 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.410781:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124488448:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155559.410899:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0698800/0x844e5faceb5e9e05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe05 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.410907:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0698800/0x844e5faceb5e9e05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe05 expref: 9 pid: 20200 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746155559.410915:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124488576:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155559.410939:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135f77400/0x844e5faceb5e9d02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd6b expref: 33 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.410946:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135f77400/0x844e5faceb5e9d02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fd6b expref: 33 pid: 9235 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746155559.410953:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124488704:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155559.410968:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155559.413064:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124488448:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155559.414373:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124488576:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155559.414381:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124488704:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155559.414407:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0698200/0x844e5faceb5ea169 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->2793471] (req 2097152->2793471) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffef expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.414420:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0698200, rc 0) 00000100:00100000:1.0:1746155559.414464:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+33:28824:x1830976123505280:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3813us (3911us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.414471:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11500 00000100:00100000:0.0:1746155559.416806:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.420178:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.420221:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.429453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.481487:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.484586:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.485841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155559.486140:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131303600/0x844e5faceb5ea185 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486146:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131303600/0x844e5faceb5ea185 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155559.486169:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9038656 00000004:00200000:0.0:1746155559.486172:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155559.486184:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131303600/0x844e5faceb5ea185 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486191:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131303600/0x844e5faceb5ea185 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486199:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131303a00/0x844e5faceb5ea177 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486204:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131303a00/0x844e5faceb5ea177 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486210:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131303a00/0x844e5faceb5ea177 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486214:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131303a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155559.486216:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131303a00/0x844e5faceb5ea177 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486221:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131303a00/0x844e5faceb5ea177 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486228:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155559.486230:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155559.486232:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131303a00/0x844e5faceb5ea177 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486236:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131303a00/0x844e5faceb5ea177 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486255:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131303800/0x844e5faceb5ea17e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486259:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131303800/0x844e5faceb5ea17e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486263:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131303800/0x844e5faceb5ea17e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486266:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131303800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155559.486275:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131303800/0x844e5faceb5ea17e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486279:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131303800/0x844e5faceb5ea17e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486284:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800942dcf00) 00010000:00010000:0.0:1746155559.486286:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155559.486288:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131303800/0x844e5faceb5ea17e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486291:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131303800/0x844e5faceb5ea17e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155559.486313:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131303400/0x844e5faceb5ea170 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fff6 expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.486322:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131303600/0x844e5faceb5ea185 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fff6 expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.486326:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155559.486328:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155559.486330:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131303600, rc 0) 00000100:00100000:0.0:1746155559.486348:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:28833:x1830976123506048:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 4650us (4870us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.486353:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9889 00000100:00100000:0.0:1746155559.490233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.490557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.490670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.490966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.491021:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123506560 00000100:00100000:1.0:1746155559.491028:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123506560 00000100:00100000:1.0:1746155559.491059:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123506816 00000100:00100000:1.0:1746155559.491061:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123506816 00000100:00100000:1.0:1746155559.491070:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123507072 00000100:00100000:1.0:1746155559.491072:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123507072 00000100:00100000:1.0:1746155559.491083:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11501 00000100:00100000:1.0:1746155559.491090:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123506560:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155559.491104:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.491117:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fef1a00/0x844e5faceb5ea18c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f0fffd expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.491135:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.491136:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.491142:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fef1a00/0x844e5faceb5ea18c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fffd expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.491154:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fef1a00/0x844e5faceb5ea18c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fffd expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.491163:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fef1a00, rc 0) 00000100:00100000:1.0:1746155559.491197:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123506560:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 107us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.491202:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11501 00000100:00100000:1.0:1746155559.491215:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11502 00000100:00100000:1.0:1746155559.491220:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123506816:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155559.491226:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.491235:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fef1e00/0x844e5faceb5ea193 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1000b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.491244:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.491246:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.491250:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fef1e00/0x844e5faceb5ea193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1000b expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.491258:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fef1e00/0x844e5faceb5ea193 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1000b expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.491265:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fef1e00, rc 0) 00000100:00100000:1.0:1746155559.491279:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123506816:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 59us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.491284:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11502 00000100:00100000:1.0:1746155559.491292:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11503 00000100:00100000:1.0:1746155559.491297:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123507072:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155559.491304:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.491310:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fef1c00/0x844e5faceb5ea19a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10019 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155559.491339:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124489088:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155559.491374:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155559.491583:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123506688 00000100:00100000:0.0:1746155559.491586:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123506688 00000100:00100000:0.0:1746155559.491602:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11504 00000100:00100000:0.0:1746155559.491607:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123506688:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155559.491613:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155559.491619:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009364a400/0x844e5faceb5ea1a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10004 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.491629:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155559.491630:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155559.491635:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009364a400/0x844e5faceb5ea1a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10004 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155559.491643:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009364a400/0x844e5faceb5ea1a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10004 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155559.491662:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009364a400, rc 0) 00000100:00100000:0.0:1746155559.491676:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123506688:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 70us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.491684:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11504 00000100:00100000:0.0:1746155559.492282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.492883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:1.0:1746155559.493445:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime: 1746155558 -> 1746155559 00002000:00010000:1.0:1746155559.493449:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155558 -> 1746155559 00002000:00010000:1.0:1746155559.493451:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime: 1746155558 -> 1746155559 00000100:00100000:1.0:1746155559.493467:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124489088:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155559.493484:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fef1c00/0x844e5faceb5ea19a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10019 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.493494:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fef1c00/0x844e5faceb5ea19a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10019 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.493526:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fef1c00, rc 0) 00000100:00100000:1.0:1746155559.493544:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976123507072:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 2246us (2874us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155559.493549:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11503 00000100:00100000:1.0:1746155559.493560:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11506 00000100:00100000:1.0:1746155559.493565:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123507200:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155559.493571:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.493578:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0698c00/0x844e5faceb5ea1af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10020 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.493592:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.493593:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.493598:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0698c00/0x844e5faceb5ea1af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10020 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.493606:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0698c00/0x844e5faceb5ea1af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10020 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.493613:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0698c00, rc 0) 00000100:00100000:1.0:1746155559.493625:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123507200:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 60us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.493630:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11506 00000100:00100000:0.0:1746155559.497988:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.499158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.500701:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.502137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.502196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.504547:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.505300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.508040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.508692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.508736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.508776:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123509120 00000100:00100000:1.0:1746155559.508780:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123509120 00000100:00100000:1.0:1746155559.508801:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3963 00000100:00100000:1.0:1746155559.508806:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:28833:x1830976123509120:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:1.0:1746155559.508927:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:28833:x1830976123509120:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 120us (190us total) trans 8589943805 rc 0/0 00000100:00100000:1.0:1746155559.508932:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3963 00000100:00100000:0.0:1746155559.512904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.512971:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.513049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.513095:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123509248 00000100:00100000:1.0:1746155559.513102:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123509248 00000100:00100000:1.0:1746155559.513131:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11508 00000100:00100000:1.0:1746155559.513137:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123509248:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.513151:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.513164:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0698c00/0x844e5faceb5ea203 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10043 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155559.513203:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124489984:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155559.513250:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155559.516074:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124489984:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155559.516096:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0698c00/0x844e5faceb5ea203 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10043 expref: 34 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.516106:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0698c00/0x844e5faceb5ea203 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10043 expref: 34 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.516116:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0698c00, rc 0) 00000100:00100000:1.0:1746155559.516156:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123509248:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3019us (3259us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155559.516162:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11508 00000100:00100000:1.0:1746155559.517024:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.517180:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123509632 00000100:00100000:0.0:1746155559.517186:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123509632 00002000:00100000:0.0:1746155559.518012:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2793471) req@ffff88012fef1880 x1830976123509632/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155559.518023:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef1880 with x1830976123509632 ext(2097152->2793471) 00010000:00010000:0.0:1746155559.518029:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0698200/0x844e5faceb5ea169 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffef expref: 32 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.518038:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0698200/0x844e5faceb5ea169 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffef expref: 32 pid: 8437 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746155559.518048:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fef1880 00000100:00100000:0.0:1746155559.518071:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 633 00000100:00100000:0.0:1746155559.518078:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1960:x1830976123509632:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155559.522969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.525643:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.525979:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123509888 00000100:00100000:0.0:1746155559.525984:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123509888 00002000:00100000:0.0:1746155559.526091:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1994752->2097151) req@ffff880136633b80 x1830976123509888/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155559.526099:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136633b80 with x1830976123509888 ext(1994752->2097151) 00010000:00010000:0.0:1746155559.526106:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093333600/0x844e5faceb5ea162 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffe8 expref: 34 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.526410:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093333600/0x844e5faceb5ea162 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffe8 expref: 34 pid: 8437 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746155559.526417:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136633b80 00000100:00100000:0.0:1746155559.526888:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 634 00000100:00100000:0.0:1746155559.526894:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1960:x1830976123509888:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155559.529485:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1960:x1830976123509888:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 2589us (3845us total) trans 21474840487 rc 0/0 00000100:00100000:0.0:1746155559.529492:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 634 00002000:00100000:0.0:1746155559.529497:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1994752->2097151) req@ffff880136633b80 x1830976123509888/t21474840487(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/448 e 0 to 0 dl 1746155570 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155559.529520:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136633b80 with x1830976123509888 ext(1994752->2097151) 00010000:00010000:0.0:1746155559.529526:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093333600/0x844e5faceb5ea162 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffe8 expref: 36 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.529534:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093333600/0x844e5faceb5ea162 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffe8 expref: 36 pid: 8437 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746155559.529539:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136633b80 00000100:00100000:0.0:1746155559.530633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.530710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.530851:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5732 00000100:00100000:0.0:1746155559.530859:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1960:x1830976123510144:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.530867:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.530875:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093333600/0x844e5faceb5ea162 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffe8 expref: 36 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.530883:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093333600/0x844e5faceb5ea162 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffe8 expref: 36 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.530895:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093333600/0x844e5faceb5ea162 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffe8 expref: 36 pid: 8437 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.530909:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155559.530910:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155559.530914:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bfbcc00/0x844e5faceb5ea218 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10058 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.530926:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bfbcc00/0x844e5faceb5ea218 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10058 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.530949:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bfbcc00/0x844e5faceb5ea218 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10058 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155559.530959:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124490496:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155559.531013:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155559.534922:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.540811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.555728:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.555763:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.555777:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.555796:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123510912 00000100:00100000:1.0:1746155559.555804:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123510912 00002000:00100000:1.0:1746155559.555842:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012fef0e00 x1830976123510912/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.555850:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0e00 with x1830976123510912 ext(2097152->3145727) 00002000:00010000:1.0:1746155559.555855:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef0e00 00000100:00100000:1.0:1746155559.555868:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123511424 00000100:00100000:1.0:1746155559.555871:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123511424 00002000:00100000:1.0:1746155559.555881:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012fef3480 x1830976123511424/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.555887:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef3480 with x1830976123511424 ext(2097152->3145727) 00002000:00010000:1.0:1746155559.555889:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef3480 00000100:00100000:1.0:1746155559.555896:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123511168 00000100:00100000:1.0:1746155559.555898:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123511168 00002000:00100000:1.0:1746155559.555906:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009286ea00 x1830976123511168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.555912:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286ea00 with x1830976123511168 ext(3145728->4194303) 00002000:00010000:1.0:1746155559.555914:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286ea00 00000100:00100000:1.0:1746155559.555941:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4294 00000100:00100000:1.0:1746155559.555948:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123510912:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155559.555948:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4295 00000100:00100000:0.0:1746155559.555956:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976123511424:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155559.557347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.566823:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976123511424:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10862us (11053us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155559.566832:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4295 00002000:00100000:0.0:1746155559.566840:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012fef3480 x1830976123511424/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/440 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155559.566848:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef3480 with x1830976123511424 ext(2097152->3145727) 00002000:00010000:0.0:1746155559.566853:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef3480 00000100:00100000:1.0:1746155559.572532:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976123511552:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7644us (15184us total) trans 0 rc 802816/802816 00000100:00100000:1.0:1746155559.572541:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4297 00002000:00100000:1.0:1746155559.572548:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->3948543) req@ffff880130c9ca80 x1830976123511552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/440 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 802816/802816 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.572557:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ca80 with x1830976123511552 ext(3145728->3948543) 00002000:00010000:1.0:1746155559.572561:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9ca80 00000100:00100000:0.0:1746155559.573735:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123510912:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17786us (18014us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155559.573742:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4294 00002000:00100000:0.0:1746155559.573749:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012fef0e00 x1830976123510912/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/440 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155559.573755:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0e00 with x1830976123510912 ext(2097152->3145727) 00002000:00010000:0.0:1746155559.573758:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef0e00 00000100:00100000:0.0:1746155559.577950:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.577986:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.578024:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.596213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.596246:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.596279:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.596309:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123512832 00000100:00100000:1.0:1746155559.596316:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123512832 00002000:00100000:1.0:1746155559.596352:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880094c30000 x1830976123512832/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.596360:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c30000 with x1830976123512832 ext(0->1048575) 00002000:00010000:1.0:1746155559.596366:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c30000 00000100:00100000:1.0:1746155559.596381:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4298 00000100:00100000:1.0:1746155559.596387:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1960:x1830976123512832:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155559.607188:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+37:1960:x1830976123512832:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10792us (10931us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155559.607199:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4298 00002000:00100000:1.0:1746155559.607210:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880094c30000 x1830976123512832/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/440 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.607218:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c30000 with x1830976123512832 ext(0->1048575) 00002000:00010000:1.0:1746155559.607223:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c30000 00000100:00100000:0.0:1746155559.620821:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.625876:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.628128:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.629244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.629259:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123513600 00000100:00100000:0.0:1746155559.629261:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123513600 00000100:00100000:0.0:1746155559.629279:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11516 00000100:00100000:0.0:1746155559.629284:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123513344:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155559.629289:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155559.629294:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7d400/0x844e5faceb5ea27a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10082 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.629303:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155559.629304:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155559.629311:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7d400/0x844e5faceb5ea27a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10082 expref: 13 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155559.629322:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7d400/0x844e5faceb5ea27a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10082 expref: 13 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155559.629331:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a7d400, rc 0) 00000100:00100000:0.0:1746155559.629362:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976123513344:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 77us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.629367:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11516 00000100:00100000:1.0:1746155559.629584:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.629629:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.629641:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123513728 00000100:00100000:0.0:1746155559.629643:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123513728 00000100:00100000:0.0:1746155559.629676:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123513856 00000100:00100000:0.0:1746155559.629679:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123513856 00000100:00100000:0.0:1746155559.629690:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11518 00000100:00100000:0.0:1746155559.629695:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1962:x1830976123513728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155559.629701:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155559.629706:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c800/0x844e5faceb5ea288 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10097 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155559.629726:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124491264:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155559.629751:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155559.629841:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11519 00000100:00100000:1.0:1746155559.629848:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123513856:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.629854:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.629860:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094704c00/0x844e5faceb5ea28f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1009e expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155559.629879:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124491392:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155559.629975:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155559.631669:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124491392:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155559.631696:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094704c00/0x844e5faceb5ea28f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1009e expref: 26 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.631710:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094704c00/0x844e5faceb5ea28f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1009e expref: 26 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.631720:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094704c00, rc 0) 00000100:00100000:1.0:1746155559.631743:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123513856:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1897us (2113us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155559.631749:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11519 00000100:00100000:0.0:1746155559.631900:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124491264:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155559.631915:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c800/0x844e5faceb5ea288 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10097 expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155559.631923:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c800/0x844e5faceb5ea288 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10097 expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155559.631943:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a7c800, rc 0) 00000100:00100000:0.0:1746155559.631970:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1962:x1830976123513728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2275us (2386us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155559.631976:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11518 00000100:00100000:0.0:1746155559.638175:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.638202:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123514112 00000100:00100000:0.0:1746155559.638209:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123514112 00000100:00100000:1.0:1746155559.638219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.638242:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11520 00000100:00100000:0.0:1746155559.638249:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+35:28841:x1830976123514112:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155559.638264:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155559.638277:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c600/0x844e5faceb5ea296 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f100ac expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.638299:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131303a00/0x844e5faceb5ea20a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10051 expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.638305:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155559.638307:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155559.638310:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c600/0x844e5faceb5ea296 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ac expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.638330:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131303a00/0x844e5faceb5ea20a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10051 expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.638340:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131303a00/0x844e5faceb5ea20a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10051 expref: 30 pid: 1625 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746155559.638350:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124491520:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155559.638412:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155559.640077:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.640100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.642958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.644974:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.645029:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123514752 00000100:00100000:1.0:1746155559.645034:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123514752 00010000:00010000:1.0:1746155559.645055:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131302000/0x844e5faceb5ea1f5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1003c expref: 304 pid: 27374 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.645075:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5735 00000100:00100000:1.0:1746155559.645080:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:1960:x1830976123514752:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155559.645091:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155559.645096:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131302000/0x844e5faceb5ea1f5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1003c expref: 304 pid: 27374 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746155559.645104:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131302000/0x844e5faceb5ea1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1003c expref: 304 pid: 27374 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746155559.645121:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155559.645125:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea2a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155559.645139:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea2a4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155559.645145:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea2a4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155559.645159:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155559.645183:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:1960:x1830976123514752:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 103us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.645188:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5735 00000100:00100000:0.0:1746155559.654018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.659758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.659796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.659820:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123515008 00000100:00100000:1.0:1746155559.659827:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123515008 00010000:00010000:1.0:1746155559.659855:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131303a00/0x844e5faceb5ea20a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10051 expref: 33 pid: 1625 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.659892:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123515136 00000100:00100000:1.0:1746155559.659895:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123515136 00010000:00010000:1.0:1746155559.659905:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39e00/0x844e5faceb5ea2a4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100a5 expref: 17 pid: 27374 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.659923:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5736 00000100:00100000:1.0:1746155559.659930:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123515008:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155559.659942:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155559.659959:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131303a00/0x844e5faceb5ea20a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10051 expref: 33 pid: 1625 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746155559.659968:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131303a00/0x844e5faceb5ea20a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10051 expref: 33 pid: 1625 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746155559.659985:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131303a00/0x844e5faceb5ea20a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10051 expref: 33 pid: 1625 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746155559.659999:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.660001:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.660006:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c600/0x844e5faceb5ea296 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ac expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.660012:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c600/0x844e5faceb5ea296 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ac expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.660033:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c600/0x844e5faceb5ea296 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ac expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155559.660148:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124492160:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155559.660195:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155559.663095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.664009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.664161:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124492160:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155559.664176:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155559.664206:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123515008:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4277us (4456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.664214:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5736 00000100:00100000:0.0:1746155559.664337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.664365:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.669778:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.671034:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.671078:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123516416 00000100:00100000:1.0:1746155559.671082:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123516416 00000100:00100000:0.0:1746155559.675240:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.675659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.680995:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a45c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124492416:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155559.681016:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff81400/0x844e5faceb5ea322 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100dd expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.681027:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff81400, rc 0) 00000100:00100000:0.0:1746155559.681047:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+26:28841:x1830976123516800:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5136us (5388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.681052:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11523 00000100:00100000:0.0:1746155559.691415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.691617:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123517056 00000100:00100000:1.0:1746155559.691625:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123517056 00010000:00010000:1.0:1746155559.691662:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131302a00/0x844e5faceb5ea1b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3948544->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10027 expref: 44 pid: 1625 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746155559.691692:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5738 00000100:00100000:1.0:1746155559.691699:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976123517056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155559.691710:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155559.691727:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131302a00/0x844e5faceb5ea1b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3948544->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10027 expref: 44 pid: 1625 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746155559.691738:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131302a00/0x844e5faceb5ea1b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3948544->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10027 expref: 44 pid: 1625 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746155559.691755:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131302a00/0x844e5faceb5ea1b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3948544->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10027 expref: 44 pid: 1625 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746155559.691769:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.691771:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.691776:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff81400/0x844e5faceb5ea322 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100dd expref: 25 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.691784:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff81400/0x844e5faceb5ea322 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100dd expref: 25 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.691809:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff81400/0x844e5faceb5ea322 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100dd expref: 25 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155559.691819:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124492544:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155559.691886:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155559.693735:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124492544:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155559.693754:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155559.693809:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1961:x1830976123517056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2109us (2399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.693816:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5738 00000100:00100000:0.0:1746155559.710769:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.710807:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.710924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.711014:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123517568 00000100:00100000:0.0:1746155559.711018:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123517568 00002000:00100000:0.0:1746155559.711036:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800a3fc7100 x1830976123517568/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155559.711045:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc7100 with x1830976123517568 ext(3145728->4194303) 00002000:00010000:0.0:1746155559.711050:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc7100 00000100:00100000:0.0:1746155559.711064:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123517824 00000100:00100000:0.0:1746155559.711066:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123517824 00002000:00100000:0.0:1746155559.711076:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800a3fc4a80 x1830976123517824/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155559.711083:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4a80 with x1830976123517824 ext(3145728->4194303) 00002000:00010000:0.0:1746155559.711086:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc4a80 00000100:00100000:0.0:1746155559.711096:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4301 00000100:00100000:0.0:1746155559.711101:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1962:x1830976123517568:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155559.712212:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4303 00000100:00100000:1.0:1746155559.712221:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1962:x1830976123517440:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155559.731127:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123517440:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18907us (20365us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155559.731134:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4303 00002000:00100000:0.0:1746155559.731138:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a3fc5180 x1830976123517440/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/440 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155559.731144:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5180 with x1830976123517440 ext(2097152->3145727) 00002000:00010000:0.0:1746155559.731148:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc5180 00000100:00100000:0.0:1746155559.743663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.765853:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.765966:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.766033:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123518464 00000100:00100000:1.0:1746155559.766037:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123518464 00000100:00100000:1.0:1746155559.766882:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3967 00000100:00100000:1.0:1746155559.766890:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009461bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:28841:x1830976123518464:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155559.767029:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009461bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:28841:x1830976123518464:12345-192.168.202.51@tcp:35:cat.0 Request processed in 140us (1182us total) trans 8589943815 rc 0/0 00000100:00100000:1.0:1746155559.767036:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3967 00000100:00100000:0.0:1746155559.773337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.773379:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.773418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.773451:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123518592 00000100:00100000:0.0:1746155559.773457:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123518592 00010000:00010000:0.0:1746155559.773487:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009364a400/0x844e5faceb5ea1a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10004 expref: 10 pid: 8438 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746155559.773543:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123518720 00000100:00100000:0.0:1746155559.773546:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123518720 00010000:00010000:0.0:1746155559.773557:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c14c200/0x844e5faceb5ea02e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff4e expref: 44 pid: 4461 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746155559.773569:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123518848 00000100:00100000:0.0:1746155559.773571:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123518848 00010000:00010000:0.0:1746155559.773579:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c14de00/0x844e5faceb5ea027 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff47 expref: 26 pid: 4461 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746155559.773592:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5739 00000100:00100000:0.0:1746155559.773599:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123518592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.773610:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.773629:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009364a400/0x844e5faceb5ea1a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10004 expref: 10 pid: 8438 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.773639:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009364a400/0x844e5faceb5ea1a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10004 expref: 10 pid: 8438 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.773672:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009364a400/0x844e5faceb5ea1a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10004 expref: 10 pid: 8438 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.773692:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155559.773727:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123518592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 129us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.773733:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5739 00000100:00100000:0.0:1746155559.773748:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5741 00000100:00100000:0.0:1746155559.773764:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123518848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.773771:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.773779:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c14de00/0x844e5faceb5ea027 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff47 expref: 26 pid: 4461 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.773787:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c14de00/0x844e5faceb5ea027 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff47 expref: 26 pid: 4461 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.774109:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c14de00/0x844e5faceb5ea027 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff47 expref: 26 pid: 4461 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.774118:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155559.774120:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155559.774129:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff81e00/0x844e5faceb5ea329 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100e4 expref: 42 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.774136:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff81e00/0x844e5faceb5ea329 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100e4 expref: 42 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.774194:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff81e00/0x844e5faceb5ea329 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100e4 expref: 42 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155559.774206:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124493056:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155559.774275:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3329c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155559.776642:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124493056:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155559.776667:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155559.776729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.777041:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123518848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3286us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.777048:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5741 00000100:00100000:0.0:1746155559.782614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.788278:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.788312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.788337:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.788379:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123519360 00000100:00100000:0.0:1746155559.788386:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123519360 00010000:00010000:0.0:1746155559.788414:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fef1e00/0x844e5faceb5ea193 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1000b expref: 9 pid: 8437 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746155559.788434:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5742 00000100:00100000:0.0:1746155559.788440:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123519360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.788451:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.788469:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fef1e00/0x844e5faceb5ea193 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1000b expref: 9 pid: 8437 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.788477:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fef1e00/0x844e5faceb5ea193 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1000b expref: 9 pid: 8437 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.788496:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155559.788551:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123519360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 110us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.788556:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5742 00000100:00100000:0.0:1746155559.788568:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123519488 00000100:00100000:0.0:1746155559.788570:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123519488 00010000:00010000:0.0:1746155559.788578:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094705800/0x844e5faceb5ea035 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff55 expref: 45 pid: 4461 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746155559.788588:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123519616 00000100:00100000:0.0:1746155559.788590:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123519616 00010000:00010000:0.0:1746155559.788596:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a093a800/0x844e5faceb5ea05f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff71 expref: 25 pid: 4461 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746155559.788606:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5743 00000100:00100000:0.0:1746155559.788609:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1963:x1830976123519488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.788614:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.788619:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094705800/0x844e5faceb5ea035 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff55 expref: 45 pid: 4461 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.788626:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094705800/0x844e5faceb5ea035 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff55 expref: 45 pid: 4461 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.788636:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155559.788655:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1963:x1830976123519488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.788659:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5743 00000100:00100000:0.0:1746155559.788686:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5744 00000100:00100000:0.0:1746155559.788690:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123519616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.788695:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.788700:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a093a800/0x844e5faceb5ea05f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff71 expref: 25 pid: 4461 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.788707:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a093a800/0x844e5faceb5ea05f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ff71 expref: 25 pid: 4461 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746155559.788715:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155559.788717:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155559.788723:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136866400/0x844e5faceb5ea330 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100eb expref: 44 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.788730:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136866400/0x844e5faceb5ea330 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100eb expref: 44 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155559.788750:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136866400/0x844e5faceb5ea330 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100eb expref: 44 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155559.788758:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124493568:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155559.788795:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155559.789938:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124493568:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155559.789948:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155559.789980:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123519616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1288us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.789986:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5744 00000100:00100000:0.0:1746155559.793425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.798973:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.799004:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123520128 00000100:00100000:1.0:1746155559.799011:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123520128 00000100:00100000:1.0:1746155559.799059:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3968 00000100:00100000:1.0:1746155559.799070:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:28847:x1830976123520128:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155559.799266:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:28847:x1830976123520128:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 199us (867us total) trans 8589943816 rc 0/0 00000100:00100000:1.0:1746155559.799271:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3968 00000100:00100000:0.0:1746155559.804292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.811079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.817232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.820211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.827684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.827765:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123521024 00000100:00100000:1.0:1746155559.827773:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123521024 00000100:00100000:1.0:1746155559.827820:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9900 00000100:00100000:1.0:1746155559.827828:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:28853:x1830976123521024:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.827848:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.827862:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094705000/0x844e5faceb5ea33e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f100f9 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.827936:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094704a00/0x844e5faceb5ea345 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.827948:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094704a00/0x844e5faceb5ea345 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.827957:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094704a00/0x844e5faceb5ea345 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155559.827966:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155559.828058:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094705000/0x844e5faceb5ea33e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100f9 expref: 309 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.829051:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094704a00/0x844e5faceb5ea345 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100f9 expref: 308 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.829064:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155559.829066:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746155559.829069:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094704a00, rc 0) 00000100:00100000:1.0:1746155559.829127:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+308:28853:x1830976123521024:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1297us (1449us total) trans 8589943817 rc 0/0 00000100:00100000:1.0:1746155559.829133:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9900 00000100:00100000:0.0:1746155559.829160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.833054:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.834604:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.834622:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123521280 00000100:00100000:0.0:1746155559.834627:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123521280 00002000:00100000:0.0:1746155559.834668:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1482751) req@ffff8801317c6a00 x1830976123521280/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155559.834676:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6a00 with x1830976123521280 ext(1048576->1482751) 00010000:00010000:0.0:1746155559.834682:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136866400/0x844e5faceb5ea330 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100eb expref: 44 pid: 29728 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746155559.834693:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136866400/0x844e5faceb5ea330 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100eb expref: 44 pid: 29728 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746155559.834699:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801317c6a00 00000100:00100000:0.0:1746155559.834726:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 638 00000100:00100000:0.0:1746155559.834733:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1960:x1830976123521280:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155559.834984:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123521408 00000100:00100000:1.0:1746155559.834989:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123521408 00000100:00100000:1.0:1746155559.835088:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11528 00000100:00100000:1.0:1746155559.835094:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1961:x1830976123521408:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.835102:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.835114:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094704c00/0x844e5faceb5ea35a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10107 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155559.835154:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124494080:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155559.835213:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3329c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155559.835284:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123521664 00000100:00100000:1.0:1746155559.835288:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123521664 00000100:00100000:1.0:1746155559.835303:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11530 00000100:00100000:1.0:1746155559.835307:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123521664:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.835313:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.835325:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094704800/0x844e5faceb5ea368 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10115 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.835334:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.835337:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.835343:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094704800/0x844e5faceb5ea368 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10115 expref: 33 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.835355:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094704800/0x844e5faceb5ea368 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10115 expref: 33 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.835363:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094704800, rc 0) 00000100:00100000:1.0:1746155559.835383:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123521664:12345-192.168.202.51@tcp:101:cat.0 Request processed in 75us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.835388:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11530 00002000:00010000:1.0:1746155559.837490:0:29728:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155559 -> 1746155560 00000100:00100000:1.0:1746155559.837527:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124494080:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155559.837549:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094704c00/0x844e5faceb5ea35a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10107 expref: 50 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.837558:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094704c00/0x844e5faceb5ea35a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10107 expref: 50 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.837569:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094704c00, rc 0) 00000100:00100000:1.0:1746155559.837599:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+48:1961:x1830976123521408:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2505us (4552us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155559.837605:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11528 00000100:00100000:0.0:1746155559.844758:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.846654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.847448:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.852535:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123522432 00000100:00100000:1.0:1746155559.852542:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123522432 00002000:00100000:1.0:1746155559.852571:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3db:0x0] (1413120->1417215) req@ffff880093a44000 x1830976123522432/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.852580:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a44000 with x1830976123522432 ext(1413120->1417215) 00002000:00010000:1.0:1746155559.852584:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093a44000 00000100:00100000:1.0:1746155559.852614:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4308 00000100:00100000:1.0:1746155559.852621:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123522432:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155559.852753:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123522432:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 132us (344us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155559.852759:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4308 00002000:00100000:1.0:1746155559.852764:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3db:0x0] (1413120->1417215) req@ffff880093a44000 x1830976123522432/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.852771:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a44000 with x1830976123522432 ext(1413120->1417215) 00002000:00010000:1.0:1746155559.852774:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093a44000 00000100:00100000:0.0:1746155559.854695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.854968:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123522688 00000100:00100000:1.0:1746155559.854974:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123522688 00000100:00100000:1.0:1746155559.855007:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3969 00000100:00100000:1.0:1746155559.855013:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:28846:x1830976123522688:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155559.855332:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+26:28846:x1830976123522688:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 317us (638us total) trans 8589943818 rc 0/0 00000100:00100000:1.0:1746155559.855338:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3969 00000100:00100000:0.0:1746155559.858359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.862705:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.875747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.883164:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.892088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.894037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.894254:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123523712 00000100:00100000:1.0:1746155559.894259:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123523712 00000100:00100000:1.0:1746155559.894297:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9901 00000100:00100000:1.0:1746155559.894304:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+26:28857:x1830976123523712:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.894321:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.894333:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eea00/0x844e5faceb5ea384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10131 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.894401:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ea38b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.894412:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ea38b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155559.894421:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ea38b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155559.894428:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155559.894536:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eea00/0x844e5faceb5ea384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10131 expref: 29 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.894550:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ea38b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10131 expref: 28 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.894557:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155559.894559:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746155559.894561:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01eec00, rc 0) 00000100:00100000:1.0:1746155559.894589:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:28857:x1830976123523712:12345-192.168.202.51@tcp:101:cat.0 Request processed in 286us (553us total) trans 8589943819 rc 0/0 00000100:00100000:1.0:1746155559.894594:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9901 00000100:00100000:0.0:1746155559.898190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.898756:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.899124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.899223:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123524096 00000100:00100000:1.0:1746155559.899227:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123524096 00000100:00100000:1.0:1746155559.899244:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11535 00000100:00100000:1.0:1746155559.899249:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123524096:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155559.899255:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155559.899262:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01ef000/0x844e5faceb5ea3a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10138 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155559.899272:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.899274:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155559.899278:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01ef000/0x844e5faceb5ea3a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10138 expref: 30 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.899286:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01ef000/0x844e5faceb5ea3a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10138 expref: 30 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155559.899293:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01ef000, rc 0) 00000100:00100000:1.0:1746155559.899311:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123524096:12345-192.168.202.51@tcp:101:cat.0 Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155559.899316:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11535 00000100:00100000:0.0:1746155559.907950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.907998:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.916320:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.918066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.918369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.918400:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.918416:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123525504 00000100:00100000:1.0:1746155559.918419:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123525504 00002000:00100000:1.0:1746155559.918436:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009286c700 x1830976123525504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.918442:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286c700 with x1830976123525504 ext(3145728->4194303) 00002000:00010000:1.0:1746155559.918445:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286c700 00000100:00100000:1.0:1746155559.918463:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123525632 00000100:00100000:1.0:1746155559.918465:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123525632 00002000:00100000:1.0:1746155559.918475:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009286fb80 x1830976123525632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.918486:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286fb80 with x1830976123525632 ext(3145728->4194303) 00002000:00010000:1.0:1746155559.918489:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286fb80 00000100:00100000:1.0:1746155559.918495:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123524992 00000100:00100000:1.0:1746155559.918497:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123524992 00002000:00100000:1.0:1746155559.918520:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009286ed80 x1830976123524992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.918526:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286ed80 with x1830976123524992 ext(2097152->3145727) 00002000:00010000:1.0:1746155559.918528:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286ed80 00000100:00100000:1.0:1746155559.918544:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4314 00000100:00100000:1.0:1746155559.918549:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+50:1960:x1830976123525504:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155559.919617:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4316 00000100:00100000:1.0:1746155559.920100:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123524992:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155559.932181:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+50:1960:x1830976123525504:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13622us (14105us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155559.932194:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4314 00002000:00100000:0.0:1746155559.932204:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009286c700 x1830976123525504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/440 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155559.932212:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286c700 with x1830976123525504 ext(3145728->4194303) 00002000:00010000:0.0:1746155559.932216:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286c700 00000100:00100000:1.0:1746155559.939097:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123524992:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19473us (20694us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155559.939104:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4316 00002000:00100000:1.0:1746155559.939109:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009286ed80 x1830976123524992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/440 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.939116:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286ed80 with x1830976123524992 ext(2097152->3145727) 00002000:00010000:1.0:1746155559.939119:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286ed80 00000100:00100000:0.0:1746155559.948427:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.948499:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123526016 00000100:00100000:1.0:1746155559.948529:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123526016 00002000:00100000:1.0:1746155559.948565:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800a62a3800 x1830976123526016/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.948579:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a3800 with x1830976123526016 ext(4194304->4956159) 00002000:00010000:1.0:1746155559.948584:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a3800 00000100:00100000:1.0:1746155559.948607:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4317 00000100:00100000:1.0:1746155559.948614:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123526016:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155559.953932:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123526016:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5309us (5504us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155559.953942:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4317 00002000:00100000:1.0:1746155559.953953:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800a62a3800 x1830976123526016/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:630/0 lens 488/440 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.953962:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a3800 with x1830976123526016 ext(4194304->4956159) 00002000:00010000:1.0:1746155559.953966:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a3800 00000100:00100000:0.0:1746155559.971094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.973966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.973997:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.974019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.974057:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123526400 00000100:00100000:0.0:1746155559.974062:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123526400 00010000:00010000:0.0:1746155559.974082:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1d8e00/0x844e5faceb5ea306 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100cf expref: 308 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155559.974101:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123526656 00000100:00100000:0.0:1746155559.974103:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123526656 00010000:00010000:0.0:1746155559.974111:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c14c800/0x844e5faceb5ea2b9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100b3 expref: 16 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155559.974121:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123526528 00000100:00100000:0.0:1746155559.974123:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123526528 00010000:00010000:0.0:1746155559.974131:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c14c400/0x844e5faceb5ea2d5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ba expref: 30 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155559.974149:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5749 00000100:00100000:0.0:1746155559.974155:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+308:1963:x1830976123526400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.974163:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.974168:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1d8e00/0x844e5faceb5ea306 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100cf expref: 308 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155559.974176:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1d8e00/0x844e5faceb5ea306 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100cf expref: 308 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155559.974191:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155559.974195:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d600/0x844e5faceb5ea3ae lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155559.974201:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d600/0x844e5faceb5ea3ae lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155559.974205:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155559.974228:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+308:1963:x1830976123526400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 73us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.974234:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5749 00000100:00100000:0.0:1746155559.974246:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5750 00000100:00100000:0.0:1746155559.974250:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1963:x1830976123526656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.974256:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.974259:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c14c800/0x844e5faceb5ea2b9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100b3 expref: 16 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155559.974270:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c14c800/0x844e5faceb5ea2b9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100b3 expref: 16 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155559.974279:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155559.974281:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d600/0x844e5faceb5ea3ae lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155559.974286:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d600/0x844e5faceb5ea3ae lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155559.974290:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155559.974308:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1963:x1830976123526656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 58us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.974313:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5750 00000100:00100000:0.0:1746155559.974343:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5751 00000100:00100000:0.0:1746155559.974347:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1963:x1830976123526528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155559.974353:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155559.974356:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c14c400/0x844e5faceb5ea2d5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ba expref: 30 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155559.974363:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c14c400/0x844e5faceb5ea2d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ba expref: 30 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155559.974372:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155559.974374:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d600/0x844e5faceb5ea3ae lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155559.974380:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d600/0x844e5faceb5ea3ae lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155559.974385:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d600/0x844e5faceb5ea3ae lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155559.974397:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155559.974410:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1963:x1830976123526528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 62us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155559.974414:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5751 00000100:00100000:0.0:1746155559.977756:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.982119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.983694:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.989122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155559.989332:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123527296 00000100:00100000:1.0:1746155559.989339:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123527296 00002000:00100000:1.0:1746155559.989372:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (2084864->2088959) req@ffff88012fe8ea00 x1830976123527296/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/0 e 0 to 0 dl 1746155570 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.989381:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8ea00 with x1830976123527296 ext(2084864->2088959) 00002000:00010000:1.0:1746155559.989385:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fe8ea00 00000100:00100000:1.0:1746155559.989414:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4318 00000100:00100000:1.0:1746155559.989420:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123527296:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155559.989558:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123527296:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 138us (441us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155559.989567:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4318 00002000:00100000:1.0:1746155559.989572:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (2084864->2088959) req@ffff88012fe8ea00 x1830976123527296/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:630/0 lens 488/4536 e 0 to 0 dl 1746155570 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155559.989579:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8ea00 with x1830976123527296 ext(2084864->2088959) 00002000:00010000:1.0:1746155559.989582:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fe8ea00 00000100:00100000:0.0:1746155559.991432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.996282:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155559.996322:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.000614:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.033144:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155560.033513:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746155560.046155:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155560.052190:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.052220:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.052239:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123528576 00000100:00100000:0.0:1746155560.052243:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123528576 00010000:00010000:0.0:1746155560.052266:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb38a00/0x844e5faceb5ea249 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10066 expref: 36 pid: 1625 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.052284:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123528448 00000100:00100000:0.0:1746155560.052287:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123528448 00010000:00010000:0.0:1746155560.052301:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7d400/0x844e5faceb5ea27a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10082 expref: 12 pid: 10591 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.052752:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5757 00000100:00100000:0.0:1746155560.052758:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976123528448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155560.052764:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155560.052772:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7d400/0x844e5faceb5ea27a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10082 expref: 12 pid: 10591 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746155560.052780:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7d400/0x844e5faceb5ea27a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10082 expref: 12 pid: 10591 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746155560.052789:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7d400/0x844e5faceb5ea27a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10082 expref: 12 pid: 10591 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746155560.052799:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155560.052815:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123528448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 58us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155560.052820:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5757 00000100:00080000:0.0:1746155560.052856:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155560.054790:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123528704 00000100:00100000:0.0:1746155560.054796:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123528704 00010000:00010000:0.0:1746155560.054815:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bfbcc00/0x844e5faceb5ea218 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10058 expref: 34 pid: 4461 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.054833:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5758 00000100:00100000:0.0:1746155560.054839:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976123528704:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155560.054847:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155560.054860:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bfbcc00/0x844e5faceb5ea218 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10058 expref: 34 pid: 4461 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.054869:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bfbcc00/0x844e5faceb5ea218 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10058 expref: 34 pid: 4461 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.054882:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bfbcc00/0x844e5faceb5ea218 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10058 expref: 34 pid: 4461 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.054890:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.054892:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.054897:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 33 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.054905:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 33 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.054928:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 33 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.054938:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124496512:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155560.055000:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.060656:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.060679:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123528960 00000100:00100000:1.0:1746155560.060686:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123528960 00002000:00100000:1.0:1746155560.060720:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1998848->2002943) req@ffff88009286e680 x1830976123528960/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.060730:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286e680 with x1830976123528960 ext(1998848->2002943) 00002000:00010000:1.0:1746155560.060735:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286e680 00000100:00100000:1.0:1746155560.060847:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4320 00000100:00100000:1.0:1746155560.060855:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123528960:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155560.061013:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123528960:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 158us (373us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155560.061019:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4320 00002000:00100000:1.0:1746155560.061025:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1998848->2002943) req@ffff88009286e680 x1830976123528960/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.061031:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286e680 with x1830976123528960 ext(1998848->2002943) 00002000:00010000:1.0:1746155560.061034:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286e680 00000100:00100000:0.0:1746155560.062085:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124496512:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155560.062099:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155560.062126:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1962:x1830976123528704:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7287us (7357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155560.062134:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5758 00000100:00100000:0.0:1746155560.067892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155560.069601:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c600/0x844e5faceb5ea296 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ac expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.069613:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094704800/0x844e5faceb5ea368 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10115 expref: 34 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.069620:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff81000/0x844e5faceb5ea2ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100c1 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.069626:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.069628:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.069631:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->2134015] (req 2097152->2134015) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.069763:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff81000/0x844e5faceb5ea2ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100c1 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.069778:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff81000/0x844e5faceb5ea2ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100c1 expref: 10 pid: 8437 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.069792:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124496640:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155560.069877:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094704800/0x844e5faceb5ea368 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10115 expref: 34 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.069886:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094704800/0x844e5faceb5ea368 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10115 expref: 34 pid: 10591 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.069900:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124496768:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155560.069925:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c600/0x844e5faceb5ea296 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ac expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.069933:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c600/0x844e5faceb5ea296 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ac expref: 34 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.069941:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124496896:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155560.069957:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746155560.085215:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff81000/0x844e5faceb5ea2ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100c1 expref: 10 pid: 8437 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.085231:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124496640:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155560.085239:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094704800/0x844e5faceb5ea368 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10115 expref: 34 pid: 10591 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.085245:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124496768:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155560.085251:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124496896:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155560.085269:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->2134015] (req 2097152->2134015) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 33 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.085277:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff81200, rc 0) 00000100:00100000:1.0:1746155560.085295:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:28865:x1830976123529088:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 17220us (17414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.085301:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11539 00000100:00100000:0.0:1746155560.087953:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.089067:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123529472 00000100:00100000:0.0:1746155560.089074:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123529472 00010000:00010000:0.0:1746155560.089099:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c600/0x844e5faceb5ea296 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ac expref: 35 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.089982:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5761 00000100:00100000:0.0:1746155560.089990:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1961:x1830976123529472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155560.090001:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155560.090018:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c600/0x844e5faceb5ea296 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ac expref: 35 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.090029:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c600/0x844e5faceb5ea296 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ac expref: 35 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.090050:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a7c600/0x844e5faceb5ea296 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100ac expref: 35 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.090063:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.090064:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.090069:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 32 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.090076:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 32 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.090164:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 32 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.090173:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124497024:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155560.090292:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.099082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.099100:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123529728 00000100:00100000:0.0:1746155560.099107:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123529728 00002000:00100000:0.0:1746155560.099135:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2129920->2134015) req@ffff88012bdf5f80 x1830976123529728/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.099144:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5f80 with x1830976123529728 ext(2129920->2134015) 00002000:00010000:0.0:1746155560.099149:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5f80 00000100:00100000:0.0:1746155560.099165:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4321 00000100:00100000:0.0:1746155560.099171:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123529728:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155560.099291:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123529728:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 119us (214us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155560.099297:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4321 00002000:00100000:0.0:1746155560.099303:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2129920->2134015) req@ffff88012bdf5f80 x1830976123529728/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.099308:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5f80 with x1830976123529728 ext(2129920->2134015) 00002000:00010000:0.0:1746155560.099311:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5f80 00000100:00100000:0.0:1746155560.100298:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124497024:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155560.100312:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155560.101189:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1961:x1830976123529472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 11198us (13238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155560.101198:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5761 00000100:00100000:1.0:1746155560.139549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.139571:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123529856 00000100:00100000:0.0:1746155560.139579:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123529856 00000100:00100000:0.0:1746155560.139609:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11540 00000100:00100000:0.0:1746155560.139616:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+34:28869:x1830976123529856:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155560.139632:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155560.139655:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10170 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.139679:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 32 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.139686:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155560.139688:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155560.139692:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1347584->1572863] (req 1347584->1572863) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 35 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.139715:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 32 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.139726:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 32 pid: 29728 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.139737:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124497152:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155560.139792:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.145489:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124497152:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155560.145534:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1347584->1572863] (req 1347584->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 35 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.145549:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136867800, rc 0) 00000100:00100000:1.0:1746155560.145585:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+35:28869:x1830976123529856:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5968us (6040us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.145592:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11540 00000100:00100000:0.0:1746155560.146167:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.146224:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123529984 00000100:00100000:1.0:1746155560.146229:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123529984 00002000:00100000:1.0:1746155560.146259:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1998848->2097151) req@ffff88012bdf7b80 x1830976123529984/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.146268:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7b80 with x1830976123529984 ext(1998848->2097151) 00010000:00010000:1.0:1746155560.146274:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 33 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.146284:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 33 pid: 29728 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746155560.146290:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bdf7b80 00000100:00100000:1.0:1746155560.146304:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 641 00000100:00100000:1.0:1746155560.146310:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123529984:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155560.148407:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123529984:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 2093us (2237us total) trans 21474840489 rc 0/0 00000100:00100000:1.0:1746155560.148414:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 641 00002000:00100000:1.0:1746155560.148420:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1998848->2097151) req@ffff88012bdf7b80 x1830976123529984/t21474840489(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/448 e 0 to 0 dl 1746155571 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.148428:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7b80 with x1830976123529984 ext(1998848->2097151) 00010000:00010000:1.0:1746155560.148433:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 35 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.148443:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 35 pid: 29728 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746155560.148454:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bdf7b80 00000100:00100000:0.0:1746155560.150401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.150490:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123530112 00000100:00100000:1.0:1746155560.150495:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123530112 00010000:00010000:1.0:1746155560.150547:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 35 pid: 29728 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.150719:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5762 00000100:00100000:1.0:1746155560.150726:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123530112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.150737:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746155560.150750:0:9789:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155559 -> 1746155560 00002000:00010000:1.0:1746155560.150753:0:9789:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155559 -> 1746155560 00010000:00010000:1.0:1746155560.150758:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 35 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.150767:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 35 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.150786:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da6c000/0x844e5faceb5ea3df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10162 expref: 35 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.153562:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.153566:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.153577:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->1572863) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.153587:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->1572863) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.156919:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.156937:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124497280:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155560.157001:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.164455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.167535:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124497280:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155560.167553:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.167595:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123530112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 16869us (17198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.167605:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5762 00000100:00100000:1.0:1746155560.167635:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123530368 00000100:00100000:1.0:1746155560.167640:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123530368 00002000:00100000:1.0:1746155560.167677:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1347584->1351679) req@ffff88012bdf7800 x1830976123530368/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.167687:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7800 with x1830976123530368 ext(1347584->1351679) 00002000:00010000:1.0:1746155560.167690:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf7800 00000100:00100000:1.0:1746155560.167704:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4322 00000100:00100000:1.0:1746155560.167710:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1960:x1830976123530368:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155560.167825:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1960:x1830976123530368:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 113us (3374us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155560.167830:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4322 00002000:00100000:1.0:1746155560.167834:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1347584->1351679) req@ffff88012bdf7800 x1830976123530368/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.167846:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7800 with x1830976123530368 ext(1347584->1351679) 00002000:00010000:1.0:1746155560.167848:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf7800 00000100:00100000:0.0:1746155560.169401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.171395:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123530496 00000100:00100000:1.0:1746155560.171401:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123530496 00000100:00100000:1.0:1746155560.171433:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11541 00000100:00100000:1.0:1746155560.171440:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1960:x1830976123530496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155560.171452:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.171465:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938a1400/0x844e5faceb5ea3f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10177 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.171679:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124497408:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155560.171750:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.172912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.172973:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123530752 00000100:00100000:1.0:1746155560.172977:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123530752 00002000:00100000:1.0:1746155560.172997:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1568768->1572863) req@ffff88009286f100 x1830976123530752/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.173006:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286f100 with x1830976123530752 ext(1568768->1572863) 00002000:00010000:1.0:1746155560.173009:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286f100 00000100:00100000:1.0:1746155560.173021:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4323 00000100:00100000:1.0:1746155560.173026:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+37:1962:x1830976123530752:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155560.173143:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+37:1962:x1830976123530752:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 116us (231us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155560.173149:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4323 00002000:00100000:1.0:1746155560.173155:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1568768->1572863) req@ffff88009286f100 x1830976123530752/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.173161:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286f100 with x1830976123530752 ext(1568768->1572863) 00002000:00010000:1.0:1746155560.173164:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286f100 00000100:00100000:1.0:1746155560.179223:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124497408:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155560.179251:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938a1400/0x844e5faceb5ea3f4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10177 expref: 36 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.179264:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938a1400/0x844e5faceb5ea3f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10177 expref: 36 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.179272:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938a1400, rc 0) 00000100:00100000:1.0:1746155560.179311:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1960:x1830976123530496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7872us (9912us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155560.179318:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11541 00000100:00100000:1.0:1746155560.192791:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.192813:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.192968:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.193051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.193064:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.193088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.193129:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123531520 00000100:00100000:1.0:1746155560.193136:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123531520 00002000:00100000:1.0:1746155560.193171:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2084863) req@ffff880136633100 x1830976123531520/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.193180:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136633100 with x1830976123531520 ext(1048576->2084863) 00002000:00010000:1.0:1746155560.193186:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136633100 00000100:00100000:1.0:1746155560.193200:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123531648 00000100:00100000:1.0:1746155560.193202:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123531648 00002000:00100000:1.0:1746155560.193844:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1073152->2097151) req@ffff880136633800 x1830976123531648/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.193851:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136633800 with x1830976123531648 ext(1073152->2097151) 00002000:00010000:1.0:1746155560.193854:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136633800 00000100:00100000:1.0:1746155560.193866:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123531904 00000100:00100000:1.0:1746155560.193868:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123531904 00002000:00100000:1.0:1746155560.193881:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880136630700 x1830976123531904/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 504/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.193888:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136630700 with x1830976123531904 ext(1048576->2097151) 00002000:00010000:1.0:1746155560.193891:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136630700 00000100:00100000:1.0:1746155560.193903:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4324 00000100:00100000:1.0:1746155560.193909:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1962:x1830976123531520:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155560.195288:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123530880 00000100:00100000:0.0:1746155560.195294:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123530880 00000100:00100000:0.0:1746155560.195321:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123531008 00000100:00100000:0.0:1746155560.195323:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123531008 00000100:00100000:0.0:1746155560.195333:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123531136 00000100:00100000:0.0:1746155560.195335:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123531136 00000100:00100000:0.0:1746155560.195348:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11542 00000100:00100000:0.0:1746155560.195353:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123530880:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155560.195362:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155560.195375:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093554400/0x844e5faceb5ea3fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1017e expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.195413:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124497536:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155560.195476:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6161300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.195493:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4326 00000100:00100000:0.0:1746155560.195499:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1962:x1830976123531904:12345-192.168.202.51@tcp:3:cat.0 00000100:00080000:0.0:1746155560.196624:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746155560.205099:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124497536:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155560.205130:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093554400/0x844e5faceb5ea3fb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1017e expref: 21 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.205143:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093554400/0x844e5faceb5ea3fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1017e expref: 21 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.205153:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093554400, rc 0) 00000100:00100000:1.0:1746155560.205495:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123530880:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10139us (12707us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155560.205525:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11542 00000100:00100000:0.0:1746155560.210680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.210821:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123532288 00000100:00100000:1.0:1746155560.210827:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123532288 00000100:00100000:1.0:1746155560.210868:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3970 00000100:00100000:1.0:1746155560.210875:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:27129:x1830976123532288:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746155560.211007:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+310:27129:x1830976123532288:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 132us (332us total) trans 8589943822 rc 0/0 00000100:00100000:1.0:1746155560.211013:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3970 00000100:00100000:1.0:1746155560.215809:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.218143:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1962:x1830976123531904:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22639us (25049us total) trans 0 rc 823296/823296 00000100:00100000:0.0:1746155560.218153:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4326 00002000:00100000:0.0:1746155560.218161:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880136630700 x1830976123531904/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 504/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 823296/823296 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.218170:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136630700 with x1830976123531904 ext(1048576->2097151) 00002000:00010000:0.0:1746155560.218174:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136630700 00000100:00100000:0.0:1746155560.218284:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123532544 00000100:00100000:0.0:1746155560.218289:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123532544 00000100:00100000:0.0:1746155560.218316:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3971 00000100:00100000:0.0:1746155560.218321:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+29:7661:x1830976123532544:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746155560.218447:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+30:7661:x1830976123532544:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 124us (2641us total) trans 8589943823 rc 0/0 00000100:00100000:0.0:1746155560.218452:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3971 00000100:00100000:0.0:1746155560.220896:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.220996:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123532672 00000100:00100000:1.0:1746155560.221002:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123532672 00010000:00010000:1.0:1746155560.221025:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d800/0x844e5faceb5ea3d1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1015b expref: 310 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.221048:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5763 00000100:00100000:1.0:1746155560.221054:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+310:1963:x1830976123532672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155560.221368:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1962:x1830976123531520:12345-192.168.202.51@tcp:3:cat.0 Request processed in 27457us (28315us total) trans 0 rc 1036288/1036288 00000100:00100000:0.0:1746155560.221375:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4324 00002000:00100000:0.0:1746155560.221381:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2084863) req@ffff880136633100 x1830976123531520/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1036288/1036288 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.221390:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136633100 with x1830976123531520 ext(1048576->2084863) 00002000:00010000:0.0:1746155560.221393:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136633100 00010000:00010000:1.0:1746155560.222080:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.222088:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d800/0x844e5faceb5ea3d1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1015b expref: 310 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.222099:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d800/0x844e5faceb5ea3d1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1015b expref: 310 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.222116:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d800/0x844e5faceb5ea3d1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1015b expref: 310 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.222130:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155560.222134:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.222141:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.222145:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.222150:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.222179:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:1963:x1830976123532672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1125us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.222185:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5763 00000100:00100000:1.0:1746155560.226546:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.226577:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.227104:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123532800 00000100:00100000:0.0:1746155560.227107:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123532800 00010000:00010000:0.0:1746155560.227123:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d600/0x844e5faceb5ea3ae lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10146 expref: 30 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.227174:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5764 00000100:00100000:0.0:1746155560.227179:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123532800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155560.227188:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155560.227193:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d600/0x844e5faceb5ea3ae lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10146 expref: 30 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.227202:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d600/0x844e5faceb5ea3ae lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10146 expref: 30 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.227218:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da6d600/0x844e5faceb5ea3ae lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10146 expref: 30 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.227231:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155560.227235:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227243:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227248:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227266:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155560.227288:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123532800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 108us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155560.227293:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5764 00010000:00010000:0.0:1746155560.227331:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227337:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155560.227369:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:0.0:1746155560.227373:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155560.227385:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227394:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227401:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fa00/0x844e5faceb5ea410 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227406:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fa00/0x844e5faceb5ea410 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227411:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fa00/0x844e5faceb5ea410 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227415:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f22fa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155560.227419:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fa00/0x844e5faceb5ea410 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227424:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fa00/0x844e5faceb5ea410 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227431:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155560.227433:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155560.227435:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fa00/0x844e5faceb5ea410 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227439:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fa00/0x844e5faceb5ea410 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227446:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fe00/0x844e5faceb5ea417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227450:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fe00/0x844e5faceb5ea417 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227454:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fe00/0x844e5faceb5ea417 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227457:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f22fe00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155560.227459:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fe00/0x844e5faceb5ea417 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227463:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fe00/0x844e5faceb5ea417 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227467:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800912d5100) 00010000:00010000:0.0:1746155560.227468:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155560.227469:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fe00/0x844e5faceb5ea417 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227473:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22fe00/0x844e5faceb5ea417 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.227495:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f800/0x844e5faceb5ea409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10193 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.227518:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10193 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.227523:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155560.227524:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155560.227526:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f22e000, rc 0) 00000100:00100000:0.0:1746155560.228020:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:28877:x1830976123532032:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 31479us (32384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155560.228026:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9904 00000100:00100000:0.0:1746155560.235922:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.235978:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.236082:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123533184 00000100:00100000:0.0:1746155560.236089:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123533184 00002000:00100000:0.0:1746155560.236120:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (2084864->2097151) req@ffff88012bdf7100 x1830976123533184/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 12776/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.236129:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7100 with x1830976123533184 ext(2084864->2097151) 00010000:00010000:0.0:1746155560.236137:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da6ca00/0x844e5faceb5ea3bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1014d expref: 8 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.236150:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da6ca00/0x844e5faceb5ea3bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1014d expref: 8 pid: 8437 timeout: 789 lvb_type: 0 00002000:00010000:0.0:1746155560.236157:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bdf7100 00000100:00100000:0.0:1746155560.236174:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 642 00000100:00100000:0.0:1746155560.236179:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1962:x1830976123533184:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155560.236559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.236587:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123533312 00000100:00100000:1.0:1746155560.236591:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123533312 00000100:00100000:1.0:1746155560.236615:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11547 00000100:00100000:1.0:1746155560.236620:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1960:x1830976123533312:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155560.236627:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.236634:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938a0e00/0x844e5faceb5ea43a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f101a8 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.236669:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124498432:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155560.236707:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.236714:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123533184:12345-192.168.202.51@tcp:4:cat.0 Request processed in 533us (734us total) trans 17179873110 rc 0/0 00000100:00080000:1.0:1746155560.236717:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155560.236720:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 642 00002000:00100000:0.0:1746155560.236726:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (2084864->2097151) req@ffff88012bdf7100 x1830976123533184/t17179873110(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 12776/448 e 0 to 0 dl 1746155571 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.236733:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7100 with x1830976123533184 ext(2084864->2097151) 00010000:00010000:0.0:1746155560.236738:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da6ca00/0x844e5faceb5ea3bc lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1014d expref: 10 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.236746:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da6ca00/0x844e5faceb5ea3bc lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1014d expref: 10 pid: 8437 timeout: 789 lvb_type: 0 00002000:00010000:0.0:1746155560.236751:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bdf7100 00000100:00100000:0.0:1746155560.242657:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11550 00000100:00100000:0.0:1746155560.242665:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123533568:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155560.242673:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155560.242680:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0699600/0x844e5faceb5ea44f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f101b6 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.242701:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124498688:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155560.242729:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.242759:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123533952 00000100:00100000:0.0:1746155560.242761:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123533952 00002000:00100000:0.0:1746155560.242780:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2134015) req@ffff880130899c00 x1830976123533952/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.242788:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899c00 with x1830976123533952 ext(2097152->2134015) 00010000:00010000:0.0:1746155560.242792:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 34 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.242801:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 34 pid: 29728 timeout: 789 lvb_type: 0 00002000:00010000:0.0:1746155560.242806:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130899c00 00000100:00100000:0.0:1746155560.242817:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 643 00000100:00100000:0.0:1746155560.242821:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123533952:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155560.243959:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124498432:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155560.243977:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938a0e00/0x844e5faceb5ea43a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101a8 expref: 9 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.243988:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938a0e00/0x844e5faceb5ea43a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101a8 expref: 9 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.243996:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938a0e00, rc 0) 00000100:00100000:0.0:1746155560.244051:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123533312:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 7430us (7492us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155560.244058:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11547 00000100:00100000:0.0:1746155560.247928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.248516:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123534080 00000100:00100000:1.0:1746155560.248522:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123534080 00010000:00010000:1.0:1746155560.248545:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da6ca00/0x844e5faceb5ea3bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1014d expref: 10 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.248565:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5765 00000100:00100000:1.0:1746155560.248572:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123534080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155560.248575:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124498688:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155560.248583:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155560.248590:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0699600/0x844e5faceb5ea44f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101b6 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.248594:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da6ca00/0x844e5faceb5ea3bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1014d expref: 10 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.248600:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0699600/0x844e5faceb5ea44f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101b6 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.248604:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da6ca00/0x844e5faceb5ea3bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1014d expref: 10 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.248606:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0699600, rc 0) 00010000:00010000:1.0:1746155560.248619:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da6ca00/0x844e5faceb5ea3bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1014d expref: 10 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.248626:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123533568:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5962us (6212us total) trans 0 rc 301/301 00010000:00010000:1.0:1746155560.248630:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.248631:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155560.248631:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11550 00010000:00010000:1.0:1746155560.248637:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5ea42c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1019a expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.248654:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5ea42c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1019a expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.248678:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5ea42c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1019a expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.248693:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124498944:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155560.248741:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.250006:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976123533952:12345-192.168.202.51@tcp:4:cat.0 Request processed in 7182us (7537us total) trans 21474840490 rc 0/0 00000100:00100000:1.0:1746155560.250014:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 643 00002000:00100000:1.0:1746155560.250021:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2134015) req@ffff880130899c00 x1830976123533952/t21474840490(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/448 e 0 to 0 dl 1746155571 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.250270:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899c00 with x1830976123533952 ext(2097152->2134015) 00010000:00010000:1.0:1746155560.250278:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 36 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.250290:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 36 pid: 29728 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746155560.250296:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130899c00 00000100:00100000:1.0:1746155560.253629:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124498944:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155560.253653:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.253684:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1963:x1830976123534080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5112us (5760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.253690:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5765 00000100:00100000:1.0:1746155560.253702:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123534464 00000100:00100000:1.0:1746155560.253705:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123534464 00010000:00010000:1.0:1746155560.253716:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 36 pid: 29728 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.253736:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5766 00000100:00100000:1.0:1746155560.253740:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976123534464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.253747:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746155560.253759:0:9789:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 4959 -> 5263 00010000:00010000:1.0:1746155560.253764:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 36 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.253773:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 36 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.253789:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff81200/0x844e5faceb5ea3e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2134015) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10169 expref: 36 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.253799:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.253800:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.253806:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f22e400/0x844e5faceb5ea433 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101a1 expref: 35 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.253814:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f22e400/0x844e5faceb5ea433 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101a1 expref: 35 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.253838:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f22e400/0x844e5faceb5ea433 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101a1 expref: 35 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.253849:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124499072:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155560.253887:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.257113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.257136:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123534720 00000100:00100000:0.0:1746155560.257142:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123534720 00002000:00100000:0.0:1746155560.257173:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009c28f100 x1830976123534720/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.257182:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28f100 with x1830976123534720 ext(1048576->2097151) 00002000:00010000:0.0:1746155560.257186:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28f100 00000100:00100000:0.0:1746155560.257203:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4327 00000100:00100000:0.0:1746155560.257209:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123534720:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.257307:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.257338:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124499072:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155560.257352:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.257378:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976123534464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3637us (4007us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.257385:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5766 00000100:00100000:1.0:1746155560.257397:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123534848 00000100:00100000:1.0:1746155560.257399:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123534848 00010000:00010000:1.0:1746155560.257409:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10193 expref: 18 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.257422:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5767 00000100:00100000:1.0:1746155560.257426:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1961:x1830976123534848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.257432:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.257437:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10193 expref: 18 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.257445:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10193 expref: 18 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.257460:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155560.257463:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.257470:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.257478:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.257488:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.257499:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1961:x1830976123534848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 73us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.257518:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5767 00010000:00010000:1.0:1746155560.257578:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22e000/0x844e5faceb5ea41e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10193 expref: 17 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.257587:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124499200:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155560.257596:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.257602:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.257606:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155560.257618:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155560.257718:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f600/0x844e5faceb5ea45d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101cb expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.257728:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101cb expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.257733:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155560.257735:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155560.257738:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f22f200, rc 0) 00000100:00100000:1.0:1746155560.257756:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:28877:x1830976123534336:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4316us (4437us total) trans 8589943824 rc 0/0 00000100:00100000:1.0:1746155560.257761:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9905 00000100:00100000:0.0:1746155560.261783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.261839:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123534976 00000100:00100000:1.0:1746155560.261845:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123534976 00000100:00100000:1.0:1746155560.261878:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9906 00000100:00100000:1.0:1746155560.261885:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:28877:x1830976123534976:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155560.261902:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.261916:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009048b800/0x844e5faceb5ea472 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f101d2 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.261975:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.261986:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101cb expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.261992:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.262014:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101cb expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.262025:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101cb expref: 18 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.262034:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124499328:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155560.262107:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.268389:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124499328:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155560.268406:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155560.269055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.269108:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.269122:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123535360 00000100:00100000:0.0:1746155560.269124:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123535360 00010000:00010000:0.0:1746155560.269137:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101cb expref: 19 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.269154:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5768 00000100:00100000:0.0:1746155560.269159:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+19:1960:x1830976123535360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155560.269168:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155560.269173:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101cb expref: 19 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.269182:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101cb expref: 19 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.269198:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f22f200/0x844e5faceb5ea464 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101cb expref: 19 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.269209:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155560.269212:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.269220:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.269225:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.269239:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155560.269266:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1960:x1830976123535360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 106us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155560.269271:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5768 00010000:00010000:0.0:1746155560.269290:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.269294:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155560.269323:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:0.0:1746155560.269327:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155560.269339:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.269364:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009048b800/0x844e5faceb5ea472 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d2 expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.269374:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d2 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.269379:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155560.269381:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155560.269384:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009048aa00, rc 0) 00000100:00100000:0.0:1746155560.269405:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:28877:x1830976123534976:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 7521us (7627us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155560.269410:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9906 00000100:00100000:0.0:1746155560.269475:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123535616 00000100:00100000:0.0:1746155560.269478:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123535616 00002000:00100000:0.0:1746155560.269494:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8801317c6d80 x1830976123535616/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.269512:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6d80 with x1830976123535616 ext(3145728->4194303) 00002000:00010000:0.0:1746155560.269515:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c6d80 00000100:00100000:0.0:1746155560.269528:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4329 00000100:00100000:0.0:1746155560.269533:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+38:1961:x1830976123535616:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.275546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.275567:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.275580:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.275599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.278386:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.279242:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+38:1961:x1830976123535616:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9706us (10131us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155560.279249:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4329 00002000:00100000:0.0:1746155560.279257:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8801317c6d80 x1830976123535616/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.279265:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6d80 with x1830976123535616 ext(3145728->4194303) 00002000:00010000:0.0:1746155560.279269:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c6d80 00000100:00100000:1.0:1746155560.283422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.283441:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123536384 00000100:00100000:1.0:1746155560.283447:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123536384 00002000:00100000:1.0:1746155560.283474:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1073151) req@ffff880094c30380 x1830976123536384/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.283482:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c30380 with x1830976123536384 ext(1048576->1073151) 00010000:00010000:1.0:1746155560.283488:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da6ce00/0x844e5faceb5ea3c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10154 expref: 9 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.283560:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da6ce00/0x844e5faceb5ea3c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10154 expref: 9 pid: 8437 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746155560.283567:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c30380 00000100:00100000:1.0:1746155560.283581:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 644 00000100:00100000:1.0:1746155560.283588:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976123536384:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155560.288040:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123536384:12345-192.168.202.51@tcp:4:cat.0 Request processed in 4446us (4612us total) trans 17179873111 rc 0/0 00000100:00100000:0.0:1746155560.288050:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 644 00002000:00100000:0.0:1746155560.288059:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1073151) req@ffff880094c30380 x1830976123536384/t17179873111(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/448 e 0 to 0 dl 1746155571 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.288068:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c30380 with x1830976123536384 ext(1048576->1073151) 00010000:00010000:0.0:1746155560.288077:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da6ce00/0x844e5faceb5ea3c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10154 expref: 11 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.288090:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da6ce00/0x844e5faceb5ea3c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10154 expref: 11 pid: 8437 timeout: 789 lvb_type: 0 00002000:00010000:0.0:1746155560.288097:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c30380 00000100:00100000:1.0:1746155560.291140:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123536896 00000100:00100000:1.0:1746155560.291148:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123536896 00000100:00100000:1.0:1746155560.291195:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9907 00000100:00100000:1.0:1746155560.291204:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:28877:x1830976123536896:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155560.291418:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.291432:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052c00/0x844e5faceb5ea4a3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1020a expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.291525:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5ea4aa lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.291537:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5ea4aa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.291837:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5ea4aa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155560.291849:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155560.291927:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052c00/0x844e5faceb5ea4a3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1020a expref: 20 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.291936:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5ea4aa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1020a expref: 19 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.291942:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155560.291944:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155560.291946:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c052400, rc 0) 00000100:00100000:1.0:1746155560.292163:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+19:28877:x1830976123536896:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 959us (1290us total) trans 8589943825 rc 0/0 00000100:00100000:1.0:1746155560.292169:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9907 00000100:00100000:0.0:1746155560.294594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.294650:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123537024 00000100:00100000:1.0:1746155560.294656:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123537024 00010000:00010000:1.0:1746155560.294679:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da6ce00/0x844e5faceb5ea3c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10154 expref: 14 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.294699:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5769 00000100:00100000:1.0:1746155560.294704:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123537024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.294713:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.294729:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da6ce00/0x844e5faceb5ea3c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10154 expref: 14 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.294738:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da6ce00/0x844e5faceb5ea3c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10154 expref: 14 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.294753:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.294755:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.294761:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f22ec00/0x844e5faceb5ea495 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101f5 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.294767:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f22ec00/0x844e5faceb5ea495 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101f5 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.294790:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f22ec00/0x844e5faceb5ea495 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101f5 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.294798:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124499968:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155560.294845:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.295154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.295411:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.295452:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.295837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.295859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.295985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.296099:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11563 00000100:00100000:0.0:1746155560.296106:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123537408:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155560.296119:0:29728:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.296131:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f22ec00/0x844e5faceb5ea495 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101f5 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.296136:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.296137:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.296139:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.296151:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f22ec00/0x844e5faceb5ea495 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101f5 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.296158:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f22ec00/0x844e5faceb5ea495 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101f5 expref: 19 pid: 18270 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.296164:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124501248:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155560.296356:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.296367:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123537664 00000100:00100000:0.0:1746155560.296370:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123537664 00000100:00100000:0.0:1746155560.296387:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11564 00000100:00100000:0.0:1746155560.296391:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123537664:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155560.296404:0:9235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.296413:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f22e400/0x844e5faceb5ea433 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101a1 expref: 7 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.296422:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ea49c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101ee expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.296426:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.296427:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.296429:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.296443:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ea49c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101ee expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.296450:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ea49c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101ee expref: 10 pid: 10591 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.296457:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124501504:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155560.296475:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f22e400/0x844e5faceb5ea433 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101a1 expref: 7 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.296481:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f22e400/0x844e5faceb5ea433 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101a1 expref: 7 pid: 4461 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.296487:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124501632:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155560.296496:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.297995:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.298019:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.298070:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124499968:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155560.298082:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.298114:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123537024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3408us (3523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.298122:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5769 00000100:00100000:1.0:1746155560.298228:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123538048 00000100:00100000:1.0:1746155560.298232:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123538048 00010000:00010000:1.0:1746155560.298250:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f22ee00/0x844e5faceb5ea4b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101fc expref: 11 pid: 4461 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.298378:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123537920 00000100:00100000:0.0:1746155560.298382:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123537920 00010000:00010000:0.0:1746155560.298394:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f22f400/0x844e5faceb5ea480 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d9 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.298421:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5770 00000100:00100000:0.0:1746155560.298427:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123537920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155560.298436:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155560.298471:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5771 00000100:00100000:1.0:1746155560.298476:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123538048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.298482:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.298488:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f22ee00/0x844e5faceb5ea4b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101fc expref: 11 pid: 4461 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.298497:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f22ee00/0x844e5faceb5ea4b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101fc expref: 11 pid: 4461 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.298525:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f22ee00/0x844e5faceb5ea4b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101fc expref: 11 pid: 4461 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.298538:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.298555:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123538048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.298560:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5771 00010000:00010000:0.0:1746155560.298652:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f22f400/0x844e5faceb5ea480 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d9 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746155560.298660:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f22f400/0x844e5faceb5ea480 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d9 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746155560.298670:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f22f400/0x844e5faceb5ea480 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d9 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746155560.298678:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155560.298697:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123537920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 266us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155560.298703:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5770 00000100:00100000:0.0:1746155560.299340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.299400:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123538432 00000100:00100000:1.0:1746155560.299404:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123538432 00002000:00100000:1.0:1746155560.299423:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880095269f80 x1830976123538432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.299431:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269f80 with x1830976123538432 ext(1048576->2097151) 00010000:00010000:1.0:1746155560.299437:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f22ec00/0x844e5faceb5ea495 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101f5 expref: 20 pid: 18270 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.299445:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f22ec00/0x844e5faceb5ea495 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101f5 expref: 20 pid: 18270 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746155560.299450:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095269f80 00000100:00100000:1.0:1746155560.299461:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 645 00000100:00100000:1.0:1746155560.299467:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976123538432:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155560.302067:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.302169:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124501504:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155560.302179:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124501632:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155560.302196:0:9235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.302220:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124501248:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155560.302229:0:29728:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.302321:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123538560 00000100:00100000:1.0:1746155560.302326:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123538560 00010000:00010000:1.0:1746155560.302348:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5ea42c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1019a expref: 22 pid: 1625 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.303265:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5772 00000100:00100000:1.0:1746155560.303272:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123538560:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.303283:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.303303:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5ea42c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1019a expref: 22 pid: 1625 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.303312:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5ea42c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1019a expref: 22 pid: 1625 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.303335:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5ea42c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1019a expref: 22 pid: 1625 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.303345:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.303347:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.303351:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f22ea00/0x844e5faceb5ea4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.303358:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f22ea00/0x844e5faceb5ea4c6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.303375:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155560.303475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.303595:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123538560:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 322us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.303601:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5772 00000100:00100000:1.0:1746155560.303613:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123538688 00000100:00100000:1.0:1746155560.303616:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123538688 00010000:00010000:1.0:1746155560.303625:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f22e600/0x844e5faceb5ea448 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101c4 expref: 9 pid: 8437 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.303636:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123538944 00000100:00100000:1.0:1746155560.303638:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123538944 00010000:00010000:1.0:1746155560.303656:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fef1a00/0x844e5faceb5ea18c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fffd expref: 11 pid: 8437 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.303667:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123539456 00000100:00100000:1.0:1746155560.303669:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123539456 00010000:00010000:1.0:1746155560.303677:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136867400/0x844e5faceb5ea36f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1011c expref: 21 pid: 1625 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.303685:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5773 00000100:00100000:1.0:1746155560.303690:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123538688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.303696:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746155560.303703:0:7064:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4139 00010000:00010000:1.0:1746155560.303707:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f22e600/0x844e5faceb5ea448 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101c4 expref: 9 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.303713:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f22e600/0x844e5faceb5ea448 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101c4 expref: 9 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.303723:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f22e600/0x844e5faceb5ea448 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101c4 expref: 9 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.303731:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.303747:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123538688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.303752:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5773 00000100:00100000:1.0:1746155560.303760:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5774 00000100:00100000:1.0:1746155560.303764:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123538944:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.303769:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.303780:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fef1a00/0x844e5faceb5ea18c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fffd expref: 11 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.303791:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fef1a00/0x844e5faceb5ea18c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fffd expref: 11 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.303801:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fef1a00/0x844e5faceb5ea18c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fffd expref: 11 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.303808:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.303819:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123538944:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.303823:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5774 00000100:00100000:1.0:1746155560.303831:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5775 00000100:00100000:1.0:1746155560.303836:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123539456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.303842:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.303848:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136867400/0x844e5faceb5ea36f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1011c expref: 21 pid: 1625 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.303855:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136867400/0x844e5faceb5ea36f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1011c expref: 21 pid: 1625 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.303865:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136867400/0x844e5faceb5ea36f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1011c expref: 21 pid: 1625 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.303872:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.303886:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976123539456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.303893:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5775 00000100:00100000:1.0:1746155560.303908:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123539712 00000100:00100000:1.0:1746155560.303910:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123539712 00000100:00100000:1.0:1746155560.303938:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9908 00000100:00100000:1.0:1746155560.303943:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+29:28879:x1830976123539712:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155560.303958:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.303969:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009048e200/0x844e5faceb5ea4f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10211 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.304009:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123538176 00000100:00100000:0.0:1746155560.304012:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123538176 00002000:00100000:0.0:1746155560.304030:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1347584->1572863) req@ffff88009fe90e00 x1830976123538176/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746155560.304032:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009048f600/0x844e5faceb5ea4f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00002000:00100000:0.0:1746155560.304038:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe90e00 with x1830976123538176 ext(1347584->1572863) 00010000:00010000:1.0:1746155560.304041:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d2 expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.304044:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 8 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.304048:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5ea4aa lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1020a expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.304051:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 8 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.304053:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009048f600/0x844e5faceb5ea4f7 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00002000:00010000:0.0:1746155560.304057:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe90e00 00000100:00100000:0.0:1746155560.304067:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 646 00010000:00010000:1.0:1746155560.304071:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5ea4aa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1020a expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.304072:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1960:x1830976123538176:12345-192.168.202.51@tcp:4:cat.0 00010000:00010000:1.0:1746155560.304079:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5ea4aa lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1020a expref: 18 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.304087:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124501760:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155560.304138:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d2 expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.304144:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d2 expref: 18 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.304151:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124501888:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155560.304165:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.304191:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.304212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.304234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.304268:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123539072 00000100:00100000:0.0:1746155560.304272:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123539072 00010000:00010000:0.0:1746155560.304283:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ea49c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101ee expref: 10 pid: 10591 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.304299:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123539328 00000100:00100000:0.0:1746155560.304299:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123539840 00000100:00100000:1.0:1746155560.304301:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123539328 00000100:00100000:0.0:1746155560.304301:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123539840 00010000:00010000:0.0:1746155560.304307:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f22e400/0x844e5faceb5ea433 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101a1 expref: 10 pid: 4461 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.304310:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff81400/0x844e5faceb5ea322 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100dd expref: 10 pid: 29728 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.304318:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5776 00000100:00100000:1.0:1746155560.304321:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5777 00000100:00100000:0.0:1746155560.304322:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123539072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155560.304324:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123539840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155560.304327:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.304329:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746155560.304334:0:7063:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5263 -> 5655 00010000:00010000:0.0:1746155560.304338:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ea49c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101ee expref: 10 pid: 10591 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.306894:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f22e400/0x844e5faceb5ea433 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101a1 expref: 9 pid: 4461 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.306903:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f22e400/0x844e5faceb5ea433 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101a1 expref: 9 pid: 4461 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.306914:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f22e400/0x844e5faceb5ea433 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101a1 expref: 9 pid: 4461 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.306928:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155560.306944:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ea49c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101ee expref: 9 pid: 10591 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.306957:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1962:x1830976123539840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2631us (2744us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155560.306957:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ea49c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101ee expref: 9 pid: 10591 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.306962:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5777 00010000:00010000:0.0:1746155560.306965:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.306966:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.306968:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.306974:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.306991:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155560.306999:0:9235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.307006:0:9235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.307006:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123539072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2683us (2814us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155560.307011:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5776 00010000:00010000:1.0:1746155560.307018:0:9235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.307023:0:9235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.307028:0:9235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.307033:0:9235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d1db000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155560.307036:0:9235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.307041:0:9235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.307053:0:9235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.307058:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d1db000/0x844e5faceb5ea4e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.307083:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123537664:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 10691us (11098us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.307089:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11564 00000100:00100000:1.0:1746155560.308314:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123539968 00000100:00100000:1.0:1746155560.308318:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123539968 00010000:00010000:1.0:1746155560.308333:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5ea4aa lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1020a expref: 19 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.308347:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123540096 00000100:00100000:1.0:1746155560.308348:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123540096 00010000:00010000:1.0:1746155560.308355:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d2 expref: 20 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.308366:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5781 00000100:00100000:1.0:1746155560.308370:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:1961:x1830976123539968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.308377:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.308381:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5ea4aa lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1020a expref: 20 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.308389:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5ea4aa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1020a expref: 20 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.308400:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5ea4aa lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1020a expref: 20 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.308409:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155560.308412:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009048f600/0x844e5faceb5ea4f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.308419:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009048f600/0x844e5faceb5ea4f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.308422:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.308440:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+19:1961:x1830976123539968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 70us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.308445:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5781 00000100:00100000:1.0:1746155560.308453:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5782 00000100:00100000:1.0:1746155560.308458:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1961:x1830976123540096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.308463:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.308466:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d2 expref: 18 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.308472:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d2 expref: 18 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.308481:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009048aa00/0x844e5faceb5ea479 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101d2 expref: 18 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.308488:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155560.308491:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009048f600/0x844e5faceb5ea4f7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.308496:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009048f600/0x844e5faceb5ea4f7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.308500:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009048f600/0x844e5faceb5ea4f7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.308527:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.308540:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1961:x1830976123540096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 82us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.308545:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5782 00000100:00100000:1.0:1746155560.308557:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123540224 00000100:00100000:1.0:1746155560.308559:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123540224 00000100:00100000:1.0:1746155560.308572:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11565 00000100:00100000:1.0:1746155560.308575:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+8:28872:x1830976123540224:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155560.308585:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.308593:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc7f200/0x844e5faceb5ea4fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10218 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155560.308604:0:9235:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d9:0x0] initial LVB size: 4954272, mtime: 0x68143828, atime: 0x68143828, ctime: 0x68143828, blocks: 0x1617 00010000:00010000:1.0:1746155560.308614:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.308615:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.308620:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc7f200/0x844e5faceb5ea4fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10218 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.308629:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc7f200/0x844e5faceb5ea4fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10218 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.308640:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7f200, rc 0) 00000100:00100000:1.0:1746155560.308665:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+9:28872:x1830976123540224:12345-192.168.202.51@tcp:101:cat.0 Request processed in 89us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.308670:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11565 00000100:00100000:0.0:1746155560.309198:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976123538176:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5125us (5516us total) trans 21474840491 rc 0/0 00000100:00100000:0.0:1746155560.309204:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 646 00002000:00100000:0.0:1746155560.309209:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1347584->1572863) req@ffff88009fe90e00 x1830976123538176/t21474840491(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/448 e 0 to 0 dl 1746155571 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.309215:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe90e00 with x1830976123538176 ext(1347584->1572863) 00010000:00010000:0.0:1746155560.309220:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 9 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.309228:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 9 pid: 29728 timeout: 789 lvb_type: 0 00002000:00010000:0.0:1746155560.309233:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe90e00 00000100:00100000:0.0:1746155560.315930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.315996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.316191:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123540480 00000100:00100000:1.0:1746155560.316194:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123540480 00000100:00100000:1.0:1746155560.316226:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11566 00000100:00100000:1.0:1746155560.316233:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:28876:x1830976123540480:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155560.316247:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.316258:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5ea50c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10226 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.316280:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155560.316284:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5ea4cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.316289:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746155560.316293:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5ea50c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10226 expref: 13 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.316306:0:9235:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5ea4cd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.316316:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5ea50c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10226 expref: 13 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.316334:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7e600, rc 0) 00000100:00100000:1.0:1746155560.317202:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:28876:x1830976123540480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 968us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.317207:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11566 00000100:00100000:1.0:1746155560.318806:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123540608 00000100:00100000:1.0:1746155560.318813:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123540608 00010000:00010000:1.0:1746155560.318836:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1347584->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 9 pid: 29728 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.318868:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5783 00000100:00100000:1.0:1746155560.318874:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123540608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.318883:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.318897:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1347584->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 9 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.318907:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1347584->1572863) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 9 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.318923:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5ea3ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1347584->1572863) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10170 expref: 9 pid: 29728 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.318934:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.318936:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.318940:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5ea4cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.318951:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5ea4cd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.318969:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.318996:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123540608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 122us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.319002:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5783 00000100:00100000:0.0:1746155560.319151:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.319292:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123540736 00000100:00100000:1.0:1746155560.319295:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123540736 00010000:00010000:1.0:1746155560.319307:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f22ec00/0x844e5faceb5ea495 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101f5 expref: 18 pid: 18270 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.319330:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5784 00000100:00100000:1.0:1746155560.319335:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123540736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.319342:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.319352:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f22ec00/0x844e5faceb5ea495 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101f5 expref: 18 pid: 18270 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.319385:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f22ec00/0x844e5faceb5ea495 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101f5 expref: 18 pid: 18270 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.319397:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f22ec00/0x844e5faceb5ea495 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f101f5 expref: 18 pid: 18270 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.319406:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.319407:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.319410:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.319416:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.319427:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.319444:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123540736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 109us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.319449:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5784 00010000:00010000:0.0:1746155560.319520:0:29728:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.319527:0:29728:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.319544:0:29728:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.319550:0:29728:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.319556:0:29728:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.319561:0:29728:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130c82600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155560.319564:0:29728:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.319570:0:29728:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.319578:0:29728:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.319583:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c82600/0x844e5faceb5ea4e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.319632:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1960:x1830976123537408:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 23526us (23771us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155560.319638:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11563 00000100:00100000:0.0:1746155560.320972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.321009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.324730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.327889:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.329497:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4333 00000100:00100000:1.0:1746155560.329520:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123541760:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155560.329669:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123541760:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 152us (1780us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155560.329675:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4333 00002000:00100000:1.0:1746155560.329681:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3da:0x0] (1785856->1789951) req@ffff880094c33b80 x1830976123541760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.329688:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c33b80 with x1830976123541760 ext(1785856->1789951) 00002000:00010000:1.0:1746155560.329691:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c33b80 00000100:00100000:0.0:1746155560.330930:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.331816:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123542016 00000100:00100000:0.0:1746155560.331819:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123542016 00000100:00100000:0.0:1746155560.331847:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9910 00000100:00100000:0.0:1746155560.331852:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:28877:x1830976123542016:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:0.0:1746155560.331872:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155560.331884:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3e00/0x844e5faceb5e9de2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fde2 expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.332178:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155560.332182:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155560.332220:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:28877:x1830976123542016:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 367us (460us total) trans 0 rc -116/-116 00000100:00100000:0.0:1746155560.332225:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9910 00000100:00100000:0.0:1746155560.333691:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.333718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.333920:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.334025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.334052:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123542656 00000100:00100000:1.0:1746155560.334056:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123542656 00000100:00100000:0.0:1746155560.335159:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.335323:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123543040 00000100:00100000:1.0:1746155560.335326:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123543040 00000100:00100000:1.0:1746155560.335350:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3972 00000100:00100000:1.0:1746155560.335355:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:28877:x1830976123543040:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:1.0:1746155560.335597:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:28877:x1830976123543040:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 241us (439us total) trans 8589943828 rc 0/0 00000100:00100000:1.0:1746155560.335604:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3972 00000100:00100000:0.0:1746155560.343579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.343618:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.343902:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.344716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.345052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.345824:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.356371:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.356565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.356593:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.356626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.356633:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123544192 00000100:00100000:1.0:1746155560.356648:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123544192 00000100:00100000:0.0:1746155560.356653:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123544448 00000100:00100000:0.0:1746155560.356657:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123544448 00002000:00100000:1.0:1746155560.356683:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012f1f3480 x1830976123544192/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.356683:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012f1f1880 x1830976123544448/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.356691:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3480 with x1830976123544192 ext(2097152->3145727) 00002000:00100000:0.0:1746155560.356691:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1880 with x1830976123544448 ext(3145728->4194303) 00002000:00010000:1.0:1746155560.356696:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3480 00002000:00010000:0.0:1746155560.356696:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f1880 00000100:00100000:1.0:1746155560.356713:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123544832 00000100:00100000:1.0:1746155560.356715:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123544832 00002000:00100000:1.0:1746155560.356724:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012f1f3100 x1830976123544832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.356730:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3100 with x1830976123544832 ext(3145728->4194303) 00002000:00010000:1.0:1746155560.356732:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3100 00000100:00100000:0.0:1746155560.357297:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123544704 00000100:00100000:0.0:1746155560.357301:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123544704 00002000:00100000:0.0:1746155560.357318:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012f1f3b80 x1830976123544704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155560.357322:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4334 00002000:00100000:0.0:1746155560.357325:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3b80 with x1830976123544704 ext(2097152->3145727) 00002000:00010000:0.0:1746155560.357328:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3b80 00000100:00100000:1.0:1746155560.357329:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123544192:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155560.357340:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4335 00000100:00100000:0.0:1746155560.357346:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123544448:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155560.357426:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4336 00000100:00100000:0.0:1746155560.357431:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123544832:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.357637:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4337 00000100:00100000:1.0:1746155560.357652:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123544704:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.376372:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123544832:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18933us (19771us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155560.376382:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4336 00002000:00100000:1.0:1746155560.376391:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012f1f3100 x1830976123544832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.376400:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3100 with x1830976123544832 ext(3145728->4194303) 00002000:00010000:1.0:1746155560.376405:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3100 00000100:00100000:1.0:1746155560.379615:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123544192:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22277us (23242us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155560.379625:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4334 00002000:00100000:1.0:1746155560.379635:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012f1f3480 x1830976123544192/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.379652:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3480 with x1830976123544192 ext(2097152->3145727) 00002000:00010000:1.0:1746155560.379656:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3480 00000100:00100000:1.0:1746155560.381395:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123544704:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23748us (24764us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155560.381403:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4337 00002000:00100000:1.0:1746155560.381409:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012f1f3b80 x1830976123544704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.381415:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3b80 with x1830976123544704 ext(2097152->3145727) 00002000:00010000:1.0:1746155560.381419:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3b80 00000100:00100000:0.0:1746155560.390435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.397847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.398216:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123545344 00000100:00100000:1.0:1746155560.398224:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123545344 00002000:00100000:1.0:1746155560.398259:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012f1f3800 x1830976123545344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.398267:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3800 with x1830976123545344 ext(4194304->4956159) 00002000:00010000:1.0:1746155560.398272:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3800 00000100:00100000:1.0:1746155560.398303:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4338 00000100:00100000:1.0:1746155560.398311:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123545344:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.404540:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123545344:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6191us (6664us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155560.404550:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4338 00002000:00100000:1.0:1746155560.404562:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012f1f3800 x1830976123545344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.404570:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3800 with x1830976123545344 ext(4194304->4956159) 00002000:00010000:1.0:1746155560.404575:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3800 00000100:00100000:0.0:1746155560.407772:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.413985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.418839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.419027:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123545728 00000100:00100000:1.0:1746155560.419033:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123545728 00010000:00010000:1.0:1746155560.419055:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c400/0x844e5faceb5ea52f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10249 expref: 12 pid: 4461 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.419102:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5785 00000100:00100000:1.0:1746155560.419109:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123545728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.419119:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.419134:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c400/0x844e5faceb5ea52f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10249 expref: 12 pid: 4461 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.419143:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c400/0x844e5faceb5ea52f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10249 expref: 12 pid: 4461 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.419160:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c400/0x844e5faceb5ea52f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10249 expref: 12 pid: 4461 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.419185:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.419371:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123545728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 261us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.419377:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5785 00000100:00100000:0.0:1746155560.421448:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.421609:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123545856 00000100:00100000:1.0:1746155560.421615:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123545856 00010000:00010000:1.0:1746155560.421637:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ea567 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1026c expref: 20 pid: 18270 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.421680:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5786 00000100:00100000:1.0:1746155560.421687:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123545856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.421696:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.421711:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ea567 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1026c expref: 20 pid: 18270 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.421717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155560.421720:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ea567 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1026c expref: 20 pid: 18270 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.421785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155560.421843:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ea567 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1026c expref: 22 pid: 18270 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.421976:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.421978:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.421983:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136ab9c00/0x844e5faceb5ea57c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10281 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.421996:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136ab9c00/0x844e5faceb5ea57c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10281 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.422026:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136ab9c00/0x844e5faceb5ea57c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10281 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.422037:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124502784:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155560.422417:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.424105:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124502784:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155560.424118:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.424141:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123545856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2454us (2697us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.424148:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5786 00000100:00100000:0.0:1746155560.424723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.424785:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123546368 00000100:00100000:1.0:1746155560.424791:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123546368 00002000:00100000:1.0:1746155560.424813:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (3022848->3026943) req@ffff88012cdeed80 x1830976123546368/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.424821:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeed80 with x1830976123546368 ext(3022848->3026943) 00002000:00010000:1.0:1746155560.424825:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdeed80 00000100:00100000:1.0:1746155560.424938:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4339 00000100:00100000:1.0:1746155560.424945:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123546368:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.425068:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123546368:12345-192.168.202.51@tcp:3:cat.0 Request processed in 123us (345us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155560.425080:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4339 00002000:00100000:1.0:1746155560.425085:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (3022848->3026943) req@ffff88012cdeed80 x1830976123546368/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.425092:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeed80 with x1830976123546368 ext(3022848->3026943) 00002000:00010000:1.0:1746155560.425095:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdeed80 00000100:00100000:0.0:1746155560.429236:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.434365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.434674:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123546624 00000100:00100000:1.0:1746155560.434680:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123546624 00010000:00010000:1.0:1746155560.434702:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc7f200/0x844e5faceb5ea4fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10218 expref: 10 pid: 9235 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.434729:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5787 00000100:00100000:1.0:1746155560.434735:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123546624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.434746:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.434762:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc7f200/0x844e5faceb5ea4fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10218 expref: 10 pid: 9235 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.434771:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc7f200/0x844e5faceb5ea4fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10218 expref: 10 pid: 9235 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.434788:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc7f200/0x844e5faceb5ea4fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10218 expref: 10 pid: 9235 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.434801:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.434814:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1962:x1830976123546624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.434822:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5787 00000100:00100000:1.0:1746155560.444675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.463321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.463404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.464354:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11584 00000100:00100000:0.0:1746155560.464360:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123547264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155560.464366:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155560.464378:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093332a00/0x844e5faceb5ea598 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f102a4 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.464415:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124503424:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155560.464484:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.475728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.475767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.475791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.475827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.475927:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123547776 00000100:00100000:1.0:1746155560.475933:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123547776 00002000:00100000:1.0:1746155560.475967:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88012cded880 x1830976123547776/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 504/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.475975:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded880 with x1830976123547776 ext(1048576->2097151) 00002000:00010000:1.0:1746155560.475979:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cded880 00000100:00100000:1.0:1746155560.476208:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123548288 00000100:00100000:1.0:1746155560.476211:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123548288 00002000:00100000:1.0:1746155560.476223:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012cdefb80 x1830976123548288/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.476230:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdefb80 with x1830976123548288 ext(1048576->2097151) 00002000:00010000:1.0:1746155560.476233:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdefb80 00000100:00100000:1.0:1746155560.476248:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4341 00000100:00100000:1.0:1746155560.476254:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123547520:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155560.476294:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4342 00000100:00100000:0.0:1746155560.476301:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123547776:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.495329:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1963:x1830976123547520:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19068us (19602us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155560.495339:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4341 00002000:00100000:1.0:1746155560.495355:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012cdef480 x1830976123547520/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.495363:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdef480 with x1830976123547520 ext(0->1048575) 00002000:00010000:1.0:1746155560.495366:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdef480 00000100:00100000:0.0:1746155560.505924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.505976:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.511164:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123548672 00000100:00100000:0.0:1746155560.511171:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123548672 00000100:00100000:0.0:1746155560.511245:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11587 00000100:00100000:0.0:1746155560.511251:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+9:28889:x1830976123548672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155560.511267:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155560.511281:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093332c00/0x844e5faceb5ea5b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f102b9 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.511302:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0b0800/0x844e5faceb5ea591 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3715071) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10296 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.511309:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155560.511311:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155560.511314:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093332c00/0x844e5faceb5ea5b4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102b9 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.511336:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0b0800/0x844e5faceb5ea591 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3715071) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10296 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.511345:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0b0800/0x844e5faceb5ea591 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3715071) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10296 expref: 14 pid: 8436 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.511355:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124503936:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155560.511887:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.514348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.514637:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123548800 00000100:00100000:1.0:1746155560.514652:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123548800 00002000:00100000:1.0:1746155560.514683:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3715071) req@ffff880137120000 x1830976123548800/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.514690:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120000 with x1830976123548800 ext(3145728->3715071) 00010000:00010000:1.0:1746155560.514696:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0b0800/0x844e5faceb5ea591 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3715071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10296 expref: 15 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.514706:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0b0800/0x844e5faceb5ea591 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3715071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10296 expref: 15 pid: 8436 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746155560.514712:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880137120000 00000100:00100000:1.0:1746155560.514805:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 647 00000100:00100000:1.0:1746155560.514813:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976123548800:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155560.524057:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976123548800:12345-192.168.202.51@tcp:4:cat.0 Request processed in 9227us (9693us total) trans 21474840492 rc 0/0 00000100:00100000:1.0:1746155560.524066:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 647 00002000:00100000:1.0:1746155560.524075:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3715071) req@ffff880137120000 x1830976123548800/t21474840492(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/448 e 0 to 0 dl 1746155571 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.524082:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120000 with x1830976123548800 ext(3145728->3715071) 00010000:00010000:1.0:1746155560.524090:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0b0800/0x844e5faceb5ea591 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3715071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10296 expref: 17 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.524103:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0b0800/0x844e5faceb5ea591 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3715071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10296 expref: 17 pid: 8436 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746155560.524108:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880137120000 00000100:00100000:0.0:1746155560.528605:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.535782:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.538845:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123549184 00000100:00100000:1.0:1746155560.538854:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123549184 00002000:00100000:1.0:1746155560.538889:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880137121f80 x1830976123549184/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.538897:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121f80 with x1830976123549184 ext(2097152->3145727) 00002000:00010000:1.0:1746155560.538907:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137121f80 00000100:00100000:1.0:1746155560.538933:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4345 00000100:00100000:1.0:1746155560.538939:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123549184:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.547596:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123549184:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8647us (11811us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155560.547608:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4345 00002000:00100000:1.0:1746155560.547619:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880137121f80 x1830976123549184/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.547628:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121f80 with x1830976123549184 ext(2097152->3145727) 00002000:00010000:1.0:1746155560.547633:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137121f80 00000100:00100000:0.0:1746155560.551696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.557009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.557047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.557144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.557189:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11590 00000100:00100000:0.0:1746155560.557191:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123549696 00000100:00100000:0.0:1746155560.557194:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123549696 00000100:00100000:1.0:1746155560.557197:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123549568:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155560.557207:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746155560.557213:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3022848->3145727) req@ffff88009f246680 x1830976123549696/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746155560.557216:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ea5c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f102ce expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.557219:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124504320:192.168.202.51@tcp:106: 00002000:00100000:0.0:1746155560.557221:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f246680 with x1830976123549696 ext(3022848->3145727) 00010000:00010000:0.0:1746155560.557227:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136ab9c00/0x844e5faceb5ea57c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10281 expref: 21 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.557228:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.557230:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.557236:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136ab9c00/0x844e5faceb5ea57c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10281 expref: 21 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.557237:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ea5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ce expref: 17 pid: 20200 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746155560.557241:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f246680 00000100:00100000:0.0:1746155560.557252:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 648 00010000:00010000:1.0:1746155560.557255:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ea5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ce expref: 17 pid: 20200 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155560.557257:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123549696:12345-192.168.202.51@tcp:4:cat.0 00010000:00010000:1.0:1746155560.557263:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913f0c00, rc 0) 00000100:00100000:3.0:1746155560.557280:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.557286:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123549568:12345-192.168.202.51@tcp:101:cat.0 Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.557292:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11590 00000100:00100000:3.0:1746155560.557316:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124504192:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155560.557340:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136951800/0x844e5faceb5ea5bb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102c0 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.557348:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136951800, rc 0) 00000100:00100000:3.0:1746155560.557379:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:28889:x1830976123549312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5547us (5691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.557384:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11588 00000100:00100000:3.0:1746155560.562909:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123549696:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5648us (5760us total) trans 17179873112 rc 0/0 00000100:00100000:3.0:1746155560.562918:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 648 00002000:00100000:3.0:1746155560.562926:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3022848->3145727) req@ffff88009f246680 x1830976123549696/t17179873112(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/448 e 0 to 0 dl 1746155571 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.562934:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f246680 with x1830976123549696 ext(3022848->3145727) 00010000:00010000:3.0:1746155560.562942:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136ab9c00/0x844e5faceb5ea57c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10281 expref: 21 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.562954:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136ab9c00/0x844e5faceb5ea57c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10281 expref: 21 pid: 8436 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746155560.562960:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f246680 00000100:00100000:0.0:1746155560.571052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.571499:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123549824 00000100:00100000:3.0:1746155560.571528:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123549824 00010000:00010000:3.0:1746155560.571557:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136ab9c00/0x844e5faceb5ea57c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10281 expref: 21 pid: 8436 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.571800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.572908:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5790 00000100:00100000:3.0:1746155560.572916:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123549824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.572926:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.572941:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136ab9c00/0x844e5faceb5ea57c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10281 expref: 21 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.572952:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136ab9c00/0x844e5faceb5ea57c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10281 expref: 21 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.572970:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136ab9c00/0x844e5faceb5ea57c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10281 expref: 21 pid: 8436 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.572999:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.573001:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.573007:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136951800/0x844e5faceb5ea5bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102c0 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.573013:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136951800/0x844e5faceb5ea5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102c0 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.573039:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136951800/0x844e5faceb5ea5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102c0 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.573053:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124504448:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155560.573098:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.577290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.577328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.577791:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123550208 00000100:00100000:3.0:1746155560.577802:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123550208 00000100:00100000:3.0:1746155560.577830:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123550336 00000100:00100000:3.0:1746155560.577831:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123550336 00000100:00100000:3.0:1746155560.577851:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11591 00000100:00100000:3.0:1746155560.577857:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+10:28893:x1830976123550208:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155560.577873:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155560.577888:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f102d5 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.577904:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11592 00010000:00010000:3.0:1746155560.577911:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093332c00/0x844e5faceb5ea5b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102b9 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.577912:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:28896:x1830976123550336:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155560.577919:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ea5c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ce expref: 19 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.577919:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155560.577926:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.577927:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.577927:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f102dc expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.577930:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3440640->3805183] (req 3440640->3805183) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 11 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.577940:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5ea50c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10226 expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.577952:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ea5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ce expref: 20 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.577953:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c4c5200/0x844e5faceb5ea544 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10242 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.577959:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.577960:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.577961:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ea5c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ce expref: 20 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746155560.577963:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1515520->1646591] (req 1515520->1646591) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102dc expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.577971:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124504576:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155560.577977:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c4c5200/0x844e5faceb5ea544 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10242 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.577985:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c4c5200/0x844e5faceb5ea544 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10242 expref: 11 pid: 8437 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.577992:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f245c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124504704:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155560.578069:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124504448:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155560.578082:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.578100:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976123549824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5185us (7057us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.578108:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5790 00010000:00010000:3.0:1746155560.578611:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093332c00/0x844e5faceb5ea5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102b9 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.578614:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5ea50c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10226 expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.578620:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093332c00/0x844e5faceb5ea5b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102b9 expref: 11 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.578623:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5ea50c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10226 expref: 20 pid: 9235 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746155560.578628:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124504832:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155560.578631:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124504960:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155560.578665:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.578675:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.580042:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f245c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124504704:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155560.580051:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124504960:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155560.580067:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1515520->1646591] (req 1515520->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102dc expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.580267:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093333000, rc 0) 00000100:00100000:1.0:1746155560.580323:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:28896:x1830976123550336:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2412us (2994us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.580328:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11592 00000100:00100000:0.0:1746155560.581920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.582254:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123550720 00000100:00100000:1.0:1746155560.582260:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123550720 00010000:00010000:1.0:1746155560.582286:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c4c5200/0x844e5faceb5ea544 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10242 expref: 11 pid: 8437 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.582320:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5791 00000100:00100000:1.0:1746155560.582327:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123550720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.582338:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.582354:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c4c5200/0x844e5faceb5ea544 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10242 expref: 11 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.582363:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c4c5200/0x844e5faceb5ea544 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10242 expref: 11 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.582380:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c4c5200/0x844e5faceb5ea544 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10242 expref: 11 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.582404:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.582442:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123550720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 116us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.582447:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5791 00000100:00100000:1.0:1746155560.582477:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.582485:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123550464 00000100:00100000:1.0:1746155560.582488:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123550464 00010000:00010000:1.0:1746155560.582498:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ea5c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ce expref: 18 pid: 20200 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.582528:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5792 00000100:00100000:1.0:1746155560.582533:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123550464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.582541:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.582549:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ea5c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ce expref: 18 pid: 20200 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.582552:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155560.582557:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ea5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ce expref: 18 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746155560.582567:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ea5c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ce expref: 18 pid: 20200 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.582568:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123550976 00000100:00100000:3.0:1746155560.582571:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123550976 00010000:00010000:1.0:1746155560.582574:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155560.582583:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5ea50c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10226 expref: 18 pid: 9235 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.582591:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123550464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 58us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.582596:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5792 00000100:00100000:3.0:1746155560.582601:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5793 00000100:00100000:3.0:1746155560.582607:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123550976:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.582614:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.582622:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5ea50c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10226 expref: 17 pid: 9235 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.582630:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5ea50c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10226 expref: 17 pid: 9235 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.582652:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5ea50c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10226 expref: 17 pid: 9235 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.582661:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155560.582668:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.582670:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.582675:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102dc expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.582682:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102dc expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.582707:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102dc expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.582707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.582717:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124505088:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155560.582761:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da480 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.583364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.583957:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123551232 00000100:00100000:1.0:1746155560.583961:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123551232 00002000:00100000:1.0:1746155560.583977:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880094c31880 x1830976123551232/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.583984:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c31880 with x1830976123551232 ext(2097152->3145727) 00002000:00010000:1.0:1746155560.583986:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c31880 00000100:00100000:1.0:1746155560.584004:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4347 00000100:00100000:1.0:1746155560.584009:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123551360:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155560.584261:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4348 00000100:00100000:3.0:1746155560.584269:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123551232:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155560.585704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.585722:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123551616 00000100:00100000:1.0:1746155560.585726:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123551616 00000100:00100000:1.0:1746155560.586011:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11593 00000100:00100000:1.0:1746155560.586018:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:28894:x1830976123551616:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155560.586029:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.586043:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5ea5de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f102e3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.586062:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f22e600/0x844e5faceb5ea513 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->1789951) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1021f expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.586068:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155560.586070:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155560.586072:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5ea5de lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102e3 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.586094:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f22e600/0x844e5faceb5ea513 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->1789951) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1021f expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.586103:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f22e600/0x844e5faceb5ea513 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->1789951) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1021f expref: 14 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.586113:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124505216:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155560.586391:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fcb600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155560.586803:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124505088:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155560.586825:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.586844:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123550976:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4237us (4292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.586852:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5793 00000100:00100000:3.0:1746155560.586958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.588020:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123551872 00000100:00100000:3.0:1746155560.588031:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123551872 00002000:00100000:3.0:1746155560.588057:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1515520->1519615) req@ffff88009fe92300 x1830976123551872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.588071:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe92300 with x1830976123551872 ext(1515520->1519615) 00002000:00010000:3.0:1746155560.588075:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe92300 00000100:00100000:3.0:1746155560.588094:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4349 00000100:00100000:3.0:1746155560.588102:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123551872:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155560.588188:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123551872:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 86us (1229us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155560.588193:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4349 00002000:00100000:3.0:1746155560.588199:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1515520->1519615) req@ffff88009fe92300 x1830976123551872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.588205:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe92300 with x1830976123551872 ext(1515520->1519615) 00002000:00010000:3.0:1746155560.588207:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe92300 00000100:00100000:0.0:1746155560.596191:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.596296:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124505216:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155560.596364:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5ea5de lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102e3 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.596381:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913f0200, rc 0) 00000100:00100000:1.0:1746155560.596419:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:28894:x1830976123551616:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10403us (10719us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.596425:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11593 00000100:00100000:3.0:1746155560.596951:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123551232:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12682us (13586us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155560.596958:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4348 00002000:00100000:3.0:1746155560.596963:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880094c31880 x1830976123551232/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.596970:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c31880 with x1830976123551232 ext(2097152->3145727) 00002000:00010000:3.0:1746155560.596973:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c31880 00000100:00100000:3.0:1746155560.601104:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123552256 00000100:00100000:3.0:1746155560.601111:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123552256 00002000:00100000:3.0:1746155560.601140:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1642496->1646591) req@ffff88012fef2300 x1830976123552256/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.601149:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef2300 with x1830976123552256 ext(1642496->1646591) 00002000:00010000:3.0:1746155560.601153:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef2300 00000100:00100000:3.0:1746155560.601168:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4350 00000100:00100000:3.0:1746155560.601174:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976123552256:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155560.601723:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123551360:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 17712us (19013us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155560.601730:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4347 00002000:00100000:1.0:1746155560.601736:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880094c31f80 x1830976123551360/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.601743:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c31f80 with x1830976123551360 ext(3145728->4194303) 00002000:00010000:1.0:1746155560.601747:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c31f80 00000100:00100000:0.0:1746155560.603282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.603895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.604022:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123552512 00000100:00100000:1.0:1746155560.604029:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123552512 00000100:00100000:1.0:1746155560.604066:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11594 00000100:00100000:1.0:1746155560.604072:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:28889:x1830976123552512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155560.604084:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.604096:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c51b800/0x844e5faceb5ea5e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f102ea expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.604113:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.604117:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3440640->3805183] (req 3440640->3805183) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 11 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.604122:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155560.604125:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c51b800/0x844e5faceb5ea5e5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ea expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.604152:0:8437:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3440640->3805183] (req 3440640->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 11 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.604162:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c51b800/0x844e5faceb5ea5e5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ea expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.604169:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c51b800, rc 0) 00000100:00100000:1.0:1746155560.604191:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:28889:x1830976123552512:12345-192.168.202.51@tcp:101:cat.0 Request processed in 119us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.604195:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11594 00000100:00100000:3.0:1746155560.604277:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123552384 00000100:00100000:3.0:1746155560.604281:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123552384 00010000:00010000:3.0:1746155560.604294:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093332c00/0x844e5faceb5ea5b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102b9 expref: 11 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746155560.604308:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5794 00000100:00100000:3.0:1746155560.604312:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123552384:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.604320:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.604333:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093332c00/0x844e5faceb5ea5b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102b9 expref: 11 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.604341:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093332c00/0x844e5faceb5ea5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102b9 expref: 11 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.604354:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093332c00/0x844e5faceb5ea5b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102b9 expref: 11 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.604664:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.604666:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.604671:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.604678:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.604701:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.604710:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 10 pid: 18270 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746155560.604721:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe90a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124505472:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155560.605067:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155560.607571:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe90a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124505472:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155560.607590:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.607620:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123552384:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3306us (4338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.607629:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5794 00000100:00100000:0.0:1746155560.608043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.608697:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.608765:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123552896 00000100:00100000:3.0:1746155560.608768:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123552896 00010000:00010000:3.0:1746155560.608782:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f22e600/0x844e5faceb5ea513 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1568768->1789951) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1021f expref: 14 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746155560.608803:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5795 00000100:00100000:3.0:1746155560.608809:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123552896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.608819:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.608834:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f22e600/0x844e5faceb5ea513 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1568768->1789951) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1021f expref: 14 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.608846:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f22e600/0x844e5faceb5ea513 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1568768->1789951) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1021f expref: 14 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.608861:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f22e600/0x844e5faceb5ea513 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1568768->1789951) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1021f expref: 14 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.608873:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.608875:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.608880:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5ea5de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102e3 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.608886:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5ea5de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102e3 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.608907:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5ea5de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102e3 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.608916:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe90a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124505600:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155560.608956:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155560.611202:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe90a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124505600:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155560.611220:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.611736:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123552896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2437us (2550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.611746:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5795 00000100:00100000:0.0:1746155560.613154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.614735:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123553152 00000100:00100000:1.0:1746155560.614744:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123553152 00002000:00100000:1.0:1746155560.614783:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3801088->3805183) req@ffff880094f0a300 x1830976123553152/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.614791:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0a300 with x1830976123553152 ext(3801088->3805183) 00010000:00010000:1.0:1746155560.614799:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 10 pid: 18270 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.614810:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 10 pid: 18270 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746155560.614816:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f0a300 00000100:00100000:1.0:1746155560.615238:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 652 00000100:00100000:1.0:1746155560.615248:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123553152:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155560.615896:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123553152:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 647us (2745us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155560.615902:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 652 00002000:00100000:1.0:1746155560.615908:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3801088->3805183) req@ffff880094f0a300 x1830976123553152/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/4536 e 0 to 0 dl 1746155571 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.615914:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0a300 with x1830976123553152 ext(3801088->3805183) 00010000:00010000:1.0:1746155560.615920:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 10 pid: 18270 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.615929:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 10 pid: 18270 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746155560.615936:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f0a300 00000100:00100000:0.0:1746155560.618333:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.618370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.618776:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123553664 00000100:00100000:1.0:1746155560.618782:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123553664 00002000:00100000:1.0:1746155560.619257:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094f0a680 x1830976123553664/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.619265:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0a680 with x1830976123553664 ext(1048576->2097151) 00002000:00010000:1.0:1746155560.619270:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f0a680 00000100:00100000:1.0:1746155560.619296:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123553792 00000100:00100000:1.0:1746155560.619303:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123553792 00002000:00100000:1.0:1746155560.619317:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880094f09180 x1830976123553792/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.619329:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09180 with x1830976123553792 ext(1048576->2097151) 00002000:00010000:1.0:1746155560.619332:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f09180 00000100:00100000:1.0:1746155560.619343:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4351 00000100:00100000:1.0:1746155560.619349:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123553664:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155560.619739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.619778:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.620583:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123554176 00000100:00100000:3.0:1746155560.620588:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123554176 00002000:00100000:3.0:1746155560.620606:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3440640->3805183) req@ffff88009100a300 x1830976123554176/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.620612:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009100a300 with x1830976123554176 ext(3440640->3805183) 00010000:00010000:3.0:1746155560.620619:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 10 pid: 18270 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.620630:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 10 pid: 18270 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746155560.620636:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009100a300 00000100:00100000:3.0:1746155560.620656:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123554048 00000100:00100000:3.0:1746155560.620658:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123554048 00002000:00100000:3.0:1746155560.620668:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880091009c00 x1830976123554048/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 504/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.620673:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091009c00 with x1830976123554048 ext(1048576->2097151) 00002000:00010000:3.0:1746155560.620676:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091009c00 00000100:00100000:3.0:1746155560.620685:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 653 00000100:00100000:3.0:1746155560.620690:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123554176:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155560.620986:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4353 00000100:00100000:3.0:1746155560.620991:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123554048:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155560.625877:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123554176:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 5176us (6128us total) trans 21474840493 rc 0/0 00000100:00100000:3.0:1746155560.625889:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 653 00002000:00100000:3.0:1746155560.625898:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3440640->3805183) req@ffff88009100a300 x1830976123554176/t21474840493(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/448 e 0 to 0 dl 1746155571 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.625908:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009100a300 with x1830976123554176 ext(3440640->3805183) 00010000:00010000:3.0:1746155560.625916:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 12 pid: 18270 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.625928:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 12 pid: 18270 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746155560.625935:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009100a300 00000100:00100000:1.0:1746155560.634342:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123553664:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14984us (16005us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155560.634352:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4351 00002000:00100000:1.0:1746155560.634363:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094f0a680 x1830976123553664/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.634371:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0a680 with x1830976123553664 ext(1048576->2097151) 00002000:00010000:1.0:1746155560.634376:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f0a680 00000100:00100000:3.0:1746155560.634497:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123554304 00000100:00100000:3.0:1746155560.634523:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123554304 00010000:00010000:3.0:1746155560.634547:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 12 pid: 18270 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.634573:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5796 00000100:00100000:0.0:1746155560.634581:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123554304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155560.634592:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746155560.634607:0:7062:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155560 -> 1746155561 00002000:00010000:0.0:1746155560.634609:0:7062:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155560 -> 1746155561 00010000:00010000:0.0:1746155560.634613:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 12 pid: 18270 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.634622:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 12 pid: 18270 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.634650:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bdfb600/0x844e5faceb5ea5d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3440640->3805183) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102d5 expref: 12 pid: 18270 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746155560.634672:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.634674:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.634680:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c51b800/0x844e5faceb5ea5e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ea expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.634692:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c51b800/0x844e5faceb5ea5e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ea expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.634716:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c51b800/0x844e5faceb5ea5e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ea expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.634725:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091008e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124505728:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155560.634762:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155560.639418:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123554048:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 18419us (19632us total) trans 0 rc 917504/917504 00000100:00100000:3.0:1746155560.639427:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4353 00002000:00100000:3.0:1746155560.639436:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880091009c00 x1830976123554048/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 504/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 917504/917504 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.639444:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091009c00 with x1830976123554048 ext(1048576->2097151) 00002000:00010000:3.0:1746155560.639449:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091009c00 00000100:00100000:1.0:1746155560.639622:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091008e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124505728:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155560.639647:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.640039:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123554304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5457us (5626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.640047:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5796 00000100:00100000:0.0:1746155560.640146:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.640342:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123554560 00000100:00100000:3.0:1746155560.640348:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123554560 00002000:00100000:3.0:1746155560.640375:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009100b100 x1830976123554560/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.640383:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009100b100 with x1830976123554560 ext(3145728->4194303) 00002000:00010000:3.0:1746155560.640386:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009100b100 00000100:00100000:3.0:1746155560.640399:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4354 00000100:00100000:3.0:1746155560.640406:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123554560:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155560.645985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.647858:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.648316:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123554560:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7908us (8170us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155560.648325:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4354 00002000:00100000:3.0:1746155560.648332:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009100b100 x1830976123554560/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.648340:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009100b100 with x1830976123554560 ext(3145728->4194303) 00002000:00010000:3.0:1746155560.648344:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009100b100 00000100:00100000:0.0:1746155560.653637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.653785:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.654074:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123555072 00000100:00100000:1.0:1746155560.654081:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123555072 00000100:00100000:1.0:1746155560.654129:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11597 00000100:00100000:1.0:1746155560.654136:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123555072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155560.654152:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.654165:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd50400/0x844e5faceb5ea601 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10306 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.654205:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124505856:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155560.654263:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439840 going to sleep for 11 seconds 00002000:00010000:1.0:1746155560.655345:0:18270:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155560 -> 1746155561 00002000:00010000:1.0:1746155560.655349:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155560 -> 1746155561 00002000:00010000:1.0:1746155560.655351:0:18270:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155560 -> 1746155561 00000100:00100000:1.0:1746155560.655364:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124505856:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155560.655380:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd50400/0x844e5faceb5ea601 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10306 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.655388:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd50400/0x844e5faceb5ea601 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10306 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.655397:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd50400, rc 0) 00000100:00100000:1.0:1746155560.655423:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123555072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1288us (1794us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155560.655428:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11597 00000100:00100000:0.0:1746155560.661447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.661481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.661674:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123555328 00000100:00100000:1.0:1746155560.661674:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123555584 00000100:00100000:3.0:1746155560.661681:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123555328 00000100:00100000:1.0:1746155560.661681:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123555584 00000100:00100000:0.0:1746155560.661690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.661702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:3.0:1746155560.661714:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800910d9180 x1830976123555328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.661724:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9180 with x1830976123555328 ext(2097152->3145727) 00002000:00010000:3.0:1746155560.661728:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d9180 00000100:00100000:0.0:1746155560.661739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.661751:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123555840 00000100:00100000:3.0:1746155560.661753:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123555840 00000100:00100000:0.0:1746155560.661758:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123556352 00000100:00100000:0.0:1746155560.661760:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123556352 00002000:00100000:3.0:1746155560.661764:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800910d8e00 x1830976123555840/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.661770:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8e00 with x1830976123555840 ext(2097152->3145727) 00002000:00010000:3.0:1746155560.661772:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910d8e00 00002000:00100000:0.0:1746155560.661775:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800910daa00 x1830976123556352/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.661782:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910daa00 with x1830976123556352 ext(4194304->4956159) 00002000:00010000:0.0:1746155560.661785:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910daa00 00000100:00100000:3.0:1746155560.661789:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4356 00000100:00100000:3.0:1746155560.661793:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123555840:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155560.661807:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4357 00000100:00100000:0.0:1746155560.661812:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123556352:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:1.0:1746155560.662330:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800910d9c00 x1830976123555584/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.662338:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9c00 with x1830976123555584 ext(3145728->4194303) 00002000:00010000:1.0:1746155560.662341:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d9c00 00000100:00100000:1.0:1746155560.662356:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4359 00000100:00100000:1.0:1746155560.662361:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123555584:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.674313:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123555584:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11943us (12822us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155560.674323:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4359 00002000:00100000:1.0:1746155560.674333:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800910d9c00 x1830976123555584/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.674341:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9c00 with x1830976123555584 ext(3145728->4194303) 00002000:00010000:1.0:1746155560.674346:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d9c00 00000100:00100000:3.0:1746155560.679055:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123556096:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16994us (17345us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155560.679064:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4358 00002000:00100000:3.0:1746155560.679072:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800910dbb80 x1830976123556096/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.679080:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910dbb80 with x1830976123556096 ext(3145728->4194303) 00002000:00010000:3.0:1746155560.679085:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910dbb80 00000100:00100000:0.0:1746155560.683817:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.684437:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123556480 00000100:00100000:1.0:1746155560.684445:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123556480 00000100:00100000:1.0:1746155560.684927:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11599 00000100:00100000:1.0:1746155560.684935:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123556480:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155560.684950:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.684964:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea608 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1030d expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.685011:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124505984:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155560.685094:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.685523:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123556736 00000100:00100000:0.0:1746155560.685526:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123556736 00002000:00100000:0.0:1746155560.685550:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012fef2a00 x1830976123556736/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.685561:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef2a00 with x1830976123556736 ext(4194304->4956159) 00002000:00010000:0.0:1746155560.685565:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef2a00 00000100:00100000:0.0:1746155560.685579:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4360 00000100:00100000:0.0:1746155560.685584:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976123556736:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.686271:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124505984:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155560.686288:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea608 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1030d expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.686297:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea608 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1030d expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.686308:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bb600, rc 0) 00000100:00100000:1.0:1746155560.686336:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123556480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1402us (2525us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155560.686341:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11599 00000100:00100000:0.0:1746155560.690241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.690342:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123556864 00000100:00100000:1.0:1746155560.690349:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123556864 00000100:00100000:1.0:1746155560.690392:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11600 00000100:00100000:1.0:1746155560.690398:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123556864:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155560.690414:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.690427:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903bac00/0x844e5faceb5ea60f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10314 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.690465:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124506112:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155560.690540:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.691046:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976123556736:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5460us (5609us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155560.691054:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4360 00002000:00100000:1.0:1746155560.691061:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012fef2a00 x1830976123556736/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.691069:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef2a00 with x1830976123556736 ext(4194304->4956159) 00002000:00010000:1.0:1746155560.691073:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef2a00 00000100:00100000:1.0:1746155560.692707:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124506112:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155560.692728:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903bac00/0x844e5faceb5ea60f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10314 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.692739:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903bac00/0x844e5faceb5ea60f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10314 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.692826:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bac00, rc 0) 00000100:00100000:1.0:1746155560.693177:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123556864:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2777us (2941us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155560.693184:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11600 00000100:00100000:0.0:1746155560.759775:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.766933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.767300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.767365:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123557248 00000100:00100000:3.0:1746155560.767372:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123557248 00000100:00100000:3.0:1746155560.767404:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123557504 00000100:00100000:3.0:1746155560.767406:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123557504 00000100:00100000:3.0:1746155560.767418:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3974 00000100:00100000:3.0:1746155560.767425:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+311:27129:x1830976123557248:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155560.768478:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:27129:x1830976123557248:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 1053us (1552us total) trans 8589943832 rc 0/0 00000100:00100000:3.0:1746155560.768484:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3974 00000100:00100000:0.0:1746155560.771731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.771855:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123557632 00000100:00100000:1.0:1746155560.771862:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123557632 00010000:00010000:1.0:1746155560.771892:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5ea521 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1022d expref: 312 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.771923:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5797 00000100:00100000:1.0:1746155560.771929:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1962:x1830976123557632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.771941:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.771946:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5ea521 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1022d expref: 312 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.771955:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5ea521 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1022d expref: 312 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.771971:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5ea521 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1022d expref: 312 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746155560.772415:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155560.772778:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155560.772783:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094129800/0x844e5faceb5ea62b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.772791:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094129800/0x844e5faceb5ea62b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.772796:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094129800/0x844e5faceb5ea62b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.772804:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.772830:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123557760 00000100:00100000:3.0:1746155560.772834:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123557760 00000100:00100000:1.0:1746155560.772846:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+311:1962:x1830976123557632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 915us (1120us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155560.772848:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009048f600/0x844e5faceb5ea4f7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10211 expref: 33 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.772852:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5797 00000100:00100000:3.0:1746155560.772865:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5798 00000100:00100000:3.0:1746155560.773001:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1961:x1830976123557760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.773011:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.773016:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009048f600/0x844e5faceb5ea4f7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10211 expref: 33 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.773024:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009048f600/0x844e5faceb5ea4f7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10211 expref: 33 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.773035:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009048f600/0x844e5faceb5ea4f7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10211 expref: 33 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.773044:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155560.773047:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094129800/0x844e5faceb5ea62b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155560.773053:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094129800/0x844e5faceb5ea62b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155560.773059:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094129800/0x844e5faceb5ea62b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155560.773074:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.773090:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123557760:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 219us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.773095:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5798 00000100:00100000:0.0:1746155560.775682:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.776348:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123557888 00000100:00100000:1.0:1746155560.776355:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123557888 00000100:00100000:1.0:1746155560.776399:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11601 00000100:00100000:1.0:1746155560.776405:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976123557888:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155560.776418:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155560.776422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155560.776431:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903bb000/0x844e5faceb5ea632 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10322 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.776446:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.776449:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.776456:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bb000/0x844e5faceb5ea632 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10322 expref: 7 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.777131:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903bb000/0x844e5faceb5ea632 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10322 expref: 7 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.777139:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bb000, rc 0) 00000100:00100000:1.0:1746155560.777168:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123557888:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 764us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.777173:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11601 00000100:00100000:0.0:1746155560.777783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.777868:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.777891:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.778082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.778523:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123558144 00000100:00100000:1.0:1746155560.778527:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123558144 00000100:00100000:1.0:1746155560.778550:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123558400 00000100:00100000:1.0:1746155560.778552:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123558400 00000100:00100000:1.0:1746155560.778562:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123558272 00000100:00100000:1.0:1746155560.778564:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123558272 00000100:00100000:1.0:1746155560.778572:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123558528 00000100:00100000:1.0:1746155560.778573:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123558528 00000100:00100000:1.0:1746155560.778583:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11603 00000100:00100000:1.0:1746155560.778587:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123558144:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155560.778598:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.778609:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903bb200/0x844e5faceb5ea640 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10330 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.778623:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.778625:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.778630:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bb200/0x844e5faceb5ea640 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10330 expref: 8 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.778672:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903bb200/0x844e5faceb5ea640 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10330 expref: 8 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.778681:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bb200, rc 0) 00000100:00100000:1.0:1746155560.778703:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123558144:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 116us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.778709:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11603 00000100:00100000:1.0:1746155560.778719:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11604 00000100:00100000:1.0:1746155560.778724:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123558400:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155560.778730:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.778738:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903bb400/0x844e5faceb5ea647 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1033e expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.778750:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.778752:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.778756:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bb400/0x844e5faceb5ea647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1033e expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.778764:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903bb400/0x844e5faceb5ea647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1033e expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.778770:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bb400, rc 0) 00000100:00100000:1.0:1746155560.778785:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123558400:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 61us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.778790:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11604 00000100:00100000:1.0:1746155560.778799:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11605 00000100:00100000:1.0:1746155560.778803:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123558272:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155560.778808:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.778813:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea64e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10337 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.778842:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124506496:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155560.778878:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.778894:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11606 00000100:00100000:1.0:1746155560.778899:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123558528:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155560.778904:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.778909:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903bb800/0x844e5faceb5ea655 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10345 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.778918:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.778920:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.778924:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bb800/0x844e5faceb5ea655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10345 expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.778931:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903bb800/0x844e5faceb5ea655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10345 expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.778937:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bb800, rc 0) 00000100:00100000:1.0:1746155560.778950:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123558528:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 52us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.778955:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11606 00000100:00100000:1.0:1746155560.781225:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124506496:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155560.781248:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea64e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10337 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.781259:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea64e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10337 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.781267:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bae00, rc 0) 00000100:00100000:1.0:1746155560.781302:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123558272:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2498us (3410us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155560.781308:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11605 00000100:00100000:3.0:1746155560.783013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.784839:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.784879:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123558912 00000100:00100000:3.0:1746155560.784883:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123558912 00010000:00010000:3.0:1746155560.784901:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094129800/0x844e5faceb5ea62b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1031b expref: 21 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746155560.784933:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5799 00000100:00100000:3.0:1746155560.784940:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+21:1961:x1830976123558912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.784951:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.785076:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094129800/0x844e5faceb5ea62b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1031b expref: 21 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.785085:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094129800/0x844e5faceb5ea62b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1031b expref: 21 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.785100:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094129800/0x844e5faceb5ea62b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1031b expref: 21 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.785110:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155560.785113:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094129000/0x844e5faceb5ea663 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155560.785120:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094129000/0x844e5faceb5ea663 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155560.785125:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094129000/0x844e5faceb5ea663 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155560.785149:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.785182:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:1961:x1830976123558912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 242us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.785188:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5799 00000100:00100000:0.0:1746155560.788361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.793160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.793239:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123559168 00000100:00100000:3.0:1746155560.793245:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123559168 00010000:00010000:3.0:1746155560.793277:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094129000/0x844e5faceb5ea663 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1034c expref: 22 pid: 27374 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746155560.794237:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5800 00000100:00100000:3.0:1746155560.794247:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+22:1960:x1830976123559168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.794260:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.794267:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094129000/0x844e5faceb5ea663 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1034c expref: 22 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.794278:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094129000/0x844e5faceb5ea663 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1034c expref: 22 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.794297:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094129000/0x844e5faceb5ea663 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1034c expref: 22 pid: 27374 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.794310:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155560.794314:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094128200/0x844e5faceb5ea678 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155560.794322:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128200/0x844e5faceb5ea678 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155560.794328:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094128200/0x844e5faceb5ea678 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155560.794356:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.794603:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+21:1960:x1830976123559168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 357us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.794610:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5800 00000100:00100000:0.0:1746155560.799361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.799412:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123559296 00000100:00100000:1.0:1746155560.799420:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123559296 00000100:00100000:1.0:1746155560.799467:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11607 00000100:00100000:1.0:1746155560.799474:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123559296:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155560.799489:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.799530:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903baa00/0x844e5faceb5ea67f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1035a expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.799580:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124506880:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155560.799656:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.802698:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124507008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746155560.802755:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155560.802847:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124507136 00000100:00100000:0.0:1746155560.802847:0:8439:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124507008 00000100:00100000:3.0:1746155560.802852:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124507136 00000100:00100000:0.0:1746155560.802852:0:8439:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124507008 00000100:00100000:0.0:1746155560.802898:0:8439:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1746155560.802905:0:8439:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1830976124507008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746155560.802923:0:8439:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 396689408 pending 6815744 free 3847225344 avail 3818913792 00000100:00100000:0.0:1746155560.802951:0:8439:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1830976124507008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155560.802957:0:8439:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1746155560.802981:0:3298:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840482 gen 2 00000004:00080000:0.0:1746155560.802985:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac5f80, transno 21474840401 00000004:00080000:0.0:1746155560.802990:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac7800, transno 21474840402 00000004:00080000:0.0:1746155560.802993:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac5880, transno 21474840403 00000004:00080000:0.0:1746155560.802994:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac4380, transno 21474840404 00000004:00080000:0.0:1746155560.802996:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac6300, transno 21474840405 00000004:00080000:0.0:1746155560.802998:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac5c00, transno 21474840406 00000004:00080000:0.0:1746155560.803000:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac7480, transno 21474840407 00000004:00080000:0.0:1746155560.803002:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac6680, transno 21474840408 00000004:00080000:0.0:1746155560.803004:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc6d80, transno 21474840409 00000004:00080000:0.0:1746155560.803006:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f703800, transno 21474840410 00000004:00080000:0.0:1746155560.803008:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f701180, transno 21474840411 00000004:00080000:0.0:1746155560.803010:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f703b80, transno 21474840412 00000004:00080000:0.0:1746155560.803012:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f700e00, transno 21474840413 00000004:00080000:0.0:1746155560.803014:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f702d80, transno 21474840414 00000004:00080000:0.0:1746155560.803016:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f702a00, transno 21474840415 00000004:00080000:0.0:1746155560.803019:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8df80, transno 21474840416 00000004:00080000:0.0:1746155560.803021:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc5500, transno 21474840417 00000004:00080000:0.0:1746155560.803023:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f700a80, transno 21474840418 00000004:00080000:0.0:1746155560.803026:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131496300, transno 21474840423 00000004:00080000:0.0:1746155560.803028:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131495c00, transno 21474840424 00000004:00080000:0.0:1746155560.803030:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131494a80, transno 21474840425 00000004:00080000:0.0:1746155560.803032:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131497100, transno 21474840426 00000004:00080000:0.0:1746155560.803034:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131496d80, transno 21474840427 00000004:00080000:0.0:1746155560.803036:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131497480, transno 21474840428 00000004:00080000:0.0:1746155560.803038:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131494e00, transno 21474840429 00000004:00080000:0.0:1746155560.803040:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131496680, transno 21474840430 00000004:00080000:0.0:1746155560.803042:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a88e00, transno 21474840431 00000004:00080000:0.0:1746155560.803045:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28d880, transno 21474840435 00000004:00080000:0.0:1746155560.803046:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28f480, transno 21474840436 00000004:00080000:0.0:1746155560.803048:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28fb80, transno 21474840437 00000004:00080000:0.0:1746155560.803050:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28dc00, transno 21474840438 00000004:00080000:0.0:1746155560.803051:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28c000, transno 21474840439 00000004:00080000:0.0:1746155560.803053:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28f800, transno 21474840440 00000004:00080000:0.0:1746155560.803055:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28ca80, transno 21474840441 00000004:00080000:0.0:1746155560.803056:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28ce00, transno 21474840442 00000004:00080000:0.0:1746155560.803058:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28e300, transno 21474840443 00000004:00080000:0.0:1746155560.803060:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136631500, transno 21474840444 00000004:00080000:0.0:1746155560.803062:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136631c00, transno 21474840445 00000004:00080000:0.0:1746155560.803063:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136631180, transno 21474840446 00000004:00080000:0.0:1746155560.803065:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136632300, transno 21474840447 00000004:00080000:0.0:1746155560.803066:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136631f80, transno 21474840448 00000004:00080000:0.0:1746155560.803172:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136632680, transno 21474840449 00000004:00080000:0.0:1746155560.803175:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136630e00, transno 21474840450 00000004:00080000:0.0:1746155560.803177:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136631880, transno 21474840451 00000004:00080000:0.0:1746155560.803179:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136632a00, transno 21474840452 00000004:00080000:0.0:1746155560.803181:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800948e7800, transno 21474840465 00000004:00080000:0.0:1746155560.803183:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800948e5500, transno 21474840466 00000004:00080000:0.0:1746155560.803185:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800948e6a00, transno 21474840467 00000004:00080000:0.0:1746155560.803187:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800948e5f80, transno 21474840468 00000004:00080000:0.0:1746155560.803189:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800948e5180, transno 21474840469 00000004:00080000:0.0:1746155560.803191:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800948e6300, transno 21474840470 00000004:00080000:0.0:1746155560.803193:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800948e4380, transno 21474840471 00000004:00080000:0.0:1746155560.803194:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800948e4700, transno 21474840472 00000004:00080000:0.0:1746155560.803197:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910db100, transno 21474840473 00000004:00080000:0.0:1746155560.803199:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ec380, transno 21474840474 00000004:00080000:0.0:1746155560.803201:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dad80, transno 21474840475 00000004:00080000:0.0:1746155560.803203:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6daa00, transno 21474840476 00000004:00080000:0.0:1746155560.803205:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b882680, transno 21474840477 00000004:00080000:0.0:1746155560.803207:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c6680, transno 21474840478 00000004:00080000:0.0:1746155560.803209:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6d9500, transno 21474840479 00000100:00100000:3.0:1746155560.803211:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000004:00080000:0.0:1746155560.803211:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800944ae680, transno 21474840480 00000004:00080000:0.0:1746155560.803213:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3eea00, transno 21474840481 00000100:00100000:3.0:1746155560.803215:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830976124507136:12345-0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1746155560.803215:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6d9180, transno 21474840482 00000100:00100000:0.0:1746155560.803222:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124507008:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746155560.803227:0:8440:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 394854400 pending 6815744 free 3850371072 avail 3822059520 00000100:00100000:3.0:1746155560.803250:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830976124507136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.803254:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1746155560.803278:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873097 gen 2 00000004:00080000:3.0:1746155560.803280:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a88000, transno 17179873027 00000004:00080000:3.0:1746155560.803284:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a8a680, transno 17179873028 00000004:00080000:3.0:1746155560.803286:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a88380, transno 17179873029 00000004:00080000:3.0:1746155560.803288:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a89f80, transno 17179873030 00000004:00080000:3.0:1746155560.803290:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a8b480, transno 17179873031 00000004:00080000:3.0:1746155560.803292:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a89500, transno 17179873032 00000004:00080000:3.0:1746155560.803295:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a88700, transno 17179873033 00000004:00080000:3.0:1746155560.803296:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a88a80, transno 17179873034 00000004:00080000:3.0:1746155560.803298:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c212300, transno 17179873035 00000004:00080000:3.0:1746155560.803300:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137121880, transno 17179873036 00000004:00080000:3.0:1746155560.803302:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137123800, transno 17179873037 00000004:00080000:3.0:1746155560.803303:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c210a80, transno 17179873038 00000004:00080000:3.0:1746155560.803305:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137123b80, transno 17179873039 00000004:00080000:3.0:1746155560.803307:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c213800, transno 17179873040 00000004:00080000:3.0:1746155560.803309:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137122300, transno 17179873041 00000004:00080000:3.0:1746155560.803311:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137121180, transno 17179873042 00000004:00080000:3.0:1746155560.803313:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae2a00, transno 17179873046 00000004:00080000:3.0:1746155560.803315:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae3100, transno 17179873047 00000004:00080000:3.0:1746155560.803317:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae0000, transno 17179873048 00000004:00080000:3.0:1746155560.803318:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae1500, transno 17179873049 00000004:00080000:3.0:1746155560.803320:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae1880, transno 17179873050 00000004:00080000:3.0:1746155560.803322:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae3480, transno 17179873051 00000004:00080000:3.0:1746155560.803324:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae0380, transno 17179873052 00000004:00080000:3.0:1746155560.803327:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae1180, transno 17179873053 00000004:00080000:3.0:1746155560.803328:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae2680, transno 17179873057 00000100:00080000:1.0:1746155560.803329:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1746155560.803330:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae1f80, transno 17179873058 00000004:00080000:3.0:1746155560.803332:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae1c00, transno 17179873059 00000100:00080000:1.0:1746155560.803332:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1746155560.803334:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae0a80, transno 17179873060 00000004:00080000:3.0:1746155560.803336:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f882680, transno 17179873061 00000004:00080000:3.0:1746155560.803338:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae3b80, transno 17179873062 00000004:00080000:3.0:1746155560.803340:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae0700, transno 17179873063 00000004:00080000:3.0:1746155560.803342:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae2d80, transno 17179873064 00000004:00080000:3.0:1746155560.803344:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366dc00, transno 17179873065 00000004:00080000:3.0:1746155560.803347:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366e300, transno 17179873066 00000004:00080000:3.0:1746155560.803349:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28df80, transno 17179873067 00000004:00080000:3.0:1746155560.803354:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366f800, transno 17179873068 00000004:00080000:3.0:1746155560.803357:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136630380, transno 17179873069 00000004:00080000:3.0:1746155560.803358:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366fb80, transno 17179873070 00000004:00080000:3.0:1746155560.803361:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136630000, transno 17179873071 00000004:00080000:3.0:1746155560.803363:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366df80, transno 17179873072 00000004:00080000:3.0:1746155560.803365:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb6bb80, transno 17179873082 00000004:00080000:3.0:1746155560.803367:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131495f80, transno 17179873083 00000004:00080000:3.0:1746155560.803369:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b882d80, transno 17179873084 00000004:00080000:3.0:1746155560.803371:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb68000, transno 17179873085 00000004:00080000:3.0:1746155560.803373:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b880e00, transno 17179873086 00000004:00080000:3.0:1746155560.803375:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131495180, transno 17179873087 00000004:00080000:3.0:1746155560.803377:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb69180, transno 17179873088 00000004:00080000:3.0:1746155560.803379:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131495500, transno 17179873089 00000004:00080000:3.0:1746155560.803381:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451e300, transno 17179873090 00000004:00080000:3.0:1746155560.803382:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451ed80, transno 17179873091 00000004:00080000:3.0:1746155560.803384:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451ea00, transno 17179873092 00000004:00080000:3.0:1746155560.803386:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451c000, transno 17179873093 00000004:00080000:3.0:1746155560.803387:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451f480, transno 17179873094 00000004:00080000:3.0:1746155560.803389:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451dc00, transno 17179873095 00000004:00080000:3.0:1746155560.803391:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451d880, transno 17179873096 00000004:00080000:3.0:1746155560.803393:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451ce00, transno 17179873097 00000100:00100000:3.0:1746155560.803398:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124507136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746155560.803927:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124506880:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155560.803948:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903baa00/0x844e5faceb5ea67f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1035a expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.803959:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903baa00/0x844e5faceb5ea67f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1035a expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.803982:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903baa00, rc 0) 00000100:00100000:1.0:1746155560.804011:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123559296:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4537us (4658us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155560.804017:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11607 00000004:00080000:0.0:1746155560.805010:0:14274:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 63 done 00000100:00100000:0.0:1746155560.812396:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.812450:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123559680 00000100:00100000:1.0:1746155560.812457:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123559680 00000100:00100000:0.0:1746155560.812752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.812904:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123559552 00000100:00100000:3.0:1746155560.812908:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123559552 00000100:00100000:3.0:1746155560.812940:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9914 00000100:00100000:3.0:1746155560.812948:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:28901:x1830976123559552:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155560.812964:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155560.812979:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131365a00/0x844e5faceb5ea686 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10361 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.813056:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131364000/0x844e5faceb5ea68d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155560.814272:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131364000/0x844e5faceb5ea68d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155560.814283:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131364000/0x844e5faceb5ea68d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:3.0:1746155560.814297:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155560.814403:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131365a00/0x844e5faceb5ea686 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10361 expref: 23 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.814424:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131364000/0x844e5faceb5ea68d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10361 expref: 22 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.814431:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155560.814434:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155560.814437:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131364000, rc 0) 00000100:00100000:3.0:1746155560.814490:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+22:28901:x1830976123559552:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1542us (1737us total) trans 8589943834 rc 0/0 00000100:00100000:3.0:1746155560.814497:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9914 00000100:00100000:1.0:1746155560.814670:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11608 00000100:00100000:1.0:1746155560.814678:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123559680:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155560.814689:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155560.814699:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903bbc00/0x844e5faceb5ea69b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10368 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.814737:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124507264:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155560.814793:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.816574:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.818057:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.818901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.818918:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.819619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.820369:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.820402:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123560448 00000100:00100000:3.0:1746155560.820407:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123560448 00000100:00100000:1.0:1746155560.820419:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123559808 00000100:00100000:1.0:1746155560.820422:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123559808 00000100:00100000:1.0:1746155560.820442:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123560064 00000100:00100000:1.0:1746155560.820444:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123560064 00000100:00100000:1.0:1746155560.820458:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11610 00000100:00100000:1.0:1746155560.820464:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123560192:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155560.820486:0:9235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea6a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.820498:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102dc expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.820517:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155560.820518:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155560.820520:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea6a9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.820536:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->1646591) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102dc expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.820544:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->1646591) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102dc expref: 16 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746155560.820553:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124507776:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155560.820582:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.820595:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11611 00000100:00100000:1.0:1746155560.820600:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123559808:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155560.820612:0:29728:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.820620:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d400/0x844e5faceb5ea53d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10234 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.820627:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800903bb000/0x844e5faceb5ea632 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10322 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.820632:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0b1e00/0x844e5faceb5ea54b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10250 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.820652:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.820653:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155560.820655:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155560.820668:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0b1e00/0x844e5faceb5ea54b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10250 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.820674:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0b1e00/0x844e5faceb5ea54b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10250 expref: 16 pid: 8437 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.820681:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124507904:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155560.820953:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123560320 00000100:00100000:0.0:1746155560.820957:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123560320 00000100:00100000:0.0:1746155560.820972:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11612 00000100:00100000:0.0:1746155560.820976:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123560064:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155560.820992:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.821001:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5ea536 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1023b expref: 13 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.821007:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903bb200/0x844e5faceb5ea640 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10330 expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.821013:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ea559 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1025e expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.821018:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.821019:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155560.821021:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.821035:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ea559 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1025e expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.821043:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ea559 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1025e expref: 21 pid: 8436 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.821050:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124508032:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155560.821074:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800903bb200/0x844e5faceb5ea640 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10330 expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.821085:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800903bb200/0x844e5faceb5ea640 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10330 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.821092:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124508160:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155560.821115:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5ea536 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1023b expref: 13 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155560.821122:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5ea536 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1023b expref: 13 pid: 4461 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746155560.821129:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094084380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124508288:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155560.821144:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155560.821687:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11614 00000100:00100000:3.0:1746155560.821692:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123560448:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155560.821708:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.821717:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136951800/0x844e5faceb5ea5bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102c0 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.821723:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903bb800/0x844e5faceb5ea655 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10345 expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.821729:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094129200/0x844e5faceb5ea5f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102f8 expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.821733:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.821734:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.821736:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.821749:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094129200/0x844e5faceb5ea5f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102f8 expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.821760:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094129200/0x844e5faceb5ea5f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102f8 expref: 21 pid: 8437 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.821768:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124508800:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155560.821792:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800903bb800/0x844e5faceb5ea655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10345 expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.821799:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800903bb800/0x844e5faceb5ea655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10345 expref: 10 pid: 29728 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.821806:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124508928:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155560.821826:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136951800/0x844e5faceb5ea5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102c0 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.821833:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136951800/0x844e5faceb5ea5bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102c0 expref: 13 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746155560.821839:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124509056:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155560.821853:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da600 going to sleep for 11 seconds 00010000:00010000:1.0:1746155560.822102:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800903bb000/0x844e5faceb5ea632 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10322 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.822110:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800903bb000/0x844e5faceb5ea632 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10322 expref: 10 pid: 18270 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.822118:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137123800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124509184:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155560.822144:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d400/0x844e5faceb5ea53d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10234 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.822150:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d400/0x844e5faceb5ea53d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10234 expref: 12 pid: 20200 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746155560.822156:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124509312:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155560.822169:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fcb600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155560.822209:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124507264:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155560.822229:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903bbc00/0x844e5faceb5ea69b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10368 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.822239:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903bbc00/0x844e5faceb5ea69b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10368 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155560.822251:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bbc00, rc 0) 00000100:00100000:1.0:1746155560.822267:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123559680:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7591us (9879us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155560.822276:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11608 00000100:00100000:0.0:1746155560.841846:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124508032:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155560.841880:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124508160:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155560.841902:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094084380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124508288:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155560.841924:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.842164:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124507904:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155560.842227:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124508416:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155560.842236:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124508544:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155560.842243:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124508672:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155560.842259:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c286800/0x844e5faceb5ea6be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.842490:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.842653:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124508800:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155560.842661:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124508928:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155560.842668:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124509056:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155560.842681:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.842711:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124507776:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155560.842719:0:9235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea6a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155560.843271:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137123800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124509184:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155560.843278:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124509312:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155560.843290:0:29728:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.843844:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.843996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.844691:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.844712:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.844725:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.844738:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.844752:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.844764:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123561216 00000100:00100000:3.0:1746155560.844767:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123561216 00010000:00010000:3.0:1746155560.844779:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bb200/0x844e5faceb5ea640 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10330 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.844791:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123560832 00000100:00100000:3.0:1746155560.844793:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123560832 00010000:00010000:3.0:1746155560.844801:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0b1e00/0x844e5faceb5ea54b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10250 expref: 17 pid: 8437 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.844808:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123561088 00000100:00100000:3.0:1746155560.844810:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123561088 00010000:00010000:3.0:1746155560.844816:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ea559 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1025e expref: 22 pid: 8436 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.844823:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123561472 00000100:00100000:3.0:1746155560.844824:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123561472 00010000:00010000:3.0:1746155560.844830:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5ea536 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1023b expref: 13 pid: 4461 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.844837:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123560704 00000100:00100000:3.0:1746155560.844839:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123560704 00010000:00010000:3.0:1746155560.844845:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5ea5de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102e3 expref: 23 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746155560.844853:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5803 00000100:00100000:3.0:1746155560.844858:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123561216:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.844864:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.844873:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800903bb200/0x844e5faceb5ea640 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10330 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.844879:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800903bb200/0x844e5faceb5ea640 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10330 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.844889:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903bb200/0x844e5faceb5ea640 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10330 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.844901:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.844918:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123561216:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 60us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.844922:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5803 00000100:00100000:3.0:1746155560.844935:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5804 00000100:00100000:3.0:1746155560.844939:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123560832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.844945:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.844955:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0b1e00/0x844e5faceb5ea54b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10250 expref: 17 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.844962:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0b1e00/0x844e5faceb5ea54b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10250 expref: 17 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.844973:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0b1e00/0x844e5faceb5ea54b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10250 expref: 17 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.844980:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.844993:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123560832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.844998:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5804 00000100:00100000:3.0:1746155560.845008:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5805 00000100:00100000:3.0:1746155560.845012:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976123561088:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.845018:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.845025:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ea559 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1025e expref: 23 pid: 8436 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845032:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ea559 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1025e expref: 23 pid: 8436 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845041:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ea559 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1025e expref: 23 pid: 8436 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845048:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.845062:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123561088:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.845066:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5805 00000100:00100000:3.0:1746155560.845076:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5806 00000100:00100000:3.0:1746155560.845080:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123561472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.845086:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.845092:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5ea536 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1023b expref: 13 pid: 4461 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845100:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5ea536 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1023b expref: 13 pid: 4461 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845111:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5ea536 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1023b expref: 13 pid: 4461 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845118:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.845120:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.845123:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.845130:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.845146:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.845160:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123561472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.845165:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5806 00000100:00100000:3.0:1746155560.845190:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5807 00000100:00100000:3.0:1746155560.845195:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123560704:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.845201:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.845208:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5ea5de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102e3 expref: 21 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.845215:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5ea5de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102e3 expref: 21 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.845226:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5ea5de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102e3 expref: 21 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.845233:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.845234:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.845237:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.845242:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.845267:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.845282:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123560704:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 86us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.845286:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5807 00000100:00100000:3.0:1746155560.845312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.845322:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123561600 00000100:00100000:3.0:1746155560.845324:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123561600 00010000:00010000:3.0:1746155560.845334:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094129e00/0x844e5faceb5ea5ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102f1 expref: 16 pid: 18270 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.845344:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5808 00000100:00100000:3.0:1746155560.845348:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123561600:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.845354:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.845362:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094129e00/0x844e5faceb5ea5ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102f1 expref: 16 pid: 18270 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845369:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094129e00/0x844e5faceb5ea5ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102f1 expref: 16 pid: 18270 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845379:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094129e00/0x844e5faceb5ea5ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102f1 expref: 16 pid: 18270 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845388:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.845402:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123561600:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 53us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.845409:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5808 00000100:00100000:3.0:1746155560.845443:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.845452:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123561984 00000100:00100000:3.0:1746155560.845455:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123561984 00010000:00010000:3.0:1746155560.845464:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bb000/0x844e5faceb5ea632 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10322 expref: 11 pid: 18270 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.845474:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5809 00000100:00100000:3.0:1746155560.845478:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123561984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.845483:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.845489:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800903bb000/0x844e5faceb5ea632 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10322 expref: 11 pid: 18270 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845496:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800903bb000/0x844e5faceb5ea632 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10322 expref: 11 pid: 18270 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845523:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903bb000/0x844e5faceb5ea632 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10322 expref: 11 pid: 18270 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845530:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.845544:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123561984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 65us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.845548:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5809 00000100:00100000:3.0:1746155560.845580:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.845593:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123562240 00000100:00100000:3.0:1746155560.845596:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123562240 00002000:00100000:3.0:1746155560.845615:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1515520->1646591) req@ffff88009fe93b80 x1830976123562240/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.845623:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe93b80 with x1830976123562240 ext(1515520->1646591) 00010000:00010000:3.0:1746155560.845628:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102dc expref: 15 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.845648:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102dc expref: 15 pid: 8437 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746155560.845654:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe93b80 00000100:00100000:3.0:1746155560.845666:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 654 00000100:00100000:3.0:1746155560.845671:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123562240:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155560.845921:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.845931:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123561344 00000100:00100000:3.0:1746155560.845933:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123561344 00010000:00010000:3.0:1746155560.845942:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bb400/0x844e5faceb5ea647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1033e expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.845952:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5810 00000100:00100000:3.0:1746155560.845956:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123561344:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.845962:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.845968:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800903bb400/0x844e5faceb5ea647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1033e expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845974:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800903bb400/0x844e5faceb5ea647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1033e expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845988:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903bb400/0x844e5faceb5ea647 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1033e expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.845995:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.846006:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123561344:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.846011:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5810 00000100:00100000:3.0:1746155560.846039:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.846048:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123561856 00000100:00100000:3.0:1746155560.846050:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123561856 00010000:00010000:3.0:1746155560.846059:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c51b800/0x844e5faceb5ea5e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ea expref: 11 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746155560.846069:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5811 00000100:00100000:3.0:1746155560.846074:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123561856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.846079:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.846085:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c51b800/0x844e5faceb5ea5e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ea expref: 11 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.846092:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c51b800/0x844e5faceb5ea5e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ea expref: 11 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.846102:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c51b800/0x844e5faceb5ea5e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102ea expref: 11 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.846113:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.846114:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.846117:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c286800/0x844e5faceb5ea6be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846123:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c286800/0x844e5faceb5ea6be lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846135:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.846147:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123561856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 73us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.846151:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5811 00010000:00010000:3.0:1746155560.846165:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c286800/0x844e5faceb5ea6be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846172:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c286800/0x844e5faceb5ea6be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846186:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c286800/0x844e5faceb5ea6be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846192:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c286800/0x844e5faceb5ea6be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846199:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c286800/0x844e5faceb5ea6be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846208:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c286800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155560.846211:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c286800/0x844e5faceb5ea6be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846218:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c286800/0x844e5faceb5ea6be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846226:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c286800/0x844e5faceb5ea6be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846232:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c286800/0x844e5faceb5ea6be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.846264:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123560320:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 24856us (25902us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.846270:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11613 00000100:00100000:3.0:1746155560.846281:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123561728 00000100:00100000:3.0:1746155560.846284:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123561728 00000100:00100000:3.0:1746155560.846297:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11615 00000100:00100000:3.0:1746155560.846301:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:28904:x1830976123561728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155560.846308:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155560.846316:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5ea6cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1036f expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846329:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846338:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155560.846339:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155560.846342:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5ea6cc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1036f expref: 13 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846350:0:4461:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846359:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5ea6cc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1036f expref: 13 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846366:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f292000, rc 0) 00000100:00100000:3.0:1746155560.846379:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+13:28904:x1830976123561728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 78us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.846383:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11615 00000100:00100000:3.0:1746155560.846412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.846421:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123562112 00000100:00100000:3.0:1746155560.846423:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123562112 00010000:00010000:3.0:1746155560.846432:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136951800/0x844e5faceb5ea5bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102c0 expref: 13 pid: 8437 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746155560.846442:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5812 00000100:00100000:3.0:1746155560.846446:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123562112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.846452:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.846460:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136951800/0x844e5faceb5ea5bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102c0 expref: 13 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.846467:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136951800/0x844e5faceb5ea5bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102c0 expref: 13 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.846477:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136951800/0x844e5faceb5ea5bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102c0 expref: 13 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746155560.846484:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.846497:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123562112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.846519:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5812 00000100:00100000:3.0:1746155560.846549:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.846559:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123562368 00000100:00100000:3.0:1746155560.846561:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123562368 00010000:00010000:3.0:1746155560.846570:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bb800/0x844e5faceb5ea655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10345 expref: 9 pid: 29728 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.846579:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5813 00000100:00100000:3.0:1746155560.846583:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123562368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.846588:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.846594:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800903bb800/0x844e5faceb5ea655 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10345 expref: 9 pid: 29728 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.846601:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800903bb800/0x844e5faceb5ea655 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10345 expref: 9 pid: 29728 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.846615:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903bb800/0x844e5faceb5ea655 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10345 expref: 9 pid: 29728 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.846622:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.846635:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123562368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.846653:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5813 00000100:00100000:3.0:1746155560.846696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.846705:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123562624 00000100:00100000:3.0:1746155560.846707:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123562624 00010000:00010000:3.0:1746155560.846716:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094129200/0x844e5faceb5ea5f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102f8 expref: 20 pid: 8437 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.846726:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5814 00000100:00100000:3.0:1746155560.846729:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976123562624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.846734:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.846740:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094129200/0x844e5faceb5ea5f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102f8 expref: 20 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.846747:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094129200/0x844e5faceb5ea5f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102f8 expref: 20 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.846756:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094129200/0x844e5faceb5ea5f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102f8 expref: 20 pid: 8437 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.846768:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.846769:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.846771:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846777:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846789:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.846802:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123562624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.846807:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5814 00010000:00010000:3.0:1746155560.846821:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846827:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846839:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846844:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846849:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846857:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f292400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155560.846860:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846865:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846873:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.846878:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f292400/0x844e5faceb5ea6c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.846903:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123560448:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 25211us (28002us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.846908:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11614 00000100:00100000:3.0:1746155560.846957:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.846968:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123562496 00000100:00100000:3.0:1746155560.846971:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123562496 00010000:00010000:3.0:1746155560.846980:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d400/0x844e5faceb5ea53d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10234 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746155560.846990:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5815 00000100:00100000:3.0:1746155560.846994:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123562496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.846999:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.847006:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d400/0x844e5faceb5ea53d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10234 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.847013:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d400/0x844e5faceb5ea53d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10234 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.847023:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d400/0x844e5faceb5ea53d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10234 expref: 10 pid: 20200 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746155560.847029:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.847031:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.847033:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847040:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847053:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.847064:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123562496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 68us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.847069:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5815 00010000:00010000:3.0:1746155560.847082:0:29728:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847088:0:29728:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847099:0:29728:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847105:0:29728:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847111:0:29728:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847115:0:29728:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800903bb600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155560.847118:0:29728:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847123:0:29728:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847131:0:29728:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847136:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea6b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.847156:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123559808:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 26557us (28238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.847161:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11611 00010000:00010000:3.0:1746155560.847283:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847290:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847302:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847308:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847313:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847318:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cf0ec00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155560.847320:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847326:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847333:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.847335:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.847339:0:8437:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5ea6cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1036f expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847345:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5ea6cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1036f expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847364:0:8437:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5ea6cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1036f expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.847378:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124509440:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155560.847425:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da480 going to sleep for 11 seconds 00010000:00010000:3.0:1746155560.847472:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847478:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847489:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847494:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847499:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847523:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009374dc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155560.847526:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847531:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847539:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.847548:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5ea6b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.847575:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1962:x1830976123560064:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 26598us (27956us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.847580:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11612 00000100:00100000:3.0:1746155560.851752:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124509440:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155560.851772:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.851780:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0ec00/0x844e5faceb5ea6a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.851830:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1962:x1830976123559936:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 32919us (35260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.851838:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11609 00000100:00100000:0.0:1746155560.855970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.856092:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123563392 00000100:00100000:3.0:1746155560.856100:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123563392 00002000:00100000:3.0:1746155560.856134:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094086680 x1830976123563392/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.856143:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094086680 with x1830976123563392 ext(1048576->2097151) 00002000:00010000:3.0:1746155560.856148:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094086680 00000100:00100000:1.0:1746155560.857101:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.857131:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.857155:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123563136 00000100:00100000:1.0:1746155560.857158:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123563136 00000100:00100000:0.0:1746155560.858002:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123563008 00000100:00100000:0.0:1746155560.858007:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123563008 00000100:00100000:0.0:1746155560.858032:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9915 00000100:00100000:0.0:1746155560.858039:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+32:28908:x1830976123563136:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155560.858057:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155560.858073:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81ba00/0x844e5faceb5ea6d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1037d expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.858153:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.858165:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128200/0x844e5faceb5ea678 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10353 expref: 21 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.858171:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131364000/0x844e5faceb5ea68d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10361 expref: 21 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.858177:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.858208:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131364000/0x844e5faceb5ea68d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10361 expref: 21 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.858217:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131364000/0x844e5faceb5ea68d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10361 expref: 21 pid: 14234 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746155560.859129:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123562240:12345-192.168.202.51@tcp:4:cat.0 Request processed in 13456us (13546us total) trans 21474840494 rc 0/0 00000100:00100000:1.0:1746155560.859138:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 654 00002000:00100000:1.0:1746155560.859146:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1515520->1646591) req@ffff88009fe93b80 x1830976123562240/t21474840494(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/448 e 0 to 0 dl 1746155571 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.859154:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe93b80 with x1830976123562240 ext(1515520->1646591) 00010000:00010000:1.0:1746155560.859161:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102dc expref: 17 pid: 8437 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746155560.859171:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093333000/0x844e5faceb5ea5d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f102dc expref: 17 pid: 8437 timeout: 790 lvb_type: 0 00002000:00010000:1.0:1746155560.859176:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe93b80 00000100:00100000:1.0:1746155560.859193:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4361 00000100:00100000:1.0:1746155560.859199:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123563392:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155560.861617:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124509568:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155560.863216:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094128200/0x844e5faceb5ea678 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10353 expref: 21 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.863229:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094128200/0x844e5faceb5ea678 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10353 expref: 21 pid: 27374 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746155560.863245:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094087480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124509696:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155560.863264:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.868066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155560.869353:0:9235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea6a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.869362:0:9235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea6a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.869743:0:9235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea6a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.869751:0:9235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea6a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.869758:0:9235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea6a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.869763:0:9235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800903bae00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155560.869766:0:9235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea6a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.869772:0:9235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea6a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.869781:0:9235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea6a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.869787:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903bae00/0x844e5faceb5ea6a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155560.870387:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1962:x1830976123560192:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 49921us (52332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155560.870394:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11610 00000100:00100000:0.0:1746155560.870556:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124509568:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155560.870936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.870969:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.870987:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123563776 00000100:00100000:1.0:1746155560.870992:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123563776 00010000:00010000:1.0:1746155560.871010:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094128200/0x844e5faceb5ea678 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10353 expref: 22 pid: 27374 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746155560.871025:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123563648 00000100:00100000:1.0:1746155560.871027:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123563648 00010000:00010000:1.0:1746155560.871034:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131364000/0x844e5faceb5ea68d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10361 expref: 23 pid: 14234 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746155560.871057:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5817 00000100:00100000:1.0:1746155560.871062:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+23:1960:x1830976123563776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.871070:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.871075:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094128200/0x844e5faceb5ea678 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10353 expref: 23 pid: 27374 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155560.871082:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094128200/0x844e5faceb5ea678 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10353 expref: 23 pid: 27374 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155560.871097:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155560.871101:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.871107:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.871111:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.871129:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+23:1960:x1830976123563776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.871134:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5817 00000100:00100000:1.0:1746155560.871144:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5818 00000100:00100000:1.0:1746155560.871149:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+22:1960:x1830976123563648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155560.871154:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155560.871157:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131364000/0x844e5faceb5ea68d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10361 expref: 22 pid: 14234 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155560.871165:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131364000/0x844e5faceb5ea68d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10361 expref: 22 pid: 14234 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155560.871173:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131364000/0x844e5faceb5ea68d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10361 expref: 22 pid: 14234 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155560.871185:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155560.871188:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.871194:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.871199:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.871204:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ea6e8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155560.871211:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ea6e8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155560.871215:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ea6e8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155560.871267:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128200/0x844e5faceb5ea678 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10353 expref: 21 pid: 27374 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746155560.871276:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094087480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124509696:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155560.871290:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155560.872322:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155560.872343:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:1960:x1830976123563648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1193us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155560.872349:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5818 00010000:00010000:0.0:1746155560.872610:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155560.872617:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155560.872627:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155560.872707:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81ba00/0x844e5faceb5ea6d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1037d expref: 35 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.872718:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1037d expref: 34 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155560.872728:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155560.872730:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155560.872731:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b81a000, rc 0) 00000100:00100000:0.0:1746155560.873185:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+34:28908:x1830976123563136:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 15144us (16083us total) trans 8589943836 rc 0/0 00000100:00100000:0.0:1746155560.873190:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9915 00000100:00100000:0.0:1746155560.879473:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.882743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.883842:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.886392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.886886:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123564416 00000100:00100000:3.0:1746155560.886895:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123564416 00000100:00100000:3.0:1746155560.886934:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3976 00000100:00100000:3.0:1746155560.886941:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:28901:x1830976123564416:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155560.887158:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+21:28901:x1830976123564416:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 216us (3317us total) trans 8589943837 rc 0/0 00000100:00100000:3.0:1746155560.887165:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3976 00000100:00100000:1.0:1746155560.890858:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.891967:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123564928 00000100:00100000:0.0:1746155560.891976:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123564928 00000100:00100000:0.0:1746155560.892404:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3977 00000100:00100000:0.0:1746155560.892414:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+21:28901:x1830976123564928:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:0.0:1746155560.892678:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+22:28901:x1830976123564928:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 263us (1823us total) trans 8589943838 rc 0/0 00000100:00100000:0.0:1746155560.892685:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3977 00000100:00100000:0.0:1746155560.915417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.915603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.915660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.916355:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123565056 00000100:00100000:3.0:1746155560.916365:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123565056 00000100:00100000:3.0:1746155560.916412:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123565184 00000100:00100000:3.0:1746155560.916417:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123565184 00000100:00100000:3.0:1746155560.916435:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123565312 00000100:00100000:3.0:1746155560.916439:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123565312 00000100:00100000:3.0:1746155560.916459:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11617 00000100:00100000:3.0:1746155560.916468:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+9:28904:x1830976123565056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155560.916486:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155560.916527:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f293200/0x844e5faceb5ea704 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1038b expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155560.916553:0:20200:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x68143829, atime: 0x68143829, ctime: 0x68143829, blocks: 0x821 00010000:00010000:3.0:1746155560.916574:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.916576:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.916584:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f293200/0x844e5faceb5ea704 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1038b expref: 10 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.916600:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f293200/0x844e5faceb5ea704 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1038b expref: 10 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.916610:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f293200, rc 0) 00000100:00100000:3.0:1746155560.916673:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+10:28904:x1830976123565056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 204us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.916680:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11617 00000100:00100000:3.0:1746155560.916700:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11618 00000100:00100000:3.0:1746155560.916707:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976123565184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155560.916715:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155560.916725:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5ea70b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10392 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155560.916738:0:20200:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x68143827, atime: 0x68143827, ctime: 0x68143827, blocks: 0x767 00010000:00010000:3.0:1746155560.916749:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.916750:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.916757:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5ea70b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10392 expref: 17 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.916768:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5ea70b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10392 expref: 17 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.916775:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f293000, rc 0) 00000100:00100000:3.0:1746155560.916799:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976123565184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 93us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.916805:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11618 00000100:00100000:3.0:1746155560.916819:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11619 00000100:00100000:3.0:1746155560.916825:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123565312:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155560.916833:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155560.916844:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f293e00/0x844e5faceb5ea712 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10399 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.916860:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.916862:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.916867:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f293e00/0x844e5faceb5ea712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10399 expref: 20 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.916877:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f293e00/0x844e5faceb5ea712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10399 expref: 20 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.916884:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f293e00, rc 0) 00000100:00100000:3.0:1746155560.916905:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123565312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 80us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.916910:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11619 00000100:00100000:0.0:1746155560.917037:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.917082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.917099:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.917166:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.933756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.933804:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.933877:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123566336 00000100:00100000:3.0:1746155560.933885:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123566336 00002000:00100000:3.0:1746155560.933919:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880094085880 x1830976123566336/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.933928:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085880 with x1830976123566336 ext(1048576->2097151) 00002000:00010000:3.0:1746155560.933932:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094085880 00000100:00100000:3.0:1746155560.933943:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123566208 00000100:00100000:3.0:1746155560.933945:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123566208 00002000:00100000:3.0:1746155560.933952:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880094084380 x1830976123566208/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.933958:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094084380 with x1830976123566208 ext(0->1048575) 00002000:00010000:3.0:1746155560.933960:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094084380 00000100:00100000:3.0:1746155560.933969:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4363 00000100:00100000:3.0:1746155560.933974:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123566336:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.936528:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4364 00000100:00100000:1.0:1746155560.936539:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123566208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155560.943272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.943306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.943331:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.943477:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123566848 00000100:00100000:1.0:1746155560.943481:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123566848 00002000:00100000:1.0:1746155560.943497:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88012f1f1500 x1830976123566848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.943528:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1500 with x1830976123566848 ext(1048576->2097151) 00002000:00010000:1.0:1746155560.943531:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f1500 00000100:00100000:1.0:1746155560.943547:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4365 00000100:00100000:1.0:1746155560.943554:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123566592:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155560.943694:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4367 00000100:00100000:0.0:1746155560.943701:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123567104:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.949042:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976123566208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12465us (15197us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155560.949053:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4364 00002000:00100000:1.0:1746155560.949064:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880094084380 x1830976123566208/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.949072:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094084380 with x1830976123566208 ext(0->1048575) 00002000:00010000:1.0:1746155560.949077:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094084380 00000100:00100000:3.0:1746155560.957813:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123566848:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14214us (14502us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155560.957821:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4366 00002000:00100000:3.0:1746155560.957827:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88012f1f1500 x1830976123566848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155560.957834:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1500 with x1830976123566848 ext(1048576->2097151) 00002000:00010000:3.0:1746155560.957837:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f1500 00000100:00100000:0.0:1746155560.961013:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.961049:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.961150:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123567232 00000100:00100000:3.0:1746155560.961158:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123567232 00000100:00100000:0.0:1746155560.961158:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.961179:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123567488 00000100:00100000:3.0:1746155560.961181:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123567488 00000100:00100000:3.0:1746155560.961204:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123567360 00000100:00100000:3.0:1746155560.961206:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123567360 00000100:00100000:3.0:1746155560.961240:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11624 00000100:00100000:3.0:1746155560.961247:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123567488:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155560.961261:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155560.961275:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5ea735 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f103ca expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.961292:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.961294:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.961300:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5ea735 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ca expref: 14 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.961313:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5ea735 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ca expref: 14 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.961325:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bb000, rc 0) 00000100:00100000:3.0:1746155560.961354:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123567488:12345-192.168.202.51@tcp:101:cat.0 Request processed in 107us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.961359:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11624 00000100:00100000:3.0:1746155560.961385:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11626 00000100:00100000:3.0:1746155560.961390:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123567232:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155560.961395:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155560.961401:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea743 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f103bc expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.961410:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.961411:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.961415:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea743 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103bc expref: 13 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.961423:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea743 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103bc expref: 13 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.961429:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bb600, rc 0) 00000100:00100000:3.0:1746155560.961564:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123567232:12345-192.168.202.51@tcp:101:cat.0 Request processed in 173us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.961569:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11626 00000100:00100000:1.0:1746155560.961905:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123566592:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18350us (18639us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155560.961912:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4365 00002000:00100000:1.0:1746155560.961919:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88012f1f0e00 x1830976123566592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.961926:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0e00 with x1830976123566592 ext(1048576->2097151) 00002000:00010000:1.0:1746155560.961930:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f0e00 00000100:00100000:0.0:1746155560.972362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.972402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.972429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.972452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.972542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155560.972574:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123567744 00000100:00100000:0.0:1746155560.972582:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123567744 00002000:00100000:0.0:1746155560.972616:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880094c32300 x1830976123567744/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.972623:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c32300 with x1830976123567744 ext(2097152->3145727) 00002000:00010000:0.0:1746155560.972628:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c32300 00000100:00100000:0.0:1746155560.972652:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123568256 00000100:00100000:0.0:1746155560.972655:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123568256 00002000:00100000:0.0:1746155560.972666:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880094c30700 x1830976123568256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.972673:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c30700 with x1830976123568256 ext(2097152->3145727) 00002000:00010000:0.0:1746155560.972676:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c30700 00000100:00100000:0.0:1746155560.972683:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123568000 00000100:00100000:0.0:1746155560.972685:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123568000 00002000:00100000:0.0:1746155560.972693:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094c33100 x1830976123568000/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.972698:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c33100 with x1830976123568000 ext(3145728->4194303) 00002000:00010000:0.0:1746155560.972701:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c33100 00000100:00100000:0.0:1746155560.972706:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123568512 00000100:00100000:0.0:1746155560.972708:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123568512 00002000:00100000:0.0:1746155560.972716:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009100ad80 x1830976123568512/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.972722:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009100ad80 with x1830976123568512 ext(3145728->4194303) 00002000:00010000:0.0:1746155560.972724:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009100ad80 00000100:00100000:0.0:1746155560.972735:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4368 00000100:00100000:0.0:1746155560.972741:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123567744:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155560.974041:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4369 00000100:00100000:1.0:1746155560.974051:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976123568256:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155560.974184:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4370 00000100:00100000:3.0:1746155560.974191:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123568000:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155560.974561:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123568640 00000100:00100000:3.0:1746155560.974565:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123568640 00000100:00100000:3.0:1746155560.975160:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11627 00000100:00100000:3.0:1746155560.975166:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:28906:x1830976123568640:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155560.975173:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155560.975186:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea74a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f103d1 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.975211:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ea6fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10384 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.975218:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094129400/0x844e5faceb5ea719 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103a0 expref: 23 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.975223:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.975224:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.975227:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea74a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1540096->2097151] (req 1540096->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103d1 expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.975248:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094129400/0x844e5faceb5ea719 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103a0 expref: 23 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155560.975258:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094129400/0x844e5faceb5ea719 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103a0 expref: 23 pid: 9235 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746155560.975268:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124509824:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155560.975333:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ea6fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10384 expref: 16 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.975341:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ea6fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10384 expref: 16 pid: 9235 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155560.975348:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124509952:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155560.975713:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155560.982642:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.982864:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123569152 00000100:00100000:1.0:1746155560.982871:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123569152 00002000:00100000:1.0:1746155560.982931:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800910dad80 x1830976123569152/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.982952:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910dad80 with x1830976123569152 ext(3145728->4194303) 00002000:00010000:1.0:1746155560.982957:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910dad80 00000100:00100000:1.0:1746155560.983006:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4372 00000100:00100000:1.0:1746155560.983013:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123569152:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155560.983136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.983159:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123569024 00000100:00100000:3.0:1746155560.983160:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155560.983162:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123569024 00002000:00100000:1.0:1746155560.983175:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880094f09f80 x1830976123569024/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155560.983182:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09f80 with x1830976123569024 ext(2097152->3145727) 00002000:00010000:1.0:1746155560.983184:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f09f80 00000100:00100000:3.0:1746155560.983185:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.983230:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124509952:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155560.983258:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124509824:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155560.983280:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea74a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1540096->2097151] (req 1540096->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103d1 expref: 25 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.983295:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bac00, rc 0) 00000100:00100000:3.0:1746155560.983321:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:28906:x1830976123568640:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8154us (10778us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.983327:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11627 00000100:00100000:3.0:1746155560.983362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.983418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155560.983432:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123569792 00000100:00100000:3.0:1746155560.983435:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123569792 00010000:00010000:3.0:1746155560.983448:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ea6fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10384 expref: 18 pid: 9235 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155560.983466:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123569920 00000100:00100000:3.0:1746155560.983468:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123569920 00010000:00010000:3.0:1746155560.983474:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094129400/0x844e5faceb5ea719 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103a0 expref: 25 pid: 9235 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746155560.983485:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5819 00000100:00100000:3.0:1746155560.983490:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123569792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.983498:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.983531:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ea6fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10384 expref: 18 pid: 9235 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155560.983540:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ea6fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10384 expref: 18 pid: 9235 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155560.983557:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ea6fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10384 expref: 18 pid: 9235 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155560.983572:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155560.983587:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123569792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155560.983593:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5819 00000100:00100000:3.0:1746155560.983603:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5820 00000100:00100000:3.0:1746155560.983608:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123569920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155560.983615:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155560.983622:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094129400/0x844e5faceb5ea719 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103a0 expref: 25 pid: 9235 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155560.983630:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094129400/0x844e5faceb5ea719 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103a0 expref: 25 pid: 9235 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155560.983649:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094129400/0x844e5faceb5ea719 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103a0 expref: 25 pid: 9235 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155560.983967:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.983969:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155560.983975:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea74a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103d1 expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.983994:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea74a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103d1 expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155560.984030:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea74a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103d1 expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155560.984056:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124510080:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155560.985057:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123569408 00000100:00100000:0.0:1746155560.985062:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123569408 00002000:00100000:0.0:1746155560.985082:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880094f08a80 x1830976123569408/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.985089:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08a80 with x1830976123569408 ext(2097152->3145727) 00002000:00010000:0.0:1746155560.985093:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f08a80 00000100:00100000:0.0:1746155560.985122:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123569536 00000100:00100000:0.0:1746155560.985124:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123569536 00002000:00100000:0.0:1746155560.985133:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88008e26d180 x1830976123569536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/0 e 0 to 0 dl 1746155571 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155560.985139:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26d180 with x1830976123569536 ext(3145728->4194303) 00002000:00010000:0.0:1746155560.985141:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26d180 00000100:00100000:0.0:1746155560.985149:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4373 00000100:00100000:0.0:1746155560.985154:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123569408:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155560.985680:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da480 going to sleep for 11 seconds 00000100:00100000:3.0:1746155560.985715:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4374 00000100:00100000:3.0:1746155560.985730:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123569536:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155560.987792:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4375 00000100:00100000:1.0:1746155560.987803:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123569024:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155560.993341:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124510080:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155560.993358:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.001058:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123569920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 17447us (17637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.001066:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5820 00000100:00100000:1.0:1746155561.001142:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123567744:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28400us (28786us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155561.001149:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4368 00002000:00100000:1.0:1746155561.001155:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880094c32300 x1830976123567744/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.001162:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c32300 with x1830976123567744 ext(2097152->3145727) 00002000:00010000:1.0:1746155561.001165:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c32300 00000100:00100000:1.0:1746155561.003343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.004560:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976123568256:12345-192.168.202.51@tcp:3:cat.0 Request processed in 30508us (32154us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155561.004569:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4369 00002000:00100000:3.0:1746155561.004579:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880094c30700 x1830976123568256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.004586:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c30700 with x1830976123568256 ext(2097152->3145727) 00002000:00010000:3.0:1746155561.004591:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c30700 00000100:00100000:3.0:1746155561.004609:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123570176 00000100:00100000:3.0:1746155561.004614:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123570176 00002000:00100000:3.0:1746155561.004647:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3db:0x0] (1540096->1544191) req@ffff880137121880 x1830976123570176/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.004654:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121880 with x1830976123570176 ext(1540096->1544191) 00002000:00010000:3.0:1746155561.004657:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137121880 00000100:00100000:3.0:1746155561.004670:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4376 00000100:00100000:3.0:1746155561.004676:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123570176:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155561.004717:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123568000:12345-192.168.202.51@tcp:3:cat.0 Request processed in 30525us (32285us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155561.004724:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4370 00002000:00100000:1.0:1746155561.004729:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094c33100 x1830976123568000/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.004737:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c33100 with x1830976123568000 ext(3145728->4194303) 00002000:00010000:1.0:1746155561.004741:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c33100 00000100:00100000:3.0:1746155561.004783:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123570176:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 107us (1444us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155561.004788:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4376 00002000:00100000:3.0:1746155561.004792:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3db:0x0] (1540096->1544191) req@ffff880137121880 x1830976123570176/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.004798:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121880 with x1830976123570176 ext(1540096->1544191) 00002000:00010000:3.0:1746155561.004801:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137121880 00000100:00100000:3.0:1746155561.016184:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123569536:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 30453us (32996us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155561.016192:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4374 00002000:00100000:3.0:1746155561.016198:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88008e26d180 x1830976123569536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.016206:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26d180 with x1830976123569536 ext(3145728->4194303) 00002000:00010000:3.0:1746155561.016209:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26d180 00000100:00100000:1.0:1746155561.020467:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123569024:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 32659us (37324us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155561.020478:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4375 00002000:00100000:1.0:1746155561.020487:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880094f09f80 x1830976123569024/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:631/0 lens 488/440 e 0 to 0 dl 1746155571 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.021234:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09f80 with x1830976123569024 ext(2097152->3145727) 00002000:00010000:1.0:1746155561.021242:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f09f80 00000100:00100000:0.0:1746155561.022225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.022301:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123570304 00000100:00100000:3.0:1746155561.022307:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123570304 00000100:00100000:3.0:1746155561.022341:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11628 00000100:00100000:3.0:1746155561.022346:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:28906:x1830976123570304:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155561.022358:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.022369:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903bba00/0x844e5faceb5ea751 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f103d8 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.022388:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f293200/0x844e5faceb5ea704 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1038b expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.022393:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094128e00/0x844e5faceb5ea720 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103a7 expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.022397:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.022398:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.022400:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bba00/0x844e5faceb5ea751 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->1187839] (req 1048576->1187839) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103d8 expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.022421:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094128e00/0x844e5faceb5ea720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103a7 expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.022428:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094128e00/0x844e5faceb5ea720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103a7 expref: 20 pid: 9235 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746155561.022434:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124510208:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155561.022530:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f293200/0x844e5faceb5ea704 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1038b expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.022537:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f293200/0x844e5faceb5ea704 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1038b expref: 11 pid: 20200 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.022545:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124510336:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155561.022571:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c8519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.026396:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.026534:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124510208:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155561.026545:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124510336:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155561.026569:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903bba00/0x844e5faceb5ea751 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->1187839] (req 1048576->1187839) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103d8 expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.026583:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bba00, rc 0) 00000100:00100000:3.0:1746155561.026632:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:28906:x1830976123570304:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4284us (4409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.026653:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11628 00000100:00100000:0.0:1746155561.027111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:1.0:1746155561.027759:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155561.029214:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.029246:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.029273:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123570816 00000100:00100000:0.0:1746155561.029276:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.029278:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123570816 00000100:00080000:1.0:1746155561.029340:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746155561.029348:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123570688 00000100:00100000:1.0:1746155561.029351:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123570688 00000100:00100000:1.0:1746155561.029371:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123570944 00000100:00100000:1.0:1746155561.029373:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123570944 00000100:00100000:1.0:1746155561.029387:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11629 00000100:00100000:1.0:1746155561.029392:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123570816:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155561.029404:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.029417:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a27c000/0x844e5faceb5ea758 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f103e6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155561.029433:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11630 00000100:00100000:0.0:1746155561.029440:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123570688:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155561.029448:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155561.029449:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124510592:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155561.029455:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c29ba00/0x844e5faceb5ea75f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f103df expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155561.029476:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124510720:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155561.029523:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fcb600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.029525:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d180 going to sleep for 11 seconds 00000100:00100000:1.0:1746155561.029551:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11631 00000100:00100000:1.0:1746155561.029556:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123570944:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155561.029877:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.029885:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131443e00/0x844e5faceb5ea766 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f103ed expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155561.029907:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124510848:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155561.030084:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439600 going to sleep for 11 seconds 00002000:00010000:1.0:1746155561.032535:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime: 1746155560 -> 1746155561 00002000:00010000:1.0:1746155561.032540:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime: 1746155560 -> 1746155561 00002000:00010000:1.0:1746155561.032542:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime: 1746155560 -> 1746155561 00000100:00100000:1.0:1746155561.032560:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124510592:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155561.032582:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a27c000/0x844e5faceb5ea758 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103e6 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.032594:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a27c000/0x844e5faceb5ea758 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103e6 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.032608:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a27c000, rc 0) 00000100:00100000:0.0:1746155561.032655:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124510720:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155561.032667:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123570816:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3274us (3455us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155561.032675:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11629 00010000:00010000:0.0:1746155561.032676:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c29ba00/0x844e5faceb5ea75f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103df expref: 20 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155561.032686:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c29ba00/0x844e5faceb5ea75f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103df expref: 20 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155561.032701:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c29ba00, rc 0) 00000100:00100000:0.0:1746155561.032719:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123570688:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3280us (3473us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155561.032724:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11630 00000100:00100000:1.0:1746155561.033700:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124510848:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155561.033714:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131443e00/0x844e5faceb5ea766 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ed expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.033723:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131443e00/0x844e5faceb5ea766 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ed expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.033729:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131443e00, rc 0) 00000100:00100000:1.0:1746155561.033758:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123570944:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4202us (4482us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155561.033763:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11631 00000100:00100000:1.0:1746155561.033804:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.034022:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123571200 00000100:00100000:0.0:1746155561.034028:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123571200 00002000:00100000:0.0:1746155561.034052:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1183744->1187839) req@ffff880137120380 x1830976123571200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.034060:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120380 with x1830976123571200 ext(1183744->1187839) 00002000:00010000:0.0:1746155561.034063:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120380 00000100:00100000:0.0:1746155561.034086:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4377 00000100:00100000:0.0:1746155561.034093:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123571200:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155561.037207:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123571200:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 3106us (3394us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155561.037217:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4377 00002000:00100000:0.0:1746155561.037226:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1183744->1187839) req@ffff880137120380 x1830976123571200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.037234:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120380 with x1830976123571200 ext(1183744->1187839) 00002000:00010000:0.0:1746155561.037239:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120380 00000100:00100000:1.0:1746155561.037413:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.037662:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123571456 00000100:00100000:0.0:1746155561.037668:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123571456 00002000:00100000:0.0:1746155561.037691:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880137122300 x1830976123571456/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.037697:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137122300 with x1830976123571456 ext(4194304->4956159) 00002000:00010000:0.0:1746155561.037700:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137122300 00000100:00100000:0.0:1746155561.037722:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4378 00000100:00100000:0.0:1746155561.037728:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123571456:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.039259:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.040364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.040474:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123571840 00000100:00100000:1.0:1746155561.040479:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123571840 00000100:00100000:1.0:1746155561.040522:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11632 00000100:00100000:1.0:1746155561.040529:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:28908:x1830976123571840:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155561.040543:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.040559:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ea76d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f103f4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.040581:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094129e00/0x844e5faceb5ea72e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103b5 expref: 21 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.040589:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5ea735 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ca expref: 14 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.040595:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155561.040596:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155561.040599:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ea76d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103f4 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.040622:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5ea735 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ca expref: 14 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.040632:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5ea735 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ca expref: 14 pid: 29728 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746155561.040653:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124510976:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155561.040718:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094129e00/0x844e5faceb5ea72e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103b5 expref: 21 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.040726:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094129e00/0x844e5faceb5ea72e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103b5 expref: 21 pid: 9235 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746155561.040732:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124511104:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155561.040748:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.040842:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123571712 00000100:00100000:3.0:1746155561.040846:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123571712 00002000:00100000:3.0:1746155561.040867:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009a6d9180 x1830976123571712/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.040875:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d9180 with x1830976123571712 ext(4194304->4956159) 00002000:00010000:3.0:1746155561.040879:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6d9180 00000100:00100000:3.0:1746155561.040891:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4379 00000100:00100000:3.0:1746155561.040896:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123571712:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.051628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.051705:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.051724:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123572096 00000100:00100000:0.0:1746155561.051730:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123572096 00000100:00100000:0.0:1746155561.051758:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11633 00000100:00100000:0.0:1746155561.051764:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123572096:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155561.051777:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155561.051791:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ea774 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f103fb expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155561.051807:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155561.051815:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ea774 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103fb expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155561.051823:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ea774 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103fb expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155561.051834:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c29ac00, rc 0) 00000100:00100000:0.0:1746155561.051865:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123572096:12345-192.168.202.51@tcp:101:cat.0 Request processed in 101us (159us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155561.051870:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11633 00000100:00100000:1.0:1746155561.052104:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124510976:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155561.052112:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124511104:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155561.052129:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ea76d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103f4 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.052138:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093480400, rc 0) 00000100:00100000:1.0:1746155561.052153:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28908:x1830976123571840:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 11625us (11791us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155561.052158:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11632 00000100:00100000:3.0:1746155561.053263:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123571712:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12364us (14005us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155561.053271:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4379 00002000:00100000:3.0:1746155561.053278:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009a6d9180 x1830976123571712/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.053285:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d9180 with x1830976123571712 ext(4194304->4956159) 00002000:00010000:3.0:1746155561.053289:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6d9180 00000100:00100000:0.0:1746155561.054982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.056006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.056045:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123572352 00000100:00100000:1.0:1746155561.056049:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123572352 00000100:00100000:1.0:1746155561.056072:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11634 00000100:00100000:1.0:1746155561.056077:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123572352:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155561.056087:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.056096:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5ea77b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10402 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155561.056125:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124511360:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155561.056166:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.058597:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.058679:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.058694:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123572736 00000100:00100000:0.0:1746155561.058698:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123572736 00000100:00100000:0.0:1746155561.058716:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11635 00000100:00100000:0.0:1746155561.058721:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123572736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155561.058728:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155561.058739:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c29aa00/0x844e5faceb5ea782 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10409 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155561.058770:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124511488:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155561.058829:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d180 going to sleep for 11 seconds 00002000:00010000:1.0:1746155561.058850:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime: 1746155560 -> 1746155561 00002000:00010000:1.0:1746155561.058853:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime: 1746155560 -> 1746155561 00002000:00010000:1.0:1746155561.058855:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime: 1746155560 -> 1746155561 00000100:00100000:1.0:1746155561.058868:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124511360:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155561.058886:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5ea77b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10402 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.058895:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5ea77b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10402 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.058909:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d400, rc 0) 00000100:00100000:1.0:1746155561.058926:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976123572352:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2849us (2920us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155561.058931:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11634 00000100:00100000:0.0:1746155561.061209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.061264:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123572864 00000100:00100000:1.0:1746155561.061270:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123572864 00000100:00100000:1.0:1746155561.061309:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11636 00000100:00100000:1.0:1746155561.061316:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123572864:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155561.061328:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.061340:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x844e5faceb5ea789 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10410 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155561.061372:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124511616:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155561.061812:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.064423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.064525:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123572992 00000100:00100000:1.0:1746155561.064532:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123572992 00000100:00100000:1.0:1746155561.064576:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11637 00000100:00100000:1.0:1746155561.064583:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+13:28908:x1830976123572992:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155561.064594:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.064606:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10417 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.064626:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094129200/0x844e5faceb5ea727 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ae expref: 18 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.064633:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ea73c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103c3 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.064651:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155561.064653:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155561.064656:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->3723263] (req 3145728->3723263) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 14 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.064677:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ea73c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103c3 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.064831:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ea73c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103c3 expref: 14 pid: 8436 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746155561.064845:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124511744:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155561.065335:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094129200/0x844e5faceb5ea727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ae expref: 18 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.065344:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094129200/0x844e5faceb5ea727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ae expref: 18 pid: 9235 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746155561.065352:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124511872:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155561.065371:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155561.065595:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124511616:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155561.065609:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x844e5faceb5ea789 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10410 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.065617:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1c600/0x844e5faceb5ea789 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10410 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.065624:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c600, rc 0) 00000100:00100000:1.0:1746155561.065652:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123572864:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4336us (4449us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155561.065658:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11636 00000100:00100000:1.0:1746155561.068718:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124511744:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155561.068728:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124511872:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155561.068748:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->3723263] (req 3145728->3723263) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.068761:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d600, rc 0) 00000100:00100000:1.0:1746155561.068792:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:28908:x1830976123572992:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4209us (4374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155561.068798:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11637 00000100:00100000:0.0:1746155561.072458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.075016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.075133:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123573248 00000100:00100000:3.0:1746155561.075139:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123573248 00010000:00010000:3.0:1746155561.075163:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094129200/0x844e5faceb5ea727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ae expref: 19 pid: 9235 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746155561.075194:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5826 00000100:00100000:3.0:1746155561.075200:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123573248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.075211:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.075226:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094129200/0x844e5faceb5ea727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ae expref: 19 pid: 9235 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155561.075236:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094129200/0x844e5faceb5ea727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ae expref: 19 pid: 9235 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155561.075253:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094129200/0x844e5faceb5ea727 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103ae expref: 19 pid: 9235 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155561.075275:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.075277:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.075284:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 10 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.075291:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 10 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.075317:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 10 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.075327:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124512000:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155561.075385:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c8519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.075692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.075746:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123573376 00000100:00100000:1.0:1746155561.075750:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123573376 00000100:00100000:1.0:1746155561.075781:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11638 00000100:00100000:1.0:1746155561.075786:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:28904:x1830976123573376:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155561.075797:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.075805:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1041e expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.075821:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.075826:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155561.075828:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155561.075831:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4952064->5242879] (req 4952064->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1041e expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.075907:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.075916:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 12 pid: 4461 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746155561.075925:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124512128:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155561.076079:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155561.080051:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137122680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124512128:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155561.080075:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4952064->5242879] (req 4952064->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1041e expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.080087:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c400, rc 0) 00000100:00100000:1.0:1746155561.080136:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:28904:x1830976123573376:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4349us (4444us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.080143:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124512000:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155561.080143:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11638 00010000:00010000:3.0:1746155561.080155:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.080173:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123573248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4973us (7670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.080182:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5826 00000100:00100000:0.0:1746155561.083559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.087219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155561.097014:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746155561.099882:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976123573888:12345-192.168.202.51@tcp:4:cat.0 Request processed in 12055us (12661us total) trans 21474840495 rc 0/0 00000100:00100000:3.0:1746155561.099892:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 656 00002000:00100000:3.0:1746155561.099901:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3723263) req@ffff88009fac6d80 x1830976123573888/t21474840495(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/448 e 0 to 0 dl 1746155572 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.099910:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6d80 with x1830976123573888 ext(3145728->3723263) 00010000:00010000:3.0:1746155561.099919:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 14 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.099930:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 14 pid: 4461 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746155561.099937:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac6d80 00000100:00100000:0.0:1746155561.103386:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.103476:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123574016 00000100:00100000:3.0:1746155561.103483:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123574016 00010000:00010000:3.0:1746155561.103537:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 14 pid: 4461 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.103578:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5827 00000100:00100000:3.0:1746155561.103585:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976123574016:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.103598:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.103616:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 14 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.103631:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 14 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.103659:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d600/0x844e5faceb5ea790 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3723263) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10417 expref: 14 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.103674:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.103675:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.103681:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1041e expref: 13 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.103687:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1041e expref: 13 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.103713:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1041e expref: 13 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.103723:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124512256:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155561.103790:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c8519c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.105220:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124512256:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155561.105231:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.105252:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123574016:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1668us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.105258:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5827 00000100:00100000:0.0:1746155561.106286:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.106327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.106402:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123574272 00000100:00100000:1.0:1746155561.106407:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123574272 00000100:00100000:1.0:1746155561.107473:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123574144 00000100:00100000:1.0:1746155561.107479:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123574144 00000100:00100000:3.0:1746155561.107911:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124512512:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155561.108085:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.112221:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124512512:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155561.112248:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0c00/0x844e5faceb5ea79e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1042c expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.112262:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0c00/0x844e5faceb5ea79e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1042c expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155561.113047:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124512384:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155561.113064:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0400/0x844e5faceb5ea7a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10425 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155561.113073:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0400/0x844e5faceb5ea7a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10425 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.113223:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc0c00, rc 0) 00000100:00100000:3.0:1746155561.113264:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123574272:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5685us (6979us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155561.113272:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11639 00010000:00010000:0.0:1746155561.113733:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc0400, rc 0) 00000100:00100000:0.0:1746155561.113754:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123574144:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6096us (7426us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155561.113760:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11640 00000100:00100000:0.0:1746155561.115349:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.115429:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123574528 00000100:00100000:3.0:1746155561.115435:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123574528 00002000:00100000:3.0:1746155561.115469:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4952064->4956159) req@ffff88009fac5500 x1830976123574528/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.115477:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac5500 with x1830976123574528 ext(4952064->4956159) 00002000:00010000:3.0:1746155561.115482:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac5500 00000100:00100000:0.0:1746155561.115564:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4381 00000100:00100000:0.0:1746155561.115572:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976123574528:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.115759:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976123574528:12345-192.168.202.51@tcp:3:cat.0 Request processed in 188us (414us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155561.115765:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4381 00002000:00100000:0.0:1746155561.115770:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (4952064->4956159) req@ffff88009fac5500 x1830976123574528/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.115777:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac5500 with x1830976123574528 ext(4952064->4956159) 00002000:00010000:0.0:1746155561.115780:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac5500 00000100:00100000:0.0:1746155561.183589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.184147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.184267:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123574784 00000100:00100000:3.0:1746155561.184271:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123574784 00000100:00100000:3.0:1746155561.184293:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11642 00000100:00100000:3.0:1746155561.184299:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123574784:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.184306:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.184316:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1043a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.184355:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124512640:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155561.184413:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.186151:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124512640:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155561.186174:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1043a expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.186184:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1043a expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.186203:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bae00, rc 0) 00000100:00100000:3.0:1746155561.186239:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123574784:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1938us (2089us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155561.186245:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11642 00000100:00100000:0.0:1746155561.197721:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.197763:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.197945:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4382 00000100:00100000:3.0:1746155561.197954:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123575040:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155561.207560:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123575040:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9600us (9838us total) trans 0 rc 491520/491520 00000100:00100000:3.0:1746155561.207571:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4382 00002000:00100000:3.0:1746155561.207580:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1540095) req@ffff88009fac7480 x1830976123575040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 491520/491520 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.207590:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7480 with x1830976123575040 ext(1048576->1540095) 00002000:00010000:3.0:1746155561.207595:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac7480 00000100:00100000:0.0:1746155561.228584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:3.0:1746155561.228772:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800910c8000 x1830976123575552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.228782:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8000 with x1830976123575552 ext(2097152->3145727) 00002000:00010000:3.0:1746155561.228787:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c8000 00000100:00100000:3.0:1746155561.228806:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4384 00000100:00100000:3.0:1746155561.228814:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123575552:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.248629:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.250448:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123575680 00000100:00100000:3.0:1746155561.250458:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123575680 00000100:00100000:3.0:1746155561.250521:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11643 00000100:00100000:3.0:1746155561.250528:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976123575680:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.250543:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.250557:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5ea7ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10441 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.250598:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124512768:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155561.250681:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155561.251594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.261698:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123575552:12345-192.168.202.51@tcp:3:cat.0 Request processed in 32875us (33111us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155561.261707:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4384 00002000:00100000:3.0:1746155561.261715:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800910c8000 x1830976123575552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.261724:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8000 with x1830976123575552 ext(2097152->3145727) 00002000:00010000:3.0:1746155561.261728:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c8000 00000100:00100000:3.0:1746155561.263280:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124512768:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155561.263306:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5ea7ba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10441 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.263318:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903bb000/0x844e5faceb5ea7ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10441 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.263343:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bb000, rc 0) 00000100:00100000:3.0:1746155561.263371:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976123575680:12345-192.168.202.51@tcp:101:cat.0 Request processed in 12844us (14749us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155561.263378:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11643 00000100:00100000:0.0:1746155561.273253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.273379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.273424:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123576192 00000100:00100000:0.0:1746155561.273433:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123576192 00002000:00100000:0.0:1746155561.273476:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800910cbb80 x1830976123576192/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.273486:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cbb80 with x1830976123576192 ext(0->1048575) 00002000:00010000:0.0:1746155561.273491:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910cbb80 00000100:00100000:0.0:1746155561.273549:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4385 00000100:00100000:0.0:1746155561.273561:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976123576192:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155561.296193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.297648:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976123576192:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24089us (24269us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155561.297657:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4385 00002000:00100000:0.0:1746155561.297663:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800910cbb80 x1830976123576192/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.297670:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cbb80 with x1830976123576192 ext(0->1048575) 00002000:00010000:0.0:1746155561.297673:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910cbb80 00000100:00100000:0.0:1746155561.307138:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.307448:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123576448 00000100:00100000:3.0:1746155561.307458:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123576448 00000100:00100000:3.0:1746155561.307530:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11646 00000100:00100000:3.0:1746155561.307542:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28926:x1830976123576448:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.307561:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.307578:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903ba400/0x844e5faceb5ea7cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10456 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.307605:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea74a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103d1 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.307612:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155561.307614:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155561.307617:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903ba400/0x844e5faceb5ea7cf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10456 expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.307657:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea74a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103d1 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.307673:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea74a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103d1 expref: 21 pid: 18270 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.307684:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124513152:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155561.310821:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.311844:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.311974:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123576576 00000100:00100000:3.0:1746155561.311981:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123576576 00010000:00010000:3.0:1746155561.312008:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ea76d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2772992->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103f4 expref: 17 pid: 8436 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.312032:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5828 00000100:00100000:3.0:1746155561.312038:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123576576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.312050:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.312067:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ea76d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2772992->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103f4 expref: 17 pid: 8436 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.312077:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ea76d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2772992->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103f4 expref: 17 pid: 8436 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.312094:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ea76d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2772992->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103f4 expref: 17 pid: 8436 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.312108:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.312110:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.312115:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0800/0x844e5faceb5ea7c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1044f expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.312122:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0800/0x844e5faceb5ea7c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1044f expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.312148:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0800/0x844e5faceb5ea7c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1044f expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.312158:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124513280:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155561.312220:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.314739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.337201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.337247:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.337266:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123576960 00000100:00100000:0.0:1746155561.337272:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123576960 00002000:00100000:0.0:1746155561.337304:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800910cb480 x1830976123576960/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.337312:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb480 with x1830976123576960 ext(2097152->3145727) 00002000:00010000:0.0:1746155561.337316:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910cb480 00000100:00100000:0.0:1746155561.337340:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123577088 00000100:00100000:0.0:1746155561.337343:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123577088 00002000:00100000:0.0:1746155561.337351:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88008ff18380 x1830976123577088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.337358:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff18380 with x1830976123577088 ext(3145728->4194303) 00002000:00010000:0.0:1746155561.337360:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ff18380 00000100:00100000:0.0:1746155561.337372:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4386 00000100:00100000:0.0:1746155561.337378:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123576960:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.338538:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4387 00000100:00100000:0.0:1746155561.338548:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123577088:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155561.352676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.352733:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123577472 00000100:00100000:3.0:1746155561.352740:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123577472 00002000:00100000:3.0:1746155561.352764:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880137120a80 x1830976123577472/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.352771:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120a80 with x1830976123577472 ext(3145728->4194303) 00002000:00010000:3.0:1746155561.352774:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120a80 00000100:00100000:3.0:1746155561.352798:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4388 00000100:00100000:3.0:1746155561.352804:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123577472:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155561.366373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.368009:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123577472:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15199us (15328us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155561.368019:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4388 00002000:00100000:3.0:1746155561.368029:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880137120a80 x1830976123577472/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.368037:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120a80 with x1830976123577472 ext(3145728->4194303) 00002000:00010000:3.0:1746155561.368041:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120a80 00000100:00100000:0.0:1746155561.373692:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.373879:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123577728 00000100:00100000:3.0:1746155561.373885:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123577728 00000100:00100000:3.0:1746155561.373918:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11647 00000100:00100000:3.0:1746155561.373925:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123577728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.373939:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.373951:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5ea7d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1045d expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.373968:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.373970:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.373976:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5ea7d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1045d expref: 25 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.373990:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5ea7d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1045d expref: 25 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.374002:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bbc00, rc 0) 00000100:00100000:3.0:1746155561.374033:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123577728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 108us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.374038:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11647 00000100:00100000:1.0:1746155561.374483:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.374909:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123577984 00000100:00100000:3.0:1746155561.374913:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123577984 00002000:00100000:3.0:1746155561.374933:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88012cded500 x1830976123577984/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.374942:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded500 with x1830976123577984 ext(1048576->2097151) 00002000:00010000:3.0:1746155561.374945:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cded500 00000100:00100000:3.0:1746155561.374957:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4389 00000100:00100000:3.0:1746155561.374961:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123577984:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.379329:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.386861:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123577984:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11890us (12370us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155561.386873:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4389 00002000:00100000:3.0:1746155561.386882:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88012cded500 x1830976123577984/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.386891:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded500 with x1830976123577984 ext(1048576->2097151) 00002000:00010000:3.0:1746155561.386896:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cded500 00000100:00100000:0.0:1746155561.399114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.403225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.410966:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.416768:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.418204:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123578880 00000100:00100000:3.0:1746155561.418211:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123578880 00002000:00100000:3.0:1746155561.418251:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88008ff19500 x1830976123578880/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.418260:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff19500 with x1830976123578880 ext(1048576->2097151) 00002000:00010000:3.0:1746155561.418264:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ff19500 00000100:00100000:3.0:1746155561.418291:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4391 00000100:00100000:3.0:1746155561.418301:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976123578880:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.425646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.428611:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123578880:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10310us (11851us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155561.428620:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4391 00002000:00100000:3.0:1746155561.428628:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88008ff19500 x1830976123578880/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.428649:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff19500 with x1830976123578880 ext(1048576->2097151) 00002000:00010000:3.0:1746155561.428653:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ff19500 00000100:00100000:0.0:1746155561.431130:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.432022:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123579136 00000100:00100000:3.0:1746155561.432028:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123579136 00010000:00010000:3.0:1746155561.432052:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea743 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103bc expref: 16 pid: 1625 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746155561.432095:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5831 00000100:00100000:3.0:1746155561.432102:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123579136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.432116:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.432134:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea743 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103bc expref: 16 pid: 1625 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155561.432143:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea743 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103bc expref: 16 pid: 1625 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155561.432161:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903bb600/0x844e5faceb5ea743 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f103bc expref: 16 pid: 1625 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155561.432176:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.432285:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976123579136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 181us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.432291:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5831 00000100:00100000:0.0:1746155561.432418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.432526:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123579264 00000100:00100000:3.0:1746155561.432529:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123579264 00010000:00010000:3.0:1746155561.432541:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5ea70b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10392 expref: 20 pid: 20200 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746155561.432555:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5832 00000100:00100000:3.0:1746155561.432560:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123579264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.432567:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.432574:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5ea70b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10392 expref: 20 pid: 20200 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155561.432582:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5ea70b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10392 expref: 20 pid: 20200 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155561.432593:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5ea70b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10392 expref: 20 pid: 20200 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155561.432601:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.432603:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.432608:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136867a00/0x844e5faceb5ea7e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 229376->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1046b expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.432616:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136867a00/0x844e5faceb5ea7e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 229376->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1046b expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.432653:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136867a00/0x844e5faceb5ea7e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 229376->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1046b expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.432664:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124514048:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155561.432845:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.437557:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.437661:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124514048:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155561.437679:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.437716:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123579264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5153us (5297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.437728:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5832 00000100:00100000:0.0:1746155561.442082:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123579776 00000100:00100000:0.0:1746155561.442089:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123579776 00002000:00100000:0.0:1746155561.442121:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009c212300 x1830976123579776/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.442129:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212300 with x1830976123579776 ext(2097152->3145727) 00002000:00010000:0.0:1746155561.442133:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c212300 00000100:00100000:0.0:1746155561.442161:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4393 00000100:00100000:0.0:1746155561.442167:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123579776:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.446101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.447205:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.447266:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123580032 00000100:00100000:3.0:1746155561.447271:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123580032 00000100:00100000:3.0:1746155561.447292:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11651 00000100:00100000:3.0:1746155561.447297:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28922:x1830976123580032:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155561.447305:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.447314:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea7f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10479 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.447328:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5ea6cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1036f expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.447335:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f293e00/0x844e5faceb5ea712 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10399 expref: 23 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.447339:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.447340:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.447343:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea7f2 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10479 expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.447356:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f293e00/0x844e5faceb5ea712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10399 expref: 23 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.447363:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f293e00/0x844e5faceb5ea712 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10399 expref: 23 pid: 20200 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746155561.447369:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124514304:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155561.447420:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5ea6cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1036f expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.447426:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5ea6cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1036f expref: 16 pid: 4461 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.447433:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124514432:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155561.447446:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.452670:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.452694:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.452749:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124514304:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155561.452757:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124514432:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155561.452782:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea7f2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10479 expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.452796:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bac00, rc 0) 00000100:00100000:3.0:1746155561.452820:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28922:x1830976123580032:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5522us (5616us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.452826:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11651 00000100:00100000:3.0:1746155561.454071:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124514176:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155561.454085:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [135168->1048575] (req 135168->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.454093:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131004400, rc 0) 00000100:00100000:3.0:1746155561.454107:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:28928:x1830976123579904:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7807us (8014us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.454115:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11650 00000100:00100000:0.0:1746155561.454314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.454418:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123580416 00000100:00100000:3.0:1746155561.454422:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123580416 00002000:00100000:3.0:1746155561.454442:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (229376->1048575) req@ffff8801366b4700 x1830976123580416/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.454451:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b4700 with x1830976123580416 ext(229376->1048575) 00010000:00010000:3.0:1746155561.454457:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136867a00/0x844e5faceb5ea7e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 229376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1046b expref: 14 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.454467:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136867a00/0x844e5faceb5ea7e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 229376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1046b expref: 14 pid: 8437 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746155561.454473:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801366b4700 00000100:00100000:3.0:1746155561.454485:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 660 00000100:00100000:3.0:1746155561.454490:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976123580416:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155561.458017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.458664:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123580544 00000100:00100000:3.0:1746155561.458671:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123580544 00000100:00100000:3.0:1746155561.458710:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11652 00000100:00100000:3.0:1746155561.458716:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28926:x1830976123580544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.458730:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.458744:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10480 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.458763:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.458764:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.458771:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10480 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.458782:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10480 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.458790:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bae00, rc 0) 00000100:00100000:3.0:1746155561.458821:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:28926:x1830976123580544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 105us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.458826:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11652 00000100:00100000:0.0:1746155561.459681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.467340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.467366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.467392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.467413:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123581056 00000100:00100000:0.0:1746155561.467420:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123581056 00002000:00100000:0.0:1746155561.467451:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8801366b4e00 x1830976123581056/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.467459:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b4e00 with x1830976123581056 ext(2097152->3145727) 00002000:00010000:0.0:1746155561.467464:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801366b4e00 00000100:00100000:0.0:1746155561.467480:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4395 00000100:00100000:0.0:1746155561.467486:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123581056:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155561.467918:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4397 00000100:00100000:1.0:1746155561.467925:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123581568:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155561.468880:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123580416:12345-192.168.202.51@tcp:4:cat.0 Request processed in 14386us (14563us total) trans 21474840497 rc 0/0 00000100:00100000:3.0:1746155561.468889:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 660 00002000:00100000:3.0:1746155561.468897:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (229376->1048575) req@ffff8801366b4700 x1830976123580416/t21474840497(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/448 e 0 to 0 dl 1746155572 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.468905:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b4700 with x1830976123580416 ext(229376->1048575) 00010000:00010000:3.0:1746155561.468912:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136867a00/0x844e5faceb5ea7e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 229376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1046b expref: 18 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.468925:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136867a00/0x844e5faceb5ea7e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 229376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1046b expref: 18 pid: 8437 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746155561.468931:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801366b4700 00000100:00100000:0.0:1746155561.479451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.479531:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123581696 00000100:00100000:3.0:1746155561.479539:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123581696 00010000:00010000:3.0:1746155561.479569:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136867a00/0x844e5faceb5ea7e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 229376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1046b expref: 18 pid: 8437 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.479899:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5835 00000100:00100000:3.0:1746155561.479908:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123581696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.479918:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155561.479934:0:9789:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155559 -> 1746155561 00002000:00010000:3.0:1746155561.479937:0:9789:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155559 -> 1746155561 00010000:00010000:3.0:1746155561.479943:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136867a00/0x844e5faceb5ea7e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 229376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1046b expref: 18 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.479952:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136867a00/0x844e5faceb5ea7e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 229376->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1046b expref: 18 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.479970:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136867a00/0x844e5faceb5ea7e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 229376->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1046b expref: 18 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.479987:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.479989:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.479994:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.480000:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.480025:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.480039:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124514688:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155561.480108:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155561.483983:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123581568:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16051us (16582us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155561.483993:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4397 00002000:00100000:1.0:1746155561.484001:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8801366b5f80 x1830976123581568/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.484009:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b5f80 with x1830976123581568 ext(3145728->4194303) 00002000:00010000:1.0:1746155561.484015:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801366b5f80 00000100:00100000:0.0:1746155561.484571:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.484801:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123581952 00000100:00100000:1.0:1746155561.484807:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123581952 00002000:00100000:1.0:1746155561.484831:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (135168->139263) req@ffff8801366b4a80 x1830976123581952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.484837:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b4a80 with x1830976123581952 ext(135168->139263) 00002000:00010000:1.0:1746155561.484841:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801366b4a80 00000100:00100000:1.0:1746155561.484864:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4398 00000100:00100000:1.0:1746155561.484869:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123581952:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155561.484945:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123581056:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17458us (17610us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155561.484951:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4395 00002000:00100000:0.0:1746155561.484956:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8801366b4e00 x1830976123581056/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.484962:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b4e00 with x1830976123581056 ext(2097152->3145727) 00002000:00010000:0.0:1746155561.484965:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801366b4e00 00000100:00100000:1.0:1746155561.484968:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123581952:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 99us (400us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155561.484973:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4398 00002000:00100000:1.0:1746155561.484976:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (135168->139263) req@ffff8801366b4a80 x1830976123581952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.484982:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b4a80 with x1830976123581952 ext(135168->139263) 00002000:00010000:1.0:1746155561.484984:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801366b4a80 00000100:00100000:3.0:1746155561.485089:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124514688:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155561.485107:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.485127:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123581696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5220us (5684us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.485134:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5835 00000100:00100000:0.0:1746155561.495004:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.497335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.497386:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123582208 00000100:00100000:3.0:1746155561.497391:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123582208 00000100:00100000:0.0:1746155561.497793:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.497832:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11654 00000100:00100000:3.0:1746155561.498141:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123582208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.498149:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.498161:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea807 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1048e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.498200:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124514944:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155561.498781:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851300 going to sleep for 11 seconds 00002000:00010000:3.0:1746155561.500750:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime: 1746155559 -> 1746155561 00000100:00100000:3.0:1746155561.500773:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124514944:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155561.500803:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea807 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1048e expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.500816:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39c00/0x844e5faceb5ea807 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1048e expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.500835:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb39c00, rc 0) 00000100:00100000:3.0:1746155561.500868:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123582208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2729us (3536us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155561.500875:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11654 00000100:00100000:0.0:1746155561.504224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.504251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.506209:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123582720 00000100:00100000:3.0:1746155561.506214:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123582720 00010000:00010000:3.0:1746155561.506234:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea7f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10479 expref: 18 pid: 4461 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.506257:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5836 00000100:00100000:3.0:1746155561.506261:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123582720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.506270:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155561.506283:0:9789:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155560 -> 1746155561 00002000:00010000:3.0:1746155561.506285:0:9789:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155560 -> 1746155561 00010000:00010000:3.0:1746155561.506289:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea7f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10479 expref: 18 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.506299:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea7f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10479 expref: 18 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.506316:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903bac00/0x844e5faceb5ea7f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10479 expref: 18 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.506336:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.506338:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.506345:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.506351:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.506376:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.506386:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124515072:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155561.506446:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851300 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.510032:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124515072:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155561.510055:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.510113:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123582720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3849us (5858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.510123:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5836 00000100:00100000:0.0:1746155561.513911:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.516278:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123582976 00000100:00100000:1.0:1746155561.516289:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123582976 00002000:00100000:1.0:1746155561.516331:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1150976->1155071) req@ffff88009286d500 x1830976123582976/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.516340:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286d500 with x1830976123582976 ext(1150976->1155071) 00002000:00010000:1.0:1746155561.516346:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286d500 00000100:00100000:1.0:1746155561.516909:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4400 00000100:00100000:1.0:1746155561.516917:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123582976:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155561.517638:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123582976:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 712us (3725us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155561.517646:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4400 00002000:00100000:1.0:1746155561.517652:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1150976->1155071) req@ffff88009286d500 x1830976123582976/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.517659:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286d500 with x1830976123582976 ext(1150976->1155071) 00002000:00010000:1.0:1746155561.517662:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286d500 00000100:00100000:3.0:1746155561.518375:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123582592:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13066us (14152us total) trans 0 rc 757760/757760 00000100:00100000:3.0:1746155561.518382:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4399 00002000:00100000:3.0:1746155561.518387:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4952063) req@ffff8801366b7b80 x1830976123582592/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 757760/757760 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.518394:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b7b80 with x1830976123582592 ext(4194304->4952063) 00002000:00010000:3.0:1746155561.518398:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801366b7b80 00000100:00100000:0.0:1746155561.521239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.521330:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123583104 00000100:00100000:3.0:1746155561.521337:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123583104 00000100:00100000:3.0:1746155561.521384:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11655 00000100:00100000:3.0:1746155561.521391:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976123583104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.521407:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.521421:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb39800/0x844e5faceb5ea80e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10495 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.521441:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.521443:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.521451:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb39800/0x844e5faceb5ea80e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10495 expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.521465:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb39800/0x844e5faceb5ea80e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10495 expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.521475:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb39800, rc 0) 00000100:00100000:3.0:1746155561.521537:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123583104:12345-192.168.202.51@tcp:101:cat.0 Request processed in 145us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.521542:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11655 00000100:00100000:0.0:1746155561.523589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.526080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.526828:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123583360 00000100:00100000:3.0:1746155561.526835:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123583360 00000100:00100000:3.0:1746155561.526891:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11657 00000100:00100000:3.0:1746155561.526899:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123583360:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.526913:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.526928:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb38a00/0x844e5faceb5ea81c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f104a3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.526976:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124515328:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155561.527058:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851300 going to sleep for 11 seconds 00002000:00010000:3.0:1746155561.528844:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155561 -> 1746155562 00002000:00010000:3.0:1746155561.528848:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155561 -> 1746155562 00002000:00010000:3.0:1746155561.528851:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155561 -> 1746155562 00000100:00100000:3.0:1746155561.528869:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124515328:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155561.528894:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb38a00/0x844e5faceb5ea81c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104a3 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.528905:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb38a00/0x844e5faceb5ea81c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104a3 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.528918:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb38a00, rc 0) 00000100:00100000:3.0:1746155561.528961:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123583360:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2062us (2883us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155561.528967:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11657 00000100:00100000:0.0:1746155561.531706:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.531738:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.531764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.531765:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123583616 00000100:00100000:3.0:1746155561.531771:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123583616 00000100:00100000:1.0:1746155561.531785:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123583872 00000100:00100000:1.0:1746155561.531789:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123583872 00002000:00100000:3.0:1746155561.531803:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d6:0x0] (0->135167) req@ffff880136631180 x1830976123583616/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.531808:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1155072->2097151) req@ffff880136632300 x1830976123583872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.531810:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631180 with x1830976123583616 ext(0->135167) 00002000:00010000:3.0:1746155561.531813:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136631180 00002000:00100000:1.0:1746155561.531815:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632300 with x1830976123583872 ext(1155072->2097151) 00002000:00010000:1.0:1746155561.531819:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136632300 00000100:00100000:3.0:1746155561.531830:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123584128 00000100:00100000:3.0:1746155561.531831:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123584128 00000100:00100000:1.0:1746155561.531833:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4401 00002000:00100000:3.0:1746155561.531838:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880136631f80 x1830976123584128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155561.531839:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123583616:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:3.0:1746155561.531842:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631f80 with x1830976123584128 ext(1048576->2097151) 00002000:00010000:3.0:1746155561.531845:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136631f80 00000100:00100000:3.0:1746155561.531852:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4402 00000100:00100000:3.0:1746155561.531855:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123583872:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155561.532078:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4403 00000100:00100000:0.0:1746155561.532207:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.532909:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123584128:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155561.538054:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.538097:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.538408:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123583616:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6567us (6707us total) trans 0 rc 135168/135168 00000100:00100000:1.0:1746155561.538421:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4401 00002000:00100000:1.0:1746155561.538432:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->135167) req@ffff880136631180 x1830976123583616/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 135168/135168 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.538440:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631180 with x1830976123583616 ext(0->135167) 00002000:00010000:1.0:1746155561.538445:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136631180 00000100:00100000:3.0:1746155561.538473:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123584512 00000100:00100000:3.0:1746155561.538481:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123584512 00000100:00100000:3.0:1746155561.538530:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123584640 00000100:00100000:3.0:1746155561.538533:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123584640 00000100:00100000:3.0:1746155561.538549:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11658 00000100:00100000:3.0:1746155561.538556:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123584512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.538571:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.538590:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb38e00/0x844e5faceb5ea823 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f104aa expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.538657:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124515456:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155561.538718:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851300 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.538735:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11659 00000100:00100000:3.0:1746155561.538741:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123584640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.538747:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.538757:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb38200/0x844e5faceb5ea82a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f104b1 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.538779:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124515584:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155561.538799:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.542050:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123583872:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10184us (10302us total) trans 0 rc 942080/942080 00000100:00100000:3.0:1746155561.542062:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4402 00002000:00100000:3.0:1746155561.542071:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1155072->2097151) req@ffff880136632300 x1830976123583872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.542079:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632300 with x1830976123583872 ext(1155072->2097151) 00002000:00010000:3.0:1746155561.542084:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136632300 00000100:00100000:3.0:1746155561.542701:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124515456:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155561.542718:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb38e00/0x844e5faceb5ea823 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104aa expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.542727:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb38e00/0x844e5faceb5ea823 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104aa expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.542733:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb38e00, rc 0) 00000100:00100000:3.0:1746155561.542877:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123584512:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4320us (4833us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155561.542882:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11658 00000100:00100000:3.0:1746155561.544218:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123584128:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12128us (12448us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155561.544228:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4403 00002000:00100000:3.0:1746155561.544236:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880136631f80 x1830976123584128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.544244:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631f80 with x1830976123584128 ext(1048576->2097151) 00002000:00010000:3.0:1746155561.544248:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136631f80 00000100:00100000:0.0:1746155561.725304:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.725398:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123584768 00000100:00100000:3.0:1746155561.725407:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123584768 00000100:00100000:3.0:1746155561.725473:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9918 00000100:00100000:3.0:1746155561.725480:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+22:28944:x1830976123584768:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155561.725531:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.725545:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38800/0x844e5faceb5ea831 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f104b8 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.725593:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39000/0x844e5faceb5ea838 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.725603:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39000/0x844e5faceb5ea838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.725613:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39000/0x844e5faceb5ea838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.725623:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38600/0x844e5faceb5ea83f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.725640:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38600/0x844e5faceb5ea83f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.725646:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38600/0x844e5faceb5ea83f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.725733:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.725743:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1037d expref: 33 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.725750:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ea6e8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10376 expref: 312 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.725760:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.725784:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ea6e8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10376 expref: 312 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.725794:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ea6e8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10376 expref: 312 pid: 15474 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.725805:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124515712:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155561.725877:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1037d expref: 33 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.725885:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1037d expref: 33 pid: 27374 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.725892:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124515840:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155561.725909:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851300 going to sleep for 11 seconds 00000100:00080000:1.0:1746155561.726023:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155561.733479:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124515712:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155561.733490:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124515840:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155561.733549:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155561.739743:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.739834:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.739925:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123584896 00000100:00100000:1.0:1746155561.739933:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123584896 00010000:00010000:1.0:1746155561.739967:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ea6e8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10376 expref: 313 pid: 15474 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746155561.739996:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123585024 00000100:00100000:1.0:1746155561.739999:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123585024 00010000:00010000:1.0:1746155561.740017:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1037d expref: 34 pid: 27374 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746155561.740043:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5837 00000100:00100000:1.0:1746155561.740049:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136631880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+313:1961:x1830976123584896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155561.740061:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155561.740066:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ea6e8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10376 expref: 313 pid: 15474 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155561.740076:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ea6e8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10376 expref: 313 pid: 15474 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155561.740098:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ea6e8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10376 expref: 313 pid: 15474 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155561.740116:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155561.740120:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740126:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740130:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740135:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155561.740168:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136631880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1961:x1830976123584896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 119us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155561.740173:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5837 00000100:00100000:1.0:1746155561.740186:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5838 00000100:00100000:1.0:1746155561.740190:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1963:x1830976123585024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155561.740197:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155561.740200:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1037d expref: 34 pid: 27374 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155561.740207:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1037d expref: 34 pid: 27374 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155561.740217:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b81a000/0x844e5faceb5ea6da lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1037d expref: 34 pid: 27374 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155561.740224:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155561.740227:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740232:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740237:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740252:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155561.740266:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136632a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1963:x1830976123585024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 74us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155561.740271:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5838 00000100:00080000:1.0:1746155561.740297:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746155561.740367:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740374:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155561.740413:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:1.0:1746155561.740418:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155561.740434:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740443:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740452:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39000/0x844e5faceb5ea838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740457:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39000/0x844e5faceb5ea838 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740462:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39000/0x844e5faceb5ea838 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740467:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb39000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155561.740470:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39000/0x844e5faceb5ea838 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740476:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39000/0x844e5faceb5ea838 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740484:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155561.740487:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155561.740490:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39000/0x844e5faceb5ea838 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740493:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39000/0x844e5faceb5ea838 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740530:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38600/0x844e5faceb5ea83f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740536:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38600/0x844e5faceb5ea83f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740540:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38600/0x844e5faceb5ea83f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740544:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb38600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155561.740546:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38600/0x844e5faceb5ea83f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740551:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38600/0x844e5faceb5ea83f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740557:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880130cddc00) 00010000:00010000:1.0:1746155561.740559:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155561.740561:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38600/0x844e5faceb5ea83f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740565:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38600/0x844e5faceb5ea83f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.740595:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb38800/0x844e5faceb5ea831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104b8 expref: 24 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.740610:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104b8 expref: 23 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.740615:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155561.740617:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155561.740619:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb39400, rc 0) 00000100:00100000:1.0:1746155561.740662:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+23:28944:x1830976123584768:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 15181us (15364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155561.740668:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9918 00000100:00100000:0.0:1746155561.742769:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.742806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.743490:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123585152 00000100:00100000:3.0:1746155561.743497:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123585152 00000100:00100000:3.0:1746155561.743545:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123585280 00000100:00100000:3.0:1746155561.743548:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123585280 00000100:00100000:3.0:1746155561.743562:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11660 00000100:00100000:3.0:1746155561.743567:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1963:x1830976123585152:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155561.743581:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.743594:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea84d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f104bf expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.743643:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124515968:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155561.743693:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851300 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.743707:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11661 00000100:00100000:3.0:1746155561.743712:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1962:x1830976123585280:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155561.743718:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.743726:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb38c00/0x844e5faceb5ea854 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f104c6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.743744:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124516096:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155561.743759:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.743871:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.744322:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123585408 00000100:00100000:3.0:1746155561.744325:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123585408 00000100:00100000:3.0:1746155561.744350:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11662 00000100:00100000:3.0:1746155561.744355:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123585408:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155561.744361:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.744368:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb39a00/0x844e5faceb5ea85b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f104cd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.744377:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.744379:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.744386:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb39a00/0x844e5faceb5ea85b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104cd expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.744397:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb39a00/0x844e5faceb5ea85b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104cd expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.744407:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb39a00, rc 0) 00000100:00100000:3.0:1746155561.744428:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123585408:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 72us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.744432:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11662 00000100:00100000:0.0:1746155561.744876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.744900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.744929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.745119:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11664 00000100:00100000:1.0:1746155561.745125:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123585664:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155561.745131:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.745137:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130886800/0x844e5faceb5ea869 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f104db expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.745146:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155561.745148:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155561.745152:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130886800/0x844e5faceb5ea869 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104db expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.745161:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130886800/0x844e5faceb5ea869 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104db expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.745168:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130886800, rc 0) 00000100:00100000:1.0:1746155561.745187:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123585664:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 62us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155561.745195:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11664 00000100:00100000:1.0:1746155561.745205:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11665 00000100:00100000:1.0:1746155561.745209:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123585792:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155561.745213:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.745218:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130887a00/0x844e5faceb5ea870 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f104e2 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.745225:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155561.745227:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155561.745230:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130887a00/0x844e5faceb5ea870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e2 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.745238:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130887a00/0x844e5faceb5ea870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e2 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.745244:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130887a00, rc 0) 00000100:00100000:1.0:1746155561.745254:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123585792:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 45us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155561.745258:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11665 00000100:00100000:3.0:1746155561.746475:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124515968:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155561.746497:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea84d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104bf expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.746540:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39200/0x844e5faceb5ea84d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104bf expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.746555:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb39200, rc 0) 00000100:00100000:3.0:1746155561.746576:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123585152:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3008us (3811us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155561.746581:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11660 00000100:00100000:3.0:1746155561.750448:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.750556:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123586048 00000100:00100000:1.0:1746155561.750564:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123586048 00000100:00100000:1.0:1746155561.750612:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9919 00000100:00100000:1.0:1746155561.750619:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+23:28944:x1830976123586048:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155561.750644:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.750660:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130887400/0x844e5faceb5ea877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f104e9 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.750740:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.750752:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104b8 expref: 24 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.750758:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.750784:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104b8 expref: 24 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.750794:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39400/0x844e5faceb5ea846 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104b8 expref: 24 pid: 15474 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746155561.750804:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124516224:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155561.750869:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155561.753887:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124516224:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155561.753912:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155561.754301:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155561.756530:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155561.756537:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155561.756552:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155561.756662:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130887400/0x844e5faceb5ea877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e9 expref: 25 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.756704:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e9 expref: 24 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.756711:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155561.756713:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155561.756715:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130886200, rc 0) 00000100:00100000:1.0:1746155561.756736:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+24:28944:x1830976123586048:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 6118us (6297us total) trans 8589943839 rc 0/0 00000100:00100000:1.0:1746155561.756742:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9919 00000100:00100000:3.0:1746155561.763106:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3296:1830976124516352:0@lo:400:kworker.0 00000100:00100000:3.0:1746155561.763159:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155561.763445:0:14231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124516352 00000100:00100000:1.0:1746155561.763451:0:14231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124516352 00000100:00100000:0.0:1746155561.764106:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1830976124516480:0@lo:400:kworker.0 00000100:00100000:0.0:1746155561.764138:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155561.764172:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124516480 00000100:00100000:0.0:1746155561.764176:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124516480 00000100:00100000:0.0:1746155561.764270:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1746155561.764278:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830976124516480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746155561.764319:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830976124516480:12345-0@lo:400:kworker.0 Request processed in 42us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155561.764325:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1746155561.764358:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1830976124516480:0@lo:400:kworker.0 00000100:00100000:1.0:1746155561.764377:0:14231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1746155561.764384:0:14231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3296:x1830976124516352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155561.764413:0:14231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3296:x1830976124516352:12345-0@lo:400:kworker.0 Request processed in 30us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.764421:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3296:1830976124516352:0@lo:400:kworker.0 00000100:00100000:3.0:1746155561.764810:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830976124516992:0@lo:400:kworker.0 00000100:00100000:3.0:1746155561.764830:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155561.764850:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746155561.764855:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1830976124516608:0@lo:400:kworker.0 00000100:00100000:3.0:1746155561.764965:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155561.764987:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124516992 00000100:00100000:3.0:1746155561.764989:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124516992 00000100:00100000:3.0:1746155561.765006:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124516608 00000100:00100000:3.0:1746155561.765007:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124516608 00000100:00100000:3.0:1746155561.765021:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1746155561.765025:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830976124516992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155561.765048:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830976124516992:12345-0@lo:400:kworker.0 Request processed in 23us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.765052:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1746155561.765062:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1746155561.765066:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830976124516608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746155561.765248:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.765283:0:14231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1746155561.765312:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155561.765316:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.765329:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123586560 00000100:00100000:1.0:1746155561.765332:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123586560 00000100:00100000:3.0:1746155561.765417:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830976124516608:12345-0@lo:400:kworker.0 Request processed in 350us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.765422:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1746155561.765433:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9920 00000100:00100000:3.0:1746155561.765438:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+24:28944:x1830976123586560:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155561.765452:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.765468:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a400/0x844e5faceb5ea88c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f104f0 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.765672:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.765684:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e9 expref: 25 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.765690:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.765707:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e9 expref: 25 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.765715:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e9 expref: 25 pid: 15474 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.765722:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124517120:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155561.765775:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851300 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.768859:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124517120:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155561.768884:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155561.772723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.773172:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123586688 00000100:00100000:3.0:1746155561.773180:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123586688 00010000:00010000:3.0:1746155561.773208:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e9 expref: 26 pid: 15474 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.773243:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5840 00000100:00100000:3.0:1746155561.773251:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+26:1963:x1830976123586688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.773264:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.773269:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e9 expref: 26 pid: 15474 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.773281:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e9 expref: 26 pid: 15474 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.773297:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5ea87e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e9 expref: 26 pid: 15474 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.773314:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155561.773318:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.773327:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.773333:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.773352:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.773389:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+25:1963:x1830976123586688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 138us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.773394:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5840 00010000:00010000:3.0:1746155561.773414:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.773420:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155561.773454:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155561.773459:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155561.773471:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.773498:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a400/0x844e5faceb5ea88c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f0 expref: 25 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.773536:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f0 expref: 24 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.773542:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155561.773544:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155561.773546:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009520bc00, rc 0) 00000100:00100000:3.0:1746155561.773583:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+24:28944:x1830976123586560:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8144us (8266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.773589:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9920 00000100:00100000:0.0:1746155561.774564:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.774613:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123586816 00000100:00100000:1.0:1746155561.774619:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123586816 00000100:00100000:1.0:1746155561.774668:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11666 00000100:00100000:1.0:1746155561.774675:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28942:x1830976123586816:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155561.774688:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.774701:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f104f7 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.774725:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1041e expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.774732:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130886800/0x844e5faceb5ea869 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104db expref: 7 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.774739:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0200/0x844e5faceb5ea7ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10433 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.774745:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155561.774746:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155561.774749:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2859008->3145727] (req 2859008->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.774771:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0200/0x844e5faceb5ea7ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10433 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.774780:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0200/0x844e5faceb5ea7ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10433 expref: 20 pid: 8436 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746155561.774791:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124517248:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155561.774873:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130886800/0x844e5faceb5ea869 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104db expref: 7 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.774881:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130886800/0x844e5faceb5ea869 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104db expref: 7 pid: 1625 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746155561.774889:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124517376:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155561.774910:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1041e expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.774917:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1041e expref: 16 pid: 4461 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746155561.774925:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124517504:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155561.774938:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fcb600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.775353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.775391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.775456:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11668 00000100:00100000:3.0:1746155561.775462:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123587072:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155561.775470:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.775478:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a74fc00/0x844e5faceb5ea8a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10505 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.775657:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124517760:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155561.776033:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155561.781269:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124517248:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155561.781279:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124517376:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155561.781955:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155561.782118:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0200/0x844e5faceb5ea7ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10433 expref: 21 pid: 8436 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746155561.782140:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0200/0x844e5faceb5ea7ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10433 expref: 21 pid: 8436 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746155561.782164:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155561.782193:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123587200:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 114us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155561.782199:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5841 00000100:00100000:0.0:1746155561.783893:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.783938:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.783953:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123587456 00000100:00100000:0.0:1746155561.783957:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123587456 00000100:00100000:0.0:1746155561.783976:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11669 00000100:00100000:0.0:1746155561.783981:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123587456:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155561.783994:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155561.784005:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6041400/0x844e5faceb5ea8af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1050c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155561.784042:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124517888:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155561.784124:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123587328 00000100:00100000:3.0:1746155561.784127:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123587328 00010000:00010000:3.0:1746155561.784140:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130886800/0x844e5faceb5ea869 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104db expref: 10 pid: 1625 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746155561.784153:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5842 00000100:00100000:3.0:1746155561.784158:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123587328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.784164:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.784175:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130886800/0x844e5faceb5ea869 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104db expref: 10 pid: 1625 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155561.784184:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130886800/0x844e5faceb5ea869 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104db expref: 10 pid: 1625 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155561.784195:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130886800/0x844e5faceb5ea869 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104db expref: 10 pid: 1625 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746155561.784209:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.784228:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123587328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 70us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.784234:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5842 00000100:00100000:1.0:1746155561.784298:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124517504:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155561.784318:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2859008->3145727] (req 2859008->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.784326:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130886400, rc 0) 00000100:00100000:1.0:1746155561.784341:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:28942:x1830976123586816:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 9668us (9780us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155561.784346:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11666 00000100:00100000:2.0:1746155561.784417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155561.784446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155561.784468:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.784561:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123587840 00000100:00100000:3.0:1746155561.784564:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123587840 00010000:00010000:3.0:1746155561.784574:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1041e expref: 18 pid: 4461 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.784586:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5843 00000100:00100000:3.0:1746155561.784590:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123587840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.784595:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.784602:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1041e expref: 18 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.784615:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1041e expref: 18 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.784625:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1c400/0x844e5faceb5ea797 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1041e expref: 18 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.784643:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.784645:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.784651:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.784657:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.784680:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155561.784681:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123587584 00000100:00100000:1.0:1746155561.784684:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123587584 00000100:00100000:3.0:1746155561.784688:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124518016:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155561.784698:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123587712 00000100:00100000:1.0:1746155561.784700:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123587712 00000100:00100000:1.0:1746155561.784711:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11670 00000100:00100000:3.0:1746155561.784714:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155561.784715:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123587584:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155561.784722:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.784731:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130886e00/0x844e5faceb5ea8b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10513 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155561.784752:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124518144:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155561.784770:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fcb600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155561.784782:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11671 00000100:00100000:1.0:1746155561.784787:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123587712:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155561.784793:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.784798:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130887600/0x844e5faceb5ea8bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1051a expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155561.784816:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124518272:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155561.784819:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d180 going to sleep for 11 seconds 00000100:00100000:1.0:1746155561.784832:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155561.785339:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124517632:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155561.785353:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ea8a1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104fe expref: 8 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155561.785362:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ea8a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104fe expref: 8 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155561.785368:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeaa00, rc 0) 00000100:00100000:2.0:1746155561.785399:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123586944:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 9949us (10046us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155561.785404:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11667 00000100:00100000:3.0:1746155561.785819:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124517760:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155561.785837:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a74fc00/0x844e5faceb5ea8a8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10505 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.785845:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a74fc00/0x844e5faceb5ea8a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10505 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.785857:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a74fc00, rc 0) 00000100:00100000:3.0:1746155561.785884:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123587072:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 10422us (10492us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155561.785889:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11668 00000100:00100000:2.0:1746155561.787749:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124517888:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155561.787770:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6041400/0x844e5faceb5ea8af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1050c expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155561.787784:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041400/0x844e5faceb5ea8af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1050c expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155561.787791:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6041400, rc 0) 00000100:00100000:2.0:1746155561.787818:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123587456:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3836us (3879us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155561.787824:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11669 00000100:00100000:3.0:1746155561.787988:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124518016:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155561.787999:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.788019:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123587840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3424us (3546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.788025:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5843 00002000:00010000:1.0:1746155561.788810:0:20200:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime: 1746155561 -> 1746155562 00002000:00010000:1.0:1746155561.788813:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155560 -> 1746155562 00002000:00010000:1.0:1746155561.788815:0:20200:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime: 1746155561 -> 1746155562 00000100:00100000:1.0:1746155561.788825:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124518272:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155561.788840:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130887600/0x844e5faceb5ea8bd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1051a expref: 16 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.788848:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130887600/0x844e5faceb5ea8bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1051a expref: 16 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.788871:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130887600, rc 0) 00000100:00100000:1.0:1746155561.788891:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123587712:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4104us (4444us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155561.788897:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11671 00000100:00100000:1.0:1746155561.788930:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124518144:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155561.788943:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130886e00/0x844e5faceb5ea8b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10513 expref: 18 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.788950:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130886e00/0x844e5faceb5ea8b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10513 expref: 18 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.788957:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130886e00, rc 0) 00000100:00100000:1.0:1746155561.788971:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123587584:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4256us (4555us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155561.788976:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11670 00000100:00100000:0.0:1746155561.790445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.791255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.791293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155561.791353:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123588352 00000100:00100000:2.0:1746155561.791360:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123588352 00002000:00100000:2.0:1746155561.791392:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (2859008->2863103) req@ffff880130c9c380 x1830976123588352/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155561.791401:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9c380 with x1830976123588352 ext(2859008->2863103) 00002000:00010000:2.0:1746155561.791405:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9c380 00000100:00100000:3.0:1746155561.791519:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123588096 00000100:00100000:3.0:1746155561.791522:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123588096 00000100:00100000:3.0:1746155561.791545:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9921 00000100:00100000:3.0:1746155561.791550:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+24:28944:x1830976123588096:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155561.791562:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.791576:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dad000/0x844e5faceb5ea8c4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10521 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.791650:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a400/0x844e5faceb5ea8cb lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.791661:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a400/0x844e5faceb5ea8cb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.791669:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a400/0x844e5faceb5ea8cb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.791677:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a400/0x844e5faceb5ea8cb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.791683:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a400/0x844e5faceb5ea8cb lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.791688:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a400/0x844e5faceb5ea8cb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.791692:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009520a400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155561.791695:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a400/0x844e5faceb5ea8cb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.791699:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a400/0x844e5faceb5ea8cb lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.791706:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155561.791709:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155561.791711:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a400/0x844e5faceb5ea8cb lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.791715:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a400/0x844e5faceb5ea8cb lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155561.791733:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dad000/0x844e5faceb5ea8c4 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10521 expref: 25 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.791739:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dad000/0x844e5faceb5ea8c4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10521 expref: 25 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.791744:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dad000, rc 0) 00000100:00100000:3.0:1746155561.791772:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+24:28944:x1830976123588096:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 221us (1330us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155561.791776:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9921 00000100:00100000:2.0:1746155561.791849:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4405 00000100:00100000:2.0:1746155561.791855:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976123588352:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155561.791960:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976123588352:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 105us (705us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155561.791964:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4405 00002000:00100000:2.0:1746155561.791968:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (2859008->2863103) req@ffff880130c9c380 x1830976123588352/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155561.791975:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9c380 with x1830976123588352 ext(2859008->2863103) 00002000:00010000:2.0:1746155561.791978:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9c380 00000100:00100000:1.0:1746155561.792252:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123588480 00000100:00100000:1.0:1746155561.792255:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123588480 00000100:00100000:1.0:1746155561.792274:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11672 00000100:00100000:1.0:1746155561.792278:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:28948:x1830976123588480:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155561.792284:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155561.792291:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10528 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.792306:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.792312:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155561.792314:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155561.792316:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10528 expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.792336:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.792344:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 19 pid: 8437 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746155561.792352:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124518400:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155561.792388:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.794125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.794203:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124518400:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155561.794227:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10528 expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.794239:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130887c00, rc 0) 00000100:00100000:1.0:1746155561.794263:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28948:x1830976123588480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1984us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155561.794270:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11672 00000100:00100000:2.0:1746155561.794331:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123588736 00000100:00100000:2.0:1746155561.794335:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123588736 00000100:00100000:2.0:1746155561.794369:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3979 00000100:00100000:2.0:1746155561.794375:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009461b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+24:28944:x1830976123588736:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:2.0:1746155561.794495:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009461b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+25:28944:x1830976123588736:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 119us (373us total) trans 8589943841 rc 0/0 00000100:00100000:2.0:1746155561.794526:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3979 00000100:00100000:0.0:1746155561.794748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.794968:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123588864 00000100:00100000:3.0:1746155561.794972:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123588864 00002000:00100000:3.0:1746155561.794990:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d6:0x0] (135168->1048575) req@ffff88009f883480 x1830976123588864/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.794998:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f883480 with x1830976123588864 ext(135168->1048575) 00010000:00010000:3.0:1746155561.795004:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 20 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.795013:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 20 pid: 8437 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746155561.795019:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f883480 00000100:00100000:3.0:1746155561.795030:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 662 00000100:00100000:3.0:1746155561.795035:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123588864:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155561.795958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155561.796021:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123588992 00000100:00100000:2.0:1746155561.796025:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123588992 00000100:00100000:2.0:1746155561.796058:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11673 00000100:00100000:2.0:1746155561.796064:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:28942:x1830976123588992:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155561.796074:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155561.796089:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1052f expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.796110:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0800/0x844e5faceb5ea7c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1044f expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.796118:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130887a00/0x844e5faceb5ea870 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e2 expref: 6 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155561.796124:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10480 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.796129:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155561.796131:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155561.796133:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->2371583] (req 2097152->2371583) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.796158:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10480 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.796167:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10480 expref: 18 pid: 8437 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746155561.796176:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124518528:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155561.797269:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130887a00/0x844e5faceb5ea870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e2 expref: 6 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155561.797281:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130887a00/0x844e5faceb5ea870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e2 expref: 6 pid: 1625 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746155561.797289:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124518656:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155561.798038:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0800/0x844e5faceb5ea7c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1044f expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.798047:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0800/0x844e5faceb5ea7c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1044f expref: 23 pid: 4461 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746155561.798057:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124518784:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155561.798658:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.799690:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124518528:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155561.800932:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.800982:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123589120 00000100:00100000:3.0:1746155561.800988:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123589120 00010000:00010000:3.0:1746155561.801016:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10480 expref: 19 pid: 8437 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.801043:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5844 00000100:00100000:3.0:1746155561.801050:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123589120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.801060:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.801076:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10480 expref: 19 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.801090:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10480 expref: 19 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.801108:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903bae00/0x844e5faceb5ea7f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10480 expref: 19 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.801125:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.801160:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123589120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 110us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.801165:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5844 00000100:00100000:2.0:1746155561.805931:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155561.805952:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123589248 00000100:00100000:2.0:1746155561.805958:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123589248 00010000:00010000:2.0:1746155561.805987:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130887a00/0x844e5faceb5ea870 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e2 expref: 7 pid: 1625 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746155561.806077:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124518656:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155561.806087:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124518784:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155561.806111:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->2371583] (req 2097152->2371583) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.806124:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeac00, rc 0) 00000100:00100000:3.0:1746155561.806156:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:28942:x1830976123588992:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 10092us (10200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.806163:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11673 00000100:00100000:2.0:1746155561.808181:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5845 00000100:00100000:2.0:1746155561.808192:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123589248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155561.808211:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155561.808229:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130887a00/0x844e5faceb5ea870 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e2 expref: 7 pid: 1625 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746155561.808242:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130887a00/0x844e5faceb5ea870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e2 expref: 7 pid: 1625 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746155561.808259:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130887a00/0x844e5faceb5ea870 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104e2 expref: 7 pid: 1625 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746155561.808281:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155561.808314:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976123589248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 124us (2389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155561.808319:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5845 00000100:00100000:3.0:1746155561.809704:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123588864:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 14665us (14953us total) trans 21474840498 rc 0/0 00000100:00100000:3.0:1746155561.809713:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 662 00002000:00100000:3.0:1746155561.809720:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d6:0x0] (135168->1048575) req@ffff88009f883480 x1830976123588864/t21474840498(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/448 e 0 to 0 dl 1746155572 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.809733:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f883480 with x1830976123588864 ext(135168->1048575) 00010000:00010000:3.0:1746155561.809741:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 22 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.809751:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 22 pid: 8437 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746155561.809757:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f883480 00000100:00100000:0.0:1746155561.810323:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.812021:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123589376 00000100:00100000:1.0:1746155561.812031:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123589376 00010000:00010000:1.0:1746155561.812060:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0800/0x844e5faceb5ea7c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1044f expref: 24 pid: 4461 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746155561.812101:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5846 00000100:00100000:1.0:1746155561.812109:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123589376:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155561.812121:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155561.812139:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0800/0x844e5faceb5ea7c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1044f expref: 24 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155561.812150:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0800/0x844e5faceb5ea7c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1044f expref: 24 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155561.812169:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0800/0x844e5faceb5ea7c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1044f expref: 24 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155561.812200:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155561.812202:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155561.812208:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.812215:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155561.812243:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155561.812255:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124518912:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155561.812318:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155561.812905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.812939:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123589504 00000100:00100000:3.0:1746155561.812944:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123589504 00010000:00010000:3.0:1746155561.812960:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 22 pid: 8437 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746155561.812988:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5847 00000100:00100000:3.0:1746155561.812994:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123589504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.813002:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.813013:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 22 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.813021:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 22 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.813033:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ea7eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 135168->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10472 expref: 22 pid: 8437 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746155561.813058:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.813060:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.813068:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10528 expref: 15 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.813075:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10528 expref: 15 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.813093:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10528 expref: 15 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.813101:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124519040:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155561.813141:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155561.816984:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124518912:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155561.817003:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155561.817038:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123589376:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4929us (6714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155561.817046:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5846 00000100:00100000:0.0:1746155561.817180:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.817222:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123589760 00000100:00100000:3.0:1746155561.817228:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123589760 00002000:00100000:3.0:1746155561.817259:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2367488->2371583) req@ffff880093a44700 x1830976123589760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.817268:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a44700 with x1830976123589760 ext(2367488->2371583) 00002000:00010000:3.0:1746155561.817281:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093a44700 00000100:00100000:3.0:1746155561.817307:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124519040:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155561.817321:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155561.817336:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4406 00000100:00100000:3.0:1746155561.817350:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123589504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4356us (4445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.817356:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5847 00000100:00100000:0.0:1746155561.817399:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123589760:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.817542:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123589760:12345-192.168.202.51@tcp:3:cat.0 Request processed in 200us (362us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155561.817547:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4406 00002000:00100000:0.0:1746155561.817552:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2367488->2371583) req@ffff880093a44700 x1830976123589760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/4536 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.817559:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a44700 with x1830976123589760 ext(2367488->2371583) 00002000:00010000:0.0:1746155561.817562:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093a44700 00000100:00100000:0.0:1746155561.823635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155561.824074:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123590016 00000100:00100000:2.0:1746155561.824082:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123590016 00002000:00100000:2.0:1746155561.824118:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880093a44a80 x1830976123590016/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155561.824126:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a44a80 with x1830976123590016 ext(0->1048575) 00002000:00010000:2.0:1746155561.824131:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a44a80 00000100:00100000:2.0:1746155561.824156:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4407 00000100:00100000:2.0:1746155561.824162:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123590016:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.826706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.826762:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123590272 00000100:00100000:3.0:1746155561.826769:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123590272 00000100:00100000:3.0:1746155561.826804:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3980 00000100:00100000:3.0:1746155561.826810:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+33:28942:x1830976123590272:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155561.826989:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+34:28942:x1830976123590272:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 178us (288us total) trans 8589943842 rc 0/0 00000100:00100000:3.0:1746155561.826995:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3980 00000100:00100000:0.0:1746155561.835555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.835580:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.835589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.835610:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123590400 00000100:00100000:3.0:1746155561.835618:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123590400 00000100:00100000:3.0:1746155561.835665:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123590656 00000100:00100000:3.0:1746155561.835668:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123590656 00000100:00100000:3.0:1746155561.835682:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123590528 00000100:00100000:3.0:1746155561.835684:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123590528 00000100:00100000:3.0:1746155561.835705:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11674 00000100:00100000:3.0:1746155561.835713:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123590400:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.835727:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155561.835728:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11675 00000100:00100000:0.0:1746155561.835735:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123590656:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.835743:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009520ba00/0x844e5faceb5ea8e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10536 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155561.835743:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155561.835752:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6041e00/0x844e5faceb5ea8e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10544 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.835763:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.835764:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.835771:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009520ba00/0x844e5faceb5ea8e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10536 expref: 23 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.835784:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009520ba00/0x844e5faceb5ea8e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10536 expref: 23 pid: 29728 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155561.835784:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124519168:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155561.835793:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009520ba00, rc 0) 00000100:00100000:3.0:1746155561.835826:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123590400:12345-192.168.202.51@tcp:101:cat.0 Request processed in 114us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.835831:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11674 00000100:00100000:0.0:1746155561.835837:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.835847:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11676 00000100:00100000:3.0:1746155561.835852:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123590528:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155561.835857:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.835863:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ea8ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1053d expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.835886:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124519296:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155561.835924:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155561.836008:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123590016:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11845us (12386us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155561.836015:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4407 00002000:00100000:2.0:1746155561.836022:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880093a44a80 x1830976123590016/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155561.836030:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a44a80 with x1830976123590016 ext(0->1048575) 00002000:00010000:2.0:1746155561.836033:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a44a80 00000100:00100000:3.0:1746155561.837245:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124519296:192.168.202.51@tcp:106: 00002000:00010000:2.0:1746155561.837254:0:4461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime: 1746155561 -> 1746155562 00002000:00010000:2.0:1746155561.837257:0:4461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime: 1746155561 -> 1746155562 00002000:00010000:2.0:1746155561.837259:0:4461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime: 1746155561 -> 1746155562 00010000:00010000:3.0:1746155561.837266:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ea8ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1053d expref: 23 pid: 29728 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155561.837270:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124519168:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155561.837275:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ea8ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1053d expref: 23 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155561.837286:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6041e00/0x844e5faceb5ea8e7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10544 expref: 24 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155561.837295:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6041e00/0x844e5faceb5ea8e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10544 expref: 24 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155561.837298:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4fd8800, rc 0) 00000100:00100000:3.0:1746155561.837323:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123590528:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1469us (1731us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155561.837328:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11676 00010000:00010000:2.0:1746155561.837790:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6041e00, rc 0) 00000100:00100000:2.0:1746155561.837819:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123590656:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2084us (2236us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155561.837824:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11675 00000100:00100000:0.0:1746155561.840681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155561.840751:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123590784 00000100:00100000:2.0:1746155561.840758:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123590784 00000100:00100000:2.0:1746155561.840791:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11677 00000100:00100000:2.0:1746155561.840797:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:28948:x1830976123590784:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155561.840809:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155561.840824:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1054b expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.840848:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.840855:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155561.840856:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155561.840859:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1054b expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.840884:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.840894:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 22 pid: 4461 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746155561.840904:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124519424:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155561.841022:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.844320:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155561.844535:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123591040 00000100:00100000:2.0:1746155561.844543:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123591040 00000100:00100000:3.0:1746155561.844732:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124519424:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155561.844760:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1054b expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746155561.844765:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880095269c00 x1830976123591040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155561.844773:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269c00 with x1830976123591040 ext(0->1048575) 00010000:00010000:3.0:1746155561.844774:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009048fe00, rc 0) 00002000:00010000:2.0:1746155561.844777:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095269c00 00000100:00100000:2.0:1746155561.844806:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4408 00000100:00100000:2.0:1746155561.844812:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123591040:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155561.844813:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:28948:x1830976123590784:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4016us (4144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.844819:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11677 00000100:00100000:0.0:1746155561.845572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.845644:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123591168 00000100:00100000:1.0:1746155561.845649:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123591168 00002000:00100000:1.0:1746155561.845669:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1376255) req@ffff88009526bb80 x1830976123591168/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.845677:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526bb80 with x1830976123591168 ext(1048576->1376255) 00010000:00010000:1.0:1746155561.845682:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 23 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155561.845694:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 23 pid: 4461 timeout: 790 lvb_type: 0 00002000:00010000:1.0:1746155561.845700:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009526bb80 00000100:00100000:1.0:1746155561.845851:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 663 00000100:00100000:1.0:1746155561.845858:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123591168:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155561.853808:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123591040:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8987us (9488us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155561.853818:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4408 00002000:00100000:3.0:1746155561.853827:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880095269c00 x1830976123591040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.853836:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269c00 with x1830976123591040 ext(0->1048575) 00002000:00010000:3.0:1746155561.853841:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095269c00 00000100:00100000:1.0:1746155561.856212:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123591168:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10346us (10633us total) trans 17179873117 rc 0/0 00000100:00100000:1.0:1746155561.856223:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 663 00002000:00100000:1.0:1746155561.856232:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1376255) req@ffff88009526bb80 x1830976123591168/t17179873117(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/448 e 0 to 0 dl 1746155572 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.856241:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526bb80 with x1830976123591168 ext(1048576->1376255) 00010000:00010000:1.0:1746155561.856250:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 25 pid: 4461 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746155561.856263:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746155561.856268:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009526bb80 00000100:00100000:0.0:1746155561.859642:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.859723:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123591296 00000100:00100000:3.0:1746155561.859731:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123591296 00010000:00010000:3.0:1746155561.859762:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155561.859803:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5848 00000100:00100000:3.0:1746155561.859811:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123591296:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.859823:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.859841:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155561.859851:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155561.859870:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a76ea00/0x844e5faceb5ea800 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10487 expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155561.859899:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.859901:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.859907:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1054b expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.859913:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1054b expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.859940:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1054b expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.859954:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124519552:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155561.860022:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.865280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.865381:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124519552:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155561.865401:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.865975:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976123591296:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6162us (6345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.865985:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5848 00000100:00100000:2.0:1746155561.866201:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123591424 00000100:00100000:2.0:1746155561.866207:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123591424 00000100:00100000:2.0:1746155561.866246:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11678 00000100:00100000:2.0:1746155561.866252:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:28953:x1830976123591424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155561.866266:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155561.866284:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8000/0x844e5faceb5ea8fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10552 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.866304:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155561.866305:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155561.866311:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8000/0x844e5faceb5ea8fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10552 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.866324:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8000/0x844e5faceb5ea8fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10552 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.866333:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4fd8000, rc 0) 00000100:00100000:2.0:1746155561.866361:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:28953:x1830976123591424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 109us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155561.866366:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11678 00000100:00100000:0.0:1746155561.869321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.869374:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123591680 00000100:00100000:1.0:1746155561.869381:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123591680 00002000:00100000:1.0:1746155561.869412:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009526a300 x1830976123591680/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.869421:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526a300 with x1830976123591680 ext(1048576->2097151) 00002000:00010000:1.0:1746155561.869426:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526a300 00000100:00100000:1.0:1746155561.869451:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4409 00000100:00100000:1.0:1746155561.869456:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123591680:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.871480:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.871924:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123591936 00000100:00100000:3.0:1746155561.871931:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123591936 00002000:00100000:3.0:1746155561.871961:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009526b800 x1830976123591936/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.871970:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526b800 with x1830976123591936 ext(1048576->2097151) 00002000:00010000:3.0:1746155561.871975:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526b800 00000100:00100000:3.0:1746155561.871997:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4410 00000100:00100000:3.0:1746155561.872004:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123591936:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.881525:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123591680:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12061us (12202us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155561.881536:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4409 00002000:00100000:0.0:1746155561.881546:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009526a300 x1830976123591680/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.881554:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526a300 with x1830976123591680 ext(1048576->2097151) 00002000:00010000:0.0:1746155561.881560:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526a300 00000100:00100000:3.0:1746155561.884996:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123591936:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12983us (13512us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155561.885006:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4410 00002000:00100000:3.0:1746155561.885015:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009526b800 x1830976123591936/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.885024:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526b800 with x1830976123591936 ext(1048576->2097151) 00002000:00010000:3.0:1746155561.885029:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526b800 00000100:00100000:0.0:1746155561.897612:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.897654:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.897675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.897703:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123592064 00000100:00100000:0.0:1746155561.897709:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123592064 00000100:00100000:0.0:1746155561.897741:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123592192 00000100:00100000:0.0:1746155561.897743:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123592192 00000100:00100000:0.0:1746155561.897756:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11679 00000100:00100000:0.0:1746155561.897762:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123592064:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155561.897776:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155561.897790:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6041a00/0x844e5faceb5ea903 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10559 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155561.897830:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124519680:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155561.897891:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.897917:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11680 00000100:00100000:0.0:1746155561.897922:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123592192:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155561.897929:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155561.897936:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6040400/0x844e5faceb5ea90a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10560 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.898018:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123592448 00000100:00100000:3.0:1746155561.898021:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123592448 00000100:00100000:3.0:1746155561.898054:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9922 00000100:00100000:3.0:1746155561.898059:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+313:28956:x1830976123592448:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155561.898069:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155561.898077:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136950200/0x844e5faceb5ea911 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10567 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.898141:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.898152:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f0 expref: 24 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.898159:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.898175:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f0 expref: 24 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.898189:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f0 expref: 24 pid: 27374 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155561.898197:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124519808:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155561.898231:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155561.898640:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124519936:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155561.899625:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.901125:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124519808:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155561.901146:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155561.901336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155561.901415:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124519680:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155561.901435:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6041a00/0x844e5faceb5ea903 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10559 expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155561.901451:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041a00/0x844e5faceb5ea903 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10559 expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155561.901463:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6041a00, rc 0) 00000100:00100000:1.0:1746155561.901640:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009018b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124519936:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155561.901655:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6040400/0x844e5faceb5ea90a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10560 expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.901664:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6040400/0x844e5faceb5ea90a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10560 expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155561.901675:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6040400, rc 0) 00000100:00100000:3.0:1746155561.901724:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123592576 00000100:00100000:3.0:1746155561.901729:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123592576 00010000:00010000:3.0:1746155561.901748:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f0 expref: 25 pid: 27374 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155561.901774:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5849 00000100:00100000:3.0:1746155561.901780:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+25:1961:x1830976123592576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.901790:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.901795:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f0 expref: 25 pid: 27374 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155561.901803:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f0 expref: 25 pid: 27374 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155561.901818:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009520bc00/0x844e5faceb5ea893 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f0 expref: 25 pid: 27374 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155561.901836:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155561.901839:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.901848:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.901854:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155561.901877:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155561.902032:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123592064:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4268us (4375us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155561.902038:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11679 00010000:00010000:2.0:1746155561.902069:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155561.902074:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155561.902087:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155561.902187:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136950200/0x844e5faceb5ea911 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10567 expref: 316 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.902197:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10567 expref: 315 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.902203:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155561.902205:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155561.902207:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136950c00, rc 0) 00000100:00100000:1.0:1746155561.902256:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123592192:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4333us (4579us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155561.902262:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11680 00000100:00100000:3.0:1746155561.902377:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+24:1961:x1830976123592576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 595us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.902383:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5849 00000100:00100000:2.0:1746155561.902688:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+315:28956:x1830976123592448:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4627us (5081us total) trans 8589943843 rc 0/0 00000100:00100000:2.0:1746155561.902694:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9922 00000100:00100000:1.0:1746155561.907250:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.907270:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.907291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.907321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.907339:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123592960 00000100:00100000:1.0:1746155561.907345:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123592960 00002000:00100000:1.0:1746155561.907380:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3432447) req@ffff88012cdec380 x1830976123592960/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 504/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.907388:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec380 with x1830976123592960 ext(2097152->3432447) 00002000:00010000:1.0:1746155561.907393:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdec380 00000100:00100000:1.0:1746155561.907405:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123593088 00000100:00100000:1.0:1746155561.907408:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123593088 00002000:00100000:1.0:1746155561.907417:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3432448->4194303) req@ffff88012cdeca80 x1830976123593088/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.907423:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeca80 with x1830976123593088 ext(3432448->4194303) 00002000:00010000:1.0:1746155561.907425:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdeca80 00000100:00100000:1.0:1746155561.907432:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123593472 00000100:00100000:1.0:1746155561.907433:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123593472 00002000:00100000:1.0:1746155561.907442:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3420160->4194303) req@ffff88012cdee680 x1830976123593472/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.907448:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdee680 with x1830976123593472 ext(3420160->4194303) 00002000:00010000:1.0:1746155561.907451:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdee680 00000100:00100000:1.0:1746155561.907457:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123593344 00000100:00100000:1.0:1746155561.907458:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123593344 00002000:00100000:1.0:1746155561.907466:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2371584->3420159) req@ffff88012cdee300 x1830976123593344/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.907471:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdee300 with x1830976123593344 ext(2371584->3420159) 00002000:00010000:1.0:1746155561.907474:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdee300 00000100:00100000:1.0:1746155561.907483:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4411 00000100:00100000:1.0:1746155561.907489:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123592960:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155561.908705:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4412 00000100:00100000:1.0:1746155561.908713:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123593088:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155561.909226:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4413 00000100:00100000:2.0:1746155561.909238:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123593472:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155561.909418:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4414 00000100:00100000:3.0:1746155561.909425:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123593344:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.917738:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155561.917768:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123593728 00000100:00100000:0.0:1746155561.917775:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123593728 00000100:00100000:0.0:1746155561.917825:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11681 00000100:00100000:0.0:1746155561.917833:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:28953:x1830976123593728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155561.917849:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155561.917865:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1056e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155561.917891:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155561.917899:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155561.917901:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155561.917904:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1056e expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155561.917928:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155561.918324:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 19 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746155561.918335:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124520064:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155561.918595:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d180 going to sleep for 11 seconds 00000100:00100000:1.0:1746155561.933848:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123592960:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26351us (26598us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155561.933858:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4411 00002000:00100000:1.0:1746155561.933868:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3432447) req@ffff88012cdec380 x1830976123592960/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 504/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.933877:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec380 with x1830976123592960 ext(2097152->3432447) 00010000:00010000:1.0:1746155561.933886:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 18 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155561.933898:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 18 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746155561.933905:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdec380 00000100:00100000:2.0:1746155561.936172:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124520064:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155561.936198:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1056e expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.936215:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e17400, rc 0) 00000100:00100000:2.0:1746155561.936262:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:28953:x1830976123593728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 18430us (18532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155561.936269:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11681 00000100:00100000:1.0:1746155561.936736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.936753:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123593856 00000100:00100000:1.0:1746155561.936759:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123593856 00002000:00100000:1.0:1746155561.936787:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2859008->3145727) req@ffff88012cdece00 x1830976123593856/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.936795:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdece00 with x1830976123593856 ext(2859008->3145727) 00010000:00010000:1.0:1746155561.936802:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 18 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155561.936812:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 18 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746155561.936818:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdece00 00000100:00100000:1.0:1746155561.936833:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 664 00000100:00100000:1.0:1746155561.936839:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123593856:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155561.937889:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123593472:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28649us (30593us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746155561.940120:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123593344:12345-192.168.202.51@tcp:3:cat.0 Request processed in 30688us (32790us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155561.940130:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4414 00002000:00100000:3.0:1746155561.940139:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (2371584->3420159) req@ffff88012cdee300 x1830976123593344/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155561.940147:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdee300 with x1830976123593344 ext(2371584->3420159) 00002000:00010000:3.0:1746155561.940151:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdee300 00000100:00100000:0.0:1746155561.940553:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123593088:12345-192.168.202.51@tcp:3:cat.0 Request processed in 31840us (33281us total) trans 0 rc 761856/761856 00000100:00100000:0.0:1746155561.940560:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4412 00002000:00100000:0.0:1746155561.940565:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3432448->4194303) req@ffff88012cdeca80 x1830976123593088/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155561.940572:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeca80 with x1830976123593088 ext(3432448->4194303) 00010000:00010000:0.0:1746155561.940578:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 18 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155561.940595:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 18 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:0.0:1746155561.940601:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdeca80 00000100:00100000:2.0:1746155561.940749:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4413 00002000:00100000:2.0:1746155561.940756:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3420160->4194303) req@ffff88012cdee680 x1830976123593472/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155561.940763:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdee680 with x1830976123593472 ext(3420160->4194303) 00002000:00010000:2.0:1746155561.940766:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdee680 00000100:00100000:0.0:1746155561.954024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155561.954083:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123593984 00000100:00100000:2.0:1746155561.954090:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123593984 00000100:00100000:2.0:1746155561.954126:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11682 00000100:00100000:2.0:1746155561.954132:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:28948:x1830976123593984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155561.954146:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155561.954160:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10575 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.954183:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155561.954185:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155561.954189:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10575 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.954199:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10575 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155561.954208:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe2c00, rc 0) 00000100:00100000:2.0:1746155561.954245:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:28948:x1830976123593984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 113us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155561.954251:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11682 00000100:00100000:1.0:1746155561.955726:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123593856:12345-192.168.202.51@tcp:4:cat.0 Request processed in 18883us (18988us total) trans 21474840499 rc 0/0 00000100:00100000:1.0:1746155561.955734:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 664 00002000:00100000:1.0:1746155561.955742:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2859008->3145727) req@ffff88012cdece00 x1830976123593856/t21474840499(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/448 e 0 to 0 dl 1746155572 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.955749:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdece00 with x1830976123593856 ext(2859008->3145727) 00010000:00010000:1.0:1746155561.955756:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 19 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155561.955766:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 19 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746155561.955771:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdece00 00000100:00100000:0.0:1746155561.970568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155561.970680:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123594112 00000100:00100000:3.0:1746155561.970687:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123594112 00010000:00010000:3.0:1746155561.970718:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 19 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155561.970741:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5850 00000100:00100000:3.0:1746155561.970747:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123594112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155561.970758:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155561.970774:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 19 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155561.970784:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 19 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155561.970803:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130886400/0x844e5faceb5ea89a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2859008->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104f7 expref: 19 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155561.970834:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.970836:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.970842:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1056e expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.970848:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1056e expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.970854:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.970855:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155561.970858:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10575 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.970863:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10575 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155561.970887:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10575 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.970897:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124520192:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155561.970973:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1056e expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155561.970980:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124520320:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155561.970996:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155561.973479:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124520192:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155561.973488:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124520320:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155561.973529:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155561.973568:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123594112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2820us (3007us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155561.973576:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5850 00000100:00100000:0.0:1746155561.977037:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155561.977114:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123594368 00000100:00100000:1.0:1746155561.977121:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123594368 00002000:00100000:1.0:1746155561.977155:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009018b100 x1830976123594368/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.977168:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018b100 with x1830976123594368 ext(2097152->3145727) 00002000:00010000:1.0:1746155561.977173:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009018b100 00000100:00100000:1.0:1746155561.977198:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4415 00000100:00100000:1.0:1746155561.977205:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123594368:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155561.983137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155561.987157:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123594624 00000100:00100000:2.0:1746155561.987169:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123594624 00002000:00100000:2.0:1746155561.987206:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880090188000 x1830976123594624/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/0 e 0 to 0 dl 1746155572 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155561.987215:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090188000 with x1830976123594624 ext(3145728->4194303) 00002000:00010000:2.0:1746155561.987219:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090188000 00000100:00100000:2.0:1746155561.987245:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4416 00000100:00100000:2.0:1746155561.987252:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123594624:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155561.989680:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123594368:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12467us (12642us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155561.989690:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4415 00002000:00100000:1.0:1746155561.989700:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009018b100 x1830976123594368/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155561.989708:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018b100 with x1830976123594368 ext(2097152->3145727) 00002000:00010000:1.0:1746155561.989713:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009018b100 00000100:00100000:1.0:1746155562.007211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.007718:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123594752 00000100:00100000:2.0:1746155562.007726:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123594752 00000100:00080000:1.0:1746155562.007839:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155562.007950:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11683 00000100:00100000:2.0:1746155562.007959:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:28953:x1830976123594752:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.007974:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.007990:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1057c expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.008020:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.008028:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155562.008029:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155562.008033:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1057c expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.008060:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.008071:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 17 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.008081:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124520448:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.009108:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.012677:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124520448:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.012702:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1057c expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.012717:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe3e00, rc 0) 00000100:00100000:3.0:1746155562.013172:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:28953:x1830976123594752:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5212us (5965us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.013180:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11683 00000100:00100000:0.0:1746155562.014398:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.014480:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123594880 00000100:00100000:0.0:1746155562.014486:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123594880 00002000:00100000:0.0:1746155562.014532:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2371583) req@ffff88009486bb80 x1830976123594880/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.014539:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486bb80 with x1830976123594880 ext(2097152->2371583) 00010000:00010000:0.0:1746155562.014546:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 18 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.014557:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 18 pid: 29728 timeout: 791 lvb_type: 0 00002000:00010000:0.0:1746155562.014562:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009486bb80 00000100:00100000:0.0:1746155562.014582:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 665 00000100:00100000:0.0:1746155562.014589:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123594880:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155562.015550:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123594624:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28293us (32416us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.015558:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4416 00002000:00100000:2.0:1746155562.015565:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880090188000 x1830976123594624/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:632/0 lens 488/440 e 0 to 0 dl 1746155572 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.015572:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090188000 with x1830976123594624 ext(3145728->4194303) 00002000:00010000:2.0:1746155562.015576:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090188000 00000100:00100000:0.0:1746155562.020803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.021147:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123595008 00000100:00100000:3.0:1746155562.021155:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123595008 00000100:00100000:3.0:1746155562.021189:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11684 00000100:00100000:3.0:1746155562.021195:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:28948:x1830976123595008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155562.021211:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.021226:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10583 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.021248:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155562.021249:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155562.021253:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10583 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.021264:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10583 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.021273:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136951e00, rc 0) 00000100:00100000:3.0:1746155562.023123:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:28948:x1830976123595008:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1923us (2321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.023131:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11684 00000100:00100000:0.0:1746155562.023977:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123594880:12345-192.168.202.51@tcp:4:cat.0 Request processed in 9386us (9578us total) trans 17179873118 rc 0/0 00000100:00100000:0.0:1746155562.023985:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 665 00002000:00100000:0.0:1746155562.023993:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2371583) req@ffff88009486bb80 x1830976123594880/t17179873118(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/448 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.024001:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486bb80 with x1830976123594880 ext(2097152->2371583) 00010000:00010000:0.0:1746155562.024008:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 21 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.024019:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 21 pid: 29728 timeout: 791 lvb_type: 0 00002000:00010000:0.0:1746155562.024025:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009486bb80 00000100:00100000:0.0:1746155562.027772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.027843:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123595136 00000100:00100000:3.0:1746155562.027849:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123595136 00010000:00010000:3.0:1746155562.027877:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 21 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.027910:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5851 00000100:00100000:3.0:1746155562.027917:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123595136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155562.027929:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155562.027947:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 21 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.027958:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 21 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.027975:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbeac00/0x844e5faceb5ea8d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2371583) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1052f expref: 21 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.028001:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.028003:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.028009:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1057c expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.028016:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1057c expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.028022:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.028023:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.028026:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10583 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.028031:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10583 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.028057:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10583 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.028129:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124520576:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155562.028461:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1057c expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.028469:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124520704:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155562.028753:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.029707:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124520576:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155562.035454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.036217:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124520704:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155562.036240:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.036289:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123595136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8370us (8521us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.036299:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5851 00000100:00100000:1.0:1746155562.037044:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123595392 00000100:00100000:1.0:1746155562.037051:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123595392 00002000:00100000:1.0:1746155562.037090:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800a0a88000 x1830976123595392/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.037109:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a88000 with x1830976123595392 ext(3145728->4194303) 00002000:00010000:1.0:1746155562.037114:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a88000 00000100:00100000:1.0:1746155562.037624:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4417 00000100:00100000:1.0:1746155562.037645:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123595392:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155562.039795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.039826:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.039866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.039918:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123595648 00000100:00100000:0.0:1746155562.039926:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123595648 00002000:00100000:0.0:1746155562.039961:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a0a8a680 x1830976123595648/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.039969:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a8a680 with x1830976123595648 ext(2097152->3145727) 00002000:00010000:0.0:1746155562.039974:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a8a680 00000100:00100000:0.0:1746155562.040004:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123595904 00000100:00100000:0.0:1746155562.040009:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123595904 00002000:00100000:0.0:1746155562.040025:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800a0a88380 x1830976123595904/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.040038:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a88380 with x1830976123595904 ext(3145728->4194303) 00002000:00010000:0.0:1746155562.040040:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a88380 00000100:00100000:0.0:1746155562.040049:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123596160 00000100:00100000:0.0:1746155562.040051:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123596160 00002000:00100000:0.0:1746155562.040072:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800a0a89f80 x1830976123596160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.040078:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a89f80 with x1830976123596160 ext(3145728->4194303) 00002000:00010000:0.0:1746155562.040081:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a89f80 00000100:00100000:0.0:1746155562.040105:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4418 00000100:00100000:0.0:1746155562.040113:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123595648:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155562.041476:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4419 00000100:00100000:0.0:1746155562.041485:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123595904:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155562.041840:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4420 00000100:00100000:3.0:1746155562.041848:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123596160:12345-192.168.202.51@tcp:3:cat.0 00000100:00080000:1.0:1746155562.042148:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155562.060773:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123595648:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20652us (20974us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.060786:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4418 00002000:00100000:2.0:1746155562.060796:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a0a8a680 x1830976123595648/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.060805:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a8a680 with x1830976123595648 ext(2097152->3145727) 00002000:00010000:2.0:1746155562.060810:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a8a680 00000100:00100000:3.0:1746155562.062795:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123596160:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20941us (22923us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155562.062803:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4420 00002000:00100000:3.0:1746155562.062811:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800a0a89f80 x1830976123596160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.062819:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a89f80 with x1830976123596160 ext(3145728->4194303) 00002000:00010000:3.0:1746155562.062823:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a89f80 00000100:00100000:0.0:1746155562.071245:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123595392:12345-192.168.202.51@tcp:3:cat.0 Request processed in 33595us (35792us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155562.071255:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4417 00002000:00100000:0.0:1746155562.071264:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800a0a88000 x1830976123595392/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.071273:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a88000 with x1830976123595392 ext(3145728->4194303) 00002000:00010000:0.0:1746155562.071279:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a88000 00000100:00100000:3.0:1746155562.071383:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123595904:12345-192.168.202.51@tcp:3:cat.0 Request processed in 29898us (31556us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155562.071390:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4419 00002000:00100000:3.0:1746155562.071397:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800a0a88380 x1830976123595904/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.071404:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a88380 with x1830976123595904 ext(3145728->4194303) 00002000:00010000:3.0:1746155562.071407:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a88380 00000100:00100000:0.0:1746155562.081814:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.081870:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123596416 00000100:00100000:2.0:1746155562.081878:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123596416 00000100:00100000:2.0:1746155562.081922:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9923 00000100:00100000:2.0:1746155562.081928:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+34:28958:x1830976123596416:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155562.081949:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.081966:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3400/0x844e5faceb5ea942 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1058a expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.082038:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ea949 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.082049:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ea949 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.082057:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ea949 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155562.082065:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155562.082142:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3400/0x844e5faceb5ea942 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1058a expref: 37 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.083025:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ea949 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1058a expref: 36 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.083038:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.083040:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155562.083043:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe3a00, rc 0) 00000100:00100000:2.0:1746155562.083643:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:28958:x1830976123596416:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1712us (1834us total) trans 8589943844 rc 0/0 00000100:00100000:2.0:1746155562.083650:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9923 00000100:00100000:3.0:1746155562.083737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.083817:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.083845:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.083859:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123597056 00000100:00100000:3.0:1746155562.083863:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123597056 00000100:00100000:3.0:1746155562.083883:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11685 00000100:00100000:3.0:1746155562.083888:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:28956:x1830976123597056:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155562.083898:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.083909:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10591 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.083928:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131443e00/0x844e5faceb5ea7dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10464 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.083936:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbebe00/0x844e5faceb5ea862 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104d4 expref: 6 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.083942:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39800/0x844e5faceb5ea80e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10495 expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.083947:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.083949:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.083952:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1343488->2097151] (req 1343488->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.083974:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb39800/0x844e5faceb5ea80e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10495 expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.083985:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb39800/0x844e5faceb5ea80e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10495 expref: 24 pid: 8437 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746155562.083993:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123596672 00000100:00100000:3.0:1746155562.083995:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124520832:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155562.083997:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123596672 00002000:00100000:0.0:1746155562.084042:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88008e26f100 x1830976123596672/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.084050:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26f100 with x1830976123596672 ext(4194304->4956159) 00010000:00010000:3.0:1746155562.084053:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbebe00/0x844e5faceb5ea862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104d4 expref: 6 pid: 18270 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746155562.084054:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26f100 00010000:00010000:3.0:1746155562.084060:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbebe00/0x844e5faceb5ea862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104d4 expref: 6 pid: 18270 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746155562.084066:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123596928 00000100:00100000:3.0:1746155562.084067:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124520960:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155562.084069:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123596928 00002000:00100000:0.0:1746155562.084080:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88008e26ed80 x1830976123596928/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.084085:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26ed80 with x1830976123596928 ext(4194304->4956159) 00002000:00010000:0.0:1746155562.084088:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26ed80 00010000:00010000:3.0:1746155562.084089:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131443e00/0x844e5faceb5ea7dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10464 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.084096:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131443e00/0x844e5faceb5ea7dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10464 expref: 18 pid: 8437 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746155562.084096:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4421 00000100:00100000:0.0:1746155562.084101:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123596672:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155562.084102:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124521088:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155562.084113:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.084127:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4422 00000100:00100000:3.0:1746155562.084131:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123596928:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155562.089624:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124520832:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155562.089651:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124520960:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155562.096108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.096550:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124521088:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.096584:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1343488->2097151] (req 1343488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.096601:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136950e00, rc 0) 00000100:00100000:2.0:1746155562.097455:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123597312 00000100:00100000:2.0:1746155562.097462:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123597312 00010000:00010000:2.0:1746155562.097490:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb39800/0x844e5faceb5ea80e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10495 expref: 27 pid: 8437 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746155562.097789:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:28956:x1830976123597056:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 13898us (13940us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.097797:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11685 00000100:00100000:2.0:1746155562.097961:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5852 00000100:00100000:2.0:1746155562.097967:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123597312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.097979:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.097996:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb39800/0x844e5faceb5ea80e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10495 expref: 26 pid: 8437 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746155562.098006:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb39800/0x844e5faceb5ea80e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10495 expref: 26 pid: 8437 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746155562.098022:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39800/0x844e5faceb5ea80e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10495 expref: 26 pid: 8437 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746155562.098035:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.098075:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123597312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 109us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.098080:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5852 00000100:00100000:3.0:1746155562.098226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.098239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.098736:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123596672:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14634us (14998us total) trans 0 rc 761856/761856 00000100:00100000:0.0:1746155562.098743:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4421 00002000:00100000:0.0:1746155562.098750:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88008e26f100 x1830976123596672/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.098758:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26f100 with x1830976123596672 ext(4194304->4956159) 00002000:00010000:0.0:1746155562.098761:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26f100 00010000:00010000:3.0:1746155562.098994:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746155562.099293:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123597184 00000100:00100000:2.0:1746155562.099297:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123597184 00010000:00010000:2.0:1746155562.099326:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbebe00/0x844e5faceb5ea862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104d4 expref: 7 pid: 18270 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746155562.099346:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123597440 00000100:00100000:2.0:1746155562.099348:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123597440 00010000:00010000:2.0:1746155562.099355:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131443e00/0x844e5faceb5ea7dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10464 expref: 18 pid: 8437 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.099366:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5853 00000100:00100000:2.0:1746155562.099370:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123597184:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.099379:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.099388:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbebe00/0x844e5faceb5ea862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104d4 expref: 7 pid: 18270 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746155562.099396:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbebe00/0x844e5faceb5ea862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104d4 expref: 7 pid: 18270 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746155562.099407:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbebe00/0x844e5faceb5ea862 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104d4 expref: 7 pid: 18270 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746155562.099416:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.099432:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1962:x1830976123597184:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 61us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.099439:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5853 00000100:00100000:2.0:1746155562.099447:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5854 00000100:00100000:2.0:1746155562.099450:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123597440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.099455:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.099460:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131443e00/0x844e5faceb5ea7dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10464 expref: 18 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.099466:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131443e00/0x844e5faceb5ea7dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10464 expref: 18 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.099475:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131443e00/0x844e5faceb5ea7dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10464 expref: 18 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.099481:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.099483:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.099488:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.099494:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.099532:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.099540:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124521216:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155562.099579:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd9c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746155562.099689:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155562.101814:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123596928:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17675us (17989us total) trans 0 rc 761856/761856 00000100:00100000:0.0:1746155562.101824:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4422 00002000:00100000:0.0:1746155562.101833:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88008e26ed80 x1830976123596928/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.101847:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26ed80 with x1830976123596928 ext(4194304->4956159) 00002000:00010000:0.0:1746155562.101852:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26ed80 00000100:00100000:3.0:1746155562.102110:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124521216:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155562.102124:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.102146:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123597440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2694us (3905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.102153:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5854 00000100:00100000:0.0:1746155562.103437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.103873:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123597696 00000100:00100000:3.0:1746155562.103879:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123597696 00000100:00100000:3.0:1746155562.103909:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11686 00000100:00100000:3.0:1746155562.103915:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123597696:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155562.103927:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.103942:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009048ee00/0x844e5faceb5ea95e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10598 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.103983:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124521344:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155562.104981:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.111298:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.111426:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123597824 00000100:00100000:0.0:1746155562.111433:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123597824 00002000:00100000:0.0:1746155562.111465:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1343488->1347583) req@ffff88009f244000 x1830976123597824/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.111474:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f244000 with x1830976123597824 ext(1343488->1347583) 00002000:00010000:0.0:1746155562.111479:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f244000 00000100:00100000:0.0:1746155562.111493:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4423 00000100:00100000:0.0:1746155562.111499:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123597824:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155562.111667:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123597824:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 167us (376us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155562.111673:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4423 00002000:00100000:0.0:1746155562.111678:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1343488->1347583) req@ffff88009f244000 x1830976123597824/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.111684:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f244000 with x1830976123597824 ext(1343488->1347583) 00002000:00010000:0.0:1746155562.111687:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f244000 00002000:00010000:3.0:1746155562.111759:0:4461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155561 -> 1746155562 00002000:00010000:3.0:1746155562.111762:0:4461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155561 -> 1746155562 00002000:00010000:3.0:1746155562.111763:0:4461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155561 -> 1746155562 00000100:00100000:3.0:1746155562.111772:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124521344:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155562.111797:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009048ee00/0x844e5faceb5ea95e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10598 expref: 18 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.111808:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009048ee00/0x844e5faceb5ea95e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10598 expref: 18 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.111818:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009048ee00, rc 0) 00000100:00100000:3.0:1746155562.111835:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123597696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7921us (8401us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155562.111840:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11686 00000100:00100000:0.0:1746155562.122385:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.122431:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.122484:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123597952 00000100:00100000:2.0:1746155562.122492:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123597952 00000100:00100000:2.0:1746155562.122563:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123598080 00000100:00100000:2.0:1746155562.122566:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123598080 00000100:00100000:2.0:1746155562.122590:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11687 00000100:00100000:2.0:1746155562.122597:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:28956:x1830976123597952:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155562.122612:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.122633:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1059f expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.122658:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1056e expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.122666:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10575 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.122672:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.122673:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.122676:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->2236415] (req 2097152->2236415) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.122700:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10575 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.122710:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10575 expref: 17 pid: 8437 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.122721:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124521472:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.122803:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1056e expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.122811:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1056e expref: 24 pid: 8437 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.122818:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124521600:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.122834:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.122848:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11688 00000100:00100000:2.0:1746155562.122853:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123598080:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.122860:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.122866:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136951800/0x844e5faceb5ea96c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105a6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.122952:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124521728:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155562.122973:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.126397:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124521472:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.129019:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124521600:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.129048:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->2236415] (req 2097152->2236415) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.129121:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124521728:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155562.129140:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136951800/0x844e5faceb5ea96c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105a6 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.129150:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136951800/0x844e5faceb5ea96c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105a6 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.129174:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136951800, rc 0) 00010000:00010000:2.0:1746155562.130262:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe2000, rc 0) 00000100:00100000:3.0:1746155562.130319:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123598080:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7459us (7881us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155562.130342:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11688 00000100:00100000:2.0:1746155562.130573:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:28956:x1830976123597952:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7977us (8195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.130583:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11687 00000100:00100000:0.0:1746155562.139377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.139430:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.139531:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123598336 00000100:00100000:1.0:1746155562.139531:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123598208 00000100:00100000:3.0:1746155562.139538:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123598336 00000100:00100000:1.0:1746155562.139539:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123598208 00010000:00010000:3.0:1746155562.139569:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10575 expref: 17 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.139569:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1056e expref: 24 pid: 8437 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.139641:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5855 00000100:00100000:1.0:1746155562.139648:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123598208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155562.139661:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155562.139679:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1056e expref: 24 pid: 8437 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.139682:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5856 00000100:00100000:3.0:1746155562.139689:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123598336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155562.139689:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1056e expref: 24 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.139697:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155562.139707:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10575 expref: 17 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.139707:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17400/0x844e5faceb5ea926 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1056e expref: 24 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.139716:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10575 expref: 17 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.139728:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5ea92d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10575 expref: 17 pid: 8437 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.139741:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.139743:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.139749:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.139756:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.139795:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.139805:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124521856:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155562.140109:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.140792:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.141090:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123598208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1440us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.141098:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5855 00000100:00100000:3.0:1746155562.144720:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124521856:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155562.144740:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.144772:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123598336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5083us (5341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.144780:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5856 00000100:00100000:0.0:1746155562.146894:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.148700:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123598592 00000100:00100000:1.0:1746155562.148711:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123598592 00002000:00100000:1.0:1746155562.148753:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2232320->2236415) req@ffff8800a0a88e00 x1830976123598592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.148761:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a88e00 with x1830976123598592 ext(2232320->2236415) 00002000:00010000:1.0:1746155562.148767:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a88e00 00000100:00100000:1.0:1746155562.148795:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4424 00000100:00100000:1.0:1746155562.148803:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123598592:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155562.148963:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123598592:12345-192.168.202.51@tcp:3:cat.0 Request processed in 160us (2074us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155562.148969:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4424 00002000:00100000:1.0:1746155562.148974:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2232320->2236415) req@ffff8800a0a88e00 x1830976123598592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.148980:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a88e00 with x1830976123598592 ext(2232320->2236415) 00002000:00010000:1.0:1746155562.148982:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a88e00 00000100:00100000:0.0:1746155562.213740:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.213860:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123598720 00000100:00100000:2.0:1746155562.213868:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123598720 00000100:00100000:2.0:1746155562.213918:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11689 00000100:00100000:2.0:1746155562.213926:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+16:28958:x1830976123598720:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155562.213942:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.213955:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105ad expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.213978:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 22 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.213984:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155562.213985:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155562.213988:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [4132864->4194303] (req 4132864->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.214010:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 22 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.214018:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 22 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.214027:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124521984:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.214099:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.215191:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124521984:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.215210:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [4132864->4194303] (req 4132864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.215221:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136951200, rc 0) 00000100:00100000:2.0:1746155562.215259:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:28958:x1830976123598720:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1333us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.215265:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11689 00000100:00100000:0.0:1746155562.216737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.217415:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123598848 00000100:00100000:1.0:1746155562.217422:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123598848 00002000:00100000:1.0:1746155562.217457:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2236415) req@ffff880131496300 x1830976123598848/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.217465:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496300 with x1830976123598848 ext(2097152->2236415) 00010000:00010000:1.0:1746155562.217472:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 23 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.217484:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 23 pid: 29728 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746155562.217490:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131496300 00000100:00100000:1.0:1746155562.217740:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 666 00000100:00100000:1.0:1746155562.217746:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123598848:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155562.223614:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123598848:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5859us (6872us total) trans 21474840500 rc 0/0 00000100:00100000:1.0:1746155562.223634:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 666 00002000:00100000:1.0:1746155562.223644:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2236415) req@ffff880131496300 x1830976123598848/t21474840500(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/448 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.223651:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496300 with x1830976123598848 ext(2097152->2236415) 00010000:00010000:1.0:1746155562.223660:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 25 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.223673:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 25 pid: 29728 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746155562.223679:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131496300 00000100:00100000:0.0:1746155562.228203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.228285:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123598976 00000100:00100000:3.0:1746155562.228291:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123598976 00010000:00010000:3.0:1746155562.228319:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 25 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.228492:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5857 00000100:00100000:3.0:1746155562.228500:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123598976:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155562.228545:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155562.228563:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 25 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.228572:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 25 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.228594:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe2000/0x844e5faceb5ea965 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2236415) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1059f expref: 25 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.228622:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.228632:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.228638:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.228645:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.228675:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.228690:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124522112:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155562.228757:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.231170:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124522112:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155562.231189:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.232594:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123598976:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3107us (3409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.232607:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5857 00000100:00100000:0.0:1746155562.234448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.235540:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123599232 00000100:00100000:1.0:1746155562.235548:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123599232 00002000:00100000:1.0:1746155562.235583:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4132864->4136959) req@ffff880131494a80 x1830976123599232/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.235593:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494a80 with x1830976123599232 ext(4132864->4136959) 00002000:00010000:1.0:1746155562.235597:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131494a80 00000100:00100000:1.0:1746155562.235616:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4425 00000100:00100000:1.0:1746155562.235622:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123599232:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155562.235778:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123599232:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 155us (1334us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155562.235784:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4425 00002000:00100000:1.0:1746155562.235789:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4132864->4136959) req@ffff880131494a80 x1830976123599232/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.235802:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494a80 with x1830976123599232 ext(4132864->4136959) 00002000:00010000:1.0:1746155562.235804:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131494a80 00000100:00100000:0.0:1746155562.241137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.241556:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123599360 00000100:00100000:2.0:1746155562.241564:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123599360 00000100:00100000:2.0:1746155562.241612:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11690 00000100:00100000:2.0:1746155562.241619:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+20:28958:x1830976123599360:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155562.241643:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.241658:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105b4 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.241682:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1057c expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.241689:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10583 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.241694:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.241695:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.241698:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->3940351] (req 3145728->3940351) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.241722:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10583 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.241733:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10583 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.241743:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124522240:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.241824:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1057c expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.241832:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1057c expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.241839:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124522368:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.241855:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.243722:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124522240:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.243732:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124522368:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.243754:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->3940351] (req 3145728->3940351) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.243765:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136951000, rc 0) 00000100:00100000:2.0:1746155562.243795:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+21:28958:x1830976123599360:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2176us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.243802:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11690 00000100:00100000:0.0:1746155562.246266:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.246324:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123599488 00000100:00100000:3.0:1746155562.246333:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123599488 00010000:00010000:3.0:1746155562.246370:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10583 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.246427:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5858 00000100:00100000:3.0:1746155562.246441:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123599488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155562.246458:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155562.246482:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10583 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.246497:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10583 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.246564:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5ea93b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10583 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.246592:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.246636:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123599488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 198us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.246642:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5858 00000100:00100000:1.0:1746155562.247130:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.247216:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123599616 00000100:00100000:0.0:1746155562.247220:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123599616 00010000:00010000:0.0:1746155562.247235:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1057c expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746155562.248380:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5859 00000100:00100000:0.0:1746155562.248389:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123599616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155562.248399:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155562.248415:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1057c expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.248426:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1057c expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.248440:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ea934 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1057c expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.248461:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.248463:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.248470:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.248477:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.248518:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.248528:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124522496:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155562.251609:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.255550:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124522496:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155562.255569:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155562.255614:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123599616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7226us (8484us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.255632:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5859 00000100:00100000:0.0:1746155562.260029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.260703:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.260781:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123599872 00000100:00100000:1.0:1746155562.260789:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123599872 00002000:00100000:1.0:1746155562.260823:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3936256->3940351) req@ffff880131494e00 x1830976123599872/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.260832:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494e00 with x1830976123599872 ext(3936256->3940351) 00002000:00010000:1.0:1746155562.260836:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494e00 00000100:00100000:1.0:1746155562.260857:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4426 00000100:00100000:1.0:1746155562.260863:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123599872:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155562.261006:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123599872:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 142us (985us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155562.261012:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4426 00002000:00100000:1.0:1746155562.261017:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3936256->3940351) req@ffff880131494e00 x1830976123599872/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.261024:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494e00 with x1830976123599872 ext(3936256->3940351) 00002000:00010000:1.0:1746155562.261027:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494e00 00000100:00100000:2.0:1746155562.261601:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123600000 00000100:00100000:2.0:1746155562.261605:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123600000 00000100:00100000:2.0:1746155562.261643:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11691 00000100:00100000:2.0:1746155562.261648:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123600000:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.261657:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.261673:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136951800/0x844e5faceb5ea981 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105bb expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.261715:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124522624:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155562.261778:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.264567:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124522624:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155562.264590:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136951800/0x844e5faceb5ea981 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105bb expref: 18 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.264601:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136951800/0x844e5faceb5ea981 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105bb expref: 18 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.264619:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136951800, rc 0) 00000100:00100000:2.0:1746155562.264668:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123600000:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3018us (3964us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155562.264674:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11691 00000100:00100000:0.0:1746155562.270786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.271550:0:14231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123600128 00000100:00100000:1.0:1746155562.271558:0:14231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123600128 00000100:00100000:1.0:1746155562.271599:0:14231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 165 00000100:00100000:1.0:1746155562.271606:0:14231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06793f43-a06c-4add-b66d-476e36bacde6+15:1961:x1830976123600128:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:1.0:1746155562.271921:0:14231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06793f43-a06c-4add-b66d-476e36bacde6+15:1961:x1830976123600128:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 314us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.271928:0:14231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 165 00000100:00100000:0.0:1746155562.272461:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.273445:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123600256 00000100:00100000:2.0:1746155562.273450:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123600256 00000100:00100000:2.0:1746155562.273480:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11692 00000100:00100000:2.0:1746155562.273485:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:28965:x1830976123600256:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.273496:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.273520:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105c2 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.273544:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.273550:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155562.273552:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155562.273555:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c2 expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.273575:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.273584:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 23 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.273593:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124522752:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.273647:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.278731:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124522752:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.278762:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c2 expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.278778:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136951c00, rc 0) 00000100:00100000:0.0:1746155562.279096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.279328:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123600384 00000100:00100000:1.0:1746155562.279334:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123600384 00002000:00100000:1.0:1746155562.279372:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1343488->2097151) req@ffff880131495180 x1830976123600384/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.279380:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495180 with x1830976123600384 ext(1343488->2097151) 00010000:00010000:1.0:1746155562.279386:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 24 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.279397:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 24 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746155562.279403:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131495180 00000100:00100000:1.0:1746155562.279420:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 667 00000100:00100000:1.0:1746155562.279426:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123600384:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155562.279887:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+18:28965:x1830976123600256:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6399us (7433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.279894:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11692 00000100:00100000:1.0:1746155562.290451:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123600384:12345-192.168.202.51@tcp:4:cat.0 Request processed in 11017us (11348us total) trans 21474840501 rc 0/0 00000100:00100000:1.0:1746155562.290461:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 667 00002000:00100000:1.0:1746155562.290470:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1343488->2097151) req@ffff880131495180 x1830976123600384/t21474840501(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/448 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.290478:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495180 with x1830976123600384 ext(1343488->2097151) 00010000:00010000:1.0:1746155562.290486:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.290500:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746155562.290532:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131495180 00000100:00100000:0.0:1746155562.295659:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.295752:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123600512 00000100:00100000:1.0:1746155562.295760:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123600512 00010000:00010000:1.0:1746155562.295789:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.295828:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5860 00000100:00100000:1.0:1746155562.295835:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123600512:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155562.295847:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155562.295865:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.295875:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.295893:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5ea957 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10591 expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.295927:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.295929:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.295935:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c2 expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.295942:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c2 expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.295970:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c2 expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.295980:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124522880:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155562.296183:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.298215:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124522880:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155562.298231:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155562.298270:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123600512:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2435us (2621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.298279:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5860 00000100:00100000:0.0:1746155562.300436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.300891:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123600768 00000100:00100000:1.0:1746155562.300899:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123600768 00002000:00100000:1.0:1746155562.300935:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880131494000 x1830976123600768/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.300944:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494000 with x1830976123600768 ext(1048576->2097151) 00002000:00010000:1.0:1746155562.300949:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131494000 00000100:00100000:1.0:1746155562.300966:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4427 00000100:00100000:1.0:1746155562.300974:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123600768:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155562.309135:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123600768:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8153us (8697us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.309146:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4427 00002000:00100000:2.0:1746155562.309155:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880131494000 x1830976123600768/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.309164:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494000 with x1830976123600768 ext(1048576->2097151) 00002000:00010000:2.0:1746155562.309168:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131494000 00000100:00100000:0.0:1746155562.326931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.326972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.327004:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.327042:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.327767:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123601280 00000100:00100000:2.0:1746155562.327775:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123601280 00002000:00100000:2.0:1746155562.327815:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (3940352->4194303) req@ffff880131497800 x1830976123601280/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.327823:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497800 with x1830976123601280 ext(3940352->4194303) 00002000:00010000:2.0:1746155562.327828:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131497800 00000100:00100000:1.0:1746155562.327835:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123601152 00000100:00100000:1.0:1746155562.327839:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123601152 00000100:00100000:2.0:1746155562.327846:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123601664 00000100:00100000:2.0:1746155562.327849:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123601664 00002000:00100000:1.0:1746155562.327857:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880131497480 x1830976123601152/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.327862:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4132863) req@ffff88009f703800 x1830976123601664/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.327865:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497480 with x1830976123601152 ext(2097152->3145727) 00002000:00010000:1.0:1746155562.327868:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131497480 00002000:00100000:2.0:1746155562.327869:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703800 with x1830976123601664 ext(3145728->4132863) 00002000:00010000:2.0:1746155562.327872:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f703800 00000100:00100000:2.0:1746155562.328040:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123601536 00000100:00100000:2.0:1746155562.328043:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123601536 00002000:00100000:2.0:1746155562.328057:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009f701180 x1830976123601536/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155562.328058:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4428 00002000:00100000:2.0:1746155562.328063:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f701180 with x1830976123601536 ext(2097152->3145727) 00002000:00010000:2.0:1746155562.328066:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f701180 00000100:00100000:3.0:1746155562.328071:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4429 00000100:00100000:2.0:1746155562.328084:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4430 00000100:00100000:3.0:1746155562.328088:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4431 00000100:00100000:2.0:1746155562.328090:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123601664:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155562.328094:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976123601536:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155562.328138:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123601152:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155562.329802:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123601280:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155562.343283:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123601536:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15179us (16230us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155562.343296:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4431 00002000:00100000:3.0:1746155562.343306:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009f701180 x1830976123601536/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.343314:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f701180 with x1830976123601536 ext(2097152->3145727) 00002000:00010000:3.0:1746155562.343320:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f701180 00000100:00100000:2.0:1746155562.345249:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123601664:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17154us (18240us total) trans 0 rc 987136/987136 00000100:00100000:2.0:1746155562.345263:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4430 00002000:00100000:2.0:1746155562.345270:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4132863) req@ffff88009f703800 x1830976123601664/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 987136/987136 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.345278:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703800 with x1830976123601664 ext(3145728->4132863) 00002000:00010000:2.0:1746155562.345281:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f703800 00000100:00100000:0.0:1746155562.345564:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123601280:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17498us (18640us total) trans 0 rc 253952/253952 00000100:00100000:0.0:1746155562.345570:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4428 00002000:00100000:0.0:1746155562.345575:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3940352->4194303) req@ffff880131497800 x1830976123601280/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 253952/253952 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.345582:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497800 with x1830976123601280 ext(3940352->4194303) 00002000:00010000:0.0:1746155562.345585:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131497800 00000100:00100000:0.0:1746155562.348985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.349011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.349068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.349096:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123601920 00000100:00100000:0.0:1746155562.349102:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123601920 00000100:00100000:0.0:1746155562.349129:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123602048 00000100:00100000:0.0:1746155562.349130:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123602048 00000100:00100000:0.0:1746155562.349139:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123602176 00000100:00100000:0.0:1746155562.349140:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123602176 00000100:00100000:0.0:1746155562.349152:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11693 00000100:00100000:0.0:1746155562.349158:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123601920:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155562.349171:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155562.349184:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090d06800/0x844e5faceb5ea98f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105c9 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.349201:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.349202:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.349209:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090d06800/0x844e5faceb5ea98f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c9 expref: 27 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155562.349222:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090d06800/0x844e5faceb5ea98f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c9 expref: 27 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155562.349231:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090d06800, rc 0) 00000100:00100000:0.0:1746155562.349265:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123601920:12345-192.168.202.51@tcp:101:cat.0 Request processed in 106us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.349271:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11693 00000100:00100000:0.0:1746155562.349283:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11694 00000100:00100000:0.0:1746155562.349287:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123602048:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155562.349293:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155562.349295:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123601152:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21217us (22320us total) trans 0 rc 1048576/1048576 00010000:00010000:0.0:1746155562.349300:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ea996 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105d0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.349303:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4429 00002000:00100000:1.0:1746155562.349310:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880131497480 x1830976123601152/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.349317:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497480 with x1830976123601152 ext(2097152->3145727) 00002000:00010000:1.0:1746155562.349321:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131497480 00000100:00100000:0.0:1746155562.349331:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f702a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124523008:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155562.349341:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11695 00000100:00100000:1.0:1746155562.349347:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123602176:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155562.349354:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.349363:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcbaa00/0x844e5faceb5ea99d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105d7 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.349386:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.349387:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124523136:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155562.349407:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.355480:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f702a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124523008:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155562.355548:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ea996 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105d0 expref: 27 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.355560:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ea996 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105d0 expref: 27 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.355580:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090d06a00, rc 0) 00000100:00100000:2.0:1746155562.355638:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123602048:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6348us (6624us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155562.355645:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11694 00000100:00100000:1.0:1746155562.356146:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124523136:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155562.356164:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbaa00/0x844e5faceb5ea99d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105d7 expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.356172:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbaa00/0x844e5faceb5ea99d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105d7 expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.356183:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbaa00, rc 0) 00000100:00100000:1.0:1746155562.356209:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123602176:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6862us (7139us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155562.356215:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11695 00000100:00100000:0.0:1746155562.361344:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.361405:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123602432 00000100:00100000:1.0:1746155562.361413:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123602432 00002000:00100000:1.0:1746155562.361452:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009f700a80 x1830976123602432/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.361461:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700a80 with x1830976123602432 ext(4194304->4956159) 00002000:00010000:1.0:1746155562.361465:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f700a80 00000100:00100000:1.0:1746155562.361497:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4432 00000100:00100000:1.0:1746155562.361526:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123602432:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155562.366328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.367326:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123602688 00000100:00100000:2.0:1746155562.367334:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123602688 00002000:00100000:2.0:1746155562.367368:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009f700700 x1830976123602688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.367377:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700700 with x1830976123602688 ext(1048576->2097151) 00002000:00010000:2.0:1746155562.367382:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f700700 00000100:00100000:2.0:1746155562.367401:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4433 00000100:00100000:2.0:1746155562.367408:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123602688:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155562.368645:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123602432:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7138us (7304us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155562.368653:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4432 00002000:00100000:1.0:1746155562.368660:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009f700a80 x1830976123602432/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.368667:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700a80 with x1830976123602432 ext(4194304->4956159) 00002000:00010000:1.0:1746155562.368672:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f700a80 00000100:00100000:2.0:1746155562.386047:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123602688:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18630us (19718us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.386057:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4433 00002000:00100000:2.0:1746155562.386067:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009f700700 x1830976123602688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.386076:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700700 with x1830976123602688 ext(1048576->2097151) 00002000:00010000:2.0:1746155562.386081:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f700700 00000100:00100000:0.0:1746155562.393639:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.393688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.393713:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123602944 00000100:00100000:1.0:1746155562.393720:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123602944 00000100:00100000:2.0:1746155562.393741:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123602816 00000100:00100000:2.0:1746155562.393745:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123602816 00000100:00100000:1.0:1746155562.393775:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11696 00000100:00100000:1.0:1746155562.393783:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123602944:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155562.393802:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.393817:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6041a00/0x844e5faceb5ea9a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105e5 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.393859:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124523264:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155562.393927:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.395001:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11697 00000100:00100000:2.0:1746155562.395009:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123602816:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.395019:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.395029:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009374fe00/0x844e5faceb5ea9ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105de expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.395058:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124523392:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155562.395115:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.403366:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124523392:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155562.403418:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009374fe00/0x844e5faceb5ea9ab lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105de expref: 27 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.403434:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009374fe00/0x844e5faceb5ea9ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105de expref: 27 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.403481:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374fe00, rc 0) 00000100:00100000:2.0:1746155562.403568:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123602816:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8559us (9877us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155562.403575:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11697 00000100:00100000:1.0:1746155562.404079:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124523264:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155562.404097:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6041a00/0x844e5faceb5ea9a4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105e5 expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.404106:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6041a00/0x844e5faceb5ea9a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105e5 expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.404182:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6041a00, rc 0) 00000100:00100000:1.0:1746155562.404210:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123602944:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10426us (10585us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155562.404216:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11696 00000100:00100000:0.0:1746155562.407094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.407178:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123603072 00000100:00100000:1.0:1746155562.407186:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123603072 00000100:00100000:1.0:1746155562.407271:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11698 00000100:00100000:1.0:1746155562.407278:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:28969:x1830976123603072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155562.407293:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.407307:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105ec expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.407333:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.407340:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155562.407341:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155562.407344:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ec expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.407370:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.407382:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 17 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.407392:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124523520:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.408307:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155562.416079:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.416374:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124523520:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.416788:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ec expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.416805:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6040800, rc 0) 00000100:00100000:1.0:1746155562.416845:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:28969:x1830976123603072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9567us (9757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.416854:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11698 00000100:00100000:2.0:1746155562.417288:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123603200 00000100:00100000:2.0:1746155562.417295:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123603200 00002000:00100000:2.0:1746155562.417328:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4132864->4194303) req@ffff88009fb6bb80 x1830976123603200/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.417336:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6bb80 with x1830976123603200 ext(4132864->4194303) 00010000:00010000:2.0:1746155562.417343:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 18 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.417358:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 18 pid: 29728 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746155562.417364:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb6bb80 00000100:00100000:2.0:1746155562.417390:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 668 00000100:00100000:2.0:1746155562.417397:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123603200:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155562.421636:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123603200:12345-192.168.202.51@tcp:4:cat.0 Request processed in 4223us (5548us total) trans 21474840502 rc 0/0 00000100:00100000:2.0:1746155562.421646:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 668 00002000:00100000:2.0:1746155562.421655:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4132864->4194303) req@ffff88009fb6bb80 x1830976123603200/t21474840502(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/448 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.421669:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6bb80 with x1830976123603200 ext(4132864->4194303) 00010000:00010000:2.0:1746155562.421677:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 20 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.421689:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 20 pid: 29728 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746155562.421696:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb6bb80 00000100:00100000:0.0:1746155562.433118:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.433217:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123603328 00000100:00100000:1.0:1746155562.433224:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123603328 00010000:00010000:1.0:1746155562.433254:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 20 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.433348:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5861 00000100:00100000:1.0:1746155562.433355:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123603328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155562.433366:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155562.433385:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 20 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.433395:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 20 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.433413:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136951200/0x844e5faceb5ea973 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4132864->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ad expref: 20 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.433643:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.433645:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.433652:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ec expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.433660:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ec expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.434597:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ec expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.434611:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124523648:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155562.434685:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155562.451155:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.451224:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123603584 00000100:00100000:2.0:1746155562.451232:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123603584 00002000:00100000:2.0:1746155562.451269:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009fb68700 x1830976123603584/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.451276:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68700 with x1830976123603584 ext(2097152->3145727) 00002000:00010000:2.0:1746155562.451281:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb68700 00000100:00100000:2.0:1746155562.451297:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4434 00000100:00100000:2.0:1746155562.451305:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123603584:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155562.451465:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124523648:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155562.451482:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155562.451539:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123603328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 18183us (18427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.451548:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5861 00000100:00100000:2.0:1746155562.474536:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123603584:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23224us (23380us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.474546:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4434 00002000:00100000:2.0:1746155562.474555:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009fb68700 x1830976123603584/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.474564:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68700 with x1830976123603584 ext(2097152->3145727) 00002000:00010000:2.0:1746155562.474568:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb68700 00000100:00100000:0.0:1746155562.487965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.488975:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123603712 00000100:00100000:1.0:1746155562.488982:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123603712 00000100:00100000:1.0:1746155562.489031:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11699 00000100:00100000:1.0:1746155562.489038:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:28969:x1830976123603712:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155562.489054:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.489069:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105f3 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.489093:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.489100:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155562.489102:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155562.489105:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.489127:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.489143:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 19 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.489153:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124523776:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.489391:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.500863:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124523776:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.500891:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.500906:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f293800, rc 0) 00000100:00100000:1.0:1746155562.500942:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:28969:x1830976123603712:12345-192.168.202.51@tcp:101:cat.0 Request processed in 11903us (12983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.500949:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11699 00000100:00100000:0.0:1746155562.506230:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.506263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.506292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.506373:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123603968 00000100:00100000:3.0:1746155562.506381:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123603968 00000100:00100000:3.0:1746155562.506411:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123604096 00000100:00100000:3.0:1746155562.506412:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123604096 00000100:00100000:3.0:1746155562.506424:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11700 00000100:00100000:3.0:1746155562.506430:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123603968:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155562.506437:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123603840 00000100:00100000:2.0:1746155562.506442:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123603840 00010000:00010000:3.0:1746155562.506444:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.506457:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4c00/0x844e5faceb5ea9c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f105fa expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746155562.506467:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->3940351) req@ffff8800910da300 x1830976123603840/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746155562.506475:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.506476:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:2.0:1746155562.506476:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910da300 with x1830976123603840 ext(3145728->3940351) 00010000:00010000:3.0:1746155562.506483:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4c00/0x844e5faceb5ea9c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105fa expref: 20 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.506483:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 21 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.506495:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4c00/0x844e5faceb5ea9c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105fa expref: 20 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.506495:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 21 pid: 29728 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746155562.506521:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910da300 00010000:00010000:3.0:1746155562.506522:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b4c00, rc 0) 00000100:00100000:2.0:1746155562.506535:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 669 00000100:00100000:2.0:1746155562.506541:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123603840:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155562.506554:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123603968:12345-192.168.202.51@tcp:101:cat.0 Request processed in 124us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.506562:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11700 00000100:00100000:3.0:1746155562.506575:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11701 00000100:00100000:3.0:1746155562.506579:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123604096:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155562.506583:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.506590:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ea9c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10601 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.506615:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124523904:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155562.506667:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.514670:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124523904:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155562.514699:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ea9c7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10601 expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.514712:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ea9c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10601 expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.514725:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b5800, rc 0) 00000100:00100000:3.0:1746155562.514763:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123604096:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8181us (8468us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155562.514771:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11701 00000100:00100000:3.0:1746155562.527663:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123603840:12345-192.168.202.51@tcp:4:cat.0 Request processed in 21113us (21430us total) trans 17179873119 rc 0/0 00000100:00100000:3.0:1746155562.527673:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 669 00002000:00100000:3.0:1746155562.527682:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->3940351) req@ffff8800910da300 x1830976123603840/t17179873119(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/448 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.527690:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910da300 with x1830976123603840 ext(3145728->3940351) 00010000:00010000:3.0:1746155562.527698:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 22 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.527710:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 22 pid: 29728 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746155562.527717:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910da300 00000100:00100000:0.0:1746155562.532038:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.532107:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123604224 00000100:00100000:1.0:1746155562.532116:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123604224 00010000:00010000:1.0:1746155562.532147:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 22 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.532190:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5862 00000100:00100000:1.0:1746155562.532197:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123604224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155562.532208:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155562.532225:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 22 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.532240:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 22 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.532260:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136951000/0x844e5faceb5ea97a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3940351) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105b4 expref: 22 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.532287:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.532289:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.532295:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 25 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.532303:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 25 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.533286:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 25 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.533299:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124524032:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155562.533373:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155562.538224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.538388:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123604480 00000100:00100000:3.0:1746155562.538396:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123604480 00002000:00100000:3.0:1746155562.538430:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009ca95180 x1830976123604480/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.538439:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95180 with x1830976123604480 ext(2097152->3145727) 00002000:00010000:3.0:1746155562.538443:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca95180 00000100:00100000:1.0:1746155562.538640:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f244a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124524032:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155562.538659:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155562.539211:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123604224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7012us (7177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.539219:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5862 00000100:00100000:3.0:1746155562.539300:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4435 00000100:00100000:3.0:1746155562.539310:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123604480:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155562.551827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.551860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.552858:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123604736 00000100:00100000:2.0:1746155562.552867:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123604736 00000100:00100000:0.0:1746155562.552872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:2.0:1746155562.552920:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009ca96d80 x1830976123604736/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.552929:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96d80 with x1830976123604736 ext(2097152->3145727) 00002000:00010000:2.0:1746155562.552935:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca96d80 00000100:00100000:2.0:1746155562.552952:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123604992 00000100:00100000:2.0:1746155562.552954:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123604992 00002000:00100000:2.0:1746155562.552965:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009ca94380 x1830976123604992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.552971:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94380 with x1830976123604992 ext(3145728->4194303) 00002000:00010000:2.0:1746155562.552973:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca94380 00000100:00100000:2.0:1746155562.553650:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123605248 00000100:00100000:2.0:1746155562.553654:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123605248 00002000:00100000:2.0:1746155562.553669:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009ca97480 x1830976123605248/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.553676:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97480 with x1830976123605248 ext(3145728->4194303) 00002000:00010000:2.0:1746155562.553680:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca97480 00000100:00100000:1.0:1746155562.554138:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4436 00000100:00100000:1.0:1746155562.554147:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123604736:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155562.555815:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4437 00000100:00100000:2.0:1746155562.555825:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123604992:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155562.557089:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4438 00000100:00100000:3.0:1746155562.557099:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123605248:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155562.557322:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.557687:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123605376 00000100:00100000:3.0:1746155562.557693:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123605376 00000100:00100000:3.0:1746155562.557722:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11702 00000100:00100000:3.0:1746155562.557728:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:28973:x1830976123605376:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155562.557737:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.557751:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10608 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.557783:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.557791:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.557792:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.557795:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3792896->4194303] (req 3792896->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.557819:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.557829:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 28 pid: 20200 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.557838:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124524160:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155562.557884:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.566605:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124524160:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.566645:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3792896->4194303] (req 3792896->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.566660:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe64a00, rc 0) 00000100:00100000:3.0:1746155562.568175:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:28973:x1830976123605376:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 10440us (10847us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.568183:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11702 00000100:00100000:3.0:1746155562.570709:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123604480:12345-192.168.202.51@tcp:3:cat.0 Request processed in 31395us (32487us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155562.570718:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4435 00002000:00100000:3.0:1746155562.570726:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009ca95180 x1830976123604480/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.570734:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95180 with x1830976123604480 ext(2097152->3145727) 00002000:00010000:3.0:1746155562.570739:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca95180 00000100:00100000:2.0:1746155562.578121:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123604992:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22291us (26251us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.578131:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4437 00002000:00100000:2.0:1746155562.578141:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009ca94380 x1830976123604992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.578149:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94380 with x1830976123604992 ext(3145728->4194303) 00010000:00010000:2.0:1746155562.578158:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 28 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.578170:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 28 pid: 20200 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746155562.578176:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca94380 00000100:00100000:0.0:1746155562.580131:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123604736:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25978us (28307us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155562.580141:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4436 00002000:00100000:0.0:1746155562.580149:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009ca96d80 x1830976123604736/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.580162:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96d80 with x1830976123604736 ext(2097152->3145727) 00010000:00010000:0.0:1746155562.580170:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.580183:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00002000:00010000:0.0:1746155562.580189:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca96d80 00000100:00100000:1.0:1746155562.580767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.580839:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123605504 00000100:00100000:3.0:1746155562.580846:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123605504 00000100:00100000:3.0:1746155562.580873:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11703 00000100:00100000:3.0:1746155562.580878:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:28978:x1830976123605504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155562.580890:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155562.580909:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123605248:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23812us (28037us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155562.580915:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4438 00002000:00100000:0.0:1746155562.580921:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009ca97480 x1830976123605248/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.580927:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97480 with x1830976123605248 ext(3145728->4194303) 00002000:00010000:0.0:1746155562.580930:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca97480 00010000:00010000:3.0:1746155562.581178:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfc00/0x844e5faceb5ea9d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1060f expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.581200:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.581203:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.581208:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfc00/0x844e5faceb5ea9d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1060f expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.581220:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfc00/0x844e5faceb5ea9d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1060f expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.581230:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0dfc00, rc 0) 00000100:00100000:3.0:1746155562.581289:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+23:28978:x1830976123605504:12345-192.168.202.51@tcp:101:cat.0 Request processed in 407us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.581295:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11703 00000100:00100000:0.0:1746155562.588442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.589790:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.589888:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123605760 00000100:00100000:1.0:1746155562.589896:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123605760 00002000:00100000:1.0:1746155562.589943:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880094084e00 x1830976123605760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.589953:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094084e00 with x1830976123605760 ext(2097152->3145727) 00002000:00010000:1.0:1746155562.589958:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094084e00 00000100:00100000:1.0:1746155562.591039:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123606016 00000100:00100000:1.0:1746155562.591044:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123606016 00002000:00100000:1.0:1746155562.591060:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094085500 x1830976123606016/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.591067:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085500 with x1830976123606016 ext(3145728->4194303) 00002000:00010000:1.0:1746155562.591071:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094085500 00000100:00100000:0.0:1746155562.591956:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.591995:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.592020:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123606272 00000100:00100000:0.0:1746155562.592024:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123606272 00010000:00010000:0.0:1746155562.592050:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746155562.592072:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5863 00000100:00100000:0.0:1746155562.592080:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123606272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155562.592091:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155562.592114:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.592125:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.592142:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5ea9b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105f3 expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.592293:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4439 00000100:00100000:1.0:1746155562.592301:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123605760:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155562.592590:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4440 00000100:00100000:2.0:1746155562.592599:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123606016:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155562.593598:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123606144 00000100:00100000:2.0:1746155562.593605:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123606144 00000100:00100000:2.0:1746155562.593648:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11704 00000100:00100000:2.0:1746155562.593654:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:28969:x1830976123606144:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.593664:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.593674:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10616 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.593693:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.593698:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3792896->4194303] (req 3792896->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.593704:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155562.593706:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10616 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.593734:0:4461:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3792896->4194303] (req 3792896->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.593744:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10616 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.593752:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.593753:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.593757:0:4461:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.593764:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.593785:0:4461:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.593795:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 24 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.593805:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124524416:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155562.593847:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3900 going to sleep for 11 seconds 00010000:00010000:0.0:1746155562.593956:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155562.593983:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123606272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1903us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.593991:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5863 00000100:00100000:0.0:1746155562.601931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.601983:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123606528 00000100:00100000:3.0:1746155562.601990:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123606528 00002000:00100000:3.0:1746155562.602032:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (3792896->3796991) req@ffff880094085c00 x1830976123606528/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.602041:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085c00 with x1830976123606528 ext(3792896->3796991) 00010000:00010000:3.0:1746155562.602049:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.602061:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746155562.602067:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094085c00 00000100:00100000:3.0:1746155562.602088:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 670 00000100:00100000:3.0:1746155562.602095:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123606528:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155562.602223:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123606528:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 128us (301us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155562.602229:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 670 00002000:00100000:3.0:1746155562.602234:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3dc:0x0] (3792896->3796991) req@ffff880094085c00 x1830976123606528/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.602240:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085c00 with x1830976123606528 ext(3792896->3796991) 00010000:00010000:3.0:1746155562.602244:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.602252:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746155562.602261:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094085c00 00000100:00100000:1.0:1746155562.602494:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123605760:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10193us (14060us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155562.602520:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4439 00002000:00100000:1.0:1746155562.602527:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880094084e00 x1830976123605760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.602538:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094084e00 with x1830976123605760 ext(2097152->3145727) 00002000:00010000:1.0:1746155562.602542:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094084e00 00000100:00100000:3.0:1746155562.602564:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123606016:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9966us (12775us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155562.602569:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4440 00002000:00100000:3.0:1746155562.602574:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094085500 x1830976123606016/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.602580:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085500 with x1830976123606016 ext(3145728->4194303) 00002000:00010000:3.0:1746155562.602583:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094085500 00000100:00100000:2.0:1746155562.602652:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124524416:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155562.602666:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d582600, rc 0) 00000100:00100000:2.0:1746155562.602685:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:28969:x1830976123606144:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9032us (10732us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.602691:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11704 00000100:00100000:0.0:1746155562.605311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.606467:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123606656 00000100:00100000:2.0:1746155562.606476:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123606656 00000100:00100000:2.0:1746155562.606540:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11705 00000100:00100000:2.0:1746155562.606547:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:28971:x1830976123606656:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155562.606562:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.606576:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1061d expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.606606:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10528 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.606618:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009520ba00/0x844e5faceb5ea8e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10536 expref: 28 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.606634:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.606636:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.606640:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [286720->1048575] (req 286720->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 28 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.606663:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009520ba00/0x844e5faceb5ea8e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10536 expref: 28 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.606672:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009520ba00/0x844e5faceb5ea8e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10536 expref: 28 pid: 29728 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746155562.606683:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124524544:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.606762:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10528 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.606770:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10528 expref: 19 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.606777:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124524672:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.606794:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155562.609597:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.609646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.609711:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123607040 00000100:00100000:1.0:1746155562.609718:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123607040 00010000:00010000:1.0:1746155562.609742:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009520ba00/0x844e5faceb5ea8e0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10536 expref: 29 pid: 29728 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746155562.609765:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5864 00000100:00100000:1.0:1746155562.609771:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123607040:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155562.609781:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155562.609798:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009520ba00/0x844e5faceb5ea8e0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10536 expref: 29 pid: 29728 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746155562.609806:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009520ba00/0x844e5faceb5ea8e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10536 expref: 29 pid: 29728 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746155562.609825:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155562.609855:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123607040:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.609860:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5864 00010000:00010000:2.0:1746155562.609948:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009520ba00/0x844e5faceb5ea8e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10536 expref: 28 pid: 29728 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746155562.609968:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124524544:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.609977:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124524672:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.609996:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [286720->1048575] (req 286720->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.610006:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d582000, rc 0) 00000100:00100000:2.0:1746155562.610022:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:28971:x1830976123606656:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3477us (4719us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.610028:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11705 00000100:00100000:2.0:1746155562.610058:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123606912 00000100:00100000:2.0:1746155562.610060:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123606912 00002000:00100000:2.0:1746155562.610080:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3792896->4194303) req@ffff880094087b80 x1830976123606912/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.610088:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087b80 with x1830976123606912 ext(3792896->4194303) 00010000:00010000:2.0:1746155562.610093:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 23 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.610102:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 23 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746155562.610108:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094087b80 00000100:00100000:2.0:1746155562.610118:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 671 00000100:00100000:2.0:1746155562.610122:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123606912:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155562.610615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.610716:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.611419:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123607168 00000100:00100000:0.0:1746155562.611424:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123607168 00010000:00010000:0.0:1746155562.611455:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10528 expref: 20 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746155562.611491:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5865 00000100:00100000:0.0:1746155562.611497:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123607168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155562.611529:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155562.611541:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10528 expref: 20 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.611550:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10528 expref: 20 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.611564:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130887c00/0x844e5faceb5ea8d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10528 expref: 20 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.611577:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.611579:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.611584:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.611592:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.611614:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.611634:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124524800:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155562.611690:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.611717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.611914:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123607296 00000100:00100000:2.0:1746155562.611918:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123607296 00000100:00100000:2.0:1746155562.611945:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9924 00000100:00100000:2.0:1746155562.611950:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+24:28979:x1830976123607296:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155562.611964:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.611976:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5ea9ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10624 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.612018:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583c00/0x844e5faceb5ea9f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.612027:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583c00/0x844e5faceb5ea9f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.612035:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583c00/0x844e5faceb5ea9f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.612044:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582200/0x844e5faceb5ea9f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.612077:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582200/0x844e5faceb5ea9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.612083:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582200/0x844e5faceb5ea9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.612168:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.612177:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10567 expref: 314 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.612187:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ea949 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1058a expref: 35 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.612192:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 5/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155562.612198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155562.612209:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ea949 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1058a expref: 35 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.612232:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123607424 00000100:00100000:3.0:1746155562.612236:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123607424 00000100:00100000:1.0:1746155562.612238:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123607552 00000100:00100000:1.0:1746155562.612242:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123607552 00000100:00100000:3.0:1746155562.612260:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11706 00000100:00100000:1.0:1746155562.612267:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11707 00000100:00100000:1.0:1746155562.612272:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+20:28973:x1830976123607552:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:3.0:1746155562.612276:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:28978:x1830976123607424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155562.612279:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.612283:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.612285:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10632 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.612292:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1062b expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.612298:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ec expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.612305:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155562.612305:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4c00/0x844e5faceb5ea9c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105fa expref: 21 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.612309:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1062b expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.612310:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.612312:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.612315:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4194304->4640767] (req 4194304->4640767) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 21 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.612317:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1062b expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.612330:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0df200, rc 0) 00010000:00010000:1.0:1746155562.612337:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4c00/0x844e5faceb5ea9c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105fa expref: 21 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.612345:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4c00/0x844e5faceb5ea9c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105fa expref: 21 pid: 4461 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746155562.612353:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f245c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124525056:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155562.612354:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+26:28978:x1830976123607424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 88us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.612359:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11706 00010000:00010000:1.0:1746155562.612389:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ec expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.612396:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ec expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.612404:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124525184:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.612422:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fcb600 going to sleep for 11 seconds 00010000:00010000:2.0:1746155562.612559:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ea949 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1058a expref: 35 pid: 15474 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.612575:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124524928:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.612979:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10567 expref: 314 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.612986:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10567 expref: 314 pid: 15474 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.612993:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124525312:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.613010:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155562.615698:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124524800:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155562.615714:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155562.615741:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123607168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4244us (5126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.615752:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5865 00000100:00100000:0.0:1746155562.616024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.618122:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123607808 00000100:00100000:0.0:1746155562.618129:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123607808 00002000:00100000:0.0:1746155562.618157:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (286720->290815) req@ffff880094085f80 x1830976123607808/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.618166:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085f80 with x1830976123607808 ext(286720->290815) 00002000:00010000:0.0:1746155562.618171:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094085f80 00000100:00100000:1.0:1746155562.618348:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f245c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124525056:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.618359:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124525184:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.618379:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4194304->4640767] (req 4194304->4640767) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.618392:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01d9a00, rc 0) 00000100:00100000:3.0:1746155562.623592:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4441 00000100:00100000:3.0:1746155562.623607:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123607808:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155562.624448:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123606912:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 14322us (14854us total) trans 17179873120 rc 0/0 00000100:00100000:2.0:1746155562.624456:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 671 00002000:00100000:2.0:1746155562.624465:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3792896->4194303) req@ffff880094087b80 x1830976123606912/t17179873120(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/448 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.624478:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087b80 with x1830976123606912 ext(3792896->4194303) 00010000:00010000:2.0:1746155562.624487:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.624498:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746155562.624519:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094087b80 00000100:00100000:3.0:1746155562.624722:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123607808:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1120us (8697us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155562.624727:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4441 00002000:00100000:3.0:1746155562.624732:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (286720->290815) req@ffff880094085f80 x1830976123607808/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.624739:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085f80 with x1830976123607808 ext(286720->290815) 00002000:00010000:3.0:1746155562.624742:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094085f80 00000100:00100000:1.0:1746155562.624792:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+20:28973:x1830976123607552:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 12518us (12593us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.624799:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11707 00000100:00100000:3.0:1746155562.625405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.625419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.625447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.625477:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.625490:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123607936 00000100:00100000:3.0:1746155562.625495:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123607936 00010000:00010000:3.0:1746155562.625527:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ec expref: 27 pid: 20200 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.625542:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123608064 00000100:00100000:3.0:1746155562.625543:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123608064 00010000:00010000:3.0:1746155562.625550:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4c00/0x844e5faceb5ea9c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105fa expref: 20 pid: 4461 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746155562.625559:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123608192 00000100:00100000:3.0:1746155562.625560:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123608192 00010000:00010000:3.0:1746155562.625577:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10567 expref: 315 pid: 15474 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.625585:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123608320 00000100:00100000:3.0:1746155562.625586:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123608320 00010000:00010000:3.0:1746155562.625592:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ea949 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1058a expref: 36 pid: 15474 timeout: 791 lvb_type: 0 00000100:00080000:1.0:1746155562.625595:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155562.625600:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5866 00000100:00100000:3.0:1746155562.625605:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123607936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155562.625610:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5867 00010000:00010000:3.0:1746155562.625614:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155562.625618:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123608064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155562.625636:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155562.625637:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ec expref: 27 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.625645:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ec expref: 27 pid: 20200 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.625783:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124524928:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.625791:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124525312:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.625806:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155562.625823:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5868 00000100:00100000:2.0:1746155562.625829:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+315:1960:x1830976123608192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155562.625857:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5869 00000100:00100000:0.0:1746155562.625863:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1960:x1830976123608320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.625938:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.625942:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10567 expref: 315 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.625949:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10567 expref: 315 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.625964:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136950c00/0x844e5faceb5ea918 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10567 expref: 315 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.625981:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.625985:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.625991:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.625995:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626000:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.626019:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+314:1960:x1830976123608192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 191us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.626023:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5868 00010000:00010000:0.0:1746155562.626112:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155562.626116:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ea949 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1058a expref: 36 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.626123:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ea949 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1058a expref: 36 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.626133:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ea949 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1058a expref: 36 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.626139:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155562.626142:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.626148:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.626156:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.626168:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155562.626181:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1960:x1830976123608320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 318us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.626185:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5869 00010000:00010000:1.0:1746155562.626361:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4c00/0x844e5faceb5ea9c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105fa expref: 20 pid: 4461 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746155562.626369:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4c00/0x844e5faceb5ea9c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105fa expref: 20 pid: 4461 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746155562.626382:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4c00/0x844e5faceb5ea9c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105fa expref: 20 pid: 4461 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746155562.626394:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155562.626412:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123608064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 797us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.626418:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5867 00010000:00010000:2.0:1746155562.626464:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626469:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155562.626516:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155562.626520:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155562.626533:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626541:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626549:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583c00/0x844e5faceb5ea9f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626553:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583c00/0x844e5faceb5ea9f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626558:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583c00/0x844e5faceb5ea9f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626563:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d583c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155562.626565:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583c00/0x844e5faceb5ea9f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626571:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583c00/0x844e5faceb5ea9f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626578:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155562.626581:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155562.626584:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583c00/0x844e5faceb5ea9f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626588:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583c00/0x844e5faceb5ea9f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626595:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582200/0x844e5faceb5ea9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626599:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582200/0x844e5faceb5ea9f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626603:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582200/0x844e5faceb5ea9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626607:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d582200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155562.626608:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582200/0x844e5faceb5ea9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626612:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582200/0x844e5faceb5ea9f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626630:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800942dc800) 00010000:00010000:2.0:1746155562.626632:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155562.626634:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582200/0x844e5faceb5ea9f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626638:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582200/0x844e5faceb5ea9f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.626664:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d583600/0x844e5faceb5ea9ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10624 expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.626673:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10624 expref: 25 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.626678:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.626680:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155562.626682:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d582800, rc 0) 00000100:00100000:2.0:1746155562.626704:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+25:28979:x1830976123607296:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 14753us (15992us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.626710:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9924 00010000:00010000:3.0:1746155562.627485:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6040800/0x844e5faceb5ea9b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105ec expref: 27 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.627500:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.627518:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.627523:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 18 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.627535:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 18 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.627560:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 18 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.627572:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124525440:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155562.627615:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.632334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.632419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.632442:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.632457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.632461:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123608448 00000100:00100000:2.0:1746155562.632470:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123608448 00000100:00100000:1.0:1746155562.632480:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.632491:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123608576 00000100:00100000:1.0:1746155562.632493:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123608576 00000100:00100000:2.0:1746155562.632516:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123608704 00000100:00100000:2.0:1746155562.632518:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123608704 00000100:00100000:0.0:1746155562.632722:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123608832 00000100:00100000:0.0:1746155562.632726:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123608832 00010000:00010000:0.0:1746155562.632744:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746155562.632763:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5870 00000100:00100000:0.0:1746155562.632768:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123608832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155562.632777:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746155562.632791:0:7064:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155562 -> 1746155563 00002000:00010000:0.0:1746155562.632793:0:7064:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155562 -> 1746155563 00002000:00010000:0.0:1746155562.632795:0:7064:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155562 -> 1746155563 00010000:00010000:0.0:1746155562.632799:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.632809:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.632825:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe64a00/0x844e5faceb5ea9ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3792896->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10608 expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.632840:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.632842:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.632847:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10616 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.632853:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10616 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.632860:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.632861:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.632863:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1062b expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.632868:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1062b expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.632889:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1062b expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.632899:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094084700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124525568:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155562.632936:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123608960 00000100:00100000:1.0:1746155562.632939:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123608960 00000100:00100000:2.0:1746155562.632940:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11708 00000100:00100000:2.0:1746155562.632945:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123608448:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155562.632952:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11709 00000100:00100000:1.0:1746155562.632956:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123608704:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155562.632957:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.632960:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.632967:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5eaa14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10639 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.632967:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9400/0x844e5faceb5eaa1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10647 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.632978:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.632979:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.632983:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9400/0x844e5faceb5eaa1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10647 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155562.632991:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124525696:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155562.632992:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9400/0x844e5faceb5eaa1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10647 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.632999:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01d9400, rc 0) 00000100:00100000:3.0:1746155562.633027:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11710 00000100:00100000:3.0:1746155562.633032:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976123608576:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155562.633038:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.633045:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0de000/0x844e5faceb5eaa22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10640 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.633053:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.633054:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.633058:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0de000/0x844e5faceb5eaa22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10640 expref: 7 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.633066:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0de000/0x844e5faceb5eaa22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10640 expref: 7 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.633071:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0de000, rc 0) 00000100:00100000:2.0:1746155562.633363:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11711 00000100:00100000:2.0:1746155562.633373:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123608960:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:2.0:1746155562.633382:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3900 going to sleep for 11 seconds 00010000:00010000:0.0:1746155562.633383:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10616 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.633389:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155562.633390:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094087800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124525824:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155562.633394:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5eaa29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1064e expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.633407:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.633413:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124525952:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155562.633429:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.633449:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123608704:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 491us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.633454:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11709 00000100:00080000:1.0:1746155562.633475:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746155562.633479:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123608576:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 447us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.633486:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11710 00000100:00100000:1.0:1746155562.633498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.633588:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123609088 00000100:00100000:2.0:1746155562.633591:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123609088 00000100:00100000:2.0:1746155562.633605:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11712 00000100:00100000:2.0:1746155562.633609:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123609088:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155562.633614:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.633641:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5eaa30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10655 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.633651:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.633652:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.633656:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5eaa30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10655 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.633665:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5eaa30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10655 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.633732:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db2c00, rc 0) 00000100:00100000:2.0:1746155562.633749:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123609088:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 138us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.633752:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11712 00000100:00100000:3.0:1746155562.633782:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124525440:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155562.633793:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.633809:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123607936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8204us (8405us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.633815:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5866 00000100:00100000:2.0:1746155562.636348:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094084700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124525568:192.168.202.51@tcp:105: 00002000:00010000:3.0:1746155562.636762:0:18270:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime: 1746155562 -> 1746155563 00002000:00010000:3.0:1746155562.636765:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime: 1746155562 -> 1746155563 00002000:00010000:3.0:1746155562.636767:0:18270:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime: 1746155562 -> 1746155563 00000100:00100000:3.0:1746155562.636783:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124525696:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155562.636808:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5eaa14 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10639 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155562.636817:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094087800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124525824:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155562.636819:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5eaa14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10639 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.636828:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155562.636830:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3400, rc 0) 00000100:00100000:2.0:1746155562.636864:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123608832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4090us (4400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.636872:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5870 00002000:00010000:2.0:1746155562.636905:0:20200:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime: 1746155562 -> 1746155563 00002000:00010000:2.0:1746155562.636907:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155562 -> 1746155563 00002000:00010000:2.0:1746155562.636909:0:20200:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime: 1746155562 -> 1746155563 00000100:00100000:2.0:1746155562.636916:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124525952:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155562.636927:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5eaa29 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1064e expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.636939:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5eaa29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1064e expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.636948:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3a00, rc 0) 00000100:00100000:3.0:1746155562.636979:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123608448:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4033us (4652us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155562.636985:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11708 00000100:00100000:2.0:1746155562.637035:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123608960:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3665us (4553us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155562.637042:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11711 00000100:00100000:0.0:1746155562.637645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.637680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.637684:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123609344 00000100:00100000:2.0:1746155562.637689:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123609344 00002000:00100000:2.0:1746155562.637720:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880094087800 x1830976123609344/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.637728:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087800 with x1830976123609344 ext(3145728->4194303) 00002000:00010000:2.0:1746155562.637732:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094087800 00000100:00100000:2.0:1746155562.637746:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4442 00000100:00100000:2.0:1746155562.637753:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123609344:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155562.638761:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123609472 00000100:00100000:3.0:1746155562.638765:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123609472 00000100:00100000:3.0:1746155562.638787:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11713 00000100:00100000:3.0:1746155562.638793:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:28971:x1830976123609472:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155562.638800:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.638813:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1065c expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.638834:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1054b expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.638845:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0de000/0x844e5faceb5eaa22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10640 expref: 7 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.638851:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8000/0x844e5faceb5ea8fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10552 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.638857:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.638858:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.638861:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->1257471] (req 1048576->1257471) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.638886:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8000/0x844e5faceb5ea8fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10552 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.638896:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8000/0x844e5faceb5ea8fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10552 expref: 27 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.638905:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124526080:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155562.639320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.639356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.639371:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123609728 00000100:00100000:0.0:1746155562.639374:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123609728 00002000:00100000:0.0:1746155562.639392:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880094084000 x1830976123609728/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.639400:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094084000 with x1830976123609728 ext(3145728->4194303) 00002000:00010000:0.0:1746155562.639403:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094084000 00000100:00100000:0.0:1746155562.639415:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4443 00000100:00100000:0.0:1746155562.639420:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123609728:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155562.639548:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123609984 00000100:00100000:2.0:1746155562.639551:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123609984 00000100:00100000:2.0:1746155562.639580:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9925 00000100:00100000:2.0:1746155562.639585:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+25:28979:x1830976123609984:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155562.639594:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.639604:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3200/0x844e5faceb5eaa3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10663 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.639685:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.639695:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10624 expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.639701:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.639716:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10624 expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.639723:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10624 expref: 26 pid: 15474 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.639730:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124526208:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.641134:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0de000/0x844e5faceb5eaa22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10640 expref: 7 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.641147:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0de000/0x844e5faceb5eaa22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10640 expref: 7 pid: 29728 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746155562.641160:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124526336:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.641200:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1054b expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.641207:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1054b expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.641215:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124526464:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155562.641232:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.641292:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.641601:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.642030:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123610240 00000100:00100000:2.0:1746155562.642037:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123610240 00002000:00100000:2.0:1746155562.642065:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (4636672->4640767) req@ffff88008e26dc00 x1830976123610240/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.642074:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26dc00 with x1830976123610240 ext(4636672->4640767) 00002000:00010000:2.0:1746155562.642078:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26dc00 00000100:00100000:2.0:1746155562.642652:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4444 00000100:00100000:2.0:1746155562.642660:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123610240:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155562.642780:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123610240:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 121us (1180us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155562.642786:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4444 00002000:00100000:2.0:1746155562.642791:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (4636672->4640767) req@ffff88008e26dc00 x1830976123610240/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.642797:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26dc00 with x1830976123610240 ext(4636672->4640767) 00002000:00010000:2.0:1746155562.642799:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26dc00 00000100:00100000:0.0:1746155562.647088:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124526080:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.647297:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123609344:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9542us (9651us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.647311:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4442 00002000:00100000:2.0:1746155562.647321:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880094087800 x1830976123609344/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.647329:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087800 with x1830976123609344 ext(3145728->4194303) 00002000:00010000:2.0:1746155562.647333:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094087800 00000100:00100000:0.0:1746155562.647817:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.648036:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123610368 00000100:00100000:2.0:1746155562.648042:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123610368 00010000:00010000:2.0:1746155562.648065:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8000/0x844e5faceb5ea8fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10552 expref: 30 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.648944:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5871 00000100:00100000:2.0:1746155562.648952:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123610368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.648963:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.648981:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8000/0x844e5faceb5ea8fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10552 expref: 30 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.648990:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8000/0x844e5faceb5ea8fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10552 expref: 30 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.649007:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8000/0x844e5faceb5ea8fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10552 expref: 30 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.649019:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.649056:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123610368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 105us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.649061:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5871 00000100:00100000:0.0:1746155562.652376:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124526336:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155562.652411:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124526464:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155562.652436:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->1257471] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.652450:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0de400, rc 0) 00000100:00100000:0.0:1746155562.652478:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:28971:x1830976123609472:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 13684us (14797us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.652485:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11713 00000100:00100000:0.0:1746155562.652731:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123609728:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13310us (13410us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155562.652739:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4443 00002000:00100000:0.0:1746155562.652747:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880094084000 x1830976123609728/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.652754:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094084000 with x1830976123609728 ext(3145728->4194303) 00002000:00010000:0.0:1746155562.652758:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094084000 00000100:00100000:0.0:1746155562.652788:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.652825:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.652857:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.652873:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.652910:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.652928:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123611264 00000100:00100000:0.0:1746155562.652933:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123611264 00002000:00100000:0.0:1746155562.652956:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4640768->4956159) req@ffff88009fe92d80 x1830976123611264/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.652963:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe92d80 with x1830976123611264 ext(4640768->4956159) 00002000:00010000:0.0:1746155562.652966:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe92d80 00000100:00100000:2.0:1746155562.652978:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123610496 00000100:00100000:2.0:1746155562.652982:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123610496 00000100:00100000:0.0:1746155562.652984:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4445 00000100:00100000:0.0:1746155562.652989:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123611264:12345-192.168.202.51@tcp:3:multiop.0 00010000:00010000:2.0:1746155562.653004:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10624 expref: 27 pid: 15474 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.653022:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123610624 00000100:00100000:2.0:1746155562.653024:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123610624 00010000:00010000:2.0:1746155562.653032:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0de000/0x844e5faceb5eaa22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10640 expref: 8 pid: 29728 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746155562.653050:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123611008 00000100:00100000:2.0:1746155562.653052:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123611008 00000100:00100000:0.0:1746155562.653056:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5872 00010000:00010000:2.0:1746155562.653061:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1054b expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746155562.653062:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+27:1960:x1830976123610496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155562.653071:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155562.653074:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5873 00010000:00010000:0.0:1746155562.653076:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10624 expref: 27 pid: 15474 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.653084:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123610624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155562.653089:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10624 expref: 27 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.653091:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.653104:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0de000/0x844e5faceb5eaa22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10640 expref: 8 pid: 29728 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746155562.653104:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155562.653108:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.653112:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0de000/0x844e5faceb5eaa22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10640 expref: 8 pid: 29728 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746155562.653115:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.653122:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.653126:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0de000/0x844e5faceb5eaa22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10640 expref: 8 pid: 29728 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746155562.653133:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155562.653135:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155562.653149:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+27:1960:x1830976123610496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 88us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.653153:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123610624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 74us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.653155:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5872 00000100:00100000:2.0:1746155562.653162:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5873 00000100:00100000:0.0:1746155562.653165:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5874 00000100:00100000:0.0:1746155562.653169:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123611008:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155562.653174:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155562.653182:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1054b expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.653189:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1054b expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.653231:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123610880 00000100:00100000:3.0:1746155562.653234:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123610880 00000100:00100000:3.0:1746155562.653256:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3981 00000100:00100000:3.0:1746155562.653261:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+35:28973:x1830976123610880:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155562.653430:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+36:28973:x1830976123610880:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 168us (571us total) trans 8589943845 rc 0/0 00000100:00100000:3.0:1746155562.653435:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3981 00010000:00010000:3.0:1746155562.653463:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d582800/0x844e5faceb5ea9ff lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10624 expref: 26 pid: 15474 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.653472:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124526208:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.653481:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155562.653487:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155562.653492:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155562.653525:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155562.653583:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3200/0x844e5faceb5eaa3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10663 expref: 27 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.653593:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10663 expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.653598:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155562.653600:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155562.653602:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db2e00, rc 0) 00000100:00100000:3.0:1746155562.653634:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+26:28979:x1830976123609984:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 14048us (14277us total) trans 8589943846 rc 0/0 00000100:00100000:3.0:1746155562.653639:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9925 00010000:00010000:0.0:1746155562.653707:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009048fe00/0x844e5faceb5ea8f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1054b expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.653730:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.653732:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.653737:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 25 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.653743:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 25 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.653765:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 25 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.653775:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe91c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124526592:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155562.653942:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155562.656763:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.656805:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.656871:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123611520 00000100:00100000:3.0:1746155562.656878:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123611520 00000100:00100000:3.0:1746155562.656912:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123611392 00000100:00100000:3.0:1746155562.656914:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123611392 00000100:00100000:0.0:1746155562.656922:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11714 00000100:00100000:0.0:1746155562.656929:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123611520:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155562.656944:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155562.656959:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a000/0x844e5faceb5eaa53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10671 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.656963:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11715 00000100:00100000:3.0:1746155562.656968:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123611392:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155562.656974:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.656981:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a0dfe00/0x844e5faceb5eaa5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1066a expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.656994:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124526720:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155562.657003:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124526848:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155562.657046:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.657171:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155562.658558:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.658575:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123611648 00000100:00100000:2.0:1746155562.658581:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123611648 00000100:00100000:0.0:1746155562.658582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.659222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.659260:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123611904 00000100:00100000:3.0:1746155562.659264:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123611904 00000100:00100000:3.0:1746155562.659318:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9926 00000100:00100000:3.0:1746155562.659326:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+26:28979:x1830976123611904:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155562.659343:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.659650:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df600/0x844e5faceb5eaa61 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10686 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.659787:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123611776 00000100:00100000:2.0:1746155562.659791:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123611776 00010000:00010000:3.0:1746155562.659852:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5eaa68 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155562.659856:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11716 00010000:00010000:3.0:1746155562.659863:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10663 expref: 27 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.659865:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123611648:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155562.659870:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5eaa68 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155562.659873:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.659883:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f292a00/0x844e5faceb5eaa6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10678 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.659892:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10663 expref: 27 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.659901:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10663 expref: 27 pid: 15474 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.659910:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124526976:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.659911:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124527104:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155562.659968:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1fcb600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.659983:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11717 00000100:00100000:1.0:1746155562.659988:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123611776:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155562.659995:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.660002:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f293800/0x844e5faceb5eaa76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1067f expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.660024:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124527232:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155562.660487:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.660489:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f1db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.662532:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe91c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124526592:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155562.662550:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.662585:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123611008:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9413us (9709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.662594:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5874 00002000:00010000:1.0:1746155562.662687:0:4461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155562 -> 1746155563 00002000:00010000:1.0:1746155562.662691:0:4461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155562 -> 1746155563 00002000:00010000:1.0:1746155562.662692:0:4461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155562 -> 1746155563 00000100:00100000:1.0:1746155562.662702:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124526720:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155562.662703:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124526848:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155562.662723:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a0dfe00/0x844e5faceb5eaa5a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1066a expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.662723:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a000/0x844e5faceb5eaa53 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10671 expref: 25 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.662733:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a0dfe00/0x844e5faceb5eaa5a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1066a expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.662733:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a000/0x844e5faceb5eaa53 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10671 expref: 25 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.662741:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0dfe00, rc 0) 00010000:00010000:1.0:1746155562.662745:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3a000, rc 0) 00000100:00100000:0.0:1746155562.662995:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123611264:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10004us (10082us total) trans 0 rc 315392/315392 00000100:00100000:0.0:1746155562.663002:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4445 00002000:00100000:0.0:1746155562.663009:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4640768->4956159) req@ffff88009fe92d80 x1830976123611264/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 315392/315392 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.663017:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe92d80 with x1830976123611264 ext(4640768->4956159) 00002000:00010000:0.0:1746155562.663021:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe92d80 00000100:00100000:3.0:1746155562.663026:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123611392:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6057us (6220us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155562.663032:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11715 00000100:00100000:3.0:1746155562.663056:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124526976:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.663073:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5eaa68 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155562.663232:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123611520:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6302us (6474us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155562.663237:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11714 00000100:00100000:1.0:1746155562.663266:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124527232:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155562.663279:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f293800/0x844e5faceb5eaa76 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1067f expref: 27 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.663286:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f293800/0x844e5faceb5eaa76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1067f expref: 27 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.663292:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f293800, rc 0) 00000100:00100000:1.0:1746155562.663304:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123611776:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3316us (4721us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155562.663308:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11717 00000100:00100000:0.0:1746155562.665178:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.665210:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.665264:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123612160 00000100:00100000:2.0:1746155562.665271:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123612160 00002000:00100000:2.0:1746155562.665299:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1253376->1257471) req@ffff88009451c700 x1830976123612160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.665307:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451c700 with x1830976123612160 ext(1253376->1257471) 00002000:00010000:2.0:1746155562.665310:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451c700 00000100:00100000:2.0:1746155562.665326:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4446 00000100:00100000:2.0:1746155562.665333:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123612160:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155562.665367:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123612288 00000100:00100000:3.0:1746155562.665371:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123612288 00010000:00010000:3.0:1746155562.665385:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10663 expref: 28 pid: 15474 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.665401:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5875 00000100:00100000:3.0:1746155562.665405:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+28:1961:x1830976123612288:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155562.665412:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155562.665417:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10663 expref: 28 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.665428:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10663 expref: 28 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.665444:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaa45 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10663 expref: 28 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.665454:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155562.665457:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5eaa68 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155562.665464:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123612160:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 132us (291us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1746155562.665465:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5eaa68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155562.665470:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4446 00010000:00010000:3.0:1746155562.665471:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5eaa68 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00002000:00100000:2.0:1746155562.665474:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1253376->1257471) req@ffff88009451c700 x1830976123612160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.665480:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451c700 with x1830976123612160 ext(1253376->1257471) 00002000:00010000:2.0:1746155562.665483:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451c700 00010000:00010000:3.0:1746155562.665485:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155562.665534:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5eaa68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.666861:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5eaa68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155562.666898:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155562.666902:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155562.666914:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5eaa68 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.666942:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df600/0x844e5faceb5eaa61 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10686 expref: 28 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.666954:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5eaa68 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10686 expref: 27 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.666960:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.666963:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155562.666965:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0de800, rc 0) 00000100:00100000:3.0:1746155562.666986:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+27:1961:x1830976123612288:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1580us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.666987:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+27:28979:x1830976123611904:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 7664us (7768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.666993:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5875 00000100:00100000:2.0:1746155562.666994:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9926 00000100:00100000:1.0:1746155562.667283:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124527104:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155562.667303:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f292a00/0x844e5faceb5eaa6f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10678 expref: 27 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.667312:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f292a00/0x844e5faceb5eaa6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10678 expref: 27 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.667319:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f292a00, rc 0) 00000100:00100000:1.0:1746155562.667340:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123611648:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7477us (8783us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155562.667346:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11716 00000100:00100000:0.0:1746155562.670812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.670844:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.671320:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123612416 00000100:00100000:1.0:1746155562.671327:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123612416 00000100:00100000:0.0:1746155562.671331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.671346:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123612800 00000100:00100000:0.0:1746155562.671348:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123612800 00000100:00100000:1.0:1746155562.671355:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123612544 00000100:00100000:1.0:1746155562.671356:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123612544 00000100:00100000:0.0:1746155562.671379:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3982 00000100:00100000:0.0:1746155562.671386:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+314:28971:x1830976123612800:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155562.671405:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11718 00000100:00100000:1.0:1746155562.671410:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123612416:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155562.671418:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.671431:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f293200/0x844e5faceb5eaa7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1068d expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.671469:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124527360:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155562.671485:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11719 00000100:00100000:2.0:1746155562.671491:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123612544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.671497:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.671523:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3000/0x844e5faceb5eaa84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10694 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.671541:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f1db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.671550:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124527488:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155562.671571:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.671795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.671856:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.671868:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123612928 00000100:00100000:0.0:1746155562.671869:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+315:28971:x1830976123612800:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 483us (536us total) trans 8589943847 rc 0/0 00000100:00100000:1.0:1746155562.671870:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123612928 00000100:00100000:0.0:1746155562.671875:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3982 00000100:00100000:1.0:1746155562.671883:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123613056 00000100:00100000:1.0:1746155562.671885:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123613056 00000100:00100000:1.0:1746155562.671906:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11720 00000100:00100000:1.0:1746155562.671911:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:28969:x1830976123612928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155562.671917:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155562.671923:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11721 00010000:00010000:1.0:1746155562.671924:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1069b expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.671928:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123613056:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155562.671933:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.671938:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5eaa92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106a2 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.671939:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.671950:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155562.671952:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155562.671954:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [4194304->4956159] (req 4194304->4956159) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.671955:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124527616:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155562.671970:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.671973:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746155562.671980:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 20 pid: 20200 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.671988:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124527744:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.672004:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f1da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155562.672480:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.672522:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123613312 00000100:00100000:3.0:1746155562.672527:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123613312 00000100:00100000:0.0:1746155562.672537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.672548:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123613184 00000100:00100000:0.0:1746155562.672555:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123613184 00000100:00100000:0.0:1746155562.672569:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11722 00000100:00100000:0.0:1746155562.672574:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123613312:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155562.672581:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155562.672611:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11723 00000100:00100000:2.0:1746155562.672617:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123613184:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155562.672636:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.672643:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eaa99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106a9 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.672665:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124527872:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155562.672696:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5eaaa0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106b0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.672818:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124528000:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155562.672845:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.672887:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.676768:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124527488:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155562.676768:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124527616:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155562.676798:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5eaa92 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106a2 expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.676816:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5eaa92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106a2 expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.676830:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3400, rc 0) 00000100:00100000:2.0:1746155562.676871:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123613056:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4941us (5014us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155562.676878:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11721 00000100:00100000:2.0:1746155562.677020:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124527872:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155562.677033:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eaa99 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106a9 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.677041:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eaa99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106a9 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.677049:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db2a00, rc 0) 00000100:00100000:2.0:1746155562.677068:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123613184:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4451us (4530us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155562.677073:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11723 00000100:00100000:1.0:1746155562.677252:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124527360:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155562.677268:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f293200/0x844e5faceb5eaa7d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1068d expref: 20 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.677276:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f293200/0x844e5faceb5eaa7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1068d expref: 20 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.677283:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f293200, rc 0) 00000100:00100000:1.0:1746155562.677304:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123612416:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5894us (6498us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155562.677308:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11718 00000100:00100000:1.0:1746155562.677331:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124527744:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155562.677374:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124528000:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155562.677389:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5eaaa0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b0 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155562.677397:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5eaaa0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b0 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155562.677407:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b200, rc 0) 00010000:00010000:3.0:1746155562.677421:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3000/0x844e5faceb5eaa84 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10694 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155562.677423:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123613312:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4849us (4944us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155562.677427:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11722 00010000:00010000:3.0:1746155562.677430:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3000/0x844e5faceb5eaa84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10694 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.677436:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3000, rc 0) 00000100:00100000:3.0:1746155562.677450:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123612544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5959us (6606us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155562.677455:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11719 00010000:00010000:1.0:1746155562.678326:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [4194304->4956159] (req 4194304->4956159) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.678339:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f293a00, rc 0) 00000100:00100000:1.0:1746155562.678366:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:28969:x1830976123612928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6454us (6571us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.678371:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11720 00000100:00100000:0.0:1746155562.678814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.678964:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123613440 00000100:00100000:3.0:1746155562.678970:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123613440 00002000:00100000:3.0:1746155562.678999:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4640767) req@ffff88009451d880 x1830976123613440/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.679008:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d880 with x1830976123613440 ext(4194304->4640767) 00010000:00010000:3.0:1746155562.679014:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 19 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.679025:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 19 pid: 20200 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746155562.679031:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451d880 00000100:00100000:3.0:1746155562.679045:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 672 00000100:00100000:3.0:1746155562.679051:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123613440:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155562.682123:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.682172:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123613568 00000100:00100000:1.0:1746155562.682179:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123613568 00000100:00100000:0.0:1746155562.682191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.682217:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11724 00000100:00100000:1.0:1746155562.682223:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:28978:x1830976123613568:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155562.682238:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.682252:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106b7 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.682274:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155562.682276:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155562.682279:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4952064->5242879] (req 4952064->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.682289:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4952064->5242879] (req 4952064->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.682297:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f293c00, rc 0) 00000100:00100000:1.0:1746155562.682933:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:28978:x1830976123613568:12345-192.168.202.51@tcp:101:cat.0 Request processed in 709us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.682939:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11724 00000100:00100000:3.0:1746155562.683003:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123613824 00000100:00100000:3.0:1746155562.683007:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123613824 00000100:00100000:3.0:1746155562.683031:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9927 00000100:00100000:3.0:1746155562.683036:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+26:28979:x1830976123613824:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155562.683045:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.683055:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5eaaae lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106be expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.683123:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eaab5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155562.683138:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eaab5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155562.683146:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eaab5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155562.683156:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155562.683249:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5eaaae lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106be expref: 29 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.683259:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eaab5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106be expref: 28 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.683265:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155562.683267:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155562.683269:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0dfa00, rc 0) 00000100:00100000:3.0:1746155562.683287:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+28:28979:x1830976123613824:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 252us (1096us total) trans 8589943848 rc 0/0 00000100:00100000:3.0:1746155562.683292:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9927 00000100:00100000:3.0:1746155562.686805:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123613440:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 7747us (7984us total) trans 21474840503 rc 0/0 00000100:00100000:3.0:1746155562.686815:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 672 00002000:00100000:3.0:1746155562.686825:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4640767) req@ffff88009451d880 x1830976123613440/t21474840503(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/448 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.686834:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d880 with x1830976123613440 ext(4194304->4640767) 00010000:00010000:3.0:1746155562.686841:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 22 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.686856:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 22 pid: 20200 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746155562.686862:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451d880 00000100:00100000:0.0:1746155562.687114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.687356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.687438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.687796:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123613952 00000100:00100000:1.0:1746155562.687802:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123613952 00000100:00100000:1.0:1746155562.687829:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123614208 00000100:00100000:1.0:1746155562.687830:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123614208 00000100:00100000:1.0:1746155562.687839:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123614464 00000100:00100000:1.0:1746155562.687840:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123614464 00000100:00100000:1.0:1746155562.687851:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11725 00000100:00100000:1.0:1746155562.687856:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123613952:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155562.687885:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.687897:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.687903:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155562.687904:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155562.687907:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.687929:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.687937:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.687947:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124528128:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.687991:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f1da80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.688005:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11726 00000100:00100000:1.0:1746155562.688009:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123614208:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155562.688025:0:29728:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.688033:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903ba400/0x844e5faceb5ea7cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10456 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.688039:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb39a00/0x844e5faceb5ea85b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104cd expref: 7 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.688045:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5ea7d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1045d expref: 25 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.688049:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.688050:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.688052:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.688066:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5ea7d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1045d expref: 25 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.688073:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5ea7d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1045d expref: 25 pid: 4461 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746155562.688081:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124528256:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.688104:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb39a00/0x844e5faceb5ea85b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104cd expref: 7 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.688115:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb39a00/0x844e5faceb5ea85b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104cd expref: 7 pid: 8436 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746155562.688122:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124528384:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.688140:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800903ba400/0x844e5faceb5ea7cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10456 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.688147:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800903ba400/0x844e5faceb5ea7cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10456 expref: 23 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.688153:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124528512:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.688179:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f1db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.688226:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11727 00000100:00100000:2.0:1746155562.688234:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123614464:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155562.688250:0:9235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.688258:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155562.688260:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->4956159] (req 4194304->4956159) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.688271:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4952064->5242879] (req 4952064->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.688275:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746155562.688277:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.688297:0:9235:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4952064->5242879] (req 4952064->5242879) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.688307:0:9235:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->4956159] (req 4194304->4956159) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.688315:0:9235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.688376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.688407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.688430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.688663:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123614080 00000100:00100000:3.0:1746155562.688668:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123614080 00000100:00100000:3.0:1746155562.688687:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123614336 00000100:00100000:3.0:1746155562.688689:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123614336 00000100:00100000:3.0:1746155562.688698:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123614592 00000100:00100000:3.0:1746155562.688699:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123614592 00000100:00100000:3.0:1746155562.688709:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11728 00000100:00100000:3.0:1746155562.688714:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123614080:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155562.688729:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.688739:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 25 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.688744:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155562.688745:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155562.688747:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.688761:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 25 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.688768:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 25 pid: 20200 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.688776:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124528896:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155562.688803:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.688817:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11729 00000100:00100000:3.0:1746155562.688822:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123614336:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155562.688837:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.688846:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c2 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.688853:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9400/0x844e5faceb5eaa1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10647 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.688859:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090d06800/0x844e5faceb5ea98f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c9 expref: 26 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.688863:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.688864:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.688866:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.688877:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090d06800/0x844e5faceb5ea98f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c9 expref: 26 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.688884:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090d06800/0x844e5faceb5ea98f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c9 expref: 26 pid: 4461 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746155562.688891:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124529024:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.688911:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9400/0x844e5faceb5eaa1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10647 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.688917:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9400/0x844e5faceb5eaa1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10647 expref: 9 pid: 8437 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746155562.688923:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124529152:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.688937:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c2 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.688942:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c2 expref: 21 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.688948:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124529280:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155562.688965:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da300 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.688983:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11730 00000100:00100000:3.0:1746155562.688987:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123614592:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155562.688999:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.689007:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfc00/0x844e5faceb5ea9d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1060f expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.689017:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10616 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.689023:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5eaa30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10655 expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.689028:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1062b expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.689032:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155562.689033:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155562.689035:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 7/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.689045:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1062b expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.689051:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1062b expref: 23 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.689057:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124529408:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.689072:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5eaa30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10655 expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.689078:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5eaa30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10655 expref: 9 pid: 4461 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746155562.689084:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124529536:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.689097:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10616 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.689103:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10616 expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.689109:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124529664:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.689120:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfc00/0x844e5faceb5ea9d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1060f expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.689126:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfc00/0x844e5faceb5ea9d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1060f expref: 23 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.689132:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124529792:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155562.689141:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155562.689420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.690123:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123614720 00000100:00100000:3.0:1746155562.690128:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123614720 00010000:00010000:3.0:1746155562.690145:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 22 pid: 20200 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.690168:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5876 00000100:00100000:3.0:1746155562.690173:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123614720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155562.690181:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155562.690199:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 22 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.690209:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 22 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.690225:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9a00/0x844e5faceb5eaa06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4640767) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10632 expref: 22 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.690235:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.690237:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.690242:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.690248:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.690254:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.690255:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.690258:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.690264:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.690284:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.690293:0:7062:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.690302:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124529920:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155562.691097:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.691106:0:7062:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 26 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.691114:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124530048:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155562.691134:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155562.695356:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.695378:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123614848 00000100:00100000:0.0:1746155562.695385:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123614848 00010000:00010000:0.0:1746155562.695410:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb39a00/0x844e5faceb5ea85b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104cd expref: 10 pid: 8436 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746155562.695430:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5877 00000100:00100000:0.0:1746155562.695435:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123614848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155562.695444:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155562.695460:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb39a00/0x844e5faceb5ea85b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104cd expref: 10 pid: 8436 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746155562.695469:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb39a00/0x844e5faceb5ea85b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104cd expref: 10 pid: 8436 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746155562.695487:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155562.695857:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124528256:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.695867:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb39a00/0x844e5faceb5ea85b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f104cd expref: 10 pid: 8436 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746155562.695876:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123614848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 440us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.695883:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5877 00000100:00100000:2.0:1746155562.695997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.696026:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123614976 00000100:00100000:0.0:1746155562.696029:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123614976 00010000:00010000:0.0:1746155562.696039:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5ea7d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1045d expref: 26 pid: 4461 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746155562.696052:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5878 00000100:00100000:0.0:1746155562.696057:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123614976:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155562.696066:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155562.696072:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5ea7d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1045d expref: 26 pid: 4461 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746155562.696080:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5ea7d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1045d expref: 26 pid: 4461 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746155562.696089:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5ea7d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1045d expref: 26 pid: 4461 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746155562.696099:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155562.696114:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123614976:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.696119:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5878 00000100:00100000:1.0:1746155562.696422:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124528384:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.696434:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124528512:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.696456:0:29728:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.696477:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124528128:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.696489:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.697895:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.697928:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.697941:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123615616 00000100:00100000:0.0:1746155562.697944:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123615616 00010000:00010000:0.0:1746155562.697961:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c2 expref: 22 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746155562.697977:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5879 00000100:00100000:0.0:1746155562.697982:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123615616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155562.697991:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155562.698003:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c2 expref: 22 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.698016:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c2 expref: 22 pid: 29728 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.698031:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155562.698053:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123615616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 71us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.698057:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5879 00000100:00100000:0.0:1746155562.698082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.698093:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123615232 00000100:00100000:0.0:1746155562.698096:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123615232 00002000:00100000:0.0:1746155562.698116:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1257471) req@ffff88009f3ec380 x1830976123615232/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.698124:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ec380 with x1830976123615232 ext(1048576->1257471) 00010000:00010000:0.0:1746155562.698129:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 25 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.698138:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 25 pid: 20200 timeout: 791 lvb_type: 0 00002000:00010000:0.0:1746155562.698143:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f3ec380 00000100:00100000:0.0:1746155562.698153:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123615104 00000100:00100000:0.0:1746155562.698156:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123615104 00002000:00100000:0.0:1746155562.698166:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (286720->1048575) req@ffff88009f3ec700 x1830976123615104/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.698172:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ec700 with x1830976123615104 ext(286720->1048575) 00010000:00010000:0.0:1746155562.698177:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 27 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.698184:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 27 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:0.0:1746155562.698189:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f3ec700 00000100:00100000:0.0:1746155562.698198:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 673 00000100:00100000:0.0:1746155562.698204:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123615232:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155562.698417:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.698427:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123615360 00000100:00100000:0.0:1746155562.698430:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123615360 00000100:00100000:1.0:1746155562.698471:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 674 00000100:00100000:1.0:1746155562.698476:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123615104:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155562.698479:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124529024:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.698486:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124529152:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.698494:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ea988 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c2 expref: 21 pid: 29728 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.698526:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124529280:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.698547:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.698581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.698593:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123615744 00000100:00100000:2.0:1746155562.698595:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123615744 00010000:00010000:2.0:1746155562.698607:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5eaa30 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10655 expref: 9 pid: 4461 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746155562.698640:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5880 00000100:00100000:2.0:1746155562.698644:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123615744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.698651:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.698660:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5eaa30 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10655 expref: 9 pid: 4461 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746155562.698667:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5eaa30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10655 expref: 9 pid: 4461 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746155562.698678:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.698693:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123615744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 48us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.698698:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5880 00000100:00100000:2.0:1746155562.698722:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.698730:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123615488 00000100:00100000:2.0:1746155562.698732:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123615488 00010000:00010000:2.0:1746155562.698741:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090d06800/0x844e5faceb5ea98f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c9 expref: 28 pid: 4461 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746155562.698753:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5881 00000100:00100000:2.0:1746155562.698758:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123615488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.698763:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.698770:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090d06800/0x844e5faceb5ea98f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c9 expref: 28 pid: 4461 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746155562.698776:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090d06800/0x844e5faceb5ea98f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c9 expref: 28 pid: 4461 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746155562.698786:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090d06800/0x844e5faceb5ea98f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f105c9 expref: 28 pid: 4461 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746155562.698793:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.698806:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123615488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 47us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.698811:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5881 00000100:00100000:2.0:1746155562.698840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.698848:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123616000 00000100:00100000:2.0:1746155562.698850:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123616000 00000100:00100000:3.0:1746155562.698905:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124529920:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155562.698912:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124530048:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155562.698920:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.698935:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123614720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8762us (9516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.698941:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5876 00000100:00100000:3.0:1746155562.698984:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124528896:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.698992:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.699006:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124529408:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.699013:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5eaa30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10655 expref: 8 pid: 4461 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746155562.699024:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124529536:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155562.699031:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124529664:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155562.699037:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124529792:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.699046:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.699172:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800903ba400/0x844e5faceb5ea7cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10456 expref: 24 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.699268:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5882 00000100:00100000:2.0:1746155562.699273:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123616000:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.699279:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.699287:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800903ba400/0x844e5faceb5ea7cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10456 expref: 24 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.699299:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800903ba400/0x844e5faceb5ea7cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10456 expref: 24 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.699310:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903ba400/0x844e5faceb5ea7cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10456 expref: 24 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.699318:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.699319:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.699323:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.699330:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.699352:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155562.699356:0:29728:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.699363:0:29728:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.699365:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976123616000:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 92us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.699370:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5882 00010000:00010000:1.0:1746155562.699379:0:29728:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.699385:0:29728:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.699391:0:29728:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.699396:0:29728:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f293800 already unused, calling callback (ffffffffa0879d70) 00000100:00100000:2.0:1746155562.699398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155562.699400:0:29728:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.699406:0:29728:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.699407:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123615872 00000100:00100000:2.0:1746155562.699409:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123615872 00010000:00010000:2.0:1746155562.699417:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1062b expref: 23 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.699419:0:29728:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.699424:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f293800/0x844e5faceb5eaaca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.699428:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5883 00000100:00100000:2.0:1746155562.699432:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976123615872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.699439:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.699445:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1062b expref: 23 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.699457:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1062b expref: 23 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.699460:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123614208:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 11450us (12104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.699465:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11726 00010000:00010000:2.0:1746155562.699466:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0df200/0x844e5faceb5eaa0d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1062b expref: 23 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.699472:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.699484:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123615872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.699488:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5883 00010000:00010000:0.0:1746155562.699665:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9400/0x844e5faceb5eaa1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10647 expref: 10 pid: 8437 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746155562.699991:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5884 00000100:00100000:0.0:1746155562.699997:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123615360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155562.700004:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155562.700012:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9400/0x844e5faceb5eaa1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10647 expref: 10 pid: 8437 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746155562.700020:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9400/0x844e5faceb5eaa1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10647 expref: 10 pid: 8437 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746155562.700031:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01d9400/0x844e5faceb5eaa1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10647 expref: 10 pid: 8437 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746155562.700386:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.700387:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.700390:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.700396:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.700632:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.700639:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.700754:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155562.700770:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123615360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 773us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.700776:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5884 00010000:00010000:2.0:1746155562.700890:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.700897:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.700902:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.700908:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcbd800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155562.700910:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.700917:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.700926:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.700932:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcbd800/0x844e5faceb5eaadf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.700962:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123614336:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 12139us (12553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.700967:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11729 00000100:00100000:3.0:1746155562.701473:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.701499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.701594:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123616256 00000100:00100000:0.0:1746155562.701598:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123616256 00002000:00100000:0.0:1746155562.701629:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012bdf4e00 x1830976123616256/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.701638:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4e00 with x1830976123616256 ext(4194304->4956159) 00010000:00010000:0.0:1746155562.701643:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 28 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.701652:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 28 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.701727:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.701741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.701753:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.701906:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123616384 00000100:00100000:2.0:1746155562.701910:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123616384 00000100:00100000:2.0:1746155562.701928:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123616512 00000100:00100000:2.0:1746155562.701930:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123616512 00000100:00100000:2.0:1746155562.701948:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11731 00000100:00100000:2.0:1746155562.701954:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123616384:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.701963:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.701971:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2800/0x844e5faceb5eaaed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106c5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.702006:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124530176:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155562.702052:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.702064:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123616640 00000100:00100000:2.0:1746155562.702067:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123616640 00000100:00100000:2.0:1746155562.702085:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123616768 00000100:00100000:2.0:1746155562.702087:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123616768 00000100:00100000:2.0:1746155562.702099:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11732 00000100:00100000:2.0:1746155562.702103:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123616512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.702109:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.702117:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3800/0x844e5faceb5eaaf4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106cc expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.702137:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124530304:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155562.702155:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da480 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.702168:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11733 00000100:00100000:2.0:1746155562.702173:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123616640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.702180:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.702188:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0df600/0x844e5faceb5eaafb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106d3 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155562.702201:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3db:0x0] initial LVB size: 2097152, mtime: 0x68143829, atime: 0x68143829, ctime: 0x68143829, blocks: 0x81f 00010000:00010000:2.0:1746155562.702209:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.702211:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.702216:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0df600/0x844e5faceb5eaafb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106d3 expref: 25 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.702229:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0df600/0x844e5faceb5eaafb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106d3 expref: 25 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.702236:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0df600, rc 0) 00000100:00100000:2.0:1746155562.702251:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123616640:12345-192.168.202.51@tcp:101:cat.0 Request processed in 78us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.702256:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11733 00000100:00100000:2.0:1746155562.702272:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11734 00000100:00100000:2.0:1746155562.702278:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123616768:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.702283:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.702290:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a0de200/0x844e5faceb5eab02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106da expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155562.702299:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x6814382a, atime: 0x68143829, ctime: 0x6814382a, blocks: 0x821 00010000:00010000:2.0:1746155562.702306:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.702307:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.702311:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0de200/0x844e5faceb5eab02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106da expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.702319:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a0de200/0x844e5faceb5eab02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106da expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746155562.702436:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bdf4e00 00000100:00100000:0.0:1746155562.702450:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 675 00000100:00100000:0.0:1746155562.702455:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123616256:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155562.703113:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.703129:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123616896 00000100:00100000:3.0:1746155562.703132:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123616896 00000100:00100000:3.0:1746155562.703149:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11735 00000100:00100000:3.0:1746155562.703154:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123616896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155562.703161:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.703167:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c94d200/0x844e5faceb5eab09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106e1 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.703177:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.703184:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c94d200/0x844e5faceb5eab09 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106e1 expref: 26 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.703196:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c94d200/0x844e5faceb5eab09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106e1 expref: 26 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.703204:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94d200, rc 0) 00000100:00100000:3.0:1746155562.703223:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123616896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 69us (111us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155562.703228:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11735 00000100:00100000:3.0:1746155562.703254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.703268:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123617024 00000100:00100000:3.0:1746155562.703270:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123617024 00010000:00010000:3.0:1746155562.703281:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfc00/0x844e5faceb5ea9d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1060f expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.703296:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5885 00000100:00100000:3.0:1746155562.703301:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123617024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155562.703307:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155562.703318:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfc00/0x844e5faceb5ea9d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1060f expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.703326:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfc00/0x844e5faceb5ea9d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1060f expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.703337:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfc00/0x844e5faceb5ea9d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1060f expref: 25 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.703349:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.703364:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123617024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 63us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.703369:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5885 00000100:00100000:3.0:1746155562.703410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.703422:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123617152 00000100:00100000:3.0:1746155562.703425:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123617152 00010000:00010000:3.0:1746155562.703436:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10616 expref: 27 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.703449:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5886 00000100:00100000:3.0:1746155562.703453:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123617152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155562.703459:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155562.703466:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10616 expref: 27 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.703472:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10616 expref: 27 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.703482:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5ea9dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10616 expref: 27 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.703489:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.703490:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.703493:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.703521:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.703536:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.703550:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123617152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.703555:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5886 00010000:00010000:3.0:1746155562.703571:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.703577:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.703592:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.703598:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.703604:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.703610:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c94c200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155562.703613:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.703637:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.703646:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.703651:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c94c200/0x844e5faceb5eaae6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.703681:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976123614592:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 14693us (15250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.703686:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11730 00010000:00010000:2.0:1746155562.703810:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0de200, rc 0) 00000100:00100000:2.0:1746155562.703830:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123616768:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1552us (2075us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.703837:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11734 00000100:00100000:2.0:1746155562.705230:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123615232:12345-192.168.202.51@tcp:4:cat.0 Request processed in 7023us (7334us total) trans 17179873121 rc 0/0 00000100:00100000:2.0:1746155562.705237:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 673 00000100:00100000:1.0:1746155562.706544:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124530176:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155562.706569:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2800/0x844e5faceb5eaaed lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106c5 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.706578:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2800/0x844e5faceb5eaaed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106c5 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.706588:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db2800, rc 0) 00000100:00100000:1.0:1746155562.706610:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123616384:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4655us (5109us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155562.706615:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11731 00002000:00100000:2.0:1746155562.707238:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1257471) req@ffff88009f3ec380 x1830976123615232/t17179873121(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/448 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.707247:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ec380 with x1830976123615232 ext(1048576->1257471) 00010000:00010000:2.0:1746155562.707254:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.707263:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746155562.707269:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f3ec380 00000100:00100000:2.0:1746155562.707308:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124530304:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155562.707323:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3800/0x844e5faceb5eaaf4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106cc expref: 23 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.707330:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3800/0x844e5faceb5eaaf4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106cc expref: 23 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.707338:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3800, rc 0) 00000100:00100000:2.0:1746155562.707357:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123616512:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5252us (5629us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155562.707366:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11732 00000100:00100000:1.0:1746155562.709408:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123615104:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10924us (11318us total) trans 21474840504 rc 0/0 00000100:00100000:1.0:1746155562.709418:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 674 00002000:00100000:1.0:1746155562.709426:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (286720->1048575) req@ffff88009f3ec700 x1830976123615104/t21474840504(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/448 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.709438:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ec700 with x1830976123615104 ext(286720->1048575) 00010000:00010000:1.0:1746155562.709445:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 30 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.709455:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 30 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746155562.709460:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f3ec700 00000100:00100000:0.0:1746155562.711228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.711276:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123617280 00000100:00100000:3.0:1746155562.711285:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123617280 00000100:00100000:0.0:1746155562.711296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.711343:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123617408 00000100:00100000:2.0:1746155562.711347:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123617408 00010000:00010000:2.0:1746155562.711363:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 30 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.711387:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5887 00000100:00100000:2.0:1746155562.711393:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123617408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.711405:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.711421:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 30 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.711430:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 30 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.711448:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d582000/0x844e5faceb5ea9e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 286720->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1061d expref: 30 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.711461:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.711463:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.711467:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.711474:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.711536:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.711546:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.711554:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5888 00010000:00010000:1.0:1746155562.711555:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.711559:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123617280:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155562.711565:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155562.711572:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.711577:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.711578:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.711584:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.711585:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.711591:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f293000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155562.711593:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.711600:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0de400/0x844e5faceb5eaa37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1065c expref: 26 pid: 20200 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.711603:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.711608:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.711609:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.711611:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.711613:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.711637:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f293000/0x844e5faceb5eaac3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.711653:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155562.711692:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123613952:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 23834us (24578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.711700:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11725 00000100:00100000:2.0:1746155562.711732:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123617408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 337us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.711739:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5887 00010000:00010000:3.0:1746155562.711774:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.711796:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.711813:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123617280:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 254us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.711818:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5888 00010000:00010000:0.0:1746155562.711843:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.711849:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.711852:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155562.711862:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.711868:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.711873:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.711878:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcbd200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155562.711881:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.711886:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.711895:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.711904:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbd200/0x844e5faceb5eaad8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.711937:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1961:x1830976123614080:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 23222us (23560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.711942:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11728 00000100:00100000:1.0:1746155562.712024:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123617664 00000100:00100000:1.0:1746155562.712028:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123617664 00002000:00100000:1.0:1746155562.712050:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4952064->4956159) req@ffff88009c212a00 x1830976123617664/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.712058:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212a00 with x1830976123617664 ext(4952064->4956159) 00010000:00010000:1.0:1746155562.712064:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.712072:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746155562.712077:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c212a00 00000100:00100000:1.0:1746155562.712090:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 676 00000100:00100000:1.0:1746155562.712095:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123617664:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155562.712219:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123617664:12345-192.168.202.51@tcp:3:cat.0 Request processed in 123us (365us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155562.712225:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 676 00002000:00100000:1.0:1746155562.712230:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4952064->4956159) req@ffff88009c212a00 x1830976123617664/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.712237:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212a00 with x1830976123617664 ext(4952064->4956159) 00010000:00010000:1.0:1746155562.712241:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.712248:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746155562.712254:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c212a00 00000100:00100000:2.0:1746155562.712853:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123616256:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10397us (11379us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155562.712859:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 675 00002000:00100000:2.0:1746155562.712863:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012bdf4e00 x1830976123616256/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.712868:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4e00 with x1830976123616256 ext(4194304->4956159) 00010000:00010000:2.0:1746155562.712872:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 27 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.712879:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 27 pid: 4461 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746155562.712883:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bdf4e00 00000100:00100000:0.0:1746155562.715153:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.715204:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123617792 00000100:00100000:3.0:1746155562.715214:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123617792 00010000:00010000:3.0:1746155562.715237:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.715267:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5889 00000100:00100000:3.0:1746155562.715274:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123617792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155562.715284:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155562.715299:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.715312:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.715328:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f293c00/0x844e5faceb5eaaa7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106b7 expref: 21 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.715339:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.715372:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123617792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 98us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.715377:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5889 00000100:00100000:0.0:1746155562.717343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.717375:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.717774:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.718060:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123617920 00000100:00100000:2.0:1746155562.718066:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123617920 00000100:00100000:0.0:1746155562.718072:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.718082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.718159:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.718192:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123618176 00000100:00100000:1.0:1746155562.718192:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123618048 00000100:00100000:3.0:1746155562.718195:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123618176 00000100:00100000:1.0:1746155562.718195:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123618048 00000100:00100000:0.0:1746155562.718284:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.718296:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123618688 00000100:00100000:0.0:1746155562.718298:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123618688 00010000:00010000:0.0:1746155562.718316:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 28 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746155562.718332:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5890 00000100:00100000:0.0:1746155562.718337:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123618688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155562.718347:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155562.718362:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 28 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.718376:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 28 pid: 4461 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.718386:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123618304 00000100:00100000:2.0:1746155562.718389:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123618304 00010000:00010000:0.0:1746155562.718393:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f293a00/0x844e5faceb5eaa8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1069b expref: 29 pid: 4461 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746155562.718403:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746155562.718404:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123618560 00010000:00010000:0.0:1746155562.718404:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746155562.718406:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123618560 00010000:00010000:0.0:1746155562.718407:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.718413:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123618432 00000100:00100000:2.0:1746155562.718415:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123618432 00010000:00010000:0.0:1746155562.718415:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.718424:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11736 00000100:00100000:2.0:1746155562.718429:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123617920:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155562.718431:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155562.718440:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.718449:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3600/0x844e5faceb5eab10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106e8 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.718455:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123618688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 119us (171us total) trans 0 rc 0/0 00002000:00010000:2.0:1746155562.718460:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x6814382b, atime: 0x6814382a, ctime: 0x6814382b, blocks: 0x767 00000100:00100000:0.0:1746155562.718460:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5890 00010000:00010000:2.0:1746155562.718469:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.718471:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.718476:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3600/0x844e5faceb5eab10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106e8 expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.718485:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3600/0x844e5faceb5eab10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106e8 expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.718492:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3600, rc 0) 00000100:00100000:2.0:1746155562.718523:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123617920:12345-192.168.202.51@tcp:101:cat.0 Request processed in 93us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.718528:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11736 00000100:00100000:2.0:1746155562.718537:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11737 00000100:00100000:2.0:1746155562.718542:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123618176:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.718547:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.718555:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eab17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106f6 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.718565:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.718566:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.718570:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eab17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106f6 expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.718579:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eab17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106f6 expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.718585:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db2a00, rc 0) 00000100:00100000:2.0:1746155562.718600:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123618176:12345-192.168.202.51@tcp:101:cat.0 Request processed in 57us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.718604:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11737 00000100:00100000:2.0:1746155562.718615:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11738 00000100:00100000:2.0:1746155562.718632:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123618048:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.718637:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.718645:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5eab1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106ef expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155562.718657:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3da:0x0] initial LVB size: 2097152, mtime: 0x6814382b, atime: 0x6814382b, ctime: 0x6814382b, blocks: 0x821 00010000:00010000:2.0:1746155562.718664:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.718665:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.718669:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5eab1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106ef expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.718677:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5eab1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106ef expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.718683:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3400, rc 0) 00000100:00100000:2.0:1746155562.718697:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123618048:12345-192.168.202.51@tcp:101:cat.0 Request processed in 78us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.718705:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11738 00000100:00100000:2.0:1746155562.718715:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11739 00000100:00100000:2.0:1746155562.718720:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123618304:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155562.718722:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11740 00010000:00010000:2.0:1746155562.718725:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155562.718726:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123618560:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155562.718731:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.718731:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eab25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f106fd expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.718737:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c94da00/0x844e5faceb5eab2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1070b expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.718738:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.718739:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.718742:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eab25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106fd expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746155562.718746:0:10591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3dc:0x0] initial LVB size: 4194304, mtime: 0x6814382b, atime: 0x6814382b, ctime: 0x6814382b, blocks: 0x102b 00010000:00010000:2.0:1746155562.718750:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eab25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106fd expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.718752:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.718753:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.718756:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94da00/0x844e5faceb5eab2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1070b expref: 28 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.718756:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3e00, rc 0) 00010000:00010000:3.0:1746155562.718764:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c94da00/0x844e5faceb5eab2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1070b expref: 28 pid: 10591 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155562.718768:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123618304:12345-192.168.202.51@tcp:101:cat.0 Request processed in 49us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.718773:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11739 00010000:00010000:3.0:1746155562.718774:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94da00, rc 0) 00000100:00100000:2.0:1746155562.718781:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11741 00000100:00100000:2.0:1746155562.718785:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123618432:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155562.718786:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123618560:12345-192.168.202.51@tcp:101:cat.0 Request processed in 61us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.718790:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11740 00010000:00010000:2.0:1746155562.718790:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.718795:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5eab33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10704 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.718816:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5eab33 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10704 expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.718817:0:9235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.718824:0:9235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.718824:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5eab33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10704 expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.718832:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3a00, rc 0) 00010000:00010000:3.0:1746155562.718840:0:9235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.718844:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123618432:12345-192.168.202.51@tcp:101:cat.0 Request processed in 59us (685us total) trans 0 rc 301/301 00010000:00010000:3.0:1746155562.718846:0:9235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.718848:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11741 00010000:00010000:3.0:1746155562.718852:0:9235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.718858:0:9235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0db2e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155562.718861:0:9235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.718867:0:9235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.718886:0:9235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.718891:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5eaad1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.718922:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976123614464:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 30689us (31483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.718928:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11727 00000100:00100000:0.0:1746155562.720338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.720460:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123618816 00000100:00100000:1.0:1746155562.720465:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123618816 00000100:00100000:1.0:1746155562.720547:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11742 00000100:00100000:1.0:1746155562.720553:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:28969:x1830976123618816:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155562.720647:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.720659:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a065ae00/0x844e5faceb5eab3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10712 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155562.720672:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d9:0x0] initial LVB size: 4954272, mtime: 0x6814382b, atime: 0x6814382b, ctime: 0x6814382b, blocks: 0x1617 00010000:00010000:1.0:1746155562.720684:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.720685:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.720690:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a065ae00/0x844e5faceb5eab3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10712 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.720704:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a065ae00/0x844e5faceb5eab3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10712 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.720711:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a065ae00, rc 0) 00000100:00100000:1.0:1746155562.720747:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:28969:x1830976123618816:12345-192.168.202.51@tcp:101:cat.0 Request processed in 194us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.720753:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11742 00000100:00100000:2.0:1746155562.720948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.721074:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123619072 00000100:00100000:1.0:1746155562.721078:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123619072 00000100:00100000:1.0:1746155562.721109:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9928 00000100:00100000:1.0:1746155562.721115:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+28:28979:x1830976123619072:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:1.0:1746155562.721186:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155562.721201:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5eaa68 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10686 expref: 28 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721223:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155562.721227:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155562.721247:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155562.721255:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdcd expref: 35 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721261:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0200/0x844e5faceb5e9ddb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fddb expref: 314 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721270:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094704a00/0x844e5faceb5ea345 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100f9 expref: 314 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721275:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ea38b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10131 expref: 35 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721280:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9ef3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe83 expref: 314 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721284:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea0c1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffa2 expref: 35 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721290:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155562.721313:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea0c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffa2 expref: 35 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721322:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea0c1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffa2 expref: 35 pid: 14234 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.721333:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124530432:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.721403:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe83 expref: 314 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721410:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe83 expref: 314 pid: 27374 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.721422:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124530560:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.721444:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ea38b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10131 expref: 35 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721451:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ea38b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10131 expref: 35 pid: 14234 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.721456:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124530688:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.721476:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094704a00/0x844e5faceb5ea345 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100f9 expref: 314 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721483:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094704a00/0x844e5faceb5ea345 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100f9 expref: 314 pid: 14234 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.721490:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124530816:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.721545:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0200/0x844e5faceb5e9ddb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fddb expref: 314 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721552:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0200/0x844e5faceb5e9ddb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fddb expref: 314 pid: 27374 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.721560:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124530944:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.721578:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdcd expref: 35 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.721589:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdcd expref: 35 pid: 14234 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.721596:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124531072:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.721610:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f1da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155562.723235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.723724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.723740:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123619968 00000100:00100000:0.0:1746155562.723745:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123619968 00000100:00100000:1.0:1746155562.723833:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124530432:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.723842:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124530560:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.723848:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124530688:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.723853:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124530816:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.723859:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124530944:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.723926:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123619328 00000100:00100000:2.0:1746155562.723930:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123619328 00002000:00100000:2.0:1746155562.723953:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (4952064->4956159) req@ffff88009451e300 x1830976123619328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.723961:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451e300 with x1830976123619328 ext(4952064->4956159) 00002000:00010000:2.0:1746155562.723965:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451e300 00000100:00100000:2.0:1746155562.723979:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4447 00000100:00100000:2.0:1746155562.723984:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123619328:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155562.724101:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123619328:12345-192.168.202.51@tcp:3:cat.0 Request processed in 116us (869us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155562.724107:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4447 00002000:00100000:2.0:1746155562.724112:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d9:0x0] (4952064->4956159) req@ffff88009451e300 x1830976123619328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.724118:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451e300 with x1830976123619328 ext(4952064->4956159) 00002000:00010000:2.0:1746155562.724121:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451e300 00000100:00100000:2.0:1746155562.724149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.724220:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.724233:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123619584 00000100:00100000:2.0:1746155562.724236:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123619584 00010000:00010000:2.0:1746155562.724249:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe83 expref: 315 pid: 27374 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.724264:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123620096 00000100:00100000:2.0:1746155562.724266:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123620096 00010000:00010000:2.0:1746155562.724272:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0200/0x844e5faceb5e9ddb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fddb expref: 316 pid: 27374 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.724285:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5891 00000100:00100000:2.0:1746155562.724290:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+316:1962:x1830976123619584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.724297:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.724308:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe83 expref: 316 pid: 27374 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.724317:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe83 expref: 316 pid: 27374 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746155562.724317:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3983 00000100:00100000:0.0:1746155562.724323:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+36:7660:x1830976123619968:12345-192.168.202.51@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1746155562.724332:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0600/0x844e5faceb5e9ef3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fe83 expref: 316 pid: 27374 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.724343:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.724347:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.724354:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.724373:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+315:1962:x1830976123619584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.724379:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5891 00000100:00100000:2.0:1746155562.724388:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5892 00000100:00100000:2.0:1746155562.724393:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+314:1962:x1830976123620096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.724398:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.724401:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0200/0x844e5faceb5e9ddb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fddb expref: 314 pid: 27374 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.724409:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0200/0x844e5faceb5e9ddb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fddb expref: 314 pid: 27374 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.724418:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938a0200/0x844e5faceb5e9ddb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fddb expref: 314 pid: 27374 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.724426:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.724429:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.724434:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155562.724435:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+37:7660:x1830976123619968:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 111us (711us total) trans 8589943849 rc 0/0 00000100:00100000:0.0:1746155562.724441:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3983 00000100:00100000:2.0:1746155562.724448:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+313:1962:x1830976123620096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 55us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.724453:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5892 00000100:00100000:1.0:1746155562.724538:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124531072:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155562.724565:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155562.724968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.725176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.725214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.725904:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123619712 00000100:00100000:2.0:1746155562.725908:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123619712 00010000:00010000:2.0:1746155562.725922:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094704a00/0x844e5faceb5ea345 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100f9 expref: 313 pid: 14234 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.725936:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123619456 00000100:00100000:2.0:1746155562.725939:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123619456 00010000:00010000:2.0:1746155562.725946:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea0c1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffa2 expref: 37 pid: 14234 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.725956:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123620224 00000100:00100000:2.0:1746155562.725958:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123620224 00010000:00010000:2.0:1746155562.725964:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdcd expref: 38 pid: 14234 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.725974:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5893 00000100:00100000:2.0:1746155562.725979:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+313:1961:x1830976123619712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.725986:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.725990:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094704a00/0x844e5faceb5ea345 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100f9 expref: 313 pid: 14234 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.725997:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094704a00/0x844e5faceb5ea345 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100f9 expref: 313 pid: 14234 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.726008:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094704a00/0x844e5faceb5ea345 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f100f9 expref: 313 pid: 14234 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.726017:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.726020:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.726026:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.726043:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1961:x1830976123619712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 64us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.726049:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5893 00000100:00100000:2.0:1746155562.726059:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5894 00000100:00100000:2.0:1746155562.726063:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+38:1961:x1830976123619456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.726069:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.726077:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea0c1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffa2 expref: 38 pid: 14234 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.726085:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea0c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffa2 expref: 38 pid: 14234 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.726094:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb39600/0x844e5faceb5ea0c1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ffa2 expref: 38 pid: 14234 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.726101:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.726104:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.726108:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.726119:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+37:1961:x1830976123619456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 56us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.726124:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5894 00000100:00100000:2.0:1746155562.726132:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5895 00000100:00100000:2.0:1746155562.726137:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1961:x1830976123620224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.726142:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.726146:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdcd expref: 36 pid: 14234 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.726152:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdcd expref: 36 pid: 14234 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.726161:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77000/0x844e5faceb5e9db8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0fdcd expref: 36 pid: 14234 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.726168:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.726171:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.726175:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.726189:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1961:x1830976123620224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.726193:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5895 00000100:00100000:0.0:1746155562.727055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.727125:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123620480 00000100:00100000:3.0:1746155562.727130:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123620480 00000100:00100000:3.0:1746155562.727148:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3984 00000100:00100000:3.0:1746155562.727153:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:28969:x1830976123620480:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155562.727635:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+313:28969:x1830976123620480:12345-192.168.202.51@tcp:35:cat.0 Request processed in 480us (580us total) trans 8589943850 rc 0/0 00000100:00100000:3.0:1746155562.727642:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3984 00000100:00100000:1.0:1746155562.727885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.727961:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123620608 00000100:00100000:3.0:1746155562.727964:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123620608 00010000:00010000:3.0:1746155562.727977:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ea38b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10131 expref: 35 pid: 14234 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.727993:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5896 00000100:00100000:3.0:1746155562.727998:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1960:x1830976123620608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155562.728004:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155562.728008:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ea38b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10131 expref: 35 pid: 14234 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.728017:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ea38b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10131 expref: 35 pid: 14234 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.728029:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ea38b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10131 expref: 35 pid: 14234 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.728037:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155562.728041:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.728047:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.728053:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.728068:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.728085:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1960:x1830976123620608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.728090:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5896 00010000:00010000:0.0:1746155562.728219:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155562.728225:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000040:00080000:0.0:1746155562.728777:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2845, 88 off237744 00000004:00080000:0.0:1746155562.728784:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691878280574ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.728810:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2793, 88 off232896 00000004:00080000:0.0:1746155562.728814:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691878310882ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.728824:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2794, 88 off232984 00000004:00080000:0.0:1746155562.728827:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691878323724ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.728833:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2846, 88 off237832 00000004:00080000:0.0:1746155562.728835:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691878332401ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.728841:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2847, 88 off237920 00000004:00080000:0.0:1746155562.728844:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691878340904ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.728850:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2795, 88 off233072 00000004:00080000:0.0:1746155562.728852:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691878349339ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.728858:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2796, 88 off233160 00000004:00080000:0.0:1746155562.728860:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691878357571ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.728867:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2797, 88 off233248 00000004:00080000:0.0:1746155562.728869:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691878366091ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.728875:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2848, 88 off238008 00000004:00080000:0.0:1746155562.728878:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691878375236ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.728884:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2798, 88 off233336 00000004:00080000:0.0:1746155562.728886:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691878383464ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.728892:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2849, 88 off238096 00000004:00080000:0.0:1746155562.728894:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691878391634ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.728901:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2799, 88 off233424 00000004:00080000:0.0:1746155562.728903:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691878399921ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.728909:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2850, 88 off238184 00000004:00080000:0.0:1746155562.728911:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691878408102ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.728917:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2851, 88 off238272 00000004:00080000:0.0:1746155562.728919:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691878416056ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.728924:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2852, 88 off238360 00000004:00080000:0.0:1746155562.728926:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691878423341ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.728932:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2853, 88 off238448 00000004:00080000:0.0:1746155562.728934:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691878430987ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.728940:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2800, 88 off233512 00000004:00080000:0.0:1746155562.728942:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691878439497ns, next at 645866785986ns, rc = 0 00000001:00080000:3.0:1746155562.755778:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943851 is committed 00000004:00080000:3.0:1746155562.755786:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1993 committed 00000004:00080000:3.0:1746155562.755793:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2052 committed 00000004:00080000:3.0:1746155562.755798:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2051 committed 00000004:00080000:3.0:1746155562.755799:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2050 committed 00000004:00080000:3.0:1746155562.755800:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2049 committed 00000004:00080000:3.0:1746155562.755802:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1992 committed 00000004:00080000:3.0:1746155562.755803:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2048 committed 00000004:00080000:3.0:1746155562.755804:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1991 committed 00000004:00080000:3.0:1746155562.755806:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2047 committed 00000004:00080000:3.0:1746155562.755807:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1990 committed 00000004:00080000:3.0:1746155562.755810:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1989 committed 00000004:00080000:3.0:1746155562.755811:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1988 committed 00000004:00080000:3.0:1746155562.755812:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2046 committed 00000004:00080000:3.0:1746155562.755814:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2045 committed 00000004:00080000:3.0:1746155562.755815:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1987 committed 00000004:00080000:3.0:1746155562.755816:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1986 committed 00000004:00080000:3.0:1746155562.755818:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2044 committed 00000001:00080000:3.0:1746155562.755824:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943849 is committed 00000001:00080000:3.0:1746155562.755828:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943847 is committed 00000001:00080000:3.0:1746155562.755920:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943850 is committed 00000004:00010000:3.0:1746155562.755995:0:27374:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093a46680 reply state ffff880093f45c00 transno 8589943851 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155562.756005:0:27374:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746155562.756094:0:27374:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746155562.756107:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28979:x1830976123619072:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 34988us (35156us total) trans 8589943851 rc 0/0 00000100:00100000:3.0:1746155562.756114:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9928 00010000:00010000:3.0:1746155562.756138:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.756144:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.756149:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.756153:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a065b000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155562.756157:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.756165:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.756177:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155562.756179:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155562.756181:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.756185:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b000/0x844e5faceb5eab41 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155562.756303:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124531328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.756342:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155562.756371:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124531840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.756383:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155562.756395:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746155562.756399:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124531456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.756411:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155562.756420:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124531968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.756430:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155562.756445:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124531328 00000100:00100000:2.0:1746155562.756449:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124531328 00000100:00100000:2.0:1746155562.756474:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124531840 00000100:00100000:2.0:1746155562.756476:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124531840 00000100:00100000:2.0:1746155562.756482:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124531456 00000100:00100000:2.0:1746155562.756484:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124531456 00000100:00100000:2.0:1746155562.756490:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124531968 00000100:00100000:2.0:1746155562.756492:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124531968 00000100:00100000:2.0:1746155562.756519:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11743 00000100:00100000:2.0:1746155562.756524:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1830976124531328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155562.756664:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155562.756667:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155561 -> 1746155561 00002000:00010000:2.0:1746155562.756669:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155561 -> 1746155561 00002000:00010000:2.0:1746155562.756670:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155561 -> 1746155561 00002000:00010000:2.0:1746155562.756672:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746155562.756691:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1830976124531328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (349us total) trans 17179873122 rc 0/0 00000100:00100000:2.0:1746155562.756695:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11743 00000100:00100000:2.0:1746155562.756703:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11744 00000100:00100000:2.0:1746155562.756707:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1830976124531840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.756774:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1830976124531840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (390us total) trans 17179873123 rc 0/0 00000100:00100000:2.0:1746155562.756779:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11744 00000100:00100000:2.0:1746155562.756785:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11745 00000100:00100000:2.0:1746155562.756789:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1830976124531456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155562.756838:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746155562.756840:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.756842:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.756843:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.756845:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:2.0:1746155562.756858:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1830976124531456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (445us total) trans 17179873124 rc 0/0 00000100:00100000:2.0:1746155562.756864:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11745 00000100:00100000:2.0:1746155562.756871:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11746 00000100:00100000:2.0:1746155562.756874:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1830976124531968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155562.756947:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124531200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.756950:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3295:x1830976124531968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (519us total) trans 17179873125 rc 0/0 00000100:00100000:2.0:1746155562.756954:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11746 00000100:00080000:2.0:1746155562.756966:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155562.756966:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155562.756973:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124531200 00000100:00100000:2.0:1746155562.756976:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124531200 00000100:00100000:0.0:1746155562.756981:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124531712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.756988:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11747 00000100:00100000:2.0:1746155562.756992:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976124531200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155562.756994:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155562.757004:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746155562.757008:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124531584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155562.757021:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155562.757030:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124532096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155562.757044:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746155562.757056:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155562.757059:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00000100:00100000:0.0:1746155562.757059:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124531712 00002000:00010000:2.0:1746155562.757061:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.757062:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00000100:00100000:0.0:1746155562.757062:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124531712 00002000:00010000:2.0:1746155562.757064:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155562.757071:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124531584 00000100:00100000:0.0:1746155562.757073:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124531584 00000100:00100000:0.0:1746155562.757079:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124532096 00000100:00100000:0.0:1746155562.757080:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124532096 00000100:00100000:2.0:1746155562.757083:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124531200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (116us total) trans 17179873126 rc 0/0 00000100:00100000:0.0:1746155562.757087:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11748 00000100:00100000:2.0:1746155562.757090:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11747 00000100:00100000:0.0:1746155562.757091:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124531712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.757096:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11749 00000100:00100000:2.0:1746155562.757100:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976124531584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155562.757157:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11750 00000100:00100000:0.0:1746155562.757163:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976124532096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.757216:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124531584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (193us total) trans 17179873127 rc 0/0 00000100:00100000:2.0:1746155562.757221:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11749 00000100:00100000:0.0:1746155562.757250:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124532096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (204us total) trans 17179873128 rc 0/0 00000004:00080000:2.0:1746155562.757251:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094868000/2, rc 0, transno 17179873124 00000100:00100000:2.0:1746155562.757256:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124531456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155562.757256:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11750 00000004:00080000:2.0:1746155562.757262:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f703b80/2, rc 0, transno 17179873125 00000100:00100000:2.0:1746155562.757264:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124531968:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155562.757269:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a46a00/2, rc 0, transno 17179873122 00000100:00100000:2.0:1746155562.757271:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124531328:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155562.757275:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910db100/2, rc 0, transno 17179873123 00000100:00100000:2.0:1746155562.757277:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124531840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155562.757313:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124531712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (317us total) trans 17179873129 rc 0/0 00000100:00100000:0.0:1746155562.757317:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11748 00000004:00080000:0.0:1746155562.757426:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910d9880/2, rc 0, transno 17179873127 00000100:00100000:0.0:1746155562.757429:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124531584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155562.757434:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f700e00/2, rc 0, transno 17179873128 00000100:00100000:0.0:1746155562.757436:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124532096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155562.757441:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a47100/2, rc 0, transno 17179873126 00000100:00100000:0.0:1746155562.757443:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124531200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155562.757448:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910d9500/2, rc 0, transno 17179873129 00000100:00100000:0.0:1746155562.757450:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124531712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155562.757533:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124532224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.757562:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155562.757577:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124532224 00000100:00100000:1.0:1746155562.757578:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124532736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155562.757580:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124532224 00000100:00100000:1.0:1746155562.757591:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155562.757598:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124532736 00000100:00100000:0.0:1746155562.757599:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124532736 00000100:00100000:1.0:1746155562.757600:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746155562.757604:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124532608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155562.757607:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11751 00000100:00100000:0.0:1746155562.757611:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3298:x1830976124532224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.757616:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155562.757638:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124533120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.757650:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155562.757664:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124532608 00000100:00100000:1.0:1746155562.757666:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124532608 00000100:00100000:1.0:1746155562.757678:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124533120 00000100:00100000:1.0:1746155562.757680:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124533120 00000100:00100000:1.0:1746155562.757687:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11752 00000100:00100000:1.0:1746155562.757691:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3298:x1830976124532736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155562.757715:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155562.757717:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:0.0:1746155562.757719:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155562 -> 1746155562 00002000:00010000:0.0:1746155562.757721:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:0.0:1746155562.757722:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:0.0:1746155562.757742:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976124532224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (179us total) trans 21474840505 rc 0/0 00000100:00100000:0.0:1746155562.757747:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11751 00000100:00100000:0.0:1746155562.757755:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11753 00000100:00100000:0.0:1746155562.757759:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976124532608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.757771:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976124532736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (178us total) trans 21474840506 rc 0/0 00000100:00100000:1.0:1746155562.757776:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11752 00000100:00100000:1.0:1746155562.757784:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11754 00000100:00100000:1.0:1746155562.757788:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3298:x1830976124533120:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155562.757849:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc5500/2, rc 0, transno 21474840505 00002000:00010000:0.0:1746155562.757852:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:0.0:1746155562.757854:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00000100:00100000:1.0:1746155562.757855:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124532224:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155562.757856:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155562.757858:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155562.757859:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000004:00080000:1.0:1746155562.757861:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fe8df80/2, rc 0, transno 21474840506 00000100:00100000:1.0:1746155562.757864:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124532736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155562.757878:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3298:x1830976124532608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (260us total) trans 21474840508 rc 0/0 00000100:00100000:0.0:1746155562.757883:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11753 00000100:00100000:1.0:1746155562.757894:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976124533120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (242us total) trans 21474840507 rc 0/0 00000100:00080000:0.0:1746155562.757895:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746155562.757899:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11754 00000004:00080000:1.0:1746155562.757921:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fe8e680/2, rc 0, transno 21474840508 00000100:00100000:1.0:1746155562.757924:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124532608:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155562.757929:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b6c3b80/2, rc 0, transno 21474840507 00000100:00100000:1.0:1746155562.757931:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124533120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155562.757958:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124533248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155562.757973:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155562.758135:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124533248 00000100:00100000:1.0:1746155562.758139:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124533248 00000100:00100000:1.0:1746155562.758152:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11755 00000100:00100000:1.0:1746155562.758156:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976124533248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.758227:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3298:x1830976124533248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (252us total) trans 21474840509 rc 0/0 00000100:00100000:1.0:1746155562.758231:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11755 00000004:00080000:0.0:1746155562.758238:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130898700/2, rc 0, transno 21474840509 00000100:00100000:0.0:1746155562.758241:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124533248:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155562.758455:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124532480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155562.758476:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155562.758559:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124532352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155562.758580:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155562.758584:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124532992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155562.758592:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124532864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155562.758597:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155562.758605:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124532480 00000100:00100000:2.0:1746155562.758607:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124532480 00000100:00100000:3.0:1746155562.758617:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124532352 00000100:00100000:3.0:1746155562.758630:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124532352 00000100:00100000:2.0:1746155562.758630:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124532992 00000100:00100000:2.0:1746155562.758632:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124532992 00000100:00100000:2.0:1746155562.758643:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11756 00000100:00100000:3.0:1746155562.758732:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11757 00000100:00100000:3.0:1746155562.758737:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3296:x1830976124532992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155562.758783:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3296:x1830976124532480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.758788:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11758 00000100:00100000:1.0:1746155562.758793:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976124532352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155562.758855:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:2.0:1746155562.758857:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.758859:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.758860:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.758862:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5655 -> 5655 00000100:00100000:2.0:1746155562.758883:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3296:x1830976124532480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 236us (406us total) trans 21474840510 rc 0/0 00000100:00100000:2.0:1746155562.758888:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11756 00000100:00100000:2.0:1746155562.758903:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155562.758919:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124532864 00000100:00100000:3.0:1746155562.758921:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3296:x1830976124532992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 184us (322us total) trans 21474840511 rc 0/0 00000100:00100000:2.0:1746155562.758922:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124532864 00000100:00100000:3.0:1746155562.758926:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11757 00000100:00100000:2.0:1746155562.758932:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11759 00000100:00100000:2.0:1746155562.758936:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976124532864:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155562.758955:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fe8e300/2, rc 0, transno 21474840510 00000100:00100000:3.0:1746155562.758959:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124532480:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155562.758965:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fef0000/2, rc 0, transno 21474840511 00000100:00100000:3.0:1746155562.758967:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124532992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155562.759024:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1830976124532864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (120us total) trans 21474840512 rc 0/0 00000100:00100000:2.0:1746155562.759029:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11759 00000004:00080000:3.0:1746155562.759039:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fef3b80/2, rc 0, transno 21474840512 00000100:00100000:3.0:1746155562.759043:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124532864:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155562.759089:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155562.759092:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155562 -> 1746155562 00002000:00010000:0.0:1746155562.759093:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155561 -> 1746155561 00002000:00010000:0.0:1746155562.759095:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155562 -> 1746155562 00002000:00010000:0.0:1746155562.759096:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155562.759138:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3295:x1830976124532352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 345us (556us total) trans 21474840513 rc 0/0 00000100:00100000:0.0:1746155562.759142:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11758 00000004:00080000:3.0:1746155562.759166:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc7800/2, rc 0, transno 21474840513 00000100:00100000:3.0:1746155562.759169:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124532352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155562.761791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.761988:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123620736 00000100:00100000:3.0:1746155562.761995:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123620736 00000100:00100000:3.0:1746155562.762035:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9929 00000100:00100000:3.0:1746155562.762041:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:28979:x1830976123620736:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155562.762060:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.762074:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5eab48 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10719 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.762115:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5eab48 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10719 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.762127:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5eab48 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10719 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.762138:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155562.762140:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155562.762143:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94c400, rc 0) 00000100:00100000:3.0:1746155562.762184:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28979:x1830976123620736:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 142us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.762756:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9929 00000100:00100000:0.0:1746155562.768130:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.768221:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123620864 00000100:00100000:3.0:1746155562.768229:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123620864 00000100:00100000:3.0:1746155562.768259:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9930 00000100:00100000:3.0:1746155562.768265:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28979:x1830976123620864:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155562.768280:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.768295:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c800/0x844e5faceb5eab4f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10720 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.768371:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5eab56 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.768383:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5eab56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.768393:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5eab56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155562.768419:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155562.768423:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155562.768437:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5eab56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.768456:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c800/0x844e5faceb5eab4f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10720 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.768466:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5eab56 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10720 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.768472:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155562.768475:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155562.768477:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94d600, rc 0) 00000100:00100000:3.0:1746155562.768541:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:28979:x1830976123620864:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 275us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.768546:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9930 00000100:00100000:0.0:1746155562.770912:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.770945:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.770968:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.770980:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.770990:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.771042:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.771331:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123621120 00000100:00100000:2.0:1746155562.771338:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123621120 00000100:00100000:2.0:1746155562.771365:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123621376 00000100:00100000:2.0:1746155562.771366:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123621376 00000100:00100000:2.0:1746155562.771374:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123621632 00000100:00100000:2.0:1746155562.771376:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123621632 00000100:00100000:2.0:1746155562.771383:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123620992 00000100:00100000:2.0:1746155562.771385:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123620992 00000100:00100000:2.0:1746155562.771392:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123621248 00000100:00100000:2.0:1746155562.771393:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123621248 00000100:00100000:2.0:1746155562.771400:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123621504 00000100:00100000:2.0:1746155562.771401:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123621504 00000100:00100000:2.0:1746155562.771411:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11760 00000100:00100000:2.0:1746155562.771417:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123621120:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155562.771430:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.771443:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d583600/0x844e5faceb5eab5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1072e expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.771459:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.771461:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.771468:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d583600/0x844e5faceb5eab5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1072e expref: 8 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.771486:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d583600/0x844e5faceb5eab5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1072e expref: 8 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.771494:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d583600, rc 0) 00000100:00100000:2.0:1746155562.771545:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123621120:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 128us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.771550:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11760 00000100:00100000:2.0:1746155562.771563:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11761 00000100:00100000:2.0:1746155562.771567:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123621376:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155562.771573:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.771582:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5eab64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1073c expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.771591:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.771592:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.771596:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5eab64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1073c expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.771605:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5eab64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1073c expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.771610:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d582200, rc 0) 00000100:00100000:2.0:1746155562.771635:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123621376:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 67us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.771640:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11761 00000100:00100000:2.0:1746155562.771649:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11762 00000100:00100000:2.0:1746155562.771653:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123621632:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155562.771658:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.771664:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5eab6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1074a expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.771672:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.771673:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.771677:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5eab6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1074a expref: 8 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.771684:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5eab6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1074a expref: 8 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.771690:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d582c00, rc 0) 00000100:00100000:2.0:1746155562.771702:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123621632:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 49us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.771706:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11762 00000100:00100000:2.0:1746155562.771714:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11763 00000100:00100000:2.0:1746155562.771718:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123620992:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155562.771723:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.771728:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5eab72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10727 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.771735:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.771736:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.771740:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5eab72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10727 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.771747:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5eab72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10727 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.771753:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d583200, rc 0) 00000100:00100000:2.0:1746155562.771766:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123620992:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 48us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.771770:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11763 00000100:00100000:2.0:1746155562.771779:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11764 00000100:00100000:2.0:1746155562.771783:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123621248:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155562.771788:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.771793:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5eab79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10735 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.771800:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.771801:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.771805:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5eab79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10735 expref: 8 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.771813:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5eab79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10735 expref: 8 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.771820:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d583800, rc 0) 00000100:00100000:2.0:1746155562.771833:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123621248:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 49us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.771837:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11764 00000100:00100000:2.0:1746155562.771846:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11765 00000100:00100000:2.0:1746155562.771850:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123621504:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155562.771855:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.771860:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d583400/0x844e5faceb5eab80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10743 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.771868:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.771869:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.771872:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d583400/0x844e5faceb5eab80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10743 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.771879:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d583400/0x844e5faceb5eab80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10743 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.771885:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d583400, rc 0) 00000100:00100000:2.0:1746155562.771897:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123621504:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 48us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.771901:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11765 00000100:00100000:0.0:1746155562.779155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.779428:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.779545:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123621888 00000100:00100000:2.0:1746155562.779553:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123621888 00000100:00100000:2.0:1746155562.780807:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123622144 00000100:00100000:2.0:1746155562.780811:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123622144 00000100:00100000:2.0:1746155562.780842:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4448 00000100:00100000:2.0:1746155562.780849:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123621888:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155562.780880:0:31249:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009048fe00/0x844e5faceb5eab87 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.780881:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4449 00000100:00100000:0.0:1746155562.780886:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123622144:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155562.780892:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.780894:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.780899:0:31249:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009048fe00/0x844e5faceb5eab87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.780900:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5eab8e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.780910:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.780911:0:31249:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009048fe00/0x844e5faceb5eab87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.780911:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.780913:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5eab8e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.780920:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5eab8e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.784962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.785545:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123622400 00000100:00100000:1.0:1746155562.785552:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123622400 00000100:00100000:1.0:1746155562.785603:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4450 00000100:00100000:1.0:1746155562.785609:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123622400:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155562.785648:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eab95 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.785659:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.785661:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.785665:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eab95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.785675:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eab95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.787094:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.787111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.787135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.787148:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123622656 00000100:00100000:0.0:1746155562.787152:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123622656 00000100:00100000:0.0:1746155562.787177:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123623168 00000100:00100000:0.0:1746155562.787180:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123623168 00000100:00100000:0.0:1746155562.787191:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123622912 00000100:00100000:0.0:1746155562.787192:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123622912 00000100:00100000:0.0:1746155562.787206:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4451 00000100:00100000:0.0:1746155562.787211:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976123622656:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155562.787231:0:31253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a000/0x844e5faceb5eab9c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.787240:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.787242:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.787245:0:31253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a000/0x844e5faceb5eab9c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.787254:0:31253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a000/0x844e5faceb5eab9c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.787992:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4452 00000100:00100000:2.0:1746155562.788000:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123623168:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155562.788017:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5eaba3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.788025:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.788026:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.788028:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5eaba3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.788035:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5eaba3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.788265:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4453 00000100:00100000:0.0:1746155562.788270:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1962:x1830976123622912:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155562.788283:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b000/0x844e5faceb5eabaa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.788290:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.788291:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.788293:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b000/0x844e5faceb5eabaa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.788300:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b000/0x844e5faceb5eabaa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.792993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.793018:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123623936 00000100:00100000:0.0:1746155562.793024:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123623936 00000100:00100000:0.0:1746155562.793108:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9931 00000100:00100000:0.0:1746155562.793116:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+6:28985:x1830976123623936:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155562.793135:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155562.793150:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eabb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10751 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.793235:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eabb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.793246:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eabb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.793259:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eabb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.793268:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3be00/0x844e5faceb5eabbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.793274:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3be00/0x844e5faceb5eabbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.793278:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3be00/0x844e5faceb5eabbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.793361:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.793370:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eaab5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106be expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.793377:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.793399:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eaab5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106be expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.793409:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eaab5 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106be expref: 8 pid: 15474 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746155562.793420:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124533376:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155562.793463:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155562.799978:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.800018:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.800042:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123623680 00000100:00100000:2.0:1746155562.800050:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123623680 00000100:00100000:2.0:1746155562.800098:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123623552 00000100:00100000:2.0:1746155562.800100:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123623552 00000100:00100000:2.0:1746155562.800134:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4454 00000100:00100000:2.0:1746155562.800141:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1960:x1830976123623680:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155562.800169:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c200/0x844e5faceb5eabcd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.800181:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.800183:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.800188:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c200/0x844e5faceb5eabcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.800197:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c200/0x844e5faceb5eabcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.800790:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4455 00000100:00100000:3.0:1746155562.800797:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123623552:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155562.800813:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135f77000/0x844e5faceb5eabd4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.800821:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.800822:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.800825:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f77000/0x844e5faceb5eabd4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.800833:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f77000/0x844e5faceb5eabd4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.801541:0:31249:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009048fe00/0x844e5faceb5eab87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.801549:0:31249:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009048fe00/0x844e5faceb5eab87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.801554:0:31249:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009048fe00/0x844e5faceb5eab87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.801560:0:31249:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009048fe00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155562.801563:0:31249:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009048fe00/0x844e5faceb5eab87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.801569:0:31249:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009048fe00/0x844e5faceb5eab87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.801581:0:31249:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009048fe00/0x844e5faceb5eab87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.801586:0:31249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009048fe00/0x844e5faceb5eab87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.801660:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1963:x1830976123621888:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 20810us (22513us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.801667:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4448 00000100:00100000:0.0:1746155562.807911:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124533376:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155562.807935:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155562.807965:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.808365:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123624064 00000100:00100000:3.0:1746155562.808371:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123624064 00010000:00010000:3.0:1746155562.808394:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eaab5 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106be expref: 9 pid: 15474 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746155562.808414:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5897 00000100:00100000:3.0:1746155562.808420:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123624064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155562.808430:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155562.808434:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eaab5 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106be expref: 9 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746155562.808443:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eaab5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106be expref: 9 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.808458:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5eab8e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.808459:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eaab5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106be expref: 9 pid: 15474 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746155562.808471:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5eab8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.808477:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5eab8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.808487:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155562.808491:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155562.808498:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155562.808516:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155562.808529:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155562.808534:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808539:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155562.808552:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000100:00100000:3.0:1746155562.808562:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123624064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 141us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.808567:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5897 00010000:00010000:0.0:1746155562.808690:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808695:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808699:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808704:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3bc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155562.808707:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808711:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808718:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155562.808720:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155562.808722:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808726:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eabc6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808742:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eabb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808746:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eabb8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808750:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eabb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808753:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3a800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155562.808754:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eabb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808757:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eabb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808762:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155562.808763:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155562.808765:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eabb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808768:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eabb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808775:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3be00/0x844e5faceb5eabbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808779:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3be00/0x844e5faceb5eabbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808783:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3be00/0x844e5faceb5eabbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808786:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3be00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155562.808788:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3be00/0x844e5faceb5eabbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808792:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3be00/0x844e5faceb5eabbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808796:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009c823b00) 00010000:00010000:0.0:1746155562.808797:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155562.808798:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3be00/0x844e5faceb5eabbf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808801:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3be00/0x844e5faceb5eabbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.808832:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eabb1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10751 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.808837:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eabb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10751 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.808842:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b800, rc 0) 00000100:00100000:0.0:1746155562.808859:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+7:28985:x1830976123623936:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 15745us (15874us total) trans 8589943852 rc 301/301 00000100:00100000:0.0:1746155562.808864:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9931 00010000:00010000:3.0:1746155562.808884:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eab95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.808890:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eab95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.808895:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eab95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.808900:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a065b000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155562.808902:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eab95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.808906:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eab95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.808917:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eab95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.808922:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eab95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.809025:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1962:x1830976123622400:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 23415us (24068us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746155562.809029:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3b400 already unused, calling callback (ffffffffa0879d70) 00000100:00100000:3.0:1746155562.809032:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4450 00010000:00010000:1.0:1746155562.809032:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5eab8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.809038:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5eab8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.809047:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5eab8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.809053:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5eab8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.809093:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123622144:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 28206us (29665us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155562.809098:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4449 00010000:00010000:0.0:1746155562.814490:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a000/0x844e5faceb5eab9c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.814524:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a000/0x844e5faceb5eab9c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.814531:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a000/0x844e5faceb5eab9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.814537:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3a000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155562.814541:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a000/0x844e5faceb5eab9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.814549:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a000/0x844e5faceb5eab9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.814565:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a000/0x844e5faceb5eab9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.814570:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a000/0x844e5faceb5eab9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155562.814641:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1962:x1830976123622656:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 27424us (27543us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155562.814650:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4451 00010000:00010000:2.0:1746155562.815719:0:31250:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5eaba3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.815728:0:31250:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5eaba3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.815733:0:31250:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5eaba3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.815738:0:31250:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800903bbc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155562.815741:0:31250:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5eaba3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.815747:0:31250:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5eaba3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.815763:0:31250:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5eaba3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.815768:0:31250:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903bbc00/0x844e5faceb5eaba3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.815805:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123623168:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 27805us (28691us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.815812:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4452 00010000:00010000:2.0:1746155562.827587:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b000/0x844e5faceb5eabaa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.827603:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b000/0x844e5faceb5eabaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.827609:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b000/0x844e5faceb5eabaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.827616:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3b000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155562.827630:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b000/0x844e5faceb5eabaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.827637:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b000/0x844e5faceb5eabaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.827653:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b000/0x844e5faceb5eabaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.827658:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b000/0x844e5faceb5eabaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.827727:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123622912:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 39452us (40587us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.827736:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4453 00010000:00010000:2.0:1746155562.828931:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135f77000/0x844e5faceb5eabd4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.828940:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135f77000/0x844e5faceb5eabd4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.828950:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135f77000/0x844e5faceb5eabd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.828955:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f77000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155562.828958:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135f77000/0x844e5faceb5eabd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.828963:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135f77000/0x844e5faceb5eabd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.828973:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135f77000/0x844e5faceb5eabd4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.828978:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f77000/0x844e5faceb5eabd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155562.829013:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123623552:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 28216us (28993us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.829019:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4455 00010000:00010000:3.0:1746155562.829372:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c200/0x844e5faceb5eabcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.829379:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c200/0x844e5faceb5eabcd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.829384:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c200/0x844e5faceb5eabcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.829389:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff7c200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155562.829391:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c200/0x844e5faceb5eabcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.829396:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c200/0x844e5faceb5eabcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.829405:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c200/0x844e5faceb5eabcd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.829413:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c200/0x844e5faceb5eabcd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.830593:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123623680:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 30393us (30562us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155562.830601:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4454 00000100:00100000:0.0:1746155562.837584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.837651:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123624192 00000100:00100000:2.0:1746155562.837658:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123624192 00000100:00100000:2.0:1746155562.837706:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9932 00000100:00100000:2.0:1746155562.837714:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+7:28985:x1830976123624192:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155562.837731:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.837746:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c400/0x844e5faceb5eabe2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10758 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.837794:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c400/0x844e5faceb5eabe2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10758 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.837805:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c400/0x844e5faceb5eabe2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10758 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.837818:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.837821:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155562.837823:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7c400, rc 0) 00000100:00100000:2.0:1746155562.837870:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:28985:x1830976123624192:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 156us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.837875:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9932 00000100:00100000:0.0:1746155562.839913:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.839954:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123624448 00000100:00100000:2.0:1746155562.839961:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123624448 00000100:00100000:2.0:1746155562.840087:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9933 00000100:00100000:2.0:1746155562.840094:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+8:28988:x1830976123624448:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.840108:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.840121:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5eabe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1075f expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.840493:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c800/0x844e5faceb5eabf0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840528:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c800/0x844e5faceb5eabf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840539:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c800/0x844e5faceb5eabf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840554:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ca00/0x844e5faceb5eabf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840559:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ca00/0x844e5faceb5eabf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840563:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ca00/0x844e5faceb5eabf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840663:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5eabfe lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840670:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5eabfe lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840675:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5eabfe lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155562.840682:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155562.840747:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5eabfe lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840753:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5eabfe lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840758:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5eabfe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840763:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff7cc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155562.840766:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5eabfe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840771:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5eabfe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840780:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.840782:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155562.840785:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5eabfe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840789:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5eabfe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840810:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c800/0x844e5faceb5eabf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840818:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c800/0x844e5faceb5eabf0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840822:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c800/0x844e5faceb5eabf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840826:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff7c800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155562.840828:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c800/0x844e5faceb5eabf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840833:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c800/0x844e5faceb5eabf0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840839:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155562.840841:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155562.840843:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c800/0x844e5faceb5eabf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840847:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c800/0x844e5faceb5eabf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840854:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ca00/0x844e5faceb5eabf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840859:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ca00/0x844e5faceb5eabf7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840863:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ca00/0x844e5faceb5eabf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840866:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff7ca00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155562.840868:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ca00/0x844e5faceb5eabf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840872:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ca00/0x844e5faceb5eabf7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840877:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ae84e00) 00010000:00010000:2.0:1746155562.840879:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155562.840881:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ca00/0x844e5faceb5eabf7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.840885:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ca00/0x844e5faceb5eabf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155562.841437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155562.841584:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5eabe9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1075f expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.841592:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5eabe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1075f expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.841599:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7c600, rc 0) 00000100:00100000:2.0:1746155562.842191:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+9:28988:x1830976123624448:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2096us (2280us total) trans 8589943853 rc 301/301 00000100:00100000:2.0:1746155562.842197:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9933 00000100:00100000:0.0:1746155562.842915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.843574:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123624704 00000100:00100000:0.0:1746155562.843581:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123624704 00000100:00100000:0.0:1746155562.843629:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123624960 00000100:00100000:0.0:1746155562.843631:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123624960 00000100:00100000:0.0:1746155562.843655:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9934 00000100:00100000:0.0:1746155562.843661:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28979:x1830976123624704:12345-192.168.202.51@tcp:36:lfs.0 00000100:00100000:1.0:1746155562.843666:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9935 00000100:00100000:1.0:1746155562.843672:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:28985:x1830976123624960:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155562.843680:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.843683:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746155562.843696:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155562.843700:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c400/0x844e5faceb5eabe2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10758 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.843705:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5eab56 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10720 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.843716:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155562.843720:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155562.843729:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5eac0c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10766 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.843761:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.843960:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155562.843964:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155562.843990:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155562.843999:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155562.844007:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.844010:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5eab48 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10719 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.844015:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 2/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.844018:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155562.844031:0:15474:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.844050:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5eab48 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10719 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.844058:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5eab48 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10719 expref: 7 pid: 27374 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746155562.844067:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124533504:192.168.202.51@tcp:104: 00000004:00010000:0.0:1746155562.844115:0:14234:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009451f480 reply state ffff88009f663000 transno 8589943854 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155562.844120:0:14234:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746155562.844135:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2439840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155562.845354:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:28979:x1830976123624704:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 498us (2723us total) trans 8589943854 rc 0/0 00000100:00100000:0.0:1746155562.845366:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9934 00000100:00100000:3.0:1746155562.845927:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.846163:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123625088 00000100:00100000:0.0:1746155562.846169:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123625088 00000100:00100000:0.0:1746155562.846206:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9936 00000100:00100000:0.0:1746155562.846212:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:28988:x1830976123625088:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155562.846227:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155562.846239:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eac21 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1076d expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.846295:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155562.846304:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.846309:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155562.846320:0:14234:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.846328:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155562.847228:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155562.847236:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155562.847241:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155562.847246:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3b800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155562.847249:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155562.847254:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155562.847270:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155562.847273:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155562.847276:0:3281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155562.847282:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155562.847290:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b800/0x844e5faceb5eac1a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155562.847664:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.848012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.848044:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.848206:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.848403:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123625216 00000100:00100000:1.0:1746155562.848409:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123625216 00000100:00100000:2.0:1746155562.848424:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123625344 00000100:00100000:2.0:1746155562.848427:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123625344 00000100:00100000:1.0:1746155562.848438:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123625472 00000100:00100000:1.0:1746155562.848439:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123625472 00000100:00100000:2.0:1746155562.848476:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123625600 00000100:00100000:2.0:1746155562.848479:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123625600 00000100:00100000:2.0:1746155562.848677:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11766 00000100:00100000:2.0:1746155562.848735:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123625216:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:3.0:1746155562.848809:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11767 00000100:00100000:3.0:1746155562.848816:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123625344:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155562.848910:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155562.848910:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746155562.848913:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.848913:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.848915:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.848915:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155562 -> 1746155563 00002000:00010000:3.0:1746155562.848917:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.848917:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.848919:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746155562.848919:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:0.0:1746155562.849013:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11768 00000100:00100000:0.0:1746155562.849019:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123625472:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:1.0:1746155562.849043:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11769 00000100:00100000:1.0:1746155562.849049:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123625600:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155562.849115:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155562.849117:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155562 -> 1746155563 00002000:00010000:1.0:1746155562.849119:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155561 -> 1746155563 00002000:00010000:1.0:1746155562.849120:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155562 -> 1746155563 00002000:00010000:1.0:1746155562.849122:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746155562.849199:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155562.849201:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155561 -> 1746155563 00002000:00010000:0.0:1746155562.849202:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155561 -> 1746155563 00002000:00010000:0.0:1746155562.849204:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155561 -> 1746155563 00002000:00010000:0.0:1746155562.849205:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746155562.849264:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123625344:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 447us (1250us total) trans 17179873130 rc 0/0 00000100:00100000:2.0:1746155562.849264:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123625216:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 579us (1599us total) trans 21474840514 rc 0/0 00000100:00100000:3.0:1746155562.849269:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11767 00000100:00100000:2.0:1746155562.849272:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11766 00000100:00100000:1.0:1746155562.849337:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123625600:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 287us (1130us total) trans 21474840515 rc 0/0 00000100:00100000:0.0:1746155562.849337:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123625472:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 318us (1292us total) trans 17179873131 rc 0/0 00000100:00100000:1.0:1746155562.849342:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11769 00000100:00100000:0.0:1746155562.849344:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11768 00000100:00100000:0.0:1746155562.849400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.849430:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123625728 00000100:00100000:1.0:1746155562.849434:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123625728 00000100:00100000:1.0:1746155562.849461:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11770 00000100:00100000:1.0:1746155562.849466:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123625728:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:3.0:1746155562.849687:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124533504:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155562.849701:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00002000:00010000:1.0:1746155562.849753:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:1.0:1746155562.849755:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:1.0:1746155562.849757:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:1.0:1746155562.849759:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:1.0:1746155562.849761:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5655 -> 5655 00000100:00100000:1.0:1746155562.849838:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123625728:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 371us (438us total) trans 21474840516 rc 0/0 00000100:00100000:1.0:1746155562.849844:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11770 00000100:00100000:0.0:1746155562.850639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.850675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.850728:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123625856 00000100:00100000:1.0:1746155562.850732:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123625856 00000100:00100000:1.0:1746155562.850839:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11771 00000100:00100000:1.0:1746155562.850845:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123625856:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155562.850917:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155562.850920:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:1.0:1746155562.850922:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:1.0:1746155562.850924:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:1.0:1746155562.850926:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746155562.850953:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123625856:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 108us (314us total) trans 17179873132 rc 0/0 00000100:00100000:1.0:1746155562.850958:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11771 00000100:00100000:3.0:1746155562.851003:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123625984 00000100:00100000:3.0:1746155562.851006:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123625984 00010000:00010000:3.0:1746155562.851024:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5eab48 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10719 expref: 8 pid: 27374 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746155562.851086:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5898 00000100:00100000:2.0:1746155562.851092:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123625984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155562.851101:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155562.851107:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5eab48 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10719 expref: 8 pid: 27374 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.851116:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5eab48 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10719 expref: 8 pid: 27374 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.851133:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5eab48 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10719 expref: 8 pid: 27374 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746155562.851145:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.851150:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155562.851156:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.851162:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.851173:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155562.851179:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155562.851183:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155562.851197:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155562.851216:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123625984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 124us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.851221:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5898 00010000:00010000:0.0:1746155562.851343:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155562.851349:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00000040:00080000:0.0:1746155562.852205:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2854, 88 off238536 00000004:00080000:0.0:1746155562.852210:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692001707130ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.852256:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2801, 88 off233600 00000004:00080000:0.0:1746155562.852264:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692001761286ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.852282:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2802, 88 off233688 00000004:00080000:0.0:1746155562.852286:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692001782908ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.852298:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2855, 88 off238624 00000004:00080000:0.0:1746155562.852301:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692001797920ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.852306:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2856, 88 off238712 00000004:00080000:0.0:1746155562.852308:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692001805626ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.852314:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2803, 88 off233776 00000004:00080000:0.0:1746155562.852316:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692001813136ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.852327:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2804, 88 off233864 00000004:00080000:0.0:1746155562.852329:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692001826330ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.852335:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2805, 88 off233952 00000004:00080000:0.0:1746155562.852337:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692001833833ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.852342:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2857, 88 off238800 00000004:00080000:0.0:1746155562.852344:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692001841480ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.852356:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2806, 88 off234040 00000004:00080000:0.0:1746155562.852358:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692001854770ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.852363:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2858, 88 off238888 00000004:00080000:0.0:1746155562.852366:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692001862695ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.852371:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2807, 88 off234128 00000004:00080000:0.0:1746155562.852373:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692001870410ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155562.852384:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2859, 88 off238976 00000004:00080000:0.0:1746155562.852386:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692001883480ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.852392:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2860, 88 off239064 00000004:00080000:0.0:1746155562.852395:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692001891966ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.852400:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2861, 88 off239152 00000004:00080000:0.0:1746155562.852402:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692001899628ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.852413:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2862, 88 off239240 00000004:00080000:0.0:1746155562.852415:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692001912038ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155562.852421:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2808, 88 off234216 00000004:00080000:0.0:1746155562.852425:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692001921918ns, next at 645866785986ns, rc = 0 00000100:00100000:1.0:1746155562.853359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.853646:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123626240 00000100:00100000:2.0:1746155562.853651:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123626240 00000100:00100000:2.0:1746155562.853676:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9937 00000100:00100000:2.0:1746155562.853682:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+285:28991:x1830976123626240:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.853698:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.853710:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d200/0x844e5faceb5eac2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10774 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.853780:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d400/0x844e5faceb5eac36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.853792:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d400/0x844e5faceb5eac36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.853799:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d400/0x844e5faceb5eac36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.853808:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d600/0x844e5faceb5eac3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.853812:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d600/0x844e5faceb5eac3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.853817:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d600/0x844e5faceb5eac3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.853885:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d800/0x844e5faceb5eac44 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.853891:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d800/0x844e5faceb5eac44 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.853896:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d800/0x844e5faceb5eac44 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155562.853901:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155562.853968:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d800/0x844e5faceb5eac44 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.853974:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d800/0x844e5faceb5eac44 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.853979:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d800/0x844e5faceb5eac44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.853987:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff7d800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155562.853990:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d800/0x844e5faceb5eac44 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.853995:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d800/0x844e5faceb5eac44 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854003:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155562.854005:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155562.854008:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d800/0x844e5faceb5eac44 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854011:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d800/0x844e5faceb5eac44 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854021:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d400/0x844e5faceb5eac36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854025:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d400/0x844e5faceb5eac36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854028:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d400/0x844e5faceb5eac36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854032:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff7d400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155562.854034:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d400/0x844e5faceb5eac36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854037:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d400/0x844e5faceb5eac36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854042:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155562.854044:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155562.854046:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d400/0x844e5faceb5eac36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854050:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d400/0x844e5faceb5eac36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854056:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d600/0x844e5faceb5eac3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854061:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d600/0x844e5faceb5eac3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854064:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d600/0x844e5faceb5eac3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854068:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff7d600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155562.854070:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d600/0x844e5faceb5eac3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854074:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d600/0x844e5faceb5eac3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854079:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ae84f00) 00010000:00010000:2.0:1746155562.854081:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155562.854083:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d600/0x844e5faceb5eac3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854086:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d600/0x844e5faceb5eac3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155562.854520:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d200/0x844e5faceb5eac2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10774 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.854529:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d200/0x844e5faceb5eac2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10774 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.854537:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7d200, rc 0) 00000100:00100000:2.0:1746155562.854641:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:28991:x1830976123626240:12345-192.168.202.51@tcp:101:cat.0 Request processed in 958us (1282us total) trans 8589943856 rc 301/301 00000100:00100000:2.0:1746155562.854647:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9937 00000100:00100000:0.0:1746155562.857616:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.857707:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123626368 00000100:00100000:3.0:1746155562.857713:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123626368 00000100:00100000:3.0:1746155562.858036:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9938 00000100:00100000:3.0:1746155562.858054:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:28979:x1830976123626368:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155562.858074:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.858088:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bbc00/0x844e5faceb5eac52 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1077b expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.858131:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bbc00/0x844e5faceb5eac52 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1077b expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.858141:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bbc00/0x844e5faceb5eac52 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1077b expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.858152:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155562.858154:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155562.858157:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bbc00/0x844e5faceb5eac52 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1077b expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.858163:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903bbc00, rc 0) 00000100:00100000:3.0:1746155562.858207:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28979:x1830976123626368:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 154us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.858212:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9938 00000100:00100000:0.0:1746155562.859120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.859213:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123626496 00000100:00100000:3.0:1746155562.859217:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123626496 00000100:00100000:3.0:1746155562.859378:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9939 00000100:00100000:3.0:1746155562.859383:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:28991:x1830976123626496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155562.859393:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.859401:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eac59 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10782 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.859451:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.859460:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.859466:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000001:00080000:3.0:1746155562.871986:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943855 is committed 00000004:00080000:3.0:1746155562.871994:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2001 committed 00000004:00080000:3.0:1746155562.871999:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2061 committed 00000004:00080000:3.0:1746155562.872004:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2060 committed 00000004:00080000:3.0:1746155562.872006:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2059 committed 00000004:00080000:3.0:1746155562.872007:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2058 committed 00000004:00080000:3.0:1746155562.872009:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2000 committed 00000004:00080000:3.0:1746155562.872010:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2057 committed 00000004:00080000:3.0:1746155562.872012:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1999 committed 00000004:00080000:3.0:1746155562.872013:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2056 committed 00000004:00080000:3.0:1746155562.872014:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1998 committed 00000004:00080000:3.0:1746155562.872015:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1997 committed 00000004:00080000:3.0:1746155562.872016:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1996 committed 00000004:00080000:3.0:1746155562.872017:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2055 committed 00000004:00080000:3.0:1746155562.872019:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2054 committed 00000004:00080000:3.0:1746155562.872020:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1995 committed 00000004:00080000:3.0:1746155562.872021:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1994 committed 00000004:00080000:3.0:1746155562.872023:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2053 committed 00000001:00080000:3.0:1746155562.872028:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943854 is committed 00010000:00010000:1.0:1746155562.872059:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10766 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.872072:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155562.872074:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746155562.872077:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.872085:0:15474:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.872090:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.872095:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155562.872103:0:15474:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155562.872107:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155562.872113:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bbc00/0x844e5faceb5eac52 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1077b expref: 6 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.872119:0:15474:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bbc00/0x844e5faceb5eac52 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1077b expref: 6 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155562.872123:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124533632:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746155562.872125:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bbc00/0x844e5faceb5eac52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1077b expref: 6 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.872144:0:15474:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bbc00/0x844e5faceb5eac52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1077b expref: 6 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.872152:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124534656:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155562.872168:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155562.872190:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124534144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155562.872201:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155562.872202:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.872215:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746155562.872219:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124533760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155562.872231:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155562.872240:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124534272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155562.872250:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155562.872254:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124533632 00000100:00100000:1.0:1746155562.872260:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124533632 00000100:00100000:3.0:1746155562.872266:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124533888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155562.872277:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155562.872285:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124534400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.872293:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124534144 00000100:00100000:1.0:1746155562.872295:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124534144 00000100:00100000:3.0:1746155562.872296:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155562.872305:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746155562.872305:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124533760 00000100:00100000:1.0:1746155562.872307:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124533760 00000100:00100000:3.0:1746155562.872309:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124534016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.872315:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124534272 00000100:00100000:1.0:1746155562.872317:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124534272 00000100:00100000:3.0:1746155562.872319:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155562.872326:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124533888 00000100:00100000:3.0:1746155562.872328:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124534528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.872328:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124533888 00000100:00100000:1.0:1746155562.872335:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124534400 00000100:00100000:1.0:1746155562.872337:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124534400 00000100:00100000:3.0:1746155562.872338:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155562.872342:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124534016 00000100:00100000:1.0:1746155562.872344:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124534016 00000100:00100000:1.0:1746155562.872349:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124534528 00000100:00100000:1.0:1746155562.872351:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124534528 00000100:00100000:3.0:1746155562.872352:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11772 00000100:00100000:3.0:1746155562.872358:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124533632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.872358:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11773 00000100:00100000:1.0:1746155562.872362:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124534144:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746155562.872373:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.872378:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155562.872407:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155562.872411:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155562.872423:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155562.872446:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eac59 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10782 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.872457:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10782 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.872462:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155562.872464:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746155562.872466:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a065aa00, rc 0) 00000100:00100000:3.0:1746155562.872490:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:28991:x1830976123626496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 13106us (13371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.872496:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9939 00000100:00100000:1.0:1746155562.872524:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124534144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (321us total) trans 21474840517 rc 0/0 00000100:00100000:1.0:1746155562.872530:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11773 00000100:00100000:3.0:1746155562.872534:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11774 00000100:00100000:1.0:1746155562.872538:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11775 00000100:00100000:3.0:1746155562.872539:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124533760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.872542:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124534272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155562.872563:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11776 00000100:00100000:3.0:1746155562.872567:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124533888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.872634:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976124534272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (367us total) trans 21474840518 rc 0/0 00000100:00100000:1.0:1746155562.872639:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11775 00000100:00100000:1.0:1746155562.872648:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11777 00002000:00010000:3.0:1746155562.872651:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:3.0:1746155562.872653:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00000100:00100000:1.0:1746155562.872653:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976124534400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155562.872655:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.872657:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.872659:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5655 -> 5655 00000100:00100000:3.0:1746155562.872680:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976124533888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (402us total) trans 21474840519 rc 0/0 00000100:00100000:3.0:1746155562.872685:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11776 00000100:00100000:3.0:1746155562.872693:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11778 00000100:00100000:3.0:1746155562.872697:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124534016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.872727:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976124534400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (429us total) trans 21474840520 rc 0/0 00000100:00100000:1.0:1746155562.872732:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11777 00000100:00100000:1.0:1746155562.872741:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11779 00000100:00100000:1.0:1746155562.872745:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124534528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155562.872759:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:3.0:1746155562.872762:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155562.872763:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746155562.872765:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155562.872766:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:3.0:1746155562.872783:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976124534016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (462us total) trans 21474840521 rc 0/0 00000100:00100000:3.0:1746155562.872787:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11778 00000100:00100000:3.0:1746155562.872885:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124534912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155562.872904:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155562.872914:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124535424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.872918:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124534912 00000100:00100000:2.0:1746155562.872921:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124534912 00000100:00100000:3.0:1746155562.872925:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155562.872934:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746155562.872935:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124535424 00000100:00100000:2.0:1746155562.872936:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124535424 00000100:00100000:3.0:1746155562.872937:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124534784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.872945:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11780 00000100:00100000:3.0:1746155562.872948:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155562.872956:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124535296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.872962:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3296:x1830976124534912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155562.872967:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746155562.873037:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155562.873044:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155562.873046:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.873048:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.873050:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.873051:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:3.0:1746155562.873052:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.873054:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.873055:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.873057:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:3.0:1746155562.873072:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124533632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 714us (903us total) trans 21474840522 rc 0/0 00000100:00100000:2.0:1746155562.873073:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3296:x1830976124534912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (169us total) trans 17179873133 rc 0/0 00000100:00100000:3.0:1746155562.873080:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11772 00000100:00100000:2.0:1746155562.873086:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11780 00000100:00100000:3.0:1746155562.873089:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124534784 00000100:00100000:3.0:1746155562.873091:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124534784 00000100:00100000:2.0:1746155562.873092:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124535296 00000100:00100000:2.0:1746155562.873093:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124535296 00000100:00100000:2.0:1746155562.873103:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11781 00000100:00100000:3.0:1746155562.873105:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11782 00000100:00100000:2.0:1746155562.873106:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3296:x1830976124535424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155562.873108:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3296:x1830976124535296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155562.873169:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155562.873172:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.873173:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.873175:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.873176:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155562.873178:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3296:x1830976124535424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (252us total) trans 17179873134 rc 0/0 00000100:00100000:2.0:1746155562.873183:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11781 00000100:00100000:3.0:1746155562.873190:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124533760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 652us (958us total) trans 21474840523 rc 0/0 00000100:00100000:2.0:1746155562.873192:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11783 00000100:00100000:3.0:1746155562.873195:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11774 00000100:00100000:2.0:1746155562.873196:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3296:x1830976124534784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155562.873207:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124535040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155562.873222:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155562.873232:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124535552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155562.873244:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746155562.873257:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155562.873259:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.873260:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.873262:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.873263:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000004:00080000:3.0:1746155562.873264:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3eea00/2, rc 0, transno 21474840521 00000100:00100000:3.0:1746155562.873269:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124534016:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155562.873276:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a44380/2, rc 0, transno 21474840519 00000100:00100000:2.0:1746155562.873278:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3296:x1830976124534784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (329us total) trans 17179873135 rc 0/0 00000100:00100000:3.0:1746155562.873279:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124533888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155562.873283:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11783 00000004:00080000:3.0:1746155562.873284:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdced80/2, rc 0, transno 21474840520 00000100:00100000:3.0:1746155562.873286:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124534400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155562.873290:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124535040 00000100:00100000:3.0:1746155562.873291:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746155562.873292:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124535040 00000100:00100000:3.0:1746155562.873294:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124535168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155562.873299:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124535552 00000100:00100000:2.0:1746155562.873300:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124535552 00000100:00100000:2.0:1746155562.873306:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11784 00000100:00100000:3.0:1746155562.873308:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155562.873310:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3297:x1830976124535040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155562.873314:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124535680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155562.873329:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746155562.873358:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131497100/2, rc 0, transno 17179873135 00000100:00100000:3.0:1746155562.873361:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124534784:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155562.873366:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131496680/2, rc 0, transno 17179873133 00000100:00100000:3.0:1746155562.873368:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124534912:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155562.873373:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131495500/2, rc 0, transno 17179873134 00002000:00010000:2.0:1746155562.873373:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:3.0:1746155562.873375:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124535424:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155562.873375:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.873377:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00000100:00100000:3.0:1746155562.873378:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00010000:2.0:1746155562.873379:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.873380:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746155562.873382:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124535808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155562.873394:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155562.873399:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3297:x1830976124535040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (176us total) trans 17179873136 rc 0/0 00000100:00100000:2.0:1746155562.873404:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11784 00000100:00100000:3.0:1746155562.873405:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124535168 00000100:00100000:3.0:1746155562.873407:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124535168 00000100:00100000:2.0:1746155562.873410:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124535680 00000100:00100000:2.0:1746155562.873412:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124535680 00000100:00100000:3.0:1746155562.873416:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124535808 00000100:00100000:3.0:1746155562.873417:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124535808 00000100:00100000:2.0:1746155562.873418:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11785 00000100:00100000:2.0:1746155562.873422:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976124535552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155562.873424:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11786 00000100:00100000:3.0:1746155562.873427:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976124535168:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155562.873456:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a46300/2, rc 0, transno 21474840523 00000100:00100000:3.0:1746155562.873459:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124533760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155562.873465:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdce300/2, rc 0, transno 21474840518 00000100:00100000:3.0:1746155562.873467:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124534272:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155562.873473:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c213800/2, rc 0, transno 21474840522 00000100:00100000:3.0:1746155562.873475:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124533632:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155562.873480:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc6d80/2, rc 0, transno 21474840517 00000100:00100000:3.0:1746155562.873482:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124534144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155562.873495:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124535552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (250us total) trans 17179873137 rc 0/0 00000100:00100000:2.0:1746155562.873514:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11785 00000100:00100000:2.0:1746155562.873524:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11787 00000100:00100000:2.0:1746155562.873527:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976124535680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155562.873561:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124535168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (251us total) trans 17179873138 rc 0/0 00000100:00100000:3.0:1746155562.873565:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11786 00000100:00100000:3.0:1746155562.873574:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11788 00000100:00100000:3.0:1746155562.873578:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3296:x1830976124535808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155562.873592:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124535680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (262us total) trans 17179873139 rc 0/0 00000100:00100000:2.0:1746155562.873597:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11787 00000100:00100000:3.0:1746155562.873657:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3296:x1830976124535808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (261us total) trans 21474840524 rc 0/0 00000100:00100000:3.0:1746155562.873661:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11788 00000004:00080000:2.0:1746155562.873668:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac6300/2, rc 0, transno 21474840524 00000100:00100000:2.0:1746155562.873671:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124535808:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746155562.873924:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155562.873931:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155562.873949:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:0.0:1746155562.873952:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155562.873959:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155562.873982:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eac21 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1076d expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.873992:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1076d expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.873998:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155562.874000:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746155562.874002:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b600, rc 0) 00000100:00100000:0.0:1746155562.874023:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:28988:x1830976123625088:12345-192.168.202.51@tcp:101:cat.0 Request processed in 27812us (28098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.874027:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9936 00000100:00100000:1.0:1746155562.874281:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3297:x1830976124534528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1535us (1942us total) trans 21474840525 rc 0/0 00000100:00100000:1.0:1746155562.874287:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11779 00000100:00100000:3.0:1746155562.874485:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976124535296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1375us (1515us total) trans 17179873140 rc 0/0 00000100:00100000:3.0:1746155562.874490:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11782 00000004:00080000:2.0:1746155562.874632:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131496d80/2, rc 0, transno 17179873140 00000100:00100000:2.0:1746155562.874636:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124535296:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155562.874955:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131495c00/2, rc 0, transno 17179873138 00000100:00100000:2.0:1746155562.874958:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124535168:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155562.874965:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26fb80/2, rc 0, transno 17179873139 00000100:00100000:2.0:1746155562.874967:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124535680:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155562.874973:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131495f80/2, rc 0, transno 17179873136 00000100:00100000:2.0:1746155562.874975:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124535040:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155562.874980:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26d880/2, rc 0, transno 17179873137 00000100:00100000:2.0:1746155562.874982:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124535552:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155562.874988:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdcc000/2, rc 0, transno 21474840525 00000100:00100000:2.0:1746155562.874991:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124534528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155562.877229:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124534656:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155562.877298:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5eac0c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10766 expref: 9 pid: 15474 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746155562.877312:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10766 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.877336:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3800, rc 0) 00000100:00100000:1.0:1746155562.877496:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:28985:x1830976123624960:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 33822us (34580us total) trans 8589943855 rc 0/0 00000100:00100000:1.0:1746155562.877520:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9935 00000100:00100000:0.0:1746155562.878496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.878583:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.879056:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123626624 00000100:00100000:2.0:1746155562.879063:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123626624 00000100:00100000:2.0:1746155562.879105:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3985 00000100:00100000:2.0:1746155562.879112:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009461b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:28979:x1830976123626624:12345-192.168.202.51@tcp:49:lfs.0 00000100:00100000:2.0:1746155562.879185:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009461b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:28979:x1830976123626624:12345-192.168.202.51@tcp:49:lfs.0 Request processed in 73us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.879190:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3985 00000100:00100000:1.0:1746155562.879271:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123626752 00000100:00100000:1.0:1746155562.879275:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123626752 00000100:00100000:1.0:1746155562.879297:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9940 00000100:00100000:1.0:1746155562.879301:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:28991:x1830976123626752:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155562.879309:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.879323:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eac67 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10789 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.879352:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eac67 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10789 expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.879361:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eac67 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10789 expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.879372:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155562.879374:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155562.879377:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe3600, rc 0) 00000100:00100000:1.0:1746155562.879392:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:28991:x1830976123626752:12345-192.168.202.51@tcp:101:cat.0 Request processed in 90us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.879396:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9940 00000100:00100000:0.0:1746155562.880223:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.880285:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123626880 00000100:00100000:2.0:1746155562.880288:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123626880 00000100:00100000:2.0:1746155562.880319:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11789 00000100:00100000:2.0:1746155562.880324:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:28985:x1830976123626880:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155562.880332:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.880344:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10790 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.880361:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0df600/0x844e5faceb5eaafb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106d3 expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.880369:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5eab79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10735 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.880375:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eab17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106f6 expref: 27 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.880381:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.880382:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155562.880386:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1478656->1736703] (req 1478656->1736703) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.880408:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eab17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106f6 expref: 27 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.880418:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eab17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106f6 expref: 27 pid: 1625 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155562.880429:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124535936:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.880830:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5eab79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10735 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.880838:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5eab79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10735 expref: 10 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155562.880846:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124536064:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155562.880969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.880991:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.880992:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123627008 00000100:00100000:3.0:1746155562.880997:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123627008 00000100:00100000:3.0:1746155562.881016:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123627136 00000100:00100000:3.0:1746155562.881018:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123627136 00000100:00100000:0.0:1746155562.881025:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11790 00000100:00100000:0.0:1746155562.881032:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123627008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155562.881040:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155562.881049:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5eac75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10797 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155562.881062:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.881063:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155562.881074:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5eac75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10797 expref: 21 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155562.881091:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5eac75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10797 expref: 21 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155562.881099:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94dc00, rc 0) 00000100:00100000:0.0:1746155562.881133:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123627008:12345-192.168.202.51@tcp:101:cat.0 Request processed in 101us (164us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155562.881232:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0df600/0x844e5faceb5eaafb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106d3 expref: 24 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155562.881240:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0df600/0x844e5faceb5eaafb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106d3 expref: 24 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155562.881249:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124536192:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155562.881287:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11790 00000100:00100000:3.0:1746155562.881293:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11791 00000100:00100000:3.0:1746155562.881300:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123627136:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155562.881307:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.881314:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5eac7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1079e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.881324:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.881326:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.881330:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5eac7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1079e expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.881340:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5eac7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1079e expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.881347:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938a0600, rc 0) 00000100:00100000:2.0:1746155562.882016:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155562.882767:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123627136:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1466us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.882777:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11791 00000100:00100000:0.0:1746155562.883362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.883400:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123627264 00000100:00100000:3.0:1746155562.883405:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123627264 00000100:00100000:3.0:1746155562.883436:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11792 00000100:00100000:3.0:1746155562.883441:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123627264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155562.883451:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155562.883463:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938a0a00/0x844e5faceb5eac83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107a5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.883478:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.883479:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155562.883485:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938a0a00/0x844e5faceb5eac83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107a5 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.883495:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938a0a00/0x844e5faceb5eac83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107a5 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155562.883522:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938a0a00, rc 0) 00000100:00100000:3.0:1746155562.883546:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123627264:12345-192.168.202.51@tcp:101:cat.0 Request processed in 105us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.883551:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11792 00000100:00100000:2.0:1746155562.883707:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124535936:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.883718:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124536064:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155562.890800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.890833:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.890856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.890877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.890882:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123627648 00000100:00100000:1.0:1746155562.890889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.890891:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123627648 00000100:00100000:1.0:1746155562.890900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.890910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155562.890919:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5eab79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10735 expref: 11 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155562.890920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.890932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.890939:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123627520 00000100:00100000:3.0:1746155562.890941:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123627520 00010000:00010000:3.0:1746155562.890949:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eab17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106f6 expref: 28 pid: 1625 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155562.890955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.890962:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5899 00000100:00100000:3.0:1746155562.890968:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123627648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155562.890968:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123627392 00000100:00100000:1.0:1746155562.890971:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123627392 00010000:00010000:3.0:1746155562.890979:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155562.890986:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123627776 00000100:00100000:0.0:1746155562.890986:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5900 00000100:00100000:1.0:1746155562.890988:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123627776 00000100:00100000:0.0:1746155562.890995:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123627520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155562.890996:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123627904 00010000:00010000:3.0:1746155562.890997:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5eab79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10735 expref: 11 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155562.890997:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123627904 00010000:00010000:0.0:1746155562.891003:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155562.891004:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123628032 00000100:00100000:1.0:1746155562.891006:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123628032 00010000:00010000:3.0:1746155562.891007:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5eab79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10735 expref: 11 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155562.891011:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123628160 00000100:00100000:1.0:1746155562.891012:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123628160 00010000:00010000:0.0:1746155562.891015:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eab17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106f6 expref: 29 pid: 1625 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155562.891017:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123628288 00000100:00100000:1.0:1746155562.891019:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123628288 00000100:00100000:1.0:1746155562.891024:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123628416 00010000:00010000:3.0:1746155562.891025:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d583800/0x844e5faceb5eab79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10735 expref: 13 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155562.891025:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123628416 00010000:00010000:0.0:1746155562.891027:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eab17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106f6 expref: 29 pid: 1625 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155562.891031:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123628544 00000100:00100000:1.0:1746155562.891032:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123628544 00000100:00100000:1.0:1746155562.891039:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11793 00000100:00100000:1.0:1746155562.891044:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123627392:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155562.891044:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5eab17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106f6 expref: 29 pid: 1625 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155562.891055:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.891065:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6040800/0x844e5faceb5eac8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107ac expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.891078:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.891080:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746155562.891084:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11794 00010000:00010000:1.0:1746155562.891086:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6040800/0x844e5faceb5eac8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ac expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155562.891093:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123627776:12345-192.168.202.51@tcp:2:lfs.0 00010000:00010000:1.0:1746155562.891096:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6040800/0x844e5faceb5eac8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ac expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.891103:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6040800, rc 0) 00000100:00100000:1.0:1746155562.891138:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123627392:12345-192.168.202.51@tcp:101:cat.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.891143:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11793 00000100:00100000:1.0:1746155562.891155:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11795 00000100:00100000:1.0:1746155562.891159:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123627904:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155562.891164:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.891168:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2400/0x844e5faceb5eac91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107b3 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155562.891199:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155562.891200:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155562.891218:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123627648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 250us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155562.891222:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123627520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 229us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155562.891223:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5899 00000100:00100000:0.0:1746155562.891228:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5900 00000100:00100000:3.0:1746155562.891244:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11796 00000100:00100000:3.0:1746155562.891249:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123628032:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:0.0:1746155562.891250:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11797 00002000:00010000:3.0:1746155562.891345:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155562.891347:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.891349:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.891351:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.891352:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155562.891369:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123628032:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 119us (467us total) trans 17179873141 rc 0/0 00000100:00100000:3.0:1746155562.891375:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11796 00000100:00100000:3.0:1746155562.891385:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11798 00000100:00100000:3.0:1746155562.891389:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123628288:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155562.891450:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155562.891453:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.891455:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.891456:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.891457:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155562.891473:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123628288:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 84us (552us total) trans 21474840526 rc 0/0 00000100:00100000:3.0:1746155562.891478:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11798 00000100:00100000:3.0:1746155562.891487:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11799 00000100:00100000:3.0:1746155562.891491:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123628416:12345-192.168.202.51@tcp:2:lfs.0 00010000:00010000:1.0:1746155562.891528:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.891535:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2400/0x844e5faceb5eac91 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107b3 expref: 28 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.891548:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2400/0x844e5faceb5eac91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107b3 expref: 28 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155562.891555:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe2400, rc 0) 00002000:00010000:3.0:1746155562.891566:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:3.0:1746155562.891568:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.891570:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00000100:00100000:1.0:1746155562.891570:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123627904:12345-192.168.202.51@tcp:101:cat.0 Request processed in 411us (680us total) trans 0 rc 301/301 00002000:00010000:3.0:1746155562.891572:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:3.0:1746155562.891574:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5655 -> 5655 00000100:00100000:1.0:1746155562.891575:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11795 00000100:00100000:1.0:1746155562.891584:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11800 00000100:00100000:3.0:1746155562.891587:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123628416:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 96us (654us total) trans 21474840527 rc 0/0 00000100:00100000:1.0:1746155562.891588:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123628544:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:3.0:1746155562.891592:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11799 00002000:00010000:1.0:1746155562.891664:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155562.891667:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:1.0:1746155562.891669:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:1.0:1746155562.891670:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:1.0:1746155562.891672:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746155562.891687:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123628544:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 98us (731us total) trans 17179873142 rc 0/0 00000100:00100000:1.0:1746155562.891692:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11800 00002000:00010000:2.0:1746155562.891694:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155562.891696:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.891697:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.891699:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155562.891700:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:2.0:1746155562.891713:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123627776:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 624us (835us total) trans 21474840528 rc 0/0 00000100:00100000:2.0:1746155562.891717:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11794 00000100:00100000:0.0:1746155562.892032:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123628160:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:0.0:1746155562.892108:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155562.892111:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:0.0:1746155562.892113:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:0.0:1746155562.892114:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:0.0:1746155562.892116:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155562.892129:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123628160:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 873us (1217us total) trans 17179873143 rc 0/0 00000100:00100000:0.0:1746155562.892135:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11797 00000100:00100000:0.0:1746155562.893742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.893795:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123628672 00000100:00100000:1.0:1746155562.893802:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123628672 00010000:00010000:1.0:1746155562.893825:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0df600/0x844e5faceb5eaafb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106d3 expref: 26 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155562.893856:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5901 00000100:00100000:1.0:1746155562.893862:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123628672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155562.893872:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155562.893883:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0df600/0x844e5faceb5eaafb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106d3 expref: 26 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155562.893891:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0df600/0x844e5faceb5eaafb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106d3 expref: 26 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155562.893907:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.893909:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.893914:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.893920:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.893946:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.893956:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801366b5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124536320:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155562.894013:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926780 going to sleep for 11 seconds 00010000:00010000:2.0:1746155562.894094:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0df600/0x844e5faceb5eaafb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106d3 expref: 26 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155562.894107:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124536192:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.894128:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.894136:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094766400, rc 0) 00000100:00100000:2.0:1746155562.894153:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:28985:x1830976123626880:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 13829us (13932us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.894159:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11789 00000100:00100000:0.0:1746155562.900006:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.900116:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123628928 00000100:00100000:3.0:1746155562.900124:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123628928 00000100:00100000:3.0:1746155562.900171:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3986 00000100:00100000:3.0:1746155562.900178:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:28979:x1830976123628928:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155562.900365:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28979:x1830976123628928:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 186us (365us total) trans 8589943857 rc 0/0 00000100:00100000:3.0:1746155562.900371:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3986 00000100:00100000:0.0:1746155562.900854:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.900896:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123629312 00000100:00100000:3.0:1746155562.900900:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123629312 00002000:00100000:3.0:1746155562.900922:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009286d880 x1830976123629312/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.900931:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286d880 with x1830976123629312 ext(1048576->2097151) 00002000:00010000:3.0:1746155562.900936:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286d880 00000100:00100000:3.0:1746155562.900959:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4456 00000100:00100000:3.0:1746155562.900965:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123629312:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155562.909609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.909671:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123629440 00000100:00100000:2.0:1746155562.909679:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123629440 00002000:00100000:2.0:1746155562.909716:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8801366b5880 x1830976123629440/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.909725:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b5880 with x1830976123629440 ext(0->1048575) 00002000:00010000:2.0:1746155562.909730:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801366b5880 00000100:00100000:2.0:1746155562.909748:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4457 00000100:00100000:2.0:1746155562.909753:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123629440:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155562.910445:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801366b5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124536320:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155562.910461:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155562.910491:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123628672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 16630us (16752us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155562.910498:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5901 00000100:00100000:1.0:1746155562.910548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.910584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.910605:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.910616:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123629696 00000100:00100000:1.0:1746155562.910630:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123629696 00002000:00100000:1.0:1746155562.910647:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8801366b5c00 x1830976123629696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.910654:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b5c00 with x1830976123629696 ext(0->1048575) 00002000:00010000:1.0:1746155562.910657:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801366b5c00 00000100:00100000:1.0:1746155562.910667:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123629952 00000100:00100000:1.0:1746155562.910669:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123629952 00002000:00100000:1.0:1746155562.910679:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8801366b5500 x1830976123629952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.910685:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b5500 with x1830976123629952 ext(1048576->2097151) 00002000:00010000:1.0:1746155562.910688:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801366b5500 00000100:00100000:1.0:1746155562.910696:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123630208 00000100:00100000:1.0:1746155562.910697:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123630208 00002000:00100000:1.0:1746155562.910706:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1478656->1482751) req@ffff8801366b7800 x1830976123630208/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.910711:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b7800 with x1830976123630208 ext(1478656->1482751) 00002000:00010000:1.0:1746155562.910714:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801366b7800 00000100:00100000:1.0:1746155562.910722:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4458 00000100:00100000:1.0:1746155562.910726:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123629696:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155562.911367:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4459 00000100:00100000:1.0:1746155562.911372:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123629952:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155562.912832:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4460 00000100:00100000:0.0:1746155562.912845:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123630208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155562.912960:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123630208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 119us (2353us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155562.912967:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4460 00002000:00100000:0.0:1746155562.912973:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3db:0x0] (1478656->1482751) req@ffff8801366b7800 x1830976123630208/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.912981:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b7800 with x1830976123630208 ext(1478656->1482751) 00002000:00010000:0.0:1746155562.912986:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801366b7800 00000100:00100000:0.0:1746155562.913050:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.916763:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123630720 00000100:00100000:1.0:1746155562.916775:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123630720 00000100:00100000:1.0:1746155562.916809:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9941 00000100:00100000:1.0:1746155562.916815:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:28993:x1830976123630720:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155562.916830:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155562.916843:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17800/0x844e5faceb5eac98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107ba expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.916914:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eac9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.916925:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eac9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.916932:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eac9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.916941:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17000/0x844e5faceb5eaca6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.916945:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17000/0x844e5faceb5eaca6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.916950:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17000/0x844e5faceb5eaca6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.917018:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5eacad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.917024:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5eacad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.917028:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5eacad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155562.917035:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155562.917201:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eac9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.917207:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eac9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.917212:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eac9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.917216:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3e17600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155562.917220:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eac9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.917225:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eac9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.917234:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155562.917237:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155562.917240:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eac9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.917244:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eac9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.918049:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17000/0x844e5faceb5eaca6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.918056:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17000/0x844e5faceb5eaca6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.918061:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17000/0x844e5faceb5eaca6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.918069:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3e17000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155562.918071:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17000/0x844e5faceb5eaca6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.918076:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17000/0x844e5faceb5eaca6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.918083:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fcd5700) 00010000:00010000:1.0:1746155562.918085:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155562.918088:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17000/0x844e5faceb5eaca6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.918092:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17000/0x844e5faceb5eaca6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155562.918130:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17800/0x844e5faceb5eac98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ba expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.918140:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5eacad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ba expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.918146:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155562.918147:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155562.918149:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e16e00, rc 0) 00000100:00100000:1.0:1746155562.918177:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:28993:x1830976123630720:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1361us (5126us total) trans 8589943858 rc 0/0 00000100:00100000:1.0:1746155562.918184:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9941 00000100:00100000:0.0:1746155562.919744:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.920138:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123630464 00000100:00100000:3.0:1746155562.920145:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123630464 00000100:00100000:3.0:1746155562.920190:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3987 00000100:00100000:3.0:1746155562.920197:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:28979:x1830976123630464:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155562.920357:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:28979:x1830976123630464:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 159us (616us total) trans 8589943859 rc 0/0 00000100:00100000:3.0:1746155562.920366:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3987 00000100:00100000:2.0:1746155562.920662:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123629312:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19695us (19806us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.920669:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4456 00002000:00100000:2.0:1746155562.920677:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009286d880 x1830976123629312/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.920685:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286d880 with x1830976123629312 ext(1048576->2097151) 00002000:00010000:2.0:1746155562.920689:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286d880 00000100:00100000:1.0:1746155562.928016:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123629696:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17280us (17458us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155562.928030:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4458 00002000:00100000:1.0:1746155562.928040:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8801366b5c00 x1830976123629696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.928048:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b5c00 with x1830976123629696 ext(0->1048575) 00002000:00010000:1.0:1746155562.928053:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801366b5c00 00000100:00100000:3.0:1746155562.928456:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123629440:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18701us (18854us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155562.928462:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4457 00002000:00100000:3.0:1746155562.928467:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8801366b5880 x1830976123629440/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.928474:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b5880 with x1830976123629440 ext(0->1048575) 00002000:00010000:3.0:1746155562.928477:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801366b5880 00000100:00100000:0.0:1746155562.930303:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.930352:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123630976 00000100:00100000:2.0:1746155562.930358:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123630976 00002000:00100000:2.0:1746155562.930386:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1732608->1736703) req@ffff880136632d80 x1830976123630976/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.930393:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632d80 with x1830976123630976 ext(1732608->1736703) 00002000:00010000:2.0:1746155562.930397:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136632d80 00000100:00100000:2.0:1746155562.930410:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4461 00000100:00100000:2.0:1746155562.930416:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123630976:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155562.930546:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123630976:12345-192.168.202.51@tcp:3:cat.0 Request processed in 129us (245us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155562.930552:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4461 00002000:00100000:2.0:1746155562.930557:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1732608->1736703) req@ffff880136632d80 x1830976123630976/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/4536 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.930564:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632d80 with x1830976123630976 ext(1732608->1736703) 00002000:00010000:2.0:1746155562.930567:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136632d80 00000100:00100000:1.0:1746155562.941121:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123629952:12345-192.168.202.51@tcp:3:cat.0 Request processed in 29735us (30523us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155562.941134:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4459 00002000:00100000:1.0:1746155562.941146:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8801366b5500 x1830976123629952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155562.941155:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801366b5500 with x1830976123629952 ext(1048576->2097151) 00002000:00010000:1.0:1746155562.941161:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801366b5500 00000100:00100000:1.0:1746155562.941383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.941616:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123631232 00000100:00100000:3.0:1746155562.941632:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123631232 00000100:00100000:3.0:1746155562.941757:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3988 00000100:00100000:3.0:1746155562.941765:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+8:28985:x1830976123631232:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155562.942038:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+9:28985:x1830976123631232:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 274us (655us total) trans 8589943860 rc 0/0 00000100:00100000:3.0:1746155562.942044:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3988 00000100:00100000:0.0:1746155562.942254:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.943457:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123631488 00000100:00100000:2.0:1746155562.943463:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123631488 00002000:00100000:2.0:1746155562.943489:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880099ef7050 x1830976123631488/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 504/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.943497:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ef7050 with x1830976123631488 ext(1048576->2097151) 00002000:00010000:2.0:1746155562.943520:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ef7050 00000100:00100000:2.0:1746155562.943542:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4462 00000100:00100000:2.0:1746155562.943547:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123631488:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155562.945981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.946102:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123631744 00000100:00100000:0.0:1746155562.946108:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123631744 00002000:00100000:0.0:1746155562.946140:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800910c8380 x1830976123631744/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.946148:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8380 with x1830976123631744 ext(1048576->2097151) 00002000:00010000:0.0:1746155562.946152:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c8380 00000100:00100000:0.0:1746155562.950060:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4463 00000100:00100000:0.0:1746155562.950076:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123631744:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155562.959407:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123631488:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15851us (17144us total) trans 0 rc 790528/790528 00000100:00100000:3.0:1746155562.959418:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4462 00002000:00100000:3.0:1746155562.959427:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880099ef7050 x1830976123631488/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 504/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 790528/790528 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.959435:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ef7050 with x1830976123631488 ext(1048576->2097151) 00002000:00010000:3.0:1746155562.959440:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ef7050 00000100:00100000:0.0:1746155562.960269:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.960360:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123631872 00000100:00100000:2.0:1746155562.960367:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123631872 00000100:00100000:2.0:1746155562.960397:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11801 00000100:00100000:2.0:1746155562.960403:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:28991:x1830976123631872:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155562.960416:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155562.960430:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107c1 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.960451:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.960457:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155562.960459:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155562.960462:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c1 expref: 28 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.960487:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.960498:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 23 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155562.960525:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124536448:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155562.960575:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155562.963546:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123631744:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13429us (17524us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155562.963558:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4463 00002000:00100000:2.0:1746155562.964337:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800910c8380 x1830976123631744/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.964348:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8380 with x1830976123631744 ext(1048576->2097151) 00002000:00010000:2.0:1746155562.964353:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c8380 00000100:00100000:2.0:1746155562.965892:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124536448:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155562.965913:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c1 expref: 28 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155562.965925:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094766e00, rc 0) 00000100:00100000:2.0:1746155562.965957:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:28991:x1830976123631872:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5553us (5689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155562.965963:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11801 00000100:00100000:0.0:1746155562.973098:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155562.973394:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123632000 00000100:00100000:2.0:1746155562.973401:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123632000 00002000:00100000:2.0:1746155562.973436:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1478656->1736703) req@ffff880136632a00 x1830976123632000/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155562.973444:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632a00 with x1830976123632000 ext(1478656->1736703) 00010000:00010000:2.0:1746155562.973452:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 24 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155562.973462:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 24 pid: 4461 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746155562.973468:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136632a00 00000100:00100000:2.0:1746155562.973497:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 677 00000100:00100000:2.0:1746155562.973531:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123632000:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155562.982914:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.982958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.982986:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123632256 00000100:00100000:3.0:1746155562.982995:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123632256 00002000:00100000:3.0:1746155562.983029:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880136631c00 x1830976123632256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.983038:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631c00 with x1830976123632256 ext(2097152->3145727) 00002000:00010000:3.0:1746155562.983042:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136631c00 00000100:00100000:3.0:1746155562.983111:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123632512 00000100:00100000:3.0:1746155562.983114:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123632512 00002000:00100000:3.0:1746155562.983127:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880136631500 x1830976123632512/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.983134:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631500 with x1830976123632512 ext(3145728->4194303) 00002000:00010000:3.0:1746155562.983137:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136631500 00000100:00100000:3.0:1746155562.983154:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4464 00000100:00100000:3.0:1746155562.983162:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123632256:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155562.983200:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4465 00000100:00100000:2.0:1746155562.983208:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123632512:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155562.987407:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1961:x1830976123632000:12345-192.168.202.51@tcp:4:cat.0 Request processed in 13869us (14308us total) trans 17179873144 rc 0/0 00000100:00100000:0.0:1746155562.987419:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 677 00002000:00100000:0.0:1746155562.987429:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1478656->1736703) req@ffff880136632a00 x1830976123632000/t17179873144(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/448 e 0 to 0 dl 1746155573 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.987439:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632a00 with x1830976123632000 ext(1478656->1736703) 00010000:00010000:0.0:1746155562.987448:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 26 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155562.987460:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 26 pid: 4461 timeout: 792 lvb_type: 0 00002000:00010000:0.0:1746155562.987472:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136632a00 00000100:00100000:3.0:1746155562.987727:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155562.987765:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155562.988355:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123632768 00000100:00100000:3.0:1746155562.988361:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123632896 00000100:00100000:0.0:1746155562.988362:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123632768 00000100:00100000:3.0:1746155562.988365:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123632896 00002000:00100000:3.0:1746155562.988388:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009fac4a80 x1830976123632896/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155562.988388:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009fac4000 x1830976123632768/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/0 e 0 to 0 dl 1746155573 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155562.988395:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4a80 with x1830976123632896 ext(3145728->4194303) 00002000:00100000:0.0:1746155562.988395:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4000 with x1830976123632768 ext(2097152->3145727) 00002000:00010000:0.0:1746155562.988398:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac4000 00002000:00010000:3.0:1746155562.988399:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac4a80 00000100:00100000:0.0:1746155562.988421:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4466 00000100:00100000:0.0:1746155562.988427:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1963:x1830976123632768:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155562.989267:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4467 00000100:00100000:3.0:1746155562.989275:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1962:x1830976123632896:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155562.997790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155562.997839:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123633152 00000100:00100000:1.0:1746155562.997846:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123633152 00010000:00010000:1.0:1746155562.997876:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 30 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155562.998139:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5902 00000100:00100000:1.0:1746155562.998147:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123633152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155562.998159:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155562.998177:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 30 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155562.998192:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 30 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155562.998210:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094766400/0x844e5faceb5eac6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->1736703) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10790 expref: 30 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155562.998237:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.998238:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155562.998244:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c1 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.998252:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c1 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155562.998280:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c1 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155562.998290:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124536576:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155562.998357:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155563.007999:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123632256:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24829us (25084us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.008012:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4464 00002000:00100000:3.0:1746155563.008021:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880136631c00 x1830976123632256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.008029:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631c00 with x1830976123632256 ext(2097152->3145727) 00002000:00010000:3.0:1746155563.008034:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136631c00 00000100:00100000:2.0:1746155563.009472:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123632512:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26261us (26509us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.009480:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4465 00002000:00100000:2.0:1746155563.009487:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880136631500 x1830976123632512/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.009495:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631500 with x1830976123632512 ext(3145728->4194303) 00002000:00010000:2.0:1746155563.009498:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136631500 00000100:00100000:1.0:1746155563.009545:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1963:x1830976123632768:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21111us (21813us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155563.009552:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4466 00002000:00100000:1.0:1746155563.009558:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009fac4000 x1830976123632768/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.009565:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4000 with x1830976123632768 ext(2097152->3145727) 00002000:00010000:1.0:1746155563.009569:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac4000 00000100:00100000:1.0:1746155563.016980:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124536576:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155563.017000:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.017038:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123633152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 18890us (19255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.017048:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5902 00000100:00100000:3.0:1746155563.017308:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123632896:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28034us (29542us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.017315:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4467 00002000:00100000:3.0:1746155563.017322:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009fac4a80 x1830976123632896/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:633/0 lens 488/440 e 0 to 0 dl 1746155573 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.017330:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4a80 with x1830976123632896 ext(3145728->4194303) 00002000:00010000:3.0:1746155563.017335:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac4a80 00000100:00100000:0.0:1746155563.017950:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.018007:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.018098:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123633536 00000100:00100000:1.0:1746155563.018103:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123633536 00000100:00100000:2.0:1746155563.018111:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123633664 00000100:00100000:2.0:1746155563.018120:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123633664 00002000:00100000:1.0:1746155563.018130:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880136630380 x1830976123633536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.018137:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880136630a80 x1830976123633664/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.018138:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136630380 with x1830976123633536 ext(1048576->2097151) 00002000:00010000:1.0:1746155563.018141:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136630380 00002000:00100000:2.0:1746155563.018144:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136630a80 with x1830976123633664 ext(1048576->2097151) 00002000:00010000:2.0:1746155563.018147:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136630a80 00000100:00100000:1.0:1746155563.018157:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4468 00000100:00100000:2.0:1746155563.018161:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4469 00000100:00100000:1.0:1746155563.018163:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123633536:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155563.018165:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123633664:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155563.023196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.023588:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123633792 00000100:00100000:3.0:1746155563.023595:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123633792 00000100:00100000:3.0:1746155563.023657:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11802 00000100:00100000:3.0:1746155563.023665:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123633792:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.023680:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.023695:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938a0200/0x844e5faceb5eacc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107c8 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.023713:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.023715:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.023722:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938a0200/0x844e5faceb5eacc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c8 expref: 26 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.023738:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938a0200/0x844e5faceb5eacc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c8 expref: 26 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.023748:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938a0200, rc 0) 00000100:00100000:3.0:1746155563.023772:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123633792:12345-192.168.202.51@tcp:101:cat.0 Request processed in 109us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.023778:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11802 00000100:00080000:1.0:1746155563.023878:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155563.027936:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123633664:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9760us (9919us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.027947:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4469 00002000:00100000:2.0:1746155563.027957:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880136630a80 x1830976123633664/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.027965:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136630a80 with x1830976123633664 ext(1048576->2097151) 00002000:00010000:2.0:1746155563.027970:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136630a80 00000100:00100000:0.0:1746155563.034191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.034709:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123633536:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16545us (16757us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155563.034718:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4468 00002000:00100000:1.0:1746155563.034728:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880136630380 x1830976123633536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.034736:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136630380 with x1830976123633536 ext(1048576->2097151) 00002000:00010000:1.0:1746155563.034742:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136630380 00000100:00100000:1.0:1746155563.034758:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123634048 00000100:00100000:1.0:1746155563.034764:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123634048 00000100:00080000:1.0:1746155563.034782:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1746155563.034803:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880136633800 x1830976123634048/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.034810:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136633800 with x1830976123634048 ext(4194304->4956159) 00002000:00010000:1.0:1746155563.034813:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136633800 00000100:00100000:1.0:1746155563.034828:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4470 00000100:00100000:1.0:1746155563.034834:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123634048:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155563.040492:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123634048:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5648us (6299us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155563.040787:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4470 00002000:00100000:1.0:1746155563.040797:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880136633800 x1830976123634048/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.040806:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136633800 with x1830976123634048 ext(4194304->4956159) 00002000:00010000:1.0:1746155563.040811:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136633800 00000100:00100000:0.0:1746155563.062937:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.064245:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123634304 00000100:00100000:1.0:1746155563.064254:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123634304 00002000:00100000:1.0:1746155563.064294:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880136630700 x1830976123634304/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.064302:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136630700 with x1830976123634304 ext(2097152->3145727) 00002000:00010000:1.0:1746155563.064307:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136630700 00000100:00100000:1.0:1746155563.064339:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4471 00000100:00100000:1.0:1746155563.064346:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123634304:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155563.065703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.067148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.067185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.067213:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123634560 00000100:00100000:0.0:1746155563.067219:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123634560 00002000:00100000:0.0:1746155563.067249:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880136631180 x1830976123634560/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155563.067257:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631180 with x1830976123634560 ext(3145728->4194303) 00002000:00010000:0.0:1746155563.067262:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136631180 00000100:00100000:0.0:1746155563.067275:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123635072 00000100:00100000:0.0:1746155563.067277:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123635072 00002000:00100000:0.0:1746155563.067288:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880136632300 x1830976123635072/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155563.067294:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632300 with x1830976123635072 ext(2097152->3145727) 00002000:00010000:0.0:1746155563.067297:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136632300 00000100:00100000:0.0:1746155563.067307:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4472 00000100:00100000:0.0:1746155563.067312:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976123634560:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155563.069052:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4473 00000100:00100000:0.0:1746155563.069061:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123635072:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155563.072249:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123634816 00000100:00100000:3.0:1746155563.072260:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123634816 00000100:00100000:3.0:1746155563.072311:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3989 00000100:00100000:3.0:1746155563.072317:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+9:28988:x1830976123634816:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155563.072487:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:28988:x1830976123634816:12345-192.168.202.51@tcp:35:cat.0 Request processed in 169us (6785us total) trans 8589943861 rc 0/0 00000100:00100000:3.0:1746155563.072493:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3989 00000100:00080000:1.0:1746155563.072597:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746155563.080970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.081336:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136631180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976123634560:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14022us (14188us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.081345:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4472 00002000:00100000:2.0:1746155563.081354:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880136631180 x1830976123634560/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.081363:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631180 with x1830976123634560 ext(3145728->4194303) 00002000:00010000:2.0:1746155563.081368:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136631180 00000100:00100000:2.0:1746155563.081388:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123635328 00000100:00100000:2.0:1746155563.081393:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123635328 00002000:00100000:2.0:1746155563.081416:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009a6dad80 x1830976123635328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.081423:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dad80 with x1830976123635328 ext(3145728->4194303) 00002000:00010000:2.0:1746155563.081425:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dad80 00000100:00100000:2.0:1746155563.081435:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4474 00000100:00100000:2.0:1746155563.081441:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123635328:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155563.081961:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123634304:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17613us (19031us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.081968:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4471 00002000:00100000:3.0:1746155563.081974:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880136630700 x1830976123634304/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.081981:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136630700 with x1830976123634304 ext(2097152->3145727) 00002000:00010000:3.0:1746155563.081984:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136630700 00000100:00100000:2.0:1746155563.090269:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123635072:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21201us (23074us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.090280:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4473 00002000:00100000:2.0:1746155563.090290:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880136632300 x1830976123635072/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.090299:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632300 with x1830976123635072 ext(2097152->3145727) 00002000:00010000:2.0:1746155563.090304:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136632300 00000100:00100000:2.0:1746155563.095556:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123635328:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14107us (14586us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.095566:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4474 00002000:00100000:2.0:1746155563.095575:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009a6dad80 x1830976123635328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.095584:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dad80 with x1830976123635328 ext(3145728->4194303) 00002000:00010000:2.0:1746155563.095588:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dad80 00010000:00010000:2.0:1746155563.100706:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155563.102410:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.102527:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123635584 00000100:00100000:2.0:1746155563.102535:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123635584 00002000:00100000:2.0:1746155563.102570:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880136631f80 x1830976123635584/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.102580:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631f80 with x1830976123635584 ext(4194304->4956159) 00002000:00010000:2.0:1746155563.102586:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136631f80 00000100:00100000:2.0:1746155563.104180:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4475 00000100:00100000:2.0:1746155563.104190:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123635584:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155563.118316:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123635584:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14118us (15902us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155563.118328:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4475 00002000:00100000:2.0:1746155563.118338:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880136631f80 x1830976123635584/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.118347:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136631f80 with x1830976123635584 ext(4194304->4956159) 00002000:00010000:2.0:1746155563.118353:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136631f80 00000100:00100000:0.0:1746155563.132363:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.132454:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123635840 00000100:00100000:3.0:1746155563.132462:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123635840 00000100:00100000:3.0:1746155563.132497:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3990 00000100:00100000:3.0:1746155563.132525:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:28991:x1830976123635840:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155563.135552:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:28991:x1830976123635840:12345-192.168.202.51@tcp:35:cat.0 Request processed in 3014us (3182us total) trans 8589943862 rc 0/0 00000100:00100000:3.0:1746155563.135566:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3990 00000100:00100000:1.0:1746155563.137984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.138135:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123635968 00000100:00100000:1.0:1746155563.138143:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123635968 00000100:00100000:1.0:1746155563.138182:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11803 00000100:00100000:1.0:1746155563.138187:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:28993:x1830976123635968:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155563.138202:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.138215:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107cf expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.138238:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3600/0x844e5faceb5eab10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106e8 expref: 30 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.138245:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5eac75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10797 expref: 21 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.138252:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5eab72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10727 expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.138257:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.138259:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.138262:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [516096->1048575] (req 516096->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 30 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.138286:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5eab72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10727 expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.138297:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5eab72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10727 expref: 14 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.138307:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124536704:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.138373:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5eac75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10797 expref: 21 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.138381:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5eac75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10797 expref: 21 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.138387:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124536832:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.138406:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3600/0x844e5faceb5eab10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106e8 expref: 30 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.138412:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3600/0x844e5faceb5eab10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106e8 expref: 30 pid: 1625 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.138418:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124536960:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.138428:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155563.146784:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124536704:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155563.151676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.151791:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124536832:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.151802:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124536960:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.151830:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [516096->1048575] (req 516096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 30 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.151846:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19800, rc 0) 00000100:00100000:1.0:1746155563.151883:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:28993:x1830976123635968:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 13695us (13902us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.151894:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11803 00000100:00100000:2.0:1746155563.151964:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123636224 00000100:00100000:2.0:1746155563.151970:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123636224 00010000:00010000:2.0:1746155563.151991:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5eac75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10797 expref: 22 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155563.152210:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5903 00000100:00100000:2.0:1746155563.152217:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123636224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155563.152227:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155563.152244:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5eac75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10797 expref: 22 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746155563.152252:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5eac75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10797 expref: 22 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746155563.152268:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5eac75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10797 expref: 22 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746155563.152281:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155563.152298:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123636224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 82us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.152302:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5903 00000100:00100000:0.0:1746155563.153101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.153129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.153171:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123636096 00000100:00100000:3.0:1746155563.153174:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123636096 00010000:00010000:3.0:1746155563.153188:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5eab72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10727 expref: 15 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.153200:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123636352 00000100:00100000:3.0:1746155563.153202:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123636352 00010000:00010000:3.0:1746155563.153208:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3600/0x844e5faceb5eab10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106e8 expref: 30 pid: 1625 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.153218:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5904 00000100:00100000:3.0:1746155563.153222:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123636096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.153228:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.153235:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5eab72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10727 expref: 15 pid: 18270 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.153242:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5eab72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10727 expref: 15 pid: 18270 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.153252:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d583200/0x844e5faceb5eab72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10727 expref: 15 pid: 18270 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.153262:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.153290:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123636096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 66us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.153296:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5904 00000100:00100000:3.0:1746155563.153327:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5905 00000100:00100000:3.0:1746155563.153331:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123636352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.153336:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.153342:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3600/0x844e5faceb5eab10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106e8 expref: 30 pid: 1625 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.153349:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3600/0x844e5faceb5eab10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106e8 expref: 30 pid: 1625 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.153359:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3600/0x844e5faceb5eab10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106e8 expref: 30 pid: 1625 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.153366:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.153367:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.153371:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 29 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.153377:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 29 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.153398:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 29 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.153406:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124537088:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155563.153447:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155563.157877:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124537088:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155563.157894:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.157940:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123636352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4606us (4809us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.157950:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5905 00000100:00100000:0.0:1746155563.159941:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.160804:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123636608 00000100:00100000:2.0:1746155563.160812:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123636608 00002000:00100000:2.0:1746155563.160848:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (516096->520191) req@ffff8800a5ae3100 x1830976123636608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.160858:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae3100 with x1830976123636608 ext(516096->520191) 00002000:00010000:2.0:1746155563.160863:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae3100 00000100:00100000:2.0:1746155563.160886:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4476 00000100:00100000:2.0:1746155563.160894:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123636608:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155563.161035:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123636608:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 140us (1098us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155563.161042:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4476 00002000:00100000:2.0:1746155563.161051:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (516096->520191) req@ffff8800a5ae3100 x1830976123636608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.161058:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae3100 with x1830976123636608 ext(516096->520191) 00002000:00010000:2.0:1746155563.161061:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae3100 00000100:00100000:0.0:1746155563.166075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.166460:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123636736 00000100:00100000:1.0:1746155563.166468:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123636736 00000100:00100000:1.0:1746155563.166536:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11804 00000100:00100000:1.0:1746155563.166544:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:28993:x1830976123636736:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155563.166557:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.166572:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107d6 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.166594:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5eab1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106ef expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.166602:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5eac7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1079e expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.166609:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d583600/0x844e5faceb5eab5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1072e expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.166629:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.166631:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.166634:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 29 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.166657:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d583600/0x844e5faceb5eab5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1072e expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.166666:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d583600/0x844e5faceb5eab5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1072e expref: 12 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.166677:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124537216:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.166755:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5eac7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1079e expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.166762:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5eac7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1079e expref: 25 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.166769:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124537344:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.166790:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5eab1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106ef expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.166796:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5eab1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106ef expref: 29 pid: 1625 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.166803:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124537472:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.166815:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155563.170552:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.170761:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124537216:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.170770:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124537344:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.170776:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124537472:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.170800:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 29 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.170819:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19e00, rc 0) 00000100:00100000:1.0:1746155563.170852:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:28993:x1830976123636736:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4310us (4786us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.170859:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11804 00000100:00100000:3.0:1746155563.172044:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123636864 00000100:00100000:3.0:1746155563.172051:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123636864 00010000:00010000:3.0:1746155563.172076:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d583600/0x844e5faceb5eab5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1072e expref: 13 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.172093:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5906 00000100:00100000:3.0:1746155563.172098:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123636864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.172107:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.172124:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d583600/0x844e5faceb5eab5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1072e expref: 13 pid: 18270 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.172133:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d583600/0x844e5faceb5eab5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1072e expref: 13 pid: 18270 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.172149:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d583600/0x844e5faceb5eab5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1072e expref: 13 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.172594:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.172637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155563.172667:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.172692:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123636864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 593us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.172701:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5906 00000100:00100000:3.0:1746155563.173961:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123636992 00000100:00100000:3.0:1746155563.173967:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123636992 00010000:00010000:3.0:1746155563.173984:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5eac7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1079e expref: 26 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.174000:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123637120 00000100:00100000:3.0:1746155563.174002:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123637120 00010000:00010000:3.0:1746155563.174010:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5eab1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106ef expref: 29 pid: 1625 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.174023:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5907 00000100:00100000:3.0:1746155563.174028:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1961:x1830976123636992:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.174035:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.174059:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5eac7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1079e expref: 26 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.174067:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5eac7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1079e expref: 26 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.174080:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5eac7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1079e expref: 26 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.174090:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.174125:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123636992:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.174133:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5907 00000100:00100000:3.0:1746155563.174144:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5908 00000100:00100000:3.0:1746155563.174148:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123637120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.174159:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.174167:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5eab1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106ef expref: 29 pid: 1625 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.174175:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5eab1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106ef expref: 29 pid: 1625 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.174185:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5eab1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106ef expref: 29 pid: 1625 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.174194:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.174195:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.174201:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 28 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.174208:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 28 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.174232:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 28 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.174243:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124537600:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155563.174289:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155563.175762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.175929:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123637376 00000100:00100000:1.0:1746155563.175934:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123637376 00000100:00100000:1.0:1746155563.175970:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9942 00000100:00100000:1.0:1746155563.175977:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29000:x1830976123637376:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155563.175994:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.176007:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da8ee00/0x844e5faceb5eacd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107dd expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.176088:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5eacde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176097:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5eacde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176105:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5eacde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176115:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18000/0x844e5faceb5eace5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176119:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18000/0x844e5faceb5eace5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176127:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18000/0x844e5faceb5eace5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176208:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5eacec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176216:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5eacec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176222:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5eacec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155563.176229:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155563.176290:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5eacde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176296:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5eacde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176302:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5eacde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176306:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca18800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155563.176310:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5eacde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176315:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5eacde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176323:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155563.176325:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155563.176328:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5eacde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176335:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5eacde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176346:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18000/0x844e5faceb5eace5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176351:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18000/0x844e5faceb5eace5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176354:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18000/0x844e5faceb5eace5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176358:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca18000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155563.176360:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18000/0x844e5faceb5eace5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176364:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18000/0x844e5faceb5eace5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176369:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fcd5800) 00010000:00010000:1.0:1746155563.176371:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155563.176373:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18000/0x844e5faceb5eace5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176377:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18000/0x844e5faceb5eace5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.176404:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da8ee00/0x844e5faceb5eacd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107dd expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.176414:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5eacec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107dd expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.176430:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155563.176431:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155563.176433:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19400, rc 0) 00000100:00100000:3.0:1746155563.177479:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124537600:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155563.177494:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.177547:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123637120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3397us (4908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.177555:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5908 00000100:00100000:1.0:1746155563.179518:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29000:x1830976123637376:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3525us (3741us total) trans 8589943863 rc 0/0 00000100:00100000:1.0:1746155563.179526:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9942 00000100:00100000:0.0:1746155563.180301:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.180473:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123637632 00000100:00100000:2.0:1746155563.180479:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123637632 00002000:00100000:2.0:1746155563.180522:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1392640->1396735) req@ffff8800a5ae1880 x1830976123637632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.180530:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1880 with x1830976123637632 ext(1392640->1396735) 00002000:00010000:2.0:1746155563.180534:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ae1880 00000100:00100000:2.0:1746155563.180555:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4477 00000100:00100000:2.0:1746155563.180561:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123637632:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155563.180703:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123637632:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 142us (403us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155563.180709:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4477 00002000:00100000:2.0:1746155563.180713:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1392640->1396735) req@ffff8800a5ae1880 x1830976123637632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.180719:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1880 with x1830976123637632 ext(1392640->1396735) 00002000:00010000:2.0:1746155563.180722:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ae1880 00000100:00100000:0.0:1746155563.187778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.187984:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123637888 00000100:00100000:3.0:1746155563.187992:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123637888 00000100:00100000:3.0:1746155563.188038:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3991 00000100:00100000:3.0:1746155563.188046:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094619c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:28993:x1830976123637888:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155563.188359:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094619c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:28993:x1830976123637888:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 313us (588us total) trans 8589943864 rc 0/0 00000100:00100000:3.0:1746155563.188366:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3991 00000100:00100000:0.0:1746155563.200604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.201670:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123638144 00000100:00100000:1.0:1746155563.201678:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123638144 00000100:00100000:1.0:1746155563.201728:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9943 00000100:00100000:1.0:1746155563.201735:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29004:x1830976123638144:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155563.201753:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.201768:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18000/0x844e5faceb5eacfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107e4 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.201840:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ead01 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.201851:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ead01 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.201859:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ead01 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155563.201868:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155563.201963:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18000/0x844e5faceb5eacfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107e4 expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.202137:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ead01 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107e4 expref: 14 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.202145:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155563.202147:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746155563.202150:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca18800, rc 0) 00000100:00100000:1.0:1746155563.202210:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29004:x1830976123638144:12345-192.168.202.51@tcp:101:cat.0 Request processed in 474us (1711us total) trans 8589943865 rc 0/0 00000100:00100000:1.0:1746155563.202216:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9943 00000100:00100000:0.0:1746155563.204202:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.204245:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.204527:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123638272 00000100:00100000:2.0:1746155563.204534:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123638272 00000100:00100000:2.0:1746155563.204570:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123638400 00000100:00100000:2.0:1746155563.204572:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123638400 00000100:00100000:2.0:1746155563.204634:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11805 00000100:00100000:1.0:1746155563.204640:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11806 00000100:00100000:2.0:1746155563.204641:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123638272:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155563.204645:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123638400:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155563.204652:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.204652:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.204665:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c94c600/0x844e5faceb5ead0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107eb expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.204665:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca19a00/0x844e5faceb5ead16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107f2 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.204700:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124537856:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155563.204700:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124537728:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155563.204746:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926780 going to sleep for 11 seconds 00000100:00100000:2.0:1746155563.204813:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155563.206187:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124537856:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155563.206191:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124537728:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155563.206208:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c94c600/0x844e5faceb5ead0f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107eb expref: 22 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.206208:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca19a00/0x844e5faceb5ead16 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f2 expref: 26 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.206218:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c94c600/0x844e5faceb5ead0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107eb expref: 22 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.206221:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca19a00/0x844e5faceb5ead16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f2 expref: 26 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.206240:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19a00, rc 0) 00010000:00010000:2.0:1746155563.206241:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94c600, rc 0) 00000100:00100000:0.0:1746155563.207167:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123638400:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2518us (2918us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155563.207175:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11806 00000100:00100000:2.0:1746155563.207521:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123638272:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2878us (3321us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155563.207526:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11805 00000100:00100000:0.0:1746155563.211376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.212031:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123638528 00000100:00100000:2.0:1746155563.212039:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123638528 00000100:00100000:2.0:1746155563.212322:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11807 00000100:00100000:2.0:1746155563.212329:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29004:x1830976123638528:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155563.212344:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.212356:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f107f9 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.212379:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 28 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.212386:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155563.212388:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155563.212391:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f9 expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.212418:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 28 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.212427:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 28 pid: 19959 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.212436:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124537984:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.212893:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155563.219629:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.219728:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124537984:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.219752:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f9 expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.219767:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94c800, rc 0) 00000100:00100000:2.0:1746155563.219804:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29004:x1830976123638528:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7474us (8432us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.219811:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11807 00000100:00100000:1.0:1746155563.219885:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123638656 00000100:00100000:1.0:1746155563.219890:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123638656 00002000:00100000:1.0:1746155563.219921:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (516096->1048575) req@ffff8800a5ae1f80 x1830976123638656/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.219929:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1f80 with x1830976123638656 ext(516096->1048575) 00010000:00010000:1.0:1746155563.219935:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 29 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.219946:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 29 pid: 19959 timeout: 792 lvb_type: 0 00002000:00010000:1.0:1746155563.219957:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ae1f80 00000100:00100000:1.0:1746155563.219970:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 678 00000100:00100000:1.0:1746155563.219976:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123638656:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155563.240766:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123638656:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 20780us (21142us total) trans 21474840529 rc 0/0 00000100:00100000:2.0:1746155563.240778:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 678 00002000:00100000:2.0:1746155563.240788:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (516096->1048575) req@ffff8800a5ae1f80 x1830976123638656/t21474840529(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/448 e 0 to 0 dl 1746155574 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.240797:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1f80 with x1830976123638656 ext(516096->1048575) 00010000:00010000:2.0:1746155563.240806:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 31 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.240822:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 31 pid: 19959 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746155563.240828:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ae1f80 00000100:00100000:0.0:1746155563.250173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.250206:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123638784 00000100:00100000:0.0:1746155563.250213:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123638784 00010000:00010000:0.0:1746155563.250244:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 31 pid: 19959 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746155563.250266:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5909 00000100:00100000:0.0:1746155563.250273:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123638784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155563.250284:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.250301:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 31 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.252606:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 31 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.252644:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19800/0x844e5faceb5eacc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107cf expref: 31 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.252673:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.252675:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.252681:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f9 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.252689:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f9 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.253270:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f9 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155563.253283:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124538112:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155563.253359:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155563.259208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.259450:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124538112:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155563.259468:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155563.259516:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123638784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9242us (9349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.259526:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5909 00000100:00100000:3.0:1746155563.259543:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123639040 00000100:00100000:3.0:1746155563.259549:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123639040 00002000:00100000:3.0:1746155563.259580:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800a5ae3b80 x1830976123639040/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.259588:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae3b80 with x1830976123639040 ext(0->1048575) 00002000:00010000:3.0:1746155563.259597:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae3b80 00000100:00100000:3.0:1746155563.259636:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4478 00000100:00100000:3.0:1746155563.259643:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123639040:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155563.271704:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123639040:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12054us (12497us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.271714:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4478 00002000:00100000:3.0:1746155563.271724:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800a5ae3b80 x1830976123639040/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.271738:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae3b80 with x1830976123639040 ext(0->1048575) 00002000:00010000:3.0:1746155563.271744:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae3b80 00000100:00100000:0.0:1746155563.274946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.275038:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123639296 00000100:00100000:3.0:1746155563.275045:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123639296 00000100:00100000:0.0:1746155563.275138:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.275216:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123639424 00000100:00100000:2.0:1746155563.275219:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123639424 00000100:00100000:2.0:1746155563.275248:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11808 00000100:00100000:2.0:1746155563.275254:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:29004:x1830976123639424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155563.275268:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.275281:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10807 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.275304:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 27 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.275311:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155563.275312:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155563.275315:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.275335:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 27 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.275345:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 27 pid: 19959 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.275354:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124538240:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.275401:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155563.275641:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9944 00000100:00100000:3.0:1746155563.275647:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:29007:x1830976123639296:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.275657:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.275667:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5ead2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10800 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.275737:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5ead32 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.275748:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5ead32 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.275756:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5ead32 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155563.275765:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155563.275961:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0de800/0x844e5faceb5ead2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10800 expref: 295 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.275987:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5ead32 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10800 expref: 294 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.275993:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.275996:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746155563.275998:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0df800, rc 0) 00000100:00100000:3.0:1746155563.276437:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29007:x1830976123639296:12345-192.168.202.51@tcp:101:cat.0 Request processed in 788us (1495us total) trans 8589943866 rc 0/0 00000100:00100000:3.0:1746155563.276443:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9944 00000100:00100000:2.0:1746155563.277290:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124538240:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.277307:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.277317:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94c400, rc 0) 00000100:00100000:2.0:1746155563.277341:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29004:x1830976123639424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2087us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.277347:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11808 00000100:00100000:0.0:1746155563.278495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.278609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.278818:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123639680 00000100:00100000:2.0:1746155563.278823:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123639680 00000100:00100000:2.0:1746155563.278849:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11809 00000100:00100000:2.0:1746155563.278856:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123639680:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155563.279233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155563.279332:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.279347:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ead40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1080e expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.279365:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.279366:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.279374:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ead40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1080e expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.279391:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ead40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1080e expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.279399:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94dc00, rc 0) 00000100:00100000:2.0:1746155563.279428:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123639680:12345-192.168.202.51@tcp:101:cat.0 Request processed in 572us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.279433:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11809 00000100:00100000:2.0:1746155563.279444:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123639808 00000100:00100000:2.0:1746155563.279446:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123639808 00000100:00100000:2.0:1746155563.279459:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11810 00000100:00100000:2.0:1746155563.279464:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123639808:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155563.279471:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.279478:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c94d000/0x844e5faceb5ead47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10815 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.279527:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124538368:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155563.279574:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155563.279738:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123639552 00000100:00100000:3.0:1746155563.279742:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123639552 00002000:00100000:3.0:1746155563.279763:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1396735) req@ffff8800a5ae0a80 x1830976123639552/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.279770:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0a80 with x1830976123639552 ext(1048576->1396735) 00010000:00010000:3.0:1746155563.279775:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 30 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.279784:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 30 pid: 19959 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746155563.279790:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ae0a80 00000100:00100000:3.0:1746155563.279801:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 679 00000100:00100000:3.0:1746155563.279806:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123639552:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155563.282249:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124538368:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155563.282275:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c94d000/0x844e5faceb5ead47 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10815 expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.282286:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c94d000/0x844e5faceb5ead47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10815 expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.282312:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94d000, rc 0) 00000100:00100000:2.0:1746155563.282345:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123639808:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2879us (3111us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155563.282351:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11810 00000100:00100000:2.0:1746155563.289637:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123639552:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 9821us (11134us total) trans 17179873145 rc 0/0 00000100:00100000:2.0:1746155563.289647:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 679 00002000:00100000:2.0:1746155563.289657:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1396735) req@ffff8800a5ae0a80 x1830976123639552/t17179873145(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/448 e 0 to 0 dl 1746155574 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.289665:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0a80 with x1830976123639552 ext(1048576->1396735) 00010000:00010000:2.0:1746155563.289673:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 30 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.289686:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 30 pid: 19959 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746155563.289692:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ae0a80 00000100:00100000:0.0:1746155563.298735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.298784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.298866:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123640064 00000100:00100000:3.0:1746155563.298874:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123640064 00000100:00100000:3.0:1746155563.298910:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11811 00000100:00100000:3.0:1746155563.298916:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29000:x1830976123640064:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155563.298932:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.298947:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1081c expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.298969:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155563.298975:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.298980:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746155563.298983:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1499136->2097151] (req 1499136->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.299012:0:4461:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.299022:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1499136->2097151] (req 1499136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.299031:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0dfa00, rc 0) 00000100:00100000:3.0:1746155563.299077:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:29000:x1830976123640064:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 161us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.299082:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11811 00000100:00100000:2.0:1746155563.299558:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123639936 00000100:00100000:2.0:1746155563.299562:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123639936 00010000:00010000:2.0:1746155563.299579:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 30 pid: 19959 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.299595:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5910 00000100:00100000:2.0:1746155563.299600:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123639936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155563.299611:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155563.299639:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 30 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.299647:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 30 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.299662:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5eacd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107d6 expref: 30 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.299675:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.299677:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.299681:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.299688:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.299706:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.299715:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 26 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.299725:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124538624:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155563.299767:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155563.300187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.300581:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123640320 00000100:00100000:2.0:1746155563.300585:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123640320 00002000:00100000:2.0:1746155563.300610:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009c28fb80 x1830976123640320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.300647:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28fb80 with x1830976123640320 ext(0->1048575) 00002000:00010000:2.0:1746155563.300651:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28fb80 00000100:00100000:2.0:1746155563.300665:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4479 00000100:00100000:2.0:1746155563.300670:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123640320:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155563.303018:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124538624:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155563.303035:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.303064:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123639936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3464us (4338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.303072:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5910 00000100:00100000:3.0:1746155563.315775:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123640320:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15097us (15581us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.315785:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4479 00002000:00100000:3.0:1746155563.315794:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009c28fb80 x1830976123640320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.315808:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28fb80 with x1830976123640320 ext(0->1048575) 00002000:00010000:3.0:1746155563.315812:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28fb80 00000100:00100000:0.0:1746155563.316222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.316255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.316272:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123640576 00000100:00100000:0.0:1746155563.316278:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123640576 00002000:00100000:0.0:1746155563.316306:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009c28dc00 x1830976123640576/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155563.316314:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28dc00 with x1830976123640576 ext(1048576->2097151) 00010000:00010000:0.0:1746155563.316320:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 27 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.316332:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 27 pid: 4461 timeout: 792 lvb_type: 0 00002000:00010000:0.0:1746155563.316338:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28dc00 00000100:00100000:0.0:1746155563.316350:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123640704 00000100:00100000:0.0:1746155563.316353:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123640704 00002000:00100000:0.0:1746155563.316364:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009c28c000 x1830976123640704/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155563.316370:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28c000 with x1830976123640704 ext(1048576->2097151) 00002000:00010000:0.0:1746155563.316373:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28c000 00000100:00100000:0.0:1746155563.316685:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 680 00000100:00100000:0.0:1746155563.316693:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1962:x1830976123640576:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155563.318469:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4480 00000100:00100000:0.0:1746155563.318479:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1963:x1830976123640704:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155563.326183:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.326636:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123640960 00000100:00100000:1.0:1746155563.326645:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123640960 00000100:00100000:1.0:1746155563.326977:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11812 00000100:00100000:1.0:1746155563.326986:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:29007:x1830976123640960:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155563.327002:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.327017:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10823 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.327038:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.327044:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1499136->2097151] (req 1499136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.327050:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155563.327052:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 30 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.327080:0:19959:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1499136->2097151] (req 1499136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.327091:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 30 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.327105:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b800, rc 0) 00000100:00100000:1.0:1746155563.327142:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29007:x1830976123640960:12345-192.168.202.51@tcp:101:cat.0 Request processed in 157us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.327147:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11812 00000100:00100000:2.0:1746155563.328818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.328870:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123641216 00000100:00100000:3.0:1746155563.328876:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123641216 00000100:00100000:3.0:1746155563.328914:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9945 00000100:00100000:3.0:1746155563.328932:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29009:x1830976123641216:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155563.328945:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.328957:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df600/0x844e5faceb5ead5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1082a expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.329029:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.329039:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1076d expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.329046:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10782 expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.329052:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5eacad lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ba expref: 295 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.329057:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5eacec lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107dd expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.329062:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 7/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.329085:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5eacec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107dd expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.329094:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5eacec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107dd expref: 13 pid: 14234 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.329103:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124538880:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.329167:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5eacad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ba expref: 295 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.329174:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5eacad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ba expref: 295 pid: 14234 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.329180:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124539008:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.329198:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10782 expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.329204:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10782 expref: 295 pid: 27374 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.329209:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124539136:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.329224:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1076d expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.329230:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1076d expref: 13 pid: 14234 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.329240:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124539264:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155563.329251:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155563.330213:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1963:x1830976123640704:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11734us (13954us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155563.330221:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4480 00002000:00100000:0.0:1746155563.330229:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009c28c000 x1830976123640704/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155563.330244:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28c000 with x1830976123640704 ext(1048576->2097151) 00002000:00010000:0.0:1746155563.330248:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28c000 00000100:00100000:3.0:1746155563.330340:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1962:x1830976123640576:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13647us (14119us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.330346:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 680 00002000:00100000:3.0:1746155563.330350:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009c28dc00 x1830976123640576/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.330357:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28dc00 with x1830976123640576 ext(1048576->2097151) 00010000:00010000:3.0:1746155563.330363:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 27 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.330372:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 27 pid: 4461 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746155563.330378:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28dc00 00000100:00100000:0.0:1746155563.336936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.337137:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124538880:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155563.337146:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124539008:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155563.337153:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124539136:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.340609:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.341112:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123641472 00000100:00100000:2.0:1746155563.341120:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123641472 00010000:00010000:2.0:1746155563.341155:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5eacad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ba expref: 296 pid: 14234 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.341186:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5911 00000100:00100000:2.0:1746155563.341194:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:1962:x1830976123641472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155563.341204:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155563.341209:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5eacad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ba expref: 296 pid: 14234 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.341219:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5eacad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ba expref: 296 pid: 14234 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.341239:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5eacad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ba expref: 296 pid: 14234 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.341256:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155563.341261:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.341268:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.341272:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155563.341309:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1962:x1830976123641472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 116us (4381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.341314:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5911 00000100:00100000:3.0:1746155563.341631:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124539264:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.341656:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155563.341960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.341995:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.342013:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123641344 00000100:00100000:1.0:1746155563.342017:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123641344 00010000:00010000:1.0:1746155563.342031:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5eacec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107dd expref: 14 pid: 14234 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.342044:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123641600 00000100:00100000:1.0:1746155563.342046:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123641600 00010000:00010000:1.0:1746155563.342052:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10782 expref: 295 pid: 27374 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.342067:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123641728 00000100:00100000:1.0:1746155563.342069:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123641728 00010000:00010000:1.0:1746155563.342076:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1076d expref: 15 pid: 14234 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.342087:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5912 00000100:00100000:1.0:1746155563.342091:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976123641344:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.342098:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.342101:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5eacec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107dd expref: 15 pid: 14234 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.342108:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5eacec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107dd expref: 15 pid: 14234 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.342119:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5eacec lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107dd expref: 15 pid: 14234 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.342130:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155563.342133:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.342138:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.342142:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.342158:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976123641344:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 67us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.342163:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5912 00000100:00100000:1.0:1746155563.342171:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5913 00000100:00100000:1.0:1746155563.342175:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1963:x1830976123641600:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.342180:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.342182:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10782 expref: 295 pid: 27374 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.342189:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10782 expref: 295 pid: 27374 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.342198:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065aa00/0x844e5faceb5eac60 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10782 expref: 295 pid: 27374 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.342205:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155563.342207:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.342211:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.342215:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.342225:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1963:x1830976123641600:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.342228:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5913 00000100:00100000:1.0:1746155563.342235:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5914 00000100:00100000:1.0:1746155563.342239:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123641728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.342243:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.342246:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1076d expref: 13 pid: 14234 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.342252:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1076d expref: 13 pid: 14234 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.342260:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b600/0x844e5faceb5eac28 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1076d expref: 13 pid: 14234 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.342265:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155563.342268:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.342273:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.342278:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.342291:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.342301:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123641728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 62us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.342305:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5914 00010000:00010000:3.0:1746155563.342684:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.342690:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155563.342706:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155563.342813:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df600/0x844e5faceb5ead5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1082a expref: 295 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.345117:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1082a expref: 294 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.345127:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.345130:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155563.345132:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0dfc00, rc 0) 00000100:00100000:3.0:1746155563.345207:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29009:x1830976123641216:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 16285us (16391us total) trans 8589943867 rc 0/0 00000100:00100000:3.0:1746155563.345215:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9945 00000100:00100000:1.0:1746155563.350965:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.351002:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.351077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.351125:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123641984 00000100:00100000:2.0:1746155563.351134:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123641984 00000100:00100000:2.0:1746155563.351167:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123642112 00000100:00100000:2.0:1746155563.351168:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123642112 00000100:00100000:2.0:1746155563.351184:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11813 00000100:00100000:2.0:1746155563.351191:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123641984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155563.351206:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.351220:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17800/0x844e5faceb5ead71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10831 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.351241:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.351251:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17800/0x844e5faceb5ead71 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10831 expref: 28 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.351261:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17800/0x844e5faceb5ead71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10831 expref: 28 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.351271:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e17800, rc 0) 00000100:00100000:2.0:1746155563.351321:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123641984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 130us (317us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155563.351327:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11813 00000100:00100000:2.0:1746155563.351340:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11814 00000100:00100000:2.0:1746155563.351344:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29009:x1830976123642112:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155563.351351:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.351357:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10838 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.351369:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.351373:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 31 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.351377:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155563.351381:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1306624->1495039] (req 1306624->1495039) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.351410:0:4461:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 31 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.351419:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1306624->1495039] (req 1306624->1495039) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.351427:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e17600, rc 0) 00000100:00100000:2.0:1746155563.351446:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29009:x1830976123642112:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 101us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.351451:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11814 00000100:00100000:3.0:1746155563.351653:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123641856 00000100:00100000:3.0:1746155563.351658:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123641856 00010000:00010000:3.0:1746155563.351675:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 27 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.351704:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5915 00000100:00100000:3.0:1746155563.351709:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1962:x1830976123641856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.351717:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.351733:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 27 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.351747:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 27 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.351760:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c94c400/0x844e5faceb5ead24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10807 expref: 27 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.351767:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.351768:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.351773:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.351779:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.351795:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.351803:0:7064:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 26 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.351812:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124539520:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155563.351856:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155563.355103:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124539520:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155563.355121:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.355173:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123641856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3461us (4214us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.355183:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5915 00000100:00100000:0.0:1746155563.355947:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.356048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.356124:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123642496 00000100:00100000:2.0:1746155563.356130:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123642496 00002000:00100000:2.0:1746155563.356160:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1499136->1503231) req@ffff88009c28ca80 x1830976123642496/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.356168:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ca80 with x1830976123642496 ext(1499136->1503231) 00010000:00010000:2.0:1746155563.356174:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 26 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.356186:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 26 pid: 4461 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746155563.356192:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28ca80 00000100:00100000:2.0:1746155563.356205:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 681 00000100:00100000:2.0:1746155563.356211:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1961:x1830976123642496:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155563.357892:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123642368 00000100:00100000:3.0:1746155563.357900:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123642368 00000100:00100000:3.0:1746155563.357939:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11815 00000100:00100000:3.0:1746155563.357945:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123642368:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.357960:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.357972:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d583000/0x844e5faceb5ead7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1083f expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.358010:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124539648:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155563.358029:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123642496:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1816us (1979us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155563.358036:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 681 00002000:00100000:2.0:1746155563.358044:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1499136->1503231) req@ffff88009c28ca80 x1830976123642496/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746155574 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.358051:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ca80 with x1830976123642496 ext(1499136->1503231) 00010000:00010000:2.0:1746155563.358056:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 28 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.358062:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00010000:00010000:2.0:1746155563.358067:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 28 pid: 4461 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746155563.358077:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28ca80 00000100:00100000:0.0:1746155563.367458:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.367813:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123642752 00000100:00100000:2.0:1746155563.367820:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123642752 00002000:00100000:2.0:1746155563.367855:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1499136->2097151) req@ffff88009c28ce00 x1830976123642752/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.367863:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ce00 with x1830976123642752 ext(1499136->2097151) 00010000:00010000:2.0:1746155563.367870:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 28 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.367881:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 28 pid: 4461 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746155563.367887:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28ce00 00000100:00100000:2.0:1746155563.367916:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 682 00000100:00100000:2.0:1746155563.367923:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123642752:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155563.368566:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124539648:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155563.368591:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d583000/0x844e5faceb5ead7f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1083f expref: 28 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.368602:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d583000/0x844e5faceb5ead7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1083f expref: 28 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.368611:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d583000, rc 0) 00000100:00100000:3.0:1746155563.368658:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123642368:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10712us (12711us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155563.368665:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11815 00000100:00100000:3.0:1746155563.374102:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.374398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.376017:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123642880 00000100:00100000:2.0:1746155563.376026:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123642880 00000100:00100000:2.0:1746155563.376093:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123643008 00000100:00100000:2.0:1746155563.376096:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123643008 00000100:00100000:2.0:1746155563.376137:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11816 00000100:00100000:2.0:1746155563.376144:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+29:29000:x1830976123642880:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155563.376168:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.376184:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10846 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155563.376230:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11817 00010000:00010000:2.0:1746155563.376236:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c1 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155563.376237:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123643008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155563.376245:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155563.376252:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5ead8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1084d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.376265:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938a0200/0x844e5faceb5eacc2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c8 expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.376271:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.376286:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155563.376287:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124539776:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155563.376289:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1175551] (req 1048576->1175551) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.376316:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938a0200/0x844e5faceb5eacc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c8 expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.376344:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938a0200/0x844e5faceb5eacc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c8 expref: 31 pid: 4461 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746155563.376356:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155563.376367:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124539904:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.376402:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c1 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.376410:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c1 expref: 30 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.376479:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124540032:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.376498:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155563.379559:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124539776:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155563.379585:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5ead8d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1084d expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.379596:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938a0600/0x844e5faceb5ead8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1084d expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.379609:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938a0600, rc 0) 00000100:00100000:1.0:1746155563.379665:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123643008:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3428us (5279us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155563.379672:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11817 00000100:00100000:3.0:1746155563.379803:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124539904:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155563.379811:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124540032:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.379828:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1175551] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.379838:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e16c00, rc 0) 00000100:00100000:3.0:1746155563.379857:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+29:29000:x1830976123642880:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3714us (5764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.379862:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11816 00000100:00100000:0.0:1746155563.381264:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.381319:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123643136 00000100:00100000:3.0:1746155563.381324:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123643136 00010000:00010000:3.0:1746155563.381346:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938a0200/0x844e5faceb5eacc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c8 expref: 29 pid: 4461 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.381366:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5916 00000100:00100000:3.0:1746155563.381372:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123643136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.381384:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.381397:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938a0200/0x844e5faceb5eacc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c8 expref: 29 pid: 4461 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.381406:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938a0200/0x844e5faceb5eacc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c8 expref: 29 pid: 4461 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.381421:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938a0200/0x844e5faceb5eacc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c8 expref: 29 pid: 4461 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746155563.381445:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.381466:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123643136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.381471:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5916 00000100:00100000:3.0:1746155563.386349:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123642752:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 18418us (18889us total) trans 17179873146 rc 0/0 00000100:00100000:3.0:1746155563.386361:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 682 00002000:00100000:3.0:1746155563.386371:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1499136->2097151) req@ffff88009c28ce00 x1830976123642752/t17179873146(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/448 e 0 to 0 dl 1746155574 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.386380:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ce00 with x1830976123642752 ext(1499136->2097151) 00010000:00010000:3.0:1746155563.386389:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 28 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.386400:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 28 pid: 4461 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746155563.386406:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28ce00 00000100:00100000:0.0:1746155563.386572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.386596:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123643264 00000100:00100000:0.0:1746155563.386602:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123643264 00010000:00010000:0.0:1746155563.386633:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c1 expref: 31 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746155563.386651:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5917 00000100:00100000:0.0:1746155563.386657:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123643264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155563.386668:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.386684:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c1 expref: 31 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.386692:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c1 expref: 31 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.386710:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094766e00/0x844e5faceb5eacbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107c1 expref: 31 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.386731:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.386733:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.386739:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.386747:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.386775:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155563.386784:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124540160:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155563.386834:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155563.389312:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124540160:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155563.389329:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155563.389361:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123643264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2703us (2789us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.389369:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5917 00000100:00100000:0.0:1746155563.390298:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.390337:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.390416:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123643392 00000100:00100000:2.0:1746155563.390422:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123643392 00010000:00010000:2.0:1746155563.390443:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 28 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.390459:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123643904 00000100:00100000:3.0:1746155563.390463:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123643904 00000100:00100000:2.0:1746155563.390470:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5918 00000100:00100000:2.0:1746155563.390475:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1963:x1830976123643392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00002000:00100000:3.0:1746155563.390486:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1171456->1175551) req@ffff88009366ca80 x1830976123643904/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746155563.390486:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:3.0:1746155563.390493:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366ca80 with x1830976123643904 ext(1171456->1175551) 00002000:00010000:3.0:1746155563.390496:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366ca80 00010000:00010000:2.0:1746155563.390518:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 29 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.390528:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 29 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.390641:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0dfa00/0x844e5faceb5ead4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1499136->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1081c expref: 29 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.390739:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.390741:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.390745:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 29 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.390756:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 29 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.390780:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 29 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.390789:0:7063:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 29 pid: 19959 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.390798:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124540288:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155563.390952:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155563.391062:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4481 00000100:00100000:3.0:1746155563.391068:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123643904:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155563.391192:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123643904:12345-192.168.202.51@tcp:3:cat.0 Request processed in 123us (895us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155563.391201:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4481 00002000:00100000:3.0:1746155563.391207:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1171456->1175551) req@ffff88009366ca80 x1830976123643904/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.391214:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366ca80 with x1830976123643904 ext(1171456->1175551) 00002000:00010000:3.0:1746155563.391216:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366ca80 00000100:00100000:2.0:1746155563.395169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.395320:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124540288:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155563.395333:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155563.395367:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1963:x1830976123643392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4890us (5028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.395375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.395376:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5918 00000100:00100000:1.0:1746155563.395395:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123644416 00000100:00100000:1.0:1746155563.395401:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123644416 00002000:00100000:1.0:1746155563.395427:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800910cb100 x1830976123644416/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.395441:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb100 with x1830976123644416 ext(1048576->2097151) 00010000:00010000:1.0:1746155563.395447:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 30 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.395459:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 30 pid: 19959 timeout: 792 lvb_type: 0 00002000:00010000:1.0:1746155563.395466:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910cb100 00000100:00100000:1.0:1746155563.395495:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 683 00000100:00100000:3.0:1746155563.395500:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123644160 00000100:00100000:3.0:1746155563.395519:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123644160 00000100:00100000:1.0:1746155563.395519:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123644416:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155563.395539:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3992 00000100:00100000:3.0:1746155563.395543:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29000:x1830976123644160:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155563.395679:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29000:x1830976123644160:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 134us (518us total) trans 8589943868 rc 0/0 00000100:00100000:3.0:1746155563.395684:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3992 00000100:00100000:1.0:1746155563.406420:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123644416:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10910us (11035us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155563.406431:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 683 00002000:00100000:1.0:1746155563.406440:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800910cb100 x1830976123644416/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.406448:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb100 with x1830976123644416 ext(1048576->2097151) 00010000:00010000:1.0:1746155563.406456:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 30 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.406468:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 30 pid: 19959 timeout: 792 lvb_type: 0 00002000:00010000:1.0:1746155563.406476:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910cb100 00000100:00100000:0.0:1746155563.409897:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.410671:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123644544 00000100:00100000:3.0:1746155563.410679:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123644544 00000100:00100000:3.0:1746155563.410722:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11818 00000100:00100000:3.0:1746155563.410730:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29007:x1830976123644544:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155563.410735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155563.410745:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155563.410752:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123644672 00000100:00100000:0.0:1746155563.410755:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123644672 00010000:00010000:3.0:1746155563.410761:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10854 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.410771:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 32 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.410784:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155563.410786:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5919 00000100:00100000:0.0:1746155563.410790:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123644672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.410791:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155563.410792:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155563.410796:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.410797:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10854 expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.410812:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 32 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.410819:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.410821:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 32 pid: 19959 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.410828:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 26 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.410834:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b800/0x844e5faceb5ead55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10823 expref: 32 pid: 19959 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.410837:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124540416:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155563.410847:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.410849:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.410853:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.410859:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.410876:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155563.410884:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124540544:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155563.411648:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155563.411648:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155563.413261:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124540416:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.413282:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10854 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.413294:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800901f0800, rc 0) 00000100:00100000:3.0:1746155563.413335:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29007:x1830976123644544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2605us (3443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.413336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.413341:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11818 00000100:00100000:1.0:1746155563.413395:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124540544:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155563.413407:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.413428:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123644672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2637us (2691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.413435:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5919 00000100:00100000:1.0:1746155563.413456:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123644800 00000100:00100000:1.0:1746155563.413460:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123644800 00002000:00100000:1.0:1746155563.413486:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1175551) req@ffff88009366f480 x1830976123644800/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.413494:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366f480 with x1830976123644800 ext(1048576->1175551) 00010000:00010000:1.0:1746155563.413500:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 27 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.413532:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 27 pid: 4461 timeout: 792 lvb_type: 0 00002000:00010000:1.0:1746155563.413538:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009366f480 00000100:00100000:1.0:1746155563.413557:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 684 00000100:00100000:1.0:1746155563.413563:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123644800:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155563.413902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.414057:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123645056 00000100:00100000:3.0:1746155563.414061:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123645056 00002000:00100000:3.0:1746155563.414075:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1306624->1310719) req@ffff88009366e680 x1830976123645056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.414082:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366e680 with x1830976123645056 ext(1306624->1310719) 00002000:00010000:3.0:1746155563.414085:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366e680 00000100:00100000:3.0:1746155563.414108:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4482 00000100:00100000:3.0:1746155563.414114:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123645056:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155563.414217:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123645056:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 102us (314us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155563.414222:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4482 00002000:00100000:3.0:1746155563.414227:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1306624->1310719) req@ffff88009366e680 x1830976123645056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.414234:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366e680 with x1830976123645056 ext(1306624->1310719) 00002000:00010000:3.0:1746155563.414236:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366e680 00000100:00100000:1.0:1746155563.418434:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123644800:12345-192.168.202.51@tcp:4:cat.0 Request processed in 4862us (5088us total) trans 17179873147 rc 0/0 00000100:00100000:1.0:1746155563.418445:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 684 00002000:00100000:1.0:1746155563.418455:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1175551) req@ffff88009366f480 x1830976123644800/t17179873147(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/448 e 0 to 0 dl 1746155574 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.418464:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366f480 with x1830976123644800 ext(1048576->1175551) 00010000:00010000:1.0:1746155563.418472:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 29 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.418487:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 29 pid: 4461 timeout: 792 lvb_type: 0 00002000:00010000:1.0:1746155563.418494:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009366f480 00000100:00100000:0.0:1746155563.420528:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.420629:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123645312 00000100:00100000:1.0:1746155563.420635:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123645312 00002000:00100000:1.0:1746155563.420664:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1490944->1495039) req@ffff88009366dc00 x1830976123645312/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.420671:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366dc00 with x1830976123645312 ext(1490944->1495039) 00002000:00010000:1.0:1746155563.420675:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366dc00 00000100:00100000:1.0:1746155563.420900:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4483 00000100:00100000:1.0:1746155563.420906:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123645312:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155563.421053:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123645312:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 146us (555us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155563.421059:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4483 00002000:00100000:1.0:1746155563.421064:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1490944->1495039) req@ffff88009366dc00 x1830976123645312/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.421071:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366dc00 with x1830976123645312 ext(1490944->1495039) 00002000:00010000:1.0:1746155563.421074:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366dc00 00000100:00100000:0.0:1746155563.421829:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.422886:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123645440 00000100:00100000:1.0:1746155563.422892:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123645440 00010000:00010000:1.0:1746155563.422917:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 29 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.423343:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5920 00000100:00100000:1.0:1746155563.423350:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123645440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.423360:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.423378:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 29 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.423387:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 29 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.423404:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16c00/0x844e5faceb5ead86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10846 expref: 29 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.423434:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.423436:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.423441:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10854 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.423448:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10854 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.423476:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10854 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.423487:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124540672:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155563.423573:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155563.428727:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124540672:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155563.428748:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.428798:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123645440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5446us (6967us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.428808:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5920 00000100:00100000:0.0:1746155563.431995:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.432212:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123645696 00000100:00100000:2.0:1746155563.432219:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123645696 00002000:00100000:2.0:1746155563.432253:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009366f800 x1830976123645696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.432262:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366f800 with x1830976123645696 ext(1048576->2097151) 00002000:00010000:2.0:1746155563.432267:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366f800 00000100:00100000:2.0:1746155563.432536:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4484 00000100:00100000:2.0:1746155563.432544:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123645696:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155563.439395:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123645696:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 6844us (7399us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.439404:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4484 00002000:00100000:2.0:1746155563.439414:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009366f800 x1830976123645696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.439423:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366f800 with x1830976123645696 ext(1048576->2097151) 00002000:00010000:2.0:1746155563.439428:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366f800 00000100:00100000:0.0:1746155563.511596:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.511781:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123645952 00000100:00100000:3.0:1746155563.511789:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123645952 00000100:00100000:3.0:1746155563.511825:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9946 00000100:00100000:3.0:1746155563.511832:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29016:x1830976123645952:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.511853:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.511868:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094484a00/0x844e5faceb5ead9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1085b expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.511949:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eada2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.511961:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eada2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.511970:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eada2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.511980:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094484e00/0x844e5faceb5eada9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.511985:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094484e00/0x844e5faceb5eada9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.511990:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094484e00/0x844e5faceb5eada9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512071:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eadb0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512078:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eadb0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512084:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eadb0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155563.512090:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155563.512154:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eada2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512160:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eada2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512165:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eada2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512169:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094484c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155563.512173:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eada2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512178:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eada2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512187:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155563.512189:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155563.512192:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eada2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512200:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eada2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512225:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094484e00/0x844e5faceb5eada9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512230:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094484e00/0x844e5faceb5eada9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512233:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094484e00/0x844e5faceb5eada9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512237:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094484e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155563.512239:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094484e00/0x844e5faceb5eada9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512243:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094484e00/0x844e5faceb5eada9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512248:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801366f8d00) 00010000:00010000:3.0:1746155563.512250:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155563.512252:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094484e00/0x844e5faceb5eada9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512256:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094484e00/0x844e5faceb5eada9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.512285:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094484a00/0x844e5faceb5ead9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1085b expref: 16 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.512294:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eadb0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1085b expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.512303:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.512305:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155563.512306:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094485000, rc 0) 00000100:00100000:3.0:1746155563.512360:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29016:x1830976123645952:12345-192.168.202.51@tcp:101:cat.0 Request processed in 528us (772us total) trans 8589943869 rc 0/0 00000100:00100000:3.0:1746155563.512366:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9946 00000100:00100000:0.0:1746155563.517754:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.518145:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123646208 00000100:00100000:2.0:1746155563.518154:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123646208 00000100:00100000:2.0:1746155563.518210:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3993 00000100:00100000:2.0:1746155563.518217:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29016:x1830976123646208:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155563.518398:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29016:x1830976123646208:12345-192.168.202.51@tcp:35:cat.0 Request processed in 181us (651us total) trans 8589943870 rc 0/0 00000100:00100000:2.0:1746155563.518405:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3993 00000100:00100000:0.0:1746155563.524693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.524741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.524811:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123646336 00000100:00100000:1.0:1746155563.524819:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123646336 00000100:00100000:1.0:1746155563.524883:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123646464 00000100:00100000:1.0:1746155563.524885:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123646464 00000100:00100000:1.0:1746155563.525094:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11819 00000100:00100000:1.0:1746155563.525102:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123646336:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155563.525117:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.525131:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f600/0x844e5faceb5eadbe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10862 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.525175:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124540800:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155563.525237:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155563.525405:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11820 00000100:00100000:3.0:1746155563.525412:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123646464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.525418:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.525426:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094484800/0x844e5faceb5eadc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10869 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.525436:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.525438:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.525444:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094484800/0x844e5faceb5eadc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10869 expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.525457:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094484800/0x844e5faceb5eadc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10869 expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.525465:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094484800, rc 0) 00000100:00100000:3.0:1746155563.525484:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1961:x1830976123646464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 74us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.525490:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11820 00000100:00100000:1.0:1746155563.529989:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124540800:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155563.530018:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f600/0x844e5faceb5eadbe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10862 expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.530029:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f600/0x844e5faceb5eadbe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10862 expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.530042:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce6f600, rc 0) 00000100:00100000:1.0:1746155563.530092:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123646336:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4990us (5405us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155563.530100:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11819 00000100:00100000:0.0:1746155563.536027:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.536101:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123646720 00000100:00100000:3.0:1746155563.536110:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123646720 00000100:00100000:3.0:1746155563.536157:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9947 00000100:00100000:3.0:1746155563.536165:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29018:x1830976123646720:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155563.536184:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.536197:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094485400/0x844e5faceb5eadcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10870 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.536281:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485600/0x844e5faceb5eadd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536292:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094485600/0x844e5faceb5eadd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536301:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094485600/0x844e5faceb5eadd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536311:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485800/0x844e5faceb5eadda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536317:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094485800/0x844e5faceb5eadda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536322:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094485800/0x844e5faceb5eadda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536408:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485a00/0x844e5faceb5eade1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536416:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094485a00/0x844e5faceb5eade1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536422:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094485a00/0x844e5faceb5eade1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155563.536433:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155563.536498:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485600/0x844e5faceb5eadd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536537:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094485600/0x844e5faceb5eadd3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536543:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094485600/0x844e5faceb5eadd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536550:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094485600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155563.536553:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094485600/0x844e5faceb5eadd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536558:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094485600/0x844e5faceb5eadd3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536568:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155563.536571:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155563.536574:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094485600/0x844e5faceb5eadd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536578:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094485600/0x844e5faceb5eadd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536600:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485800/0x844e5faceb5eadda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536605:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094485800/0x844e5faceb5eadda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536610:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094485800/0x844e5faceb5eadda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536627:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094485800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155563.536630:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094485800/0x844e5faceb5eadda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536635:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094485800/0x844e5faceb5eadda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536641:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801366f8b00) 00010000:00010000:3.0:1746155563.536642:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155563.536644:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094485800/0x844e5faceb5eadda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536649:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094485800/0x844e5faceb5eadda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.536680:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094485400/0x844e5faceb5eadcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10870 expref: 19 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.536690:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485a00/0x844e5faceb5eade1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10870 expref: 18 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.536697:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.536699:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155563.536701:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094485a00, rc 0) 00000100:00100000:3.0:1746155563.536754:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29018:x1830976123646720:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 590us (734us total) trans 8589943871 rc 0/0 00000100:00100000:3.0:1746155563.536760:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9947 00000100:00100000:0.0:1746155563.539988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.540064:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123646848 00000100:00100000:1.0:1746155563.540071:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123646848 00000100:00100000:1.0:1746155563.540113:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 578 00000100:00100000:1.0:1746155563.540128:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123646848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.540141:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.540158:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094485a00/0x844e5faceb5eade1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10870 expref: 18 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.540176:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155563.540179:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.540210:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123646848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 90us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.540216:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 578 00000100:00100000:0.0:1746155563.544607:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.544689:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123646976 00000100:00100000:1.0:1746155563.544696:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123646976 00000100:00100000:1.0:1746155563.544728:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11821 00000100:00100000:1.0:1746155563.544734:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+29:29016:x1830976123646976:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155563.544748:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.544761:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10877 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.544782:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.544789:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155563.544790:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155563.544793:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10877 expref: 30 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.544815:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.544824:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 29 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.544834:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124540928:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.544978:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155563.551289:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.551403:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124540928:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.551429:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10877 expref: 30 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.551444:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce6fa00, rc 0) 00000100:00100000:2.0:1746155563.551481:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+30:29016:x1830976123646976:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6746us (6880us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.551489:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11821 00000100:00100000:3.0:1746155563.553004:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123647104 00000100:00100000:3.0:1746155563.553013:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123647104 00002000:00100000:3.0:1746155563.553050:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1306624->1495039) req@ffff8800910cad80 x1830976123647104/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.553059:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cad80 with x1830976123647104 ext(1306624->1495039) 00010000:00010000:3.0:1746155563.553067:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 30 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.553078:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 30 pid: 4461 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746155563.553084:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910cad80 00000100:00100000:3.0:1746155563.553100:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 685 00000100:00100000:3.0:1746155563.553106:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123647104:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155563.561120:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123647104:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8003us (9826us total) trans 17179873148 rc 0/0 00000100:00100000:3.0:1746155563.561133:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 685 00002000:00100000:3.0:1746155563.561145:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1306624->1495039) req@ffff8800910cad80 x1830976123647104/t17179873148(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/448 e 0 to 0 dl 1746155574 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.561154:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cad80 with x1830976123647104 ext(1306624->1495039) 00010000:00010000:3.0:1746155563.561164:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 32 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.561179:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 32 pid: 4461 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746155563.561185:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910cad80 00000100:00100000:0.0:1746155563.589869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.591592:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123647360 00000100:00100000:3.0:1746155563.591601:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123647360 00000100:00100000:3.0:1746155563.591658:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9948 00000100:00100000:3.0:1746155563.591665:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29021:x1830976123647360:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.591685:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.591699:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19f800/0x844e5faceb5eadf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1087e expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.591785:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fa00/0x844e5faceb5eadfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.591796:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fa00/0x844e5faceb5eadfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.591806:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fa00/0x844e5faceb5eadfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.591816:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.591820:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.591825:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.591901:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fe00/0x844e5faceb5eae0b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.591908:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fe00/0x844e5faceb5eae0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.591912:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fe00/0x844e5faceb5eae0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155563.591918:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155563.591974:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fa00/0x844e5faceb5eadfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.591979:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fa00/0x844e5faceb5eadfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.591984:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fa00/0x844e5faceb5eadfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.591988:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f19fa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155563.591991:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fa00/0x844e5faceb5eadfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.591995:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fa00/0x844e5faceb5eadfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.592003:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155563.592005:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155563.592008:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fa00/0x844e5faceb5eadfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.592012:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fa00/0x844e5faceb5eadfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.592034:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.592038:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.592042:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.592049:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f19fc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155563.592051:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.592055:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.592059:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801366f8f00) 00010000:00010000:3.0:1746155563.592061:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155563.592063:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.592066:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.592092:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19f800/0x844e5faceb5eadf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1087e expref: 297 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.592100:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fe00/0x844e5faceb5eae0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1087e expref: 296 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.592105:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.592107:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155563.592108:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f19fe00, rc 0) 00000100:00100000:3.0:1746155563.592149:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:29021:x1830976123647360:12345-192.168.202.51@tcp:101:cat.0 Request processed in 485us (2288us total) trans 8589943872 rc 0/0 00000100:00100000:3.0:1746155563.592154:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9948 00000100:00100000:0.0:1746155563.594869:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.596213:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.596486:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123647488 00000100:00100000:2.0:1746155563.596495:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123647488 00010000:00010000:2.0:1746155563.596550:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 32 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.596604:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5921 00000100:00100000:2.0:1746155563.596626:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123647488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155563.596643:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155563.596666:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 32 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.596677:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 32 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.596699:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5ead78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1306624->1495039) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10838 expref: 32 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.596727:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.596729:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.596736:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10877 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.596744:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10877 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.596778:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10877 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.596790:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124541056:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155563.596892:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155563.597391:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123647744 00000100:00100000:3.0:1746155563.597397:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123647744 00000100:00100000:3.0:1746155563.597446:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3994 00000100:00100000:3.0:1746155563.597454:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:29021:x1830976123647744:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155563.597661:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29021:x1830976123647744:12345-192.168.202.51@tcp:35:cat.0 Request processed in 206us (1450us total) trans 8589943873 rc 0/0 00000100:00100000:3.0:1746155563.597667:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3994 00000100:00100000:2.0:1746155563.599724:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124541056:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155563.599739:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155563.599765:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123647488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3152us (4904us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.599773:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5921 00000100:00100000:0.0:1746155563.607252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.607291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.607483:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123648128 00000100:00100000:3.0:1746155563.607490:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123648128 00002000:00100000:3.0:1746155563.607545:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88012f1f1f80 x1830976123648128/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.607554:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1f80 with x1830976123648128 ext(1048576->2097151) 00002000:00010000:3.0:1746155563.607559:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f1f80 00000100:00100000:3.0:1746155563.607582:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4485 00000100:00100000:3.0:1746155563.607588:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123648128:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155563.609649:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123647872 00000100:00100000:2.0:1746155563.609659:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123647872 00000100:00100000:2.0:1746155563.610360:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11822 00000100:00100000:2.0:1746155563.610370:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123647872:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155563.610385:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.610401:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6021a00/0x844e5faceb5eae19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10885 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.610421:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.610422:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.610431:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6021a00/0x844e5faceb5eae19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10885 expref: 32 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.610445:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6021a00/0x844e5faceb5eae19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10885 expref: 32 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.610455:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6021a00, rc 0) 00000100:00100000:2.0:1746155563.610497:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123647872:12345-192.168.202.51@tcp:101:cat.0 Request processed in 127us (3250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.610531:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11822 00000100:00100000:2.0:1746155563.613090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.615955:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123648256 00000100:00100000:1.0:1746155563.615965:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123648256 00002000:00100000:1.0:1746155563.616007:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009a6d8a80 x1830976123648256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.616015:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d8a80 with x1830976123648256 ext(1048576->2097151) 00002000:00010000:1.0:1746155563.616020:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6d8a80 00000100:00100000:3.0:1746155563.617441:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4486 00000100:00100000:3.0:1746155563.617454:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1960:x1830976123648256:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155563.623220:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123648128:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15623us (15919us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.623229:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4485 00002000:00100000:3.0:1746155563.623240:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88012f1f1f80 x1830976123648128/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.623248:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1f80 with x1830976123648128 ext(1048576->2097151) 00002000:00010000:3.0:1746155563.623253:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f1f80 00000100:00100000:0.0:1746155563.624393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.626256:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123648256:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8801us (13166us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.626265:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4486 00002000:00100000:2.0:1746155563.626274:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009a6d8a80 x1830976123648256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.626283:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d8a80 with x1830976123648256 ext(1048576->2097151) 00002000:00010000:2.0:1746155563.626288:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6d8a80 00000100:00100000:2.0:1746155563.626305:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123648640 00000100:00100000:2.0:1746155563.626310:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123648640 00002000:00100000:2.0:1746155563.626336:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88012f1f2680 x1830976123648640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.626342:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2680 with x1830976123648640 ext(1048576->2097151) 00002000:00010000:2.0:1746155563.626345:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f2680 00000100:00100000:2.0:1746155563.628450:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4487 00000100:00100000:2.0:1746155563.628465:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123648640:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155563.647193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.647345:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123649024 00000100:00100000:1.0:1746155563.647352:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123649024 00000100:00100000:1.0:1746155563.647402:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9949 00000100:00100000:1.0:1746155563.647410:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29024:x1830976123649024:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155563.647429:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.647443:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b000/0x844e5faceb5eae20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10893 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.647553:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eae27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647565:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eae27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647574:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eae27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647585:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6ee00/0x844e5faceb5eae2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647591:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6ee00/0x844e5faceb5eae2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647595:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6ee00/0x844e5faceb5eae2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647691:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f600/0x844e5faceb5eae35 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647699:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f600/0x844e5faceb5eae35 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647705:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f600/0x844e5faceb5eae35 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155563.647712:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155563.647780:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eae27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647786:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eae27 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647791:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eae27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647798:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3bc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155563.647802:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eae27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647807:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eae27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647816:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155563.647819:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155563.647822:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eae27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647826:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5eae27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647840:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6ee00/0x844e5faceb5eae2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647844:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6ee00/0x844e5faceb5eae2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647849:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6ee00/0x844e5faceb5eae2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647852:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ce6ee00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155563.647854:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6ee00/0x844e5faceb5eae2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647859:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6ee00/0x844e5faceb5eae2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647865:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fcd5800) 00010000:00010000:1.0:1746155563.647866:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155563.647869:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6ee00/0x844e5faceb5eae2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647873:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6ee00/0x844e5faceb5eae2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155563.647903:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b000/0x844e5faceb5eae20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10893 expref: 300 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.647914:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f600/0x844e5faceb5eae35 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10893 expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.647919:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155563.647920:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155563.647922:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce6f600, rc 0) 00000100:00100000:1.0:1746155563.647960:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:29024:x1830976123649024:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 552us (774us total) trans 8589943874 rc 0/0 00000100:00100000:1.0:1746155563.647966:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9949 00000100:00100000:0.0:1746155563.648741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.649028:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123648768 00000100:00100000:1.0:1746155563.649032:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123648768 00000100:00100000:0.0:1746155563.650002:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.650486:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11823 00000100:00100000:3.0:1746155563.650496:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29018:x1830976123648768:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155563.650521:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.650535:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1088c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.650556:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a065ae00/0x844e5faceb5eab3a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10712 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.650562:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938a0a00/0x844e5faceb5eac83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107a5 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.650569:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d583400/0x844e5faceb5eab80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10743 expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.650573:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.650575:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.650578:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3375104->4132863] (req 3375104->4132863) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.650601:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d583400/0x844e5faceb5eab80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10743 expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.650623:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d583400/0x844e5faceb5eab80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10743 expref: 13 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.650633:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124541184:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.651029:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123648640:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22567us (26636us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.651037:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4487 00002000:00100000:2.0:1746155563.651046:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88012f1f2680 x1830976123648640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.651054:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2680 with x1830976123648640 ext(1048576->2097151) 00002000:00010000:2.0:1746155563.651058:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f2680 00000100:00100000:2.0:1746155563.651088:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123649152 00000100:00100000:2.0:1746155563.651092:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123649152 00000100:00080000:1.0:1746155563.651406:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746155563.651764:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9950 00000100:00100000:2.0:1746155563.651771:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29023:x1830976123649152:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155563.651782:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.651792:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135688a00/0x844e5faceb5eae4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1089a expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.651831:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135688c00/0x844e5faceb5eae51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.651840:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135688c00/0x844e5faceb5eae51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.651849:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135688c00/0x844e5faceb5eae51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.651859:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135688e00/0x844e5faceb5eae58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.651864:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135688e00/0x844e5faceb5eae58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.651869:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135688e00/0x844e5faceb5eae58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.651951:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.651958:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1082a expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.651964:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.651981:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1082a expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.651989:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1082a expref: 298 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.652001:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6db100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124541312:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.652050:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd540 going to sleep for 11 seconds 00010000:00010000:3.0:1746155563.652219:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938a0a00/0x844e5faceb5eac83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107a5 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.652232:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938a0a00/0x844e5faceb5eac83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107a5 expref: 23 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.652240:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124541440:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.652267:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a065ae00/0x844e5faceb5eab3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10712 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.652275:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a065ae00/0x844e5faceb5eab3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10712 expref: 30 pid: 8437 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.652282:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124541568:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155563.652297:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155563.653125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.653179:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.653273:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123649536 00000100:00100000:1.0:1746155563.653278:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123649536 00000100:00100000:1.0:1746155563.653304:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3995 00000100:00100000:1.0:1746155563.653309:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:29024:x1830976123649536:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155563.653446:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:29024:x1830976123649536:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 135us (265us total) trans 8589943875 rc 0/0 00000100:00100000:1.0:1746155563.653451:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3995 00000100:00100000:3.0:1746155563.653525:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123649280 00000100:00100000:3.0:1746155563.653528:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123649280 00000100:00100000:3.0:1746155563.653552:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 579 00000100:00100000:3.0:1746155563.653557:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1960:x1830976123649280:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.653565:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.653579:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f600/0x844e5faceb5eae35 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10893 expref: 300 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.653593:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.653597:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.653603:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.653607:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.653626:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.653643:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1960:x1830976123649280:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.653647:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 579 00000100:00100000:2.0:1746155563.654254:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6db100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124541312:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.654269:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155563.660902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.660960:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123649664 00000100:00100000:1.0:1746155563.660972:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123649664 00010000:00010000:1.0:1746155563.661001:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d583400/0x844e5faceb5eab80 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10743 expref: 14 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.661037:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5922 00000100:00100000:1.0:1746155563.661044:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1963:x1830976123649664:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.661057:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.661076:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d583400/0x844e5faceb5eab80 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10743 expref: 14 pid: 18270 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.661086:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d583400/0x844e5faceb5eab80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10743 expref: 14 pid: 18270 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.661106:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.661140:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1963:x1830976123649664:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.661145:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5922 00010000:00010000:3.0:1746155563.661363:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d583400/0x844e5faceb5eab80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10743 expref: 13 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.661375:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124541184:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155563.661383:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124541440:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155563.661390:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124541568:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.661413:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3375104->4132863] (req 3375104->4132863) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.661423:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f19fc00, rc 0) 00000100:00100000:3.0:1746155563.662517:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29018:x1830976123648768:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 12019us (13772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.662524:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11823 00000100:00100000:0.0:1746155563.663866:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.663938:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123649920 00000100:00100000:2.0:1746155563.663944:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123649920 00010000:00010000:2.0:1746155563.663966:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a065ae00/0x844e5faceb5eab3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10712 expref: 31 pid: 8437 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.663995:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5923 00000100:00100000:2.0:1746155563.664001:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123649920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155563.664011:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155563.664026:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a065ae00/0x844e5faceb5eab3a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10712 expref: 31 pid: 8437 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.664035:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a065ae00/0x844e5faceb5eab3a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10712 expref: 31 pid: 8437 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.664062:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a065ae00/0x844e5faceb5eab3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10712 expref: 31 pid: 8437 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.664084:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155563.664111:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123649920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 110us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.664116:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5923 00000100:00100000:0.0:1746155563.665335:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.665371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.665451:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123650048 00000100:00100000:3.0:1746155563.665457:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123650048 00000100:00100000:3.0:1746155563.665492:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11824 00000100:00100000:3.0:1746155563.665500:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29021:x1830976123650048:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.665546:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.665560:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093615200/0x844e5faceb5eae66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108a1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.665579:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.665582:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.665589:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093615200/0x844e5faceb5eae66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a1 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.665603:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093615200/0x844e5faceb5eae66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a1 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.665625:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093615200, rc 0) 00000100:00100000:3.0:1746155563.665664:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29021:x1830976123650048:12345-192.168.202.51@tcp:101:cat.0 Request processed in 163us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.665669:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11824 00000100:00100000:1.0:1746155563.665758:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123649792 00000100:00100000:1.0:1746155563.665764:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123649792 00010000:00010000:1.0:1746155563.665782:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938a0a00/0x844e5faceb5eac83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107a5 expref: 23 pid: 8437 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.665823:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5924 00000100:00100000:1.0:1746155563.665831:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976123649792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.665839:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.665855:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938a0a00/0x844e5faceb5eac83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107a5 expref: 23 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.665870:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938a0a00/0x844e5faceb5eac83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107a5 expref: 23 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.665884:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938a0a00/0x844e5faceb5eac83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107a5 expref: 23 pid: 8437 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.665899:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.665901:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.665905:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.665912:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.665939:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.665951:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124541696:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155563.666009:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155563.667132:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.667230:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123650176 00000100:00100000:2.0:1746155563.667237:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123650176 00010000:00010000:2.0:1746155563.667257:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1082a expref: 299 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.667298:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5925 00000100:00100000:2.0:1746155563.667305:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1961:x1830976123650176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155563.667314:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155563.667318:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1082a expref: 299 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.667328:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1082a expref: 299 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.667341:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0dfc00/0x844e5faceb5ead63 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1082a expref: 299 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.667353:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155563.667357:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.667364:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.667370:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.667404:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155563.667437:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1961:x1830976123650176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 131us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.667443:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5925 00010000:00010000:3.0:1746155563.667549:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667557:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155563.667594:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155563.667600:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155563.667624:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667635:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667643:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135688c00/0x844e5faceb5eae51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667652:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135688c00/0x844e5faceb5eae51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667657:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135688c00/0x844e5faceb5eae51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667661:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135688c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155563.667664:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135688c00/0x844e5faceb5eae51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667670:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135688c00/0x844e5faceb5eae51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667678:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155563.667680:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155563.667684:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135688c00/0x844e5faceb5eae51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667688:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135688c00/0x844e5faceb5eae51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667702:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135688e00/0x844e5faceb5eae58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667707:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135688e00/0x844e5faceb5eae58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667711:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135688e00/0x844e5faceb5eae58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667714:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135688e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155563.667716:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135688e00/0x844e5faceb5eae58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667724:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135688e00/0x844e5faceb5eae58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667730:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009ae84100) 00010000:00010000:3.0:1746155563.667732:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155563.667734:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135688e00/0x844e5faceb5eae58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667738:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135688e00/0x844e5faceb5eae58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.667768:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135688a00/0x844e5faceb5eae4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1089a expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.667779:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1089a expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.667785:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.667786:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155563.667788:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135689000, rc 0) 00000100:00100000:3.0:1746155563.667818:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29023:x1830976123649152:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 16046us (17820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.667824:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9950 00000100:00100000:1.0:1746155563.669102:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124541696:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155563.669115:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.669348:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123649792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3517us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.669355:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5924 00000100:00100000:0.0:1746155563.669863:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.669921:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123650432 00000100:00100000:2.0:1746155563.669926:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123650432 00002000:00100000:2.0:1746155563.669951:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3375104->3379199) req@ffff88012f1f0a80 x1830976123650432/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.669959:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0a80 with x1830976123650432 ext(3375104->3379199) 00002000:00010000:2.0:1746155563.669963:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f0a80 00000100:00100000:2.0:1746155563.669985:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4488 00000100:00100000:2.0:1746155563.669990:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123650432:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155563.670101:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123650432:12345-192.168.202.51@tcp:3:cat.0 Request processed in 110us (238us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155563.670106:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4488 00002000:00100000:2.0:1746155563.670111:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3375104->3379199) req@ffff88012f1f0a80 x1830976123650432/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.670117:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0a80 with x1830976123650432 ext(3375104->3379199) 00002000:00010000:2.0:1746155563.670119:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f0a80 00000100:00100000:1.0:1746155563.677391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.677653:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.677948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.679304:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.679327:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123650816 00000100:00100000:0.0:1746155563.679335:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123650816 00000100:00100000:0.0:1746155563.679389:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123650944 00000100:00100000:0.0:1746155563.679393:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123650944 00000100:00100000:0.0:1746155563.679417:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123651072 00000100:00100000:0.0:1746155563.679420:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123651072 00000100:00100000:0.0:1746155563.679439:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11825 00000100:00100000:0.0:1746155563.679448:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1962:x1830976123650816:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155563.679465:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155563.679482:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6020800/0x844e5faceb5eae6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108a8 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.679527:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.679529:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.679539:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6020800/0x844e5faceb5eae6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a8 expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.679553:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6020800/0x844e5faceb5eae6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a8 expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.679569:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6020800, rc 0) 00000100:00100000:0.0:1746155563.679626:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1962:x1830976123650816:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 178us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.679632:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11825 00000100:00100000:0.0:1746155563.679650:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11826 00000100:00100000:0.0:1746155563.679656:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1962:x1830976123650944:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155563.679664:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155563.679674:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eae74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108af expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.679685:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.679686:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.679691:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eae74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108af expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.679700:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eae74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108af expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.679707:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6020600, rc 0) 00000100:00100000:0.0:1746155563.679728:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1962:x1830976123650944:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 72us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.679733:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11826 00000100:00100000:0.0:1746155563.679745:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11827 00000100:00100000:0.0:1746155563.679750:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1962:x1830976123651072:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155563.679758:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155563.679765:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6020400/0x844e5faceb5eae7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108b6 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.679775:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.679777:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.679781:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6020400/0x844e5faceb5eae7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108b6 expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.679790:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6020400/0x844e5faceb5eae7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108b6 expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.679796:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6020400, rc 0) 00000100:00100000:0.0:1746155563.679813:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1962:x1830976123651072:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 63us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.679818:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11827 00000100:00100000:1.0:1746155563.680623:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123651200 00000100:00100000:1.0:1746155563.680628:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123651200 00000100:00100000:1.0:1746155563.680660:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11828 00000100:00100000:1.0:1746155563.680667:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1962:x1830976123651200:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155563.680675:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.680684:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eae82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108bd expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.680721:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124541824:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155563.680777:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155563.681126:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.681408:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123650688 00000100:00100000:2.0:1746155563.681411:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123650688 00002000:00100000:2.0:1746155563.681434:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800910caa00 x1830976123650688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.681441:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910caa00 with x1830976123650688 ext(2097152->3145727) 00002000:00010000:2.0:1746155563.681745:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910caa00 00000100:00100000:1.0:1746155563.682347:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.682436:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123651456 00000100:00100000:2.0:1746155563.682439:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123651456 00002000:00100000:2.0:1746155563.682455:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4128768->4132863) req@ffff8800910cb480 x1830976123651456/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.682462:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb480 with x1830976123651456 ext(4128768->4132863) 00002000:00010000:2.0:1746155563.682465:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910cb480 00000100:00100000:2.0:1746155563.682477:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4489 00000100:00100000:2.0:1746155563.682482:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123650688:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155563.683659:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4490 00000100:00100000:3.0:1746155563.683667:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123651456:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155563.683751:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123651456:12345-192.168.202.51@tcp:3:cat.0 Request processed in 84us (1404us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155563.683756:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4490 00002000:00100000:3.0:1746155563.683762:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4128768->4132863) req@ffff8800910cb480 x1830976123651456/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.683769:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb480 with x1830976123651456 ext(4128768->4132863) 00002000:00010000:3.0:1746155563.683773:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910cb480 00002000:00010000:2.0:1746155563.686848:0:20796:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime: 1746155563 -> 1746155564 00002000:00010000:2.0:1746155563.686854:0:20796:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155563 -> 1746155564 00002000:00010000:2.0:1746155563.686856:0:20796:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime: 1746155563 -> 1746155564 00000100:00100000:2.0:1746155563.686873:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124541824:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155563.686902:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eae82 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108bd expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.686915:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eae82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108bd expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.687462:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce6f000, rc 0) 00000100:00100000:2.0:1746155563.687791:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1962:x1830976123651200:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 7121us (8486us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155563.687798:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11828 00000100:00100000:0.0:1746155563.691496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.691859:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123651712 00000100:00100000:3.0:1746155563.691867:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123651712 00000100:00100000:3.0:1746155563.691906:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9951 00000100:00100000:3.0:1746155563.691914:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29023:x1830976123651712:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155563.691932:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.691948:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093615e00/0x844e5faceb5eae89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108c4 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.692027:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.692039:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1089a expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.692046:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.692073:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1089a expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.692083:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1089a expref: 11 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.692093:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124541952:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155563.692150:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155563.692589:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123650688:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10104us (11462us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.692597:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4489 00002000:00100000:2.0:1746155563.692605:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800910caa00 x1830976123650688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.692625:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910caa00 with x1830976123650688 ext(2097152->3145727) 00002000:00010000:2.0:1746155563.692629:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910caa00 00000100:00100000:0.0:1746155563.693404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.693474:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123651968 00000100:00100000:1.0:1746155563.693479:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123651968 00000100:00100000:1.0:1746155563.693532:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3996 00000100:00100000:1.0:1746155563.693538:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29018:x1830976123651968:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155563.693756:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29018:x1830976123651968:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 218us (352us total) trans 8589943876 rc 0/0 00000100:00100000:1.0:1746155563.693762:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3996 00000100:00100000:0.0:1746155563.698269:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.698311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.698415:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123652224 00000100:00100000:3.0:1746155563.698422:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123652224 00000100:00100000:3.0:1746155563.698456:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11829 00000100:00100000:3.0:1746155563.698463:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29024:x1830976123652224:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155563.698478:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.698495:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108cb expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.698544:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10877 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.698552:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eae74 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108af expref: 13 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.698559:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6021a00/0x844e5faceb5eae19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10885 expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.698565:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.698566:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.698569:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1126400->1572863] (req 1126400->1572863) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.698594:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6021a00/0x844e5faceb5eae19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10885 expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.698605:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6021a00/0x844e5faceb5eae19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10885 expref: 33 pid: 8436 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.698632:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124542080:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.698706:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eae74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108af expref: 13 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.698715:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eae74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108af expref: 13 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.698723:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124542208:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.698746:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10877 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.698755:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10877 expref: 29 pid: 8436 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.698763:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124542336:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155563.698779:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155563.698847:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123652096 00000100:00100000:1.0:1746155563.698851:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123652096 00010000:00010000:1.0:1746155563.698870:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1089a expref: 12 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.698893:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5926 00000100:00100000:1.0:1746155563.698898:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123652096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.698906:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.698911:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1089a expref: 12 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.698920:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1089a expref: 12 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.698936:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155563.698940:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.698948:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.698953:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.698966:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.698984:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123652096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 86us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.698990:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5926 00010000:00010000:2.0:1746155563.699999:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135689000/0x844e5faceb5eae5f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1089a expref: 11 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.700029:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124541952:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.700043:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.700050:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.700054:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155563.700069:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155563.700176:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093615e00/0x844e5faceb5eae89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108c4 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.700187:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108c4 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.700192:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155563.700195:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155563.700197:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093615c00, rc 0) 00000100:00100000:2.0:1746155563.700233:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29023:x1830976123651712:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8320us (8746us total) trans 8589943877 rc 0/0 00000100:00100000:2.0:1746155563.700239:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9951 00000100:00100000:0.0:1746155563.703077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.704666:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123652352 00000100:00100000:3.0:1746155563.704674:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123652352 00000100:00100000:1.0:1746155563.705014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.705028:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.705040:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123652480 00000100:00100000:1.0:1746155563.705042:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123652480 00010000:00010000:1.0:1746155563.705060:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eae74 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108af expref: 14 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.705131:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11830 00000100:00100000:3.0:1746155563.705139:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29021:x1830976123652352:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.705153:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155563.705163:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124542080:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.705164:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108d2 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.705171:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124542208:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.705179:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124542336:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.705188:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.705194:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155563.705195:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155563.705197:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 32 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.705201:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1126400->1572863] (req 1126400->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.705210:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093615400, rc 0) 00010000:00010000:3.0:1746155563.705218:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.705226:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 21 pid: 8436 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.705235:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124542464:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.705241:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:29024:x1830976123652224:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6780us (6930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.705246:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11829 00000100:00100000:3.0:1746155563.705269:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155563.705488:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123652736 00000100:00100000:1.0:1746155563.705491:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123652736 00010000:00010000:1.0:1746155563.705517:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10877 expref: 30 pid: 8436 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746155563.705798:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5927 00000100:00100000:0.0:1746155563.705804:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123652480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155563.705813:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.705831:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eae74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108af expref: 14 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.705843:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eae74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108af expref: 14 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.705857:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eae74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108af expref: 14 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.705874:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155563.705890:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123652480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.705895:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5927 00000100:00100000:0.0:1746155563.705906:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5928 00000100:00100000:0.0:1746155563.705910:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123652736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155563.705916:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.705922:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10877 expref: 30 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.705928:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10877 expref: 30 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.705938:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ce6fa00/0x844e5faceb5eadef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10877 expref: 30 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.705946:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155563.705960:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123652736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.705967:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5928 00000100:00100000:0.0:1746155563.705995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.706051:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.706099:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123652608 00000100:00100000:1.0:1746155563.706103:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123652608 00010000:00010000:1.0:1746155563.706114:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6021a00/0x844e5faceb5eae19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10885 expref: 33 pid: 8436 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.706128:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5929 00000100:00100000:1.0:1746155563.706132:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123652608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.706138:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.706145:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6021a00/0x844e5faceb5eae19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10885 expref: 33 pid: 8436 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.706152:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6021a00/0x844e5faceb5eae19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10885 expref: 33 pid: 8436 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.706163:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6021a00/0x844e5faceb5eae19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10885 expref: 33 pid: 8436 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.706173:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.706174:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.706179:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.706190:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.706208:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.706216:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124542592:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155563.706247:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155563.706363:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123652864 00000100:00100000:2.0:1746155563.706367:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123652864 00000100:00100000:2.0:1746155563.706388:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9952 00000100:00100000:2.0:1746155563.706393:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29023:x1830976123652864:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155563.706404:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.706413:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135689a00/0x844e5faceb5eaeac lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108d9 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.706471:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135689c00/0x844e5faceb5eaeb3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.706483:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108c4 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.706488:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135689c00/0x844e5faceb5eaeb3 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.706534:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108c4 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.706543:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108c4 expref: 12 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.706551:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6db100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124542720:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.706592:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155563.708878:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124542464:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.708904:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 32 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.708918:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f19f600, rc 0) 00000100:00100000:3.0:1746155563.708950:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29021:x1830976123652352:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3811us (5880us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.708957:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11830 00000100:00100000:1.0:1746155563.708979:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124542592:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155563.708990:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.709005:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123652608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2873us (3010us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.709012:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5929 00000100:00100000:0.0:1746155563.709052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.709117:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123653120 00000100:00100000:2.0:1746155563.709123:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123653120 00002000:00100000:2.0:1746155563.709152:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1126400->1130495) req@ffff8800a62a1180 x1830976123653120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.709161:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a1180 with x1830976123653120 ext(1126400->1130495) 00002000:00010000:2.0:1746155563.709165:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a1180 00000100:00100000:2.0:1746155563.709180:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4491 00000100:00100000:2.0:1746155563.709186:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123653120:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155563.709305:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.709319:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123653248 00000100:00100000:1.0:1746155563.709323:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123653248 00002000:00100000:1.0:1746155563.709339:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3375104->4132863) req@ffff8800a62a0a80 x1830976123653248/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.709346:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a0a80 with x1830976123653248 ext(3375104->4132863) 00010000:00010000:1.0:1746155563.709350:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 22 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.709361:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 22 pid: 8436 timeout: 792 lvb_type: 0 00002000:00010000:1.0:1746155563.709372:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a62a0a80 00000100:00100000:1.0:1746155563.709384:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 686 00000100:00100000:1.0:1746155563.709389:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123653248:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155563.709541:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6db100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124542720:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.709553:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135689c00/0x844e5faceb5eaeb3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155563.709813:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123653120:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 627us (761us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155563.709819:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4491 00002000:00100000:2.0:1746155563.709825:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1126400->1130495) req@ffff8800a62a1180 x1830976123653120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.709831:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a1180 with x1830976123653120 ext(1126400->1130495) 00002000:00010000:2.0:1746155563.709834:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a1180 00000100:00100000:0.0:1746155563.710588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.710778:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123653376 00000100:00100000:1.0:1746155563.710783:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123653376 00010000:00010000:1.0:1746155563.710799:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108c4 expref: 13 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.710933:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5930 00000100:00100000:1.0:1746155563.710940:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976123653376:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.710952:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.710959:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108c4 expref: 13 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.710968:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108c4 expref: 13 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.710988:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093615c00/0x844e5faceb5eae90 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108c4 expref: 13 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.712707:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155563.712714:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135689c00/0x844e5faceb5eaeb3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.712724:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135689c00/0x844e5faceb5eaeb3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.712735:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135689c00/0x844e5faceb5eaeb3 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.712771:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.712818:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123653376:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1876us (2228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.712826:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5930 00010000:00010000:2.0:1746155563.713416:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135689c00/0x844e5faceb5eaeb3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.713424:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135689c00/0x844e5faceb5eaeb3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155563.713460:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155563.713463:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155563.713476:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135689c00/0x844e5faceb5eaeb3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.713528:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135689a00/0x844e5faceb5eaeac lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d9 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.715284:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135689c00/0x844e5faceb5eaeb3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d9 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.715296:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155563.715298:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155563.715301:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135689c00, rc 0) 00000100:00100000:2.0:1746155563.715360:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29023:x1830976123652864:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8964us (9306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.715368:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9952 00000100:00100000:1.0:1746155563.716667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.716910:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123653632 00000100:00100000:3.0:1746155563.716917:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123653632 00002000:00100000:3.0:1746155563.716950:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1568768->1572863) req@ffff88008ff19c00 x1830976123653632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.716959:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff19c00 with x1830976123653632 ext(1568768->1572863) 00002000:00010000:3.0:1746155563.716964:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ff19c00 00000100:00100000:3.0:1746155563.716980:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4492 00000100:00100000:3.0:1746155563.716986:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123653632:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155563.717109:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123653632:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 122us (446us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155563.717115:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4492 00002000:00100000:3.0:1746155563.717119:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1568768->1572863) req@ffff88008ff19c00 x1830976123653632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.717126:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff19c00 with x1830976123653632 ext(1568768->1572863) 00002000:00010000:3.0:1746155563.717128:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ff19c00 00000100:00100000:0.0:1746155563.719026:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.719203:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.719559:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123653760 00000100:00100000:3.0:1746155563.719565:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123653760 00000100:00100000:3.0:1746155563.719634:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123653888 00000100:00100000:3.0:1746155563.719637:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123653888 00000100:00100000:2.0:1746155563.719663:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11831 00000100:00100000:2.0:1746155563.719671:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976123653760:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155563.719682:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.719696:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135689400/0x844e5faceb5eaeba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108e0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.719734:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124542848:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155563.719785:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155563.719799:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11832 00000100:00100000:2.0:1746155563.719804:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976123653888:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155563.719810:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.719818:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135688e00/0x844e5faceb5eaec1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108e7 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.719836:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124542976:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155563.719852:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155563.721801:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123653248:12345-192.168.202.51@tcp:4:cat.0 Request processed in 12406us (12703us total) trans 21474840530 rc 0/0 00000100:00100000:0.0:1746155563.721806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.721809:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 686 00002000:00100000:1.0:1746155563.721818:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3375104->4132863) req@ffff8800a62a0a80 x1830976123653248/t21474840530(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/448 e 0 to 0 dl 1746155574 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.721825:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a0a80 with x1830976123653248 ext(3375104->4132863) 00010000:00010000:1.0:1746155563.721833:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 24 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.721844:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 24 pid: 8436 timeout: 792 lvb_type: 0 00002000:00010000:1.0:1746155563.721850:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a62a0a80 00000100:00100000:2.0:1746155563.721886:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123654144 00000100:00100000:2.0:1746155563.721892:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123654144 00000100:00100000:2.0:1746155563.721915:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3997 00000100:00100000:2.0:1746155563.721920:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094619850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:29024:x1830976123654144:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155563.722051:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094619850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:29024:x1830976123654144:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 130us (244us total) trans 8589943878 rc 0/0 00000100:00100000:2.0:1746155563.722055:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3997 00000100:00100000:3.0:1746155563.722057:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124542976:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155563.722075:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135688e00/0x844e5faceb5eaec1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108e7 expref: 15 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.722089:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135688e00/0x844e5faceb5eaec1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108e7 expref: 15 pid: 4461 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746155563.722092:0:20796:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155563 -> 1746155564 00002000:00010000:2.0:1746155563.722094:0:20796:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155563 -> 1746155564 00002000:00010000:2.0:1746155563.722096:0:20796:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155563 -> 1746155564 00000100:00100000:2.0:1746155563.722106:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124542848:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155563.722110:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135688e00, rc 0) 00010000:00010000:2.0:1746155563.722117:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135689400/0x844e5faceb5eaeba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108e0 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.722125:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135689400/0x844e5faceb5eaeba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108e0 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155563.722127:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976123653888:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2324us (2925us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155563.722132:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11832 00010000:00010000:2.0:1746155563.722132:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135689400, rc 0) 00000100:00100000:2.0:1746155563.722144:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976123653760:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2474us (3122us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155563.722149:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11831 00000100:00100000:0.0:1746155563.729943:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.729995:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.730516:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123654400 00000100:00100000:3.0:1746155563.730525:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123654400 00000100:00100000:3.0:1746155563.730563:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9953 00000100:00100000:3.0:1746155563.730570:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29023:x1830976123654400:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155563.730586:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.730601:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19f800/0x844e5faceb5eaec8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108ee expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.730665:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123654528 00000100:00100000:1.0:1746155563.730668:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123654528 00010000:00010000:1.0:1746155563.730686:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 24 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.730687:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eaecf lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.730699:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eaecf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155563.730706:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5931 00010000:00010000:3.0:1746155563.730707:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eaecf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155563.730711:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123654528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000004:00200000:3.0:1746155563.730717:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155563.730719:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.730736:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 24 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.730744:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 24 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.730760:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f19fc00/0x844e5faceb5eae43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3375104->18446744073709551615] (req 3375104->4132863) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1088c expref: 24 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.730774:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.730776:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.730781:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.730788:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.730808:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19f800/0x844e5faceb5eaec8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108ee expref: 14 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.730813:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.730826:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eaecf lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108ee expref: 13 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.730830:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124543104:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155563.730832:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.730834:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155563.730836:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009048fe00, rc 0) 00000100:00100000:3.0:1746155563.730868:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:29023:x1830976123654400:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 298us (933us total) trans 8589943879 rc 0/0 00000100:00100000:3.0:1746155563.730873:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9953 00000100:00100000:1.0:1746155563.730879:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155563.732634:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.732652:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123654784 00000100:00100000:0.0:1746155563.732653:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.732658:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123654784 00000100:00100000:0.0:1746155563.732677:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.732693:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123655040 00000100:00100000:2.0:1746155563.732695:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123655040 00000100:00100000:0.0:1746155563.732702:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.732707:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123655296 00000100:00100000:2.0:1746155563.732709:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123655296 00000100:00100000:0.0:1746155563.732713:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123654656 00000100:00100000:0.0:1746155563.732715:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123654656 00000100:00100000:2.0:1746155563.732720:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11833 00000100:00100000:2.0:1746155563.732725:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123654784:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:0.0:1746155563.732729:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11834 00000100:00100000:0.0:1746155563.732733:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123655040:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155563.732751:0:20796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.732751:0:19959:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.732763:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.732763:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a0de200/0x844e5faceb5eab02 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106da expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.732769:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155563.732769:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5eab64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1073c expref: 15 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.732771:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155563.732773:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.732777:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eab25 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106fd expref: 31 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.732781:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.732782:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.732784:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.732790:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.732795:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eab25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106fd expref: 31 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.732799:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 31 pid: 20796 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.732801:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eab25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106fd expref: 31 pid: 1625 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155563.732810:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124543232:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155563.732810:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124543360:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.732867:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11835 00000100:00100000:1.0:1746155563.732874:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123655296:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155563.732888:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.732896:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c94da00/0x844e5faceb5eab2c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1070b expref: 31 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.732900:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5eab64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1073c expref: 15 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.732903:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6040800/0x844e5faceb5eac8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ac expref: 28 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.732907:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5eab64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1073c expref: 15 pid: 18270 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.732909:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5eab6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1074a expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.732914:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.732915:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155563.732915:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124543488:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.732917:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.732929:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5eab6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1074a expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155563.732940:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11836 00010000:00010000:1.0:1746155563.732941:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5eab6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1074a expref: 14 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.732946:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123654656:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:1.0:1746155563.732948:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124543616:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.732961:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.732970:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f9 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.732976:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6020800/0x844e5faceb5eae6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a8 expref: 15 pid: 19959 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155563.732998:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd900 going to sleep for 11 seconds 00010000:00010000:0.0:1746155563.733008:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a0de200/0x844e5faceb5eab02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106da expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.733020:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a0de200/0x844e5faceb5eab02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106da expref: 23 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746155563.733032:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124543744:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.733046:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6040800/0x844e5faceb5eac8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ac expref: 28 pid: 9235 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155563.733047:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746155563.733054:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6040800/0x844e5faceb5eac8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ac expref: 28 pid: 9235 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.733062:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124543872:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.733080:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c94da00/0x844e5faceb5eab2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1070b expref: 31 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.733087:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c94da00/0x844e5faceb5eab2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1070b expref: 31 pid: 10591 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746155563.733093:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.733094:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124544000:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.733108:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155563.733118:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123654912 00000100:00100000:0.0:1746155563.733120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.733121:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123654912 00000100:00100000:1.0:1746155563.733153:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123655168 00000100:00100000:1.0:1746155563.733155:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123655168 00000100:00100000:1.0:1746155563.733166:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11837 00000100:00100000:1.0:1746155563.733170:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123654912:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155563.733189:0:9235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.733197:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10854 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.733203:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6020400/0x844e5faceb5eae7b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108b6 expref: 15 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.733210:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094484800/0x844e5faceb5eadc5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10869 expref: 28 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.733215:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.733216:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.733218:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.733231:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094484800/0x844e5faceb5eadc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10869 expref: 28 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.733238:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094484800/0x844e5faceb5eadc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10869 expref: 28 pid: 4461 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.733246:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124544128:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.733280:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6020400/0x844e5faceb5eae7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108b6 expref: 15 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.733287:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6020400/0x844e5faceb5eae7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108b6 expref: 15 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.733294:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124544256:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.733315:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10854 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.733326:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10854 expref: 31 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.733333:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124544384:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.733348:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926240 going to sleep for 11 seconds 00000100:00100000:1.0:1746155563.733363:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11838 00000100:00100000:1.0:1746155563.733374:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1961:x1830976123655168:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155563.733383:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ead40 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1080e expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.733388:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.733389:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.733390:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.733393:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.733396:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093615200/0x844e5faceb5eae66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a1 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.733402:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.733407:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ead40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1080e expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.733407:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155563.733408:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155563.733410:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.733414:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ead40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1080e expref: 31 pid: 4461 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.733420:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.733421:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124544512:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.733427:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 31 pid: 8436 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.733434:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124544640:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.733450:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6020800/0x844e5faceb5eae6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a8 expref: 16 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.733450:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093615200/0x844e5faceb5eae66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a1 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.733457:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6020800/0x844e5faceb5eae6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a8 expref: 16 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.733457:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093615200/0x844e5faceb5eae66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a1 expref: 31 pid: 8436 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.733463:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124544896:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.733463:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124544768:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.733475:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926900 going to sleep for 11 seconds 00010000:00010000:3.0:1746155563.733480:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f9 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.733485:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f9 expref: 23 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.733492:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124545024:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.733498:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124543104:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155563.733524:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.733539:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976123654528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2828us (3544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.733545:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5931 00000100:00100000:3.0:1746155563.735032:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155563.742989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.743002:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.743018:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.743040:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123655808 00000100:00100000:0.0:1746155563.743047:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123655808 00002000:00100000:0.0:1746155563.743082:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1126400->1572863) req@ffff88012cdec700 x1830976123655808/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155563.743090:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec700 with x1830976123655808 ext(1126400->1572863) 00010000:00010000:0.0:1746155563.743099:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 32 pid: 20796 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.743110:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 32 pid: 20796 timeout: 792 lvb_type: 0 00002000:00010000:0.0:1746155563.743117:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdec700 00000100:00100000:0.0:1746155563.743132:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 687 00000100:00100000:0.0:1746155563.743138:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123655808:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155563.743552:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.743632:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.743646:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123655424 00000100:00100000:0.0:1746155563.743649:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123655424 00010000:00010000:0.0:1746155563.743664:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5eab6b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1074a expref: 16 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746155563.743679:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123655936 00000100:00100000:0.0:1746155563.743681:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123655936 00010000:00010000:0.0:1746155563.743689:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094484800/0x844e5faceb5eadc5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10869 expref: 29 pid: 4461 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746155563.743703:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123656064 00000100:00100000:0.0:1746155563.743705:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123656064 00010000:00010000:0.0:1746155563.743711:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6020400/0x844e5faceb5eae7b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108b6 expref: 17 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746155563.743717:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123655552 00000100:00100000:0.0:1746155563.743719:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123655552 00010000:00010000:0.0:1746155563.743726:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5eab64 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1073c expref: 17 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746155563.743734:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5932 00000100:00100000:0.0:1746155563.743738:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123655424:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155563.743745:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.743757:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5eab6b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1074a expref: 17 pid: 18270 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.743770:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5eab6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1074a expref: 17 pid: 18270 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.743790:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155563.743811:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123655424:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.743816:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5932 00000100:00100000:0.0:1746155563.743829:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5933 00000100:00100000:0.0:1746155563.743833:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123655936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155563.743840:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.743848:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094484800/0x844e5faceb5eadc5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10869 expref: 29 pid: 4461 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.743855:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094484800/0x844e5faceb5eadc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10869 expref: 29 pid: 4461 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.743865:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155563.743878:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123655936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 44us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.743882:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5933 00000100:00100000:0.0:1746155563.743890:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5934 00000100:00100000:0.0:1746155563.743894:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1960:x1830976123656064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155563.743899:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.743905:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6020400/0x844e5faceb5eae7b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108b6 expref: 16 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.743913:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6020400/0x844e5faceb5eae7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108b6 expref: 16 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.743921:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155563.743934:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1960:x1830976123656064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 39us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.743938:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5934 00000100:00100000:0.0:1746155563.743947:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5935 00000100:00100000:0.0:1746155563.743951:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1963:x1830976123655552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155563.743957:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.743968:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5eab64 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1073c expref: 17 pid: 18270 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.743975:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5eab64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1073c expref: 17 pid: 18270 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.743985:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155563.743998:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1963:x1830976123655552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 46us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.744003:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5935 00000100:00100000:0.0:1746155563.744027:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.744037:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123656192 00000100:00100000:0.0:1746155563.744039:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123656192 00010000:00010000:0.0:1746155563.744048:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a0de200/0x844e5faceb5eab02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106da expref: 23 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746155563.744067:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5936 00000100:00100000:0.0:1746155563.744071:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123656192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155563.744077:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.744083:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a0de200/0x844e5faceb5eab02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106da expref: 23 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.744090:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a0de200/0x844e5faceb5eab02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106da expref: 23 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.744099:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155563.744112:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123656192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 40us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.744117:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5936 00000100:00100000:0.0:1746155563.744158:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.744169:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123655680 00000100:00100000:0.0:1746155563.744172:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123655680 00010000:00010000:0.0:1746155563.744182:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eab25 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106fd expref: 32 pid: 1625 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746155563.744197:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5937 00000100:00100000:0.0:1746155563.744201:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123655680:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155563.744207:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.744214:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eab25 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106fd expref: 32 pid: 1625 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.744226:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eab25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106fd expref: 32 pid: 1625 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746155563.744236:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.744238:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.744241:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.744248:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.744261:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155563.744274:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123655680:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.744279:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5937 00010000:00010000:2.0:1746155563.744420:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eab25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106fd expref: 31 pid: 1625 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155563.744436:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124543360:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.744445:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d582200/0x844e5faceb5eab64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1073c expref: 16 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155563.744453:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124543488:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.744462:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a0de200/0x844e5faceb5eab02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f106da expref: 22 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155563.744469:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124543744:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.744484:0:19959:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.744492:0:19959:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.744498:0:19959:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.744540:0:19959:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.744547:0:19959:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.744554:0:19959:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.744560:0:19959:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6020c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155563.744563:0:19959:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.744570:0:19959:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.744580:0:19959:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.744580:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094484800/0x844e5faceb5eadc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10869 expref: 28 pid: 4461 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746155563.744585:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6020c00/0x844e5faceb5eaedd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.744594:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124544128:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.744604:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6020400/0x844e5faceb5eae7b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108b6 expref: 15 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746155563.744622:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124544256:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.744634:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123655040:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 11899us (11978us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155563.744639:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d582c00/0x844e5faceb5eab6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1074a expref: 14 pid: 18270 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155563.744641:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11834 00000100:00100000:1.0:1746155563.744647:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124543616:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.744658:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124543872:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.744666:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124544000:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.744682:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.744762:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124543232:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.744772:0:20796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.747268:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124544384:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155563.747293:0:9235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.749787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.749801:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124544640:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.749808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.749810:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124544768:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.749821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155563.749828:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.749832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.749842:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.749857:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123656320 00000100:00100000:1.0:1746155563.749862:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123656320 00000100:00100000:2.0:1746155563.749878:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155563.749885:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6040800/0x844e5faceb5eac8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ac expref: 28 pid: 9235 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155563.749892:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123656448 00000100:00100000:2.0:1746155563.749895:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123656448 00000100:00100000:1.0:1746155563.749899:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123656704 00000100:00100000:1.0:1746155563.749900:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123656704 00010000:00010000:2.0:1746155563.749907:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093615200/0x844e5faceb5eae66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a1 expref: 31 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.749907:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6020800/0x844e5faceb5eae6d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a8 expref: 15 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155563.749915:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123656832 00000100:00100000:1.0:1746155563.749915:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123656576 00000100:00100000:1.0:1746155563.749916:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123656576 00000100:00100000:2.0:1746155563.749917:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123656832 00010000:00010000:2.0:1746155563.749922:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ead40 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1080e expref: 32 pid: 4461 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.749922:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94da00/0x844e5faceb5eab2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1070b expref: 34 pid: 10591 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746155563.749929:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123656960 00000100:00100000:2.0:1746155563.749931:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123656960 00000100:00100000:1.0:1746155563.749933:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5938 00000100:00100000:1.0:1746155563.749938:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123656320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155563.749939:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f9 expref: 22 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.749946:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5939 00010000:00010000:1.0:1746155563.749949:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155563.749950:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1963:x1830976123656704:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155563.749955:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155563.749966:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6020800/0x844e5faceb5eae6d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a8 expref: 15 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.749967:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6040800/0x844e5faceb5eac8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ac expref: 28 pid: 9235 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746155563.749975:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6020800/0x844e5faceb5eae6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a8 expref: 15 pid: 19959 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.749975:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6040800/0x844e5faceb5eac8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ac expref: 28 pid: 9235 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.749990:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6040800/0x844e5faceb5eac8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107ac expref: 28 pid: 9235 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746155563.749992:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155563.749999:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155563.750021:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1963:x1830976123656704:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 70us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.750022:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123656320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.750026:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5939 00000100:00100000:1.0:1746155563.750028:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5938 00000100:00100000:2.0:1746155563.750037:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5940 00000100:00100000:1.0:1746155563.750040:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5941 00000100:00100000:2.0:1746155563.750041:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123656448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155563.750043:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123656832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155563.750047:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.750048:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155563.750054:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093615200/0x844e5faceb5eae66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a1 expref: 32 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.750054:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ead40 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1080e expref: 32 pid: 4461 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746155563.750061:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093615200/0x844e5faceb5eae66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a1 expref: 32 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.750061:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ead40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1080e expref: 32 pid: 4461 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746155563.750070:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155563.750071:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093615200/0x844e5faceb5eae66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a1 expref: 32 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.750078:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.750081:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123656832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 37us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.750085:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5941 00000100:00100000:2.0:1746155563.750087:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123656448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 46us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.750091:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5940 00000100:00100000:1.0:1746155563.750094:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5942 00000100:00100000:2.0:1746155563.750098:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5943 00000100:00100000:1.0:1746155563.750098:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123656576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155563.750101:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123656960:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.750103:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155563.750106:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.750108:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c94da00/0x844e5faceb5eab2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1070b expref: 34 pid: 10591 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746155563.750110:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f9 expref: 22 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.750116:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c94da00/0x844e5faceb5eab2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1070b expref: 34 pid: 10591 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746155563.750117:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f9 expref: 22 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.750124:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c94da00/0x844e5faceb5eab2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1070b expref: 34 pid: 10591 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746155563.750125:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.750126:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.750129:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.750130:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.750132:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.750134:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.750137:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.750139:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.750148:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155563.750151:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155563.750159:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123656960:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.750160:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123656576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 62us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.750163:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5943 00000100:00100000:1.0:1746155563.750165:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5942 00010000:00010000:1.0:1746155563.750176:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.750195:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.750210:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.750217:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.750223:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.750228:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ecb400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155563.750231:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.750237:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.750250:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.750255:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ecb400/0x844e5faceb5eaeeb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.750288:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123655296:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 17415us (17610us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.750295:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11835 00000100:00100000:0.0:1746155563.750930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.750942:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123657088 00000100:00100000:0.0:1746155563.750945:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123657088 00010000:00010000:0.0:1746155563.750959:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10854 expref: 33 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746155563.750973:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5944 00000100:00100000:0.0:1746155563.750978:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123657088:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155563.750985:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.750995:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10854 expref: 33 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.751008:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10854 expref: 33 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.751019:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800901f0800/0x844e5faceb5ead94 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10854 expref: 33 pid: 4461 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746155563.751030:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.751031:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.751034:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.751040:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.751051:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155563.751067:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123657088:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 88us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.751073:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5944 00010000:00010000:1.0:1746155563.751345:0:9235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.751352:0:9235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.751367:0:9235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.751373:0:9235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.751378:0:9235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.751383:0:9235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e21a400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155563.751386:0:9235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.751393:0:9235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.751402:0:9235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.751407:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e21a400/0x844e5faceb5eaef9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.751443:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123654912:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 18271us (18348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.751449:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11837 00010000:00010000:3.0:1746155563.752065:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ead40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1080e expref: 29 pid: 4461 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.752080:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124544512:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.752101:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6020800/0x844e5faceb5eae6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108a8 expref: 14 pid: 19959 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746155563.752108:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124544896:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.752116:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c94c800/0x844e5faceb5ead1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107f9 expref: 21 pid: 4461 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.752123:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124545024:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155563.752136:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.752142:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.752146:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.752160:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.752166:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.752171:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.752175:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3e17600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155563.752178:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.752182:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.752190:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.752195:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e17600/0x844e5faceb5eaef2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.752224:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123654656:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 19278us (19520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.752229:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11836 00000100:00100000:1.0:1746155563.755204:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123655808:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 11957us (12076us total) trans 17179873149 rc 0/0 00000100:00100000:1.0:1746155563.755216:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 687 00002000:00100000:1.0:1746155563.755226:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1126400->1572863) req@ffff88012cdec700 x1830976123655808/t17179873149(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/448 e 0 to 0 dl 1746155574 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.755235:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec700 with x1830976123655808 ext(1126400->1572863) 00010000:00010000:1.0:1746155563.755242:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 32 pid: 20796 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.755253:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 32 pid: 20796 timeout: 792 lvb_type: 0 00002000:00010000:1.0:1746155563.755259:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdec700 00000100:00100000:2.0:1746155563.756058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.756121:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123657344 00000100:00100000:1.0:1746155563.756127:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123657344 00002000:00100000:1.0:1746155563.756155:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009a6db480 x1830976123657344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.756162:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6db480 with x1830976123657344 ext(3145728->4194303) 00010000:00010000:1.0:1746155563.756168:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 29 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.756177:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 29 pid: 8436 timeout: 792 lvb_type: 0 00002000:00010000:1.0:1746155563.756182:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6db480 00000100:00100000:1.0:1746155563.756209:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 688 00000100:00100000:1.0:1746155563.756216:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123657344:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155563.761993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.762360:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123657472 00000100:00100000:3.0:1746155563.762368:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123657472 00010000:00010000:3.0:1746155563.762404:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 32 pid: 20796 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.762438:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5945 00000100:00100000:3.0:1746155563.762445:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123657472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.762455:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.762472:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 32 pid: 20796 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.762481:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 32 pid: 20796 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.762497:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eae97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1572863) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108cb expref: 32 pid: 20796 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.762524:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.762526:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.762529:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.762536:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.763177:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155563.763187:0:20796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.763194:0:20796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.763211:0:20796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.763218:0:20796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.763223:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123657472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 777us (1236us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155563.763225:0:20796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.763228:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5945 00010000:00010000:2.0:1746155563.763230:0:20796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135688400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155563.763233:0:20796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.763239:0:20796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.763249:0:20796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.763254:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135688400/0x844e5faceb5eaee4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.763294:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123654784:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 30569us (30665us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.763301:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11833 00000100:00100000:1.0:1746155563.764439:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123657344:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8220us (8380us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155563.764447:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 688 00002000:00100000:1.0:1746155563.764456:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009a6db480 x1830976123657344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.764464:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6db480 with x1830976123657344 ext(3145728->4194303) 00010000:00010000:1.0:1746155563.764472:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 29 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.764484:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 29 pid: 8436 timeout: 792 lvb_type: 0 00002000:00010000:1.0:1746155563.764495:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6db480 00000100:00100000:0.0:1746155563.770941:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.771035:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123657600 00000100:00100000:2.0:1746155563.771044:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123657600 00000100:00100000:0.0:1746155563.771078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.771082:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11839 00000100:00100000:2.0:1746155563.771089:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29021:x1830976123657600:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155563.771106:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.771123:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135689200/0x844e5faceb5eaf07 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108f5 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155563.771145:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3dc:0x0] initial LVB size: 4194304, mtime: 0x6814382b, atime: 0x6814382b, ctime: 0x6814382b, blocks: 0x102b 00010000:00010000:2.0:1746155563.771162:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.771164:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.771171:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135689200/0x844e5faceb5eaf07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108f5 expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.771188:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135689200/0x844e5faceb5eaf07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108f5 expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.771197:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135689200, rc 0) 00000100:00100000:2.0:1746155563.771243:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29021:x1830976123657600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 154us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.771248:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11839 00000100:00100000:3.0:1746155563.771434:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123657728 00000100:00100000:3.0:1746155563.771438:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123657728 00010000:00010000:3.0:1746155563.771456:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 29 pid: 8436 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.772625:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5946 00000100:00100000:3.0:1746155563.772633:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123657728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.772641:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.772658:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 29 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.772667:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 29 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.772683:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eaea5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d2 expref: 29 pid: 8436 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.772692:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.772693:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.772696:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.772705:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.773051:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.773080:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123657728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 448us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.773085:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5946 00010000:00010000:1.0:1746155563.773360:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.773368:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.773389:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.773396:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.773402:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.773407:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e21b200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155563.773410:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.773417:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.773427:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.773436:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e21b200/0x844e5faceb5eaf00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.773687:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123655168:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 40318us (40565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.773693:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11838 00000100:00100000:0.0:1746155563.775962:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.776740:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123657984 00000100:00100000:1.0:1746155563.776748:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123657984 00002000:00100000:1.0:1746155563.776781:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012cdeed80 x1830976123657984/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.776790:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeed80 with x1830976123657984 ext(3145728->4194303) 00002000:00010000:1.0:1746155563.776794:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdeed80 00000100:00100000:1.0:1746155563.776897:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4493 00000100:00100000:1.0:1746155563.776903:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123657984:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155563.779847:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.780782:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123658240 00000100:00100000:2.0:1746155563.780791:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123658240 00000100:00100000:2.0:1746155563.781380:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9954 00000100:00100000:2.0:1746155563.781387:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:29023:x1830976123658240:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155563.781428:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746155563.781452:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135689c00/0x844e5faceb5eaeb3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108d9 expref: 13 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.781484:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800903bbc00/0x844e5faceb5eac52 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1077b expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.781493:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155563.781497:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155563.781536:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.781547:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10766 expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.781557:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eac67 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10789 expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.781563:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ead01 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107e4 expref: 17 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.781569:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5ead32 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10800 expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.781574:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eadb0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1085b expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.781580:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fe00/0x844e5faceb5eae0b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1087e expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.781586:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 9/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.781625:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fe00/0x844e5faceb5eae0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1087e expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.781637:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fe00/0x844e5faceb5eae0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1087e expref: 298 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.781647:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124545152:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.782405:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eadb0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1085b expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.782417:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eadb0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1085b expref: 17 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.782423:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124545280:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.782450:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5ead32 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10800 expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.782457:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5ead32 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10800 expref: 298 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.782463:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124545408:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.782481:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ead01 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107e4 expref: 17 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.782487:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ead01 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107e4 expref: 17 pid: 14234 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.782494:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124545536:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.783115:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eac67 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10789 expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.783123:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eac67 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10789 expref: 298 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.783131:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124545664:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.784223:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10766 expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.784232:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10766 expref: 17 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.784240:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6da680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124545792:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.784261:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155563.789288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.789314:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123658368 00000100:00100000:3.0:1746155563.789322:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123658368 00010000:00010000:3.0:1746155563.789355:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eadb0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1085b expref: 18 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.789395:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5947 00000100:00100000:3.0:1746155563.789402:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123658368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.789415:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.789421:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eadb0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1085b expref: 18 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.789431:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eadb0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1085b expref: 18 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.789452:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.789456:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.789464:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.789526:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123658368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 101us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.789532:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5947 00000100:00100000:0.0:1746155563.790187:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124545152:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155563.790198:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eadb0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1085b expref: 17 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746155563.790211:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124545280:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155563.790314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.790444:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.790526:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.790561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.790573:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123658496 00000100:00100000:3.0:1746155563.790576:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123658496 00010000:00010000:3.0:1746155563.790589:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fe00/0x844e5faceb5eae0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1087e expref: 299 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.790603:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123658624 00000100:00100000:3.0:1746155563.790605:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123658624 00010000:00010000:3.0:1746155563.790622:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5ead32 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10800 expref: 300 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.790635:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5948 00000100:00100000:3.0:1746155563.790641:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1963:x1830976123658496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.790647:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.790650:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fe00/0x844e5faceb5eae0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1087e expref: 300 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.790657:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fe00/0x844e5faceb5eae0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1087e expref: 300 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.790668:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f19fe00/0x844e5faceb5eae0b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1087e expref: 300 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.790679:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.790682:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.790687:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.790701:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1963:x1830976123658496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 61us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.790706:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5948 00000100:00100000:3.0:1746155563.790715:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5949 00000100:00100000:3.0:1746155563.790719:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1962:x1830976123658624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.790725:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.790728:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5ead32 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10800 expref: 298 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.790735:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5ead32 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10800 expref: 298 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.790743:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.790746:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.790750:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.790760:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1962:x1830976123658624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 41us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.790765:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5949 00000100:00100000:3.0:1746155563.790791:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123658880 00000100:00100000:3.0:1746155563.790794:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123658880 00000100:00100000:3.0:1746155563.790809:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3998 00000100:00100000:3.0:1746155563.790813:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+17:27128:x1830976123658880:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155563.790933:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+18:27128:x1830976123658880:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 119us (410us total) trans 8589943880 rc 0/0 00000100:00100000:3.0:1746155563.790939:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3998 00000100:00100000:2.0:1746155563.791282:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123657984:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14379us (15325us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.791289:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4493 00002000:00100000:2.0:1746155563.791296:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012cdeed80 x1830976123657984/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.791304:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeed80 with x1830976123657984 ext(3145728->4194303) 00002000:00010000:2.0:1746155563.791309:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdeed80 00000100:00100000:0.0:1746155563.791744:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123659136 00000100:00100000:0.0:1746155563.791748:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123659136 00000100:00100000:0.0:1746155563.791781:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9955 00000100:00100000:0.0:1746155563.791786:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29031:x1830976123659136:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155563.791795:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155563.791804:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020e00/0x844e5faceb5eaf15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f108fc expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.791863:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020600/0x844e5faceb5eaf1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.791871:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020600/0x844e5faceb5eaf1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.791878:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020600/0x844e5faceb5eaf1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.791886:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eaf23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.791891:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eaf23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.791896:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eaf23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.791979:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a0df800/0x844e5faceb5ead32 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10800 expref: 297 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746155563.791987:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124545408:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155563.791994:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124545536:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155563.792926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.793726:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124545664:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.793736:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6da680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124545792:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.793760:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155563.794400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.794438:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123659392 00000100:00100000:1.0:1746155563.794443:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123659392 00010000:00010000:1.0:1746155563.794463:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10766 expref: 20 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.794481:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123659264 00000100:00100000:1.0:1746155563.794483:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123659264 00010000:00010000:1.0:1746155563.794491:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eac67 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10789 expref: 297 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.794564:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5950 00000100:00100000:1.0:1746155563.794571:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123659392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.794581:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.794585:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10766 expref: 20 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.794594:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10766 expref: 20 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.794619:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5eac13 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10766 expref: 20 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.794634:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155563.794638:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.794644:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.794703:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5951 00000100:00100000:0.0:1746155563.794704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.794710:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1960:x1830976123659264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.794717:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.794722:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eac67 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10789 expref: 297 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.794744:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123659392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 174us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.794750:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5950 00000100:00100000:1.0:1746155563.794766:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123659520 00000100:00100000:1.0:1746155563.794769:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123659520 00010000:00010000:1.0:1746155563.794777:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ead01 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107e4 expref: 19 pid: 14234 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.794796:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5952 00000100:00100000:1.0:1746155563.794800:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976123659520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.794806:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.794809:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ead01 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107e4 expref: 19 pid: 14234 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.794816:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ead01 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107e4 expref: 19 pid: 14234 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.794826:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ead01 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f107e4 expref: 19 pid: 14234 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746155563.794835:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155563.794838:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.794842:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.794857:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123659520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.794862:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5952 00010000:00010000:3.0:1746155563.794906:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eac67 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10789 expref: 297 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.794918:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eac67 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10789 expref: 297 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746155563.794926:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.794928:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.794934:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.794940:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.794955:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.794972:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:1960:x1830976123659264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 263us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.794978:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5951 00010000:00010000:3.0:1746155563.795013:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.795019:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000040:00080000:3.0:1746155563.796591:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2863, 88 off239328 00000004:00080000:3.0:1746155563.796599:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692946096051ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155563.796648:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2809, 88 off234304 00000004:00080000:3.0:1746155563.796654:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692946150683ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155563.796775:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2810, 88 off234392 00000004:00080000:3.0:1746155563.796779:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692946276091ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155563.796787:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2864, 88 off239416 00000004:00080000:3.0:1746155563.796790:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692946286877ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155563.796809:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2865, 88 off239504 00000004:00080000:3.0:1746155563.796813:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692946309643ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155563.796818:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2811, 88 off234480 00000004:00080000:3.0:1746155563.796821:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692946317797ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155563.796828:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2812, 88 off234568 00000004:00080000:3.0:1746155563.796830:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692946327448ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155563.796837:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2813, 88 off234656 00000004:00080000:3.0:1746155563.796840:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692946336862ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155563.796847:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2866, 88 off239592 00000004:00080000:3.0:1746155563.796849:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692946346549ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155563.796855:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2814, 88 off234744 00000004:00080000:3.0:1746155563.796857:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692946354389ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155563.796864:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2867, 88 off239680 00000004:00080000:3.0:1746155563.796866:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692946363527ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155563.796873:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2815, 88 off234832 00000004:00080000:3.0:1746155563.796875:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692946371807ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155563.796881:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2868, 88 off239768 00000004:00080000:3.0:1746155563.796883:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692946380446ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155563.796889:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2869, 88 off239856 00000004:00080000:3.0:1746155563.796892:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692946388659ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155563.796897:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2870, 88 off239944 00000004:00080000:3.0:1746155563.796899:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692946395997ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155563.796905:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2871, 88 off240032 00000004:00080000:3.0:1746155563.796907:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692946403979ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155563.796912:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2816, 88 off234920 00000004:00080000:3.0:1746155563.796914:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692946410881ns, next at 645866785986ns, rc = 0 00000100:00100000:1.0:1746155563.796960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.797011:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123659648 00000100:00100000:2.0:1746155563.797016:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123659648 00000100:00100000:2.0:1746155563.797099:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9956 00000100:00100000:2.0:1746155563.797105:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:29021:x1830976123659648:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155563.797120:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.797131:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10903 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.797164:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.797171:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 297 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.797286:0:27374:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.797301:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 297 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.797309:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155563.797312:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155563.797314:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 297 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.797319:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce6f000, rc 0) 00000100:00100000:2.0:1746155563.797361:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29021:x1830976123659648:12345-192.168.202.51@tcp:101:cat.0 Request processed in 255us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.797366:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9956 00000004:00010000:3.0:1746155563.827986:0:15474:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fac5880 reply state ffff88012d3b3800 transno 8589943881 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155563.828000:0:15474:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746155563.828048:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021800/0x844e5faceb5eaf31 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828062:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021800/0x844e5faceb5eaf31 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828072:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021800/0x844e5faceb5eaf31 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155563.828083:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000100:00100000:3.0:1746155563.828102:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:29023:x1830976123658240:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 46711us (48258us total) trans 8589943881 rc 0/0 00000100:00100000:3.0:1746155563.828110:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9954 00000001:00080000:3.0:1746155563.828135:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943876 is committed 00000001:00080000:3.0:1746155563.828141:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943875 is committed 00000001:00080000:3.0:1746155563.828154:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943878 is committed 00000001:00080000:3.0:1746155563.828158:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943877 is committed 00000001:00080000:3.0:1746155563.828179:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943881 is committed 00000004:00080000:3.0:1746155563.828182:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2009 committed 00000004:00080000:3.0:1746155563.828187:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2070 committed 00000004:00080000:3.0:1746155563.828192:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2069 committed 00000004:00080000:3.0:1746155563.828195:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2068 committed 00010000:00010000:0.0:1746155563.828195:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021800/0x844e5faceb5eaf31 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00000004:00080000:3.0:1746155563.828196:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2067 committed 00000004:00080000:3.0:1746155563.828198:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2008 committed 00000004:00080000:3.0:1746155563.828200:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2066 committed 00000004:00080000:3.0:1746155563.828201:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2007 committed 00000004:00080000:3.0:1746155563.828202:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2065 committed 00010000:00010000:0.0:1746155563.828202:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021800/0x844e5faceb5eaf31 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00000004:00080000:3.0:1746155563.828203:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2006 committed 00000004:00080000:3.0:1746155563.828205:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2005 committed 00000004:00080000:3.0:1746155563.828206:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2004 committed 00010000:00010000:0.0:1746155563.828206:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021800/0x844e5faceb5eaf31 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155563.828207:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15474 initiator: MDT0 00000004:00080000:3.0:1746155563.828208:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2064 committed 00000004:00080000:3.0:1746155563.828209:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2063 committed 00000004:00080000:3.0:1746155563.828211:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2003 committed 00000004:00080000:3.0:1746155563.828213:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2002 committed 00010000:00010000:2.0:1746155563.828213:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15474 initiator: MDT0 00000004:00080000:3.0:1746155563.828214:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2062 committed 00000001:00080000:3.0:1746155563.828218:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943880 is committed 00010000:00010000:2.0:1746155563.828218:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155563.828218:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6021800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155563.828221:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021800/0x844e5faceb5eaf31 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155563.828223:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca19e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155563.828225:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155563.828226:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021800/0x844e5faceb5eaf31 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155563.828230:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155563.828239:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155563.828241:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155563.828244:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021800/0x844e5faceb5eaf31 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155563.828248:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155563.828250:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155563.828252:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021800/0x844e5faceb5eaf31 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155563.828254:0:3282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 285 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.828262:0:3282:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 285 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.828268:0:3282:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 285 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.828284:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020600/0x844e5faceb5eaf1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828289:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020600/0x844e5faceb5eaf1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828292:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020600/0x844e5faceb5eaf1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155563.828294:0:3282:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 285 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.828296:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6020600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155563.828298:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020600/0x844e5faceb5eaf1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828302:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020600/0x844e5faceb5eaf1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155563.828305:0:3282:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6da680 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3282:1830976124545920:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155563.828308:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155563.828310:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155563.828312:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020600/0x844e5faceb5eaf1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828316:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020600/0x844e5faceb5eaf1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828322:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eaf23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828326:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eaf23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828330:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eaf23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828334:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6021a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155563.828336:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eaf23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828340:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eaf23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828345:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009c823100) 00000100:00100000:2.0:1746155563.828346:0:3282:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746155563.828346:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155563.828348:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eaf23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828352:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eaf23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.828387:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020e00/0x844e5faceb5eaf15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108fc expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.828394:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6020e00/0x844e5faceb5eaf15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108fc expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.828401:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6020e00, rc 0) 00000100:00100000:0.0:1746155563.828426:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+7:29031:x1830976123659136:12345-192.168.202.51@tcp:101:cat.0 Request processed in 36639us (38112us total) trans 8589943882 rc 301/301 00000100:00100000:0.0:1746155563.828431:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9955 00000100:00100000:2.0:1746155563.828450:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124546176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.828478:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.828493:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124546688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.828524:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.828539:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124547200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.828554:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.828564:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124547712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.828574:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.828585:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746155563.828589:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124546304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.828600:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.828622:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124546816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.828636:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.828647:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124547328:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.828662:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.828669:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124547840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155563.828669:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124546176 00000100:00100000:1.0:1746155563.828675:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124546176 00000100:00100000:2.0:1746155563.828680:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155563.828697:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124546688 00000100:00100000:1.0:1746155563.828699:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124546688 00000100:00100000:2.0:1746155563.828700:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124547200 00000100:00100000:2.0:1746155563.828703:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124547200 00000100:00100000:1.0:1746155563.828708:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124547712 00000100:00100000:1.0:1746155563.828710:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124547712 00000100:00100000:2.0:1746155563.828719:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124546304 00000100:00100000:1.0:1746155563.828720:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124546816 00000100:00100000:2.0:1746155563.828721:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124546304 00000100:00100000:1.0:1746155563.828722:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124546816 00000100:00100000:2.0:1746155563.828730:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124547840 00000100:00100000:1.0:1746155563.828730:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124547328 00000100:00100000:1.0:1746155563.828731:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124547328 00000100:00100000:2.0:1746155563.828732:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124547840 00000100:00100000:1.0:1746155563.828739:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11840 00000100:00100000:2.0:1746155563.828743:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11841 00000100:00100000:1.0:1746155563.828744:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3297:x1830976124546176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.828748:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3297:x1830976124546688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.828759:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11842 00000100:00100000:2.0:1746155563.828763:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3297:x1830976124547200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.828885:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3297:x1830976124547200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (330us total) trans 21474840531 rc 0/0 00000100:00100000:1.0:1746155563.828887:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3297:x1830976124546176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 142us (407us total) trans 17179873150 rc 0/0 00000100:00100000:2.0:1746155563.828891:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11842 00000100:00100000:1.0:1746155563.828894:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11840 00000100:00100000:2.0:1746155563.828901:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11843 00000100:00100000:2.0:1746155563.828905:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3297:x1830976124547712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155563.828905:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11844 00000100:00100000:1.0:1746155563.828910:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3297:x1830976124546304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155563.828960:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11845 00000100:00100000:0.0:1746155563.828967:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3297:x1830976124546816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.828978:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3297:x1830976124547712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (402us total) trans 21474840532 rc 0/0 00000100:00100000:2.0:1746155563.828983:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11843 00000100:00100000:2.0:1746155563.828992:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11846 00000100:00100000:2.0:1746155563.828996:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3297:x1830976124547328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.829070:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3297:x1830976124547328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (407us total) trans 21474840533 rc 0/0 00000100:00100000:2.0:1746155563.829075:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11846 00000100:00100000:2.0:1746155563.829084:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11847 00000100:00100000:2.0:1746155563.829088:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3297:x1830976124547840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155563.829143:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3297:x1830976124546816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (505us total) trans 17179873151 rc 0/0 00000100:00100000:0.0:1746155563.829150:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11845 00000100:00100000:2.0:1746155563.829163:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3297:x1830976124547840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (481us total) trans 21474840534 rc 0/0 00000100:00100000:2.0:1746155563.829167:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11847 00000100:00100000:3.0:1746155563.829199:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124546048:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155563.829202:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6db800/2, rc 0, transno 17179873151 00000100:00100000:2.0:1746155563.829206:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124546816:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155563.829212:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cded500/2, rc 0, transno 21474840533 00000100:00100000:2.0:1746155563.829218:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124547328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155563.829219:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746155563.829224:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdee680/2, rc 0, transno 21474840534 00000100:00100000:2.0:1746155563.829226:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124547840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155563.829229:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124546560:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155563.829232:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdeca80/2, rc 0, transno 21474840532 00000100:00100000:2.0:1746155563.829234:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124547712:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.829239:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdef480/2, rc 0, transno 21474840531 00000100:00100000:3.0:1746155563.829240:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.829241:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124547200:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.829247:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6d8700/2, rc 0, transno 17179873150 00000100:00100000:3.0:1746155563.829248:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124547072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.829249:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124546176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155563.829258:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.829259:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124546048 00000100:00100000:2.0:1746155563.829261:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124546048 00000100:00100000:3.0:1746155563.829266:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124547584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.829272:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124546560 00000100:00100000:2.0:1746155563.829274:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124546560 00000100:00100000:3.0:1746155563.829277:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.829280:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124547072 00000100:00100000:2.0:1746155563.829282:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124547072 00000100:00100000:3.0:1746155563.829286:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1746155563.829287:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124547584 00000100:00100000:2.0:1746155563.829289:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124547584 00000100:00100000:3.0:1746155563.829290:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124546432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.829295:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11848 00000100:00100000:2.0:1746155563.829299:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3296:x1830976124546048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155563.829301:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155563.829306:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124546944:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155563.829317:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155563.829323:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124547456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155563.829333:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155563.829339:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124547968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155563.829350:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155563.829365:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124546432 00000100:00100000:3.0:1746155563.829367:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124546432 00000100:00100000:3.0:1746155563.829377:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124546944 00000100:00100000:3.0:1746155563.829379:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124546944 00000100:00100000:3.0:1746155563.829384:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124547456 00000100:00100000:3.0:1746155563.829386:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124547456 00000100:00100000:3.0:1746155563.829391:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124547968 00000100:00100000:3.0:1746155563.829393:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124547968 00000100:00100000:3.0:1746155563.829400:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11849 00000100:00100000:2.0:1746155563.829400:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976124546048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (180us total) trans 17179873152 rc 0/0 00000100:00100000:3.0:1746155563.829403:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976124546560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.829405:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11848 00000100:00100000:2.0:1746155563.829413:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11850 00000100:00100000:2.0:1746155563.829416:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3296:x1830976124547072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155563.829480:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976124546560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (238us total) trans 17179873153 rc 0/0 00000100:00100000:2.0:1746155563.829480:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976124547072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (220us total) trans 21474840535 rc 0/0 00000100:00100000:2.0:1746155563.829485:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11850 00000100:00100000:3.0:1746155563.829496:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11849 00000100:00100000:2.0:1746155563.829516:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11851 00000100:00100000:3.0:1746155563.829519:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11852 00000100:00100000:2.0:1746155563.829521:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3296:x1830976124547584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155563.829523:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3296:x1830976124546432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.829590:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976124547584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (311us total) trans 21474840536 rc 0/0 00000100:00100000:2.0:1746155563.829594:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11851 00002000:00010000:1.0:1746155563.829599:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155563.829602:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00000100:00100000:2.0:1746155563.829604:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11853 00002000:00010000:1.0:1746155563.829604:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:1.0:1746155563.829605:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:1.0:1746155563.829607:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:2.0:1746155563.829608:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976124546944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155563.829654:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976124546304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 743us (1051us total) trans 17179873154 rc 0/0 00000100:00100000:1.0:1746155563.829660:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11844 00000004:00080000:3.0:1746155563.829680:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6d9180/2, rc 0, transno 17179873154 00000100:00100000:3.0:1746155563.829684:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124546304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.829689:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976124546944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (371us total) trans 17179873155 rc 0/0 00000100:00100000:2.0:1746155563.829694:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11853 00000100:00100000:2.0:1746155563.829704:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11854 00000100:00100000:2.0:1746155563.829708:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3296:x1830976124547456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155563.829753:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11855 00000100:00100000:1.0:1746155563.829759:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976124547968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155563.829765:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:2.0:1746155563.829768:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155563.829769:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155563.829771:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155563.829772:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:2.0:1746155563.829789:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976124547456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (454us total) trans 21474840537 rc 0/0 00000100:00100000:2.0:1746155563.829793:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11854 00000004:00080000:2.0:1746155563.829816:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dbb80/2, rc 0, transno 17179873155 00000100:00100000:2.0:1746155563.829819:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124546944:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155563.829825:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdec380/2, rc 0, transno 21474840537 00000100:00100000:2.0:1746155563.829828:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124547456:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.829834:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6d9500/2, rc 0, transno 17179873152 00000100:00100000:2.0:1746155563.829836:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124546048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155563.829839:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976124547968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (487us total) trans 21474840538 rc 0/0 00000004:00080000:2.0:1746155563.829842:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6d8000/2, rc 0, transno 17179873153 00000100:00100000:2.0:1746155563.829845:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124546560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155563.829845:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11855 00000004:00080000:2.0:1746155563.829850:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cded880/2, rc 0, transno 21474840535 00000100:00100000:2.0:1746155563.829853:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124547072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.829857:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdee300/2, rc 0, transno 21474840536 00000100:00100000:2.0:1746155563.829859:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124547584:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.829865:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdece00/2, rc 0, transno 21474840538 00000100:00100000:2.0:1746155563.829867:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124547968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155563.830449:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976124546688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1700us (1924us total) trans 17179873156 rc 0/0 00000100:00100000:1.0:1746155563.830455:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11841 00000100:00100000:1.0:1746155563.830566:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976124546432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1042us (1264us total) trans 17179873157 rc 0/0 00000100:00100000:1.0:1746155563.830571:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11852 00000004:00080000:3.0:1746155563.830646:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6db100/2, rc 0, transno 17179873156 00000100:00100000:3.0:1746155563.830650:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124546688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.831126:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124548096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.831153:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746155563.831173:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6d9880/2, rc 0, transno 17179873157 00000100:00100000:2.0:1746155563.831177:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124546432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155563.831202:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124548096 00000100:00100000:1.0:1746155563.831207:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124548096 00000100:00100000:1.0:1746155563.831230:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11856 00000100:00100000:1.0:1746155563.831235:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976124548096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155563.831252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.831272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.831309:0:3282:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6da680 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3282:1830976124545920:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155563.831313:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123659904 00000100:00100000:3.0:1746155563.831316:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123659904 00010000:00010000:2.0:1746155563.831325:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.831331:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5eaf0e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155563.831335:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 3999 00000100:00100000:3.0:1746155563.831341:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29021:x1830976123659904:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:0.0:1746155563.831343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.831361:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123659776 00000100:00100000:0.0:1746155563.831364:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123659776 00000100:00100000:0.0:1746155563.831380:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123660032 00000100:00100000:0.0:1746155563.831382:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123660032 00000100:00100000:0.0:1746155563.831394:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9957 00000100:00100000:0.0:1746155563.831399:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29023:x1830976123659776:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155563.831411:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155563.831421:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135688200/0x844e5faceb5eaf3f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1090a expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.831452:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135688200/0x844e5faceb5eaf3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1090a expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.831463:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135688200/0x844e5faceb5eaf3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1090a expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.831476:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155563.831479:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155563.831481:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135688200, rc 0) 00000100:00100000:0.0:1746155563.831498:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29023:x1830976123659776:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 99us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.831523:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9957 00000100:00100000:0.0:1746155563.831535:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9958 00000100:00100000:3.0:1746155563.831655:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29021:x1830976123659904:12345-192.168.202.51@tcp:49:cat.0 Request processed in 312us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.831661:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 3999 00000100:00100000:0.0:1746155563.832153:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+7:29031:x1830976123660032:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155563.832163:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155563.832170:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135688e00/0x844e5faceb5eaf46 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10911 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.832207:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135688a00/0x844e5faceb5eaf4d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.832214:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135688a00/0x844e5faceb5eaf4d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.832220:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135688a00/0x844e5faceb5eaf4d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155563.832236:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:0.0:1746155563.832240:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155563.832248:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135688a00/0x844e5faceb5eaf4d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155563.832264:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135688e00/0x844e5faceb5eaf46 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10911 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.832273:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135688a00/0x844e5faceb5eaf4d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10911 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.832277:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155563.832279:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155563.832281:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135688a00, rc 0) 00000100:00100000:0.0:1746155563.832298:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29031:x1830976123660032:12345-192.168.202.51@tcp:101:cat.0 Request processed in 148us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.832678:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3296:x1830976124548096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1441us (1523us total) trans 21474840539 rc 0/0 00000100:00100000:1.0:1746155563.832684:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11856 00000100:00100000:1.0:1746155563.832720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.833028:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123660288 00000100:00100000:3.0:1746155563.833032:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123660288 00000100:00100000:3.0:1746155563.833048:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9959 00000100:00100000:3.0:1746155563.833052:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29033:x1830976123660288:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155563.833061:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.833068:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eaf54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10918 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155563.833080:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9958 00010000:00010000:3.0:1746155563.833119:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37600/0x844e5faceb5eaf5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.833126:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37600/0x844e5faceb5eaf5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.833131:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37600/0x844e5faceb5eaf5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.833139:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eaf62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.833144:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eaf62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.833149:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eaf62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00080000:2.0:1746155563.833405:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdec000/2, rc 0, transno 21474840539 00000100:00100000:2.0:1746155563.833409:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124548096:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746155563.833639:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.833647:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eaecf lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108ee expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.833653:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.833672:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eaecf lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108ee expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.833684:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eaecf lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108ee expref: 7 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746155563.833693:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124548224:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155563.833743:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155563.836229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.836285:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123660416 00000100:00100000:3.0:1746155563.836292:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123660416 00000100:00100000:3.0:1746155563.836374:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9960 00000100:00100000:3.0:1746155563.836381:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29023:x1830976123660416:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155563.836396:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.836580:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36a00/0x844e5faceb5eaf70 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1091f expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.836628:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124548224:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.836646:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.836652:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37a00/0x844e5faceb5eaf77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155563.836663:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37a00/0x844e5faceb5eaf77 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155563.836671:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37a00/0x844e5faceb5eaf77 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:3.0:1746155563.836690:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155563.836693:0:19870:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155563.836704:0:19870:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37a00/0x844e5faceb5eaf77 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155563.836747:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36a00/0x844e5faceb5eaf70 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1091f expref: 10 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.836763:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37a00/0x844e5faceb5eaf77 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1091f expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.836769:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.836771:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155563.836774:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e37a00, rc 0) 00000100:00100000:3.0:1746155563.836964:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29023:x1830976123660416:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 581us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.836970:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9960 00000100:00100000:0.0:1746155563.836974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.837431:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123660544 00000100:00100000:2.0:1746155563.837434:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123660544 00010000:00010000:2.0:1746155563.837452:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eaecf lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108ee expref: 9 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746155563.837482:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5953 00000100:00100000:2.0:1746155563.837487:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123660544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155563.837494:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155563.837499:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eaecf lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108ee expref: 9 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.837528:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eaecf lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108ee expref: 9 pid: 15474 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746155563.837625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.837645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.837656:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.837667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.837678:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.837690:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.837695:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123660672 00000100:00100000:0.0:1746155563.837699:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123660672 00000100:00100000:0.0:1746155563.837718:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123660800 00000100:00100000:0.0:1746155563.837720:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123660800 00000100:00100000:1.0:1746155563.837734:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.837870:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123661056 00000100:00100000:0.0:1746155563.837870:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123660928 00000100:00100000:3.0:1746155563.837873:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123661056 00000100:00100000:0.0:1746155563.837874:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123660928 00000100:00100000:3.0:1746155563.837889:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123661184 00000100:00100000:3.0:1746155563.837891:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123661184 00000100:00100000:1.0:1746155563.837908:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123661312 00000100:00100000:1.0:1746155563.837910:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123661312 00010000:00010000:2.0:1746155563.837938:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5eaecf lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108ee expref: 9 pid: 15474 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746155563.837949:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00000100:00100000:0.0:1746155563.837985:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123661440 00000100:00100000:3.0:1746155563.838002:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11857 00000100:00100000:3.0:1746155563.838008:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123660672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.838017:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.838027:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37c00/0x844e5faceb5eaf7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10926 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155563.838043:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x6814382b, atime: 0x6814382b, ctime: 0x6814382b, blocks: 0x767 00000100:00100000:0.0:1746155563.838046:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123661440 00010000:00010000:3.0:1746155563.838054:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.838056:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.838062:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37c00/0x844e5faceb5eaf7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10926 expref: 24 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155563.838063:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11858 00000100:00100000:0.0:1746155563.838068:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123660800:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.838074:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37c00/0x844e5faceb5eaf7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10926 expref: 24 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.838075:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.838082:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e37c00, rc 0) 00010000:00010000:0.0:1746155563.838085:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135689800/0x844e5faceb5eaf85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1092d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155563.838098:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3da:0x0] initial LVB size: 2097152, mtime: 0x6814382c, atime: 0x6814382b, ctime: 0x6814382c, blocks: 0x821 00000100:00100000:3.0:1746155563.838104:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123660672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 96us (479us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155563.838107:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.838108:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155563.838110:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11857 00010000:00010000:0.0:1746155563.838112:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135689800/0x844e5faceb5eaf85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1092d expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155563.838122:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11859 00010000:00010000:0.0:1746155563.838122:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135689800/0x844e5faceb5eaf85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1092d expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155563.838127:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123661056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155563.838129:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135689800, rc 0) 00010000:00010000:3.0:1746155563.838132:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.838139:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36000/0x844e5faceb5eaf8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1093b expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155563.838146:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123660800:12345-192.168.202.51@tcp:101:cat.0 Request processed in 78us (501us total) trans 0 rc 0/0 00002000:00010000:3.0:1746155563.838149:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x6814382b, atime: 0x6814382b, ctime: 0x6814382b, blocks: 0x821 00000100:00100000:0.0:1746155563.838151:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11858 00010000:00010000:3.0:1746155563.838156:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.838157:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.838160:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36000/0x844e5faceb5eaf8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1093b expref: 24 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155563.838163:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11860 00000100:00100000:0.0:1746155563.838167:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123660928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.838169:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36000/0x844e5faceb5eaf8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1093b expref: 24 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.838173:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.838175:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e36000, rc 0) 00010000:00010000:0.0:1746155563.838179:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135688600/0x844e5faceb5eaf93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10934 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.838189:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123661056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 62us (520us total) trans 0 rc 0/0 00002000:00010000:0.0:1746155563.838189:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3db:0x0] initial LVB size: 2097152, mtime: 0x6814382b, atime: 0x6814382b, ctime: 0x6814382b, blocks: 0x81f 00000100:00100000:3.0:1746155563.838193:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11859 00010000:00010000:0.0:1746155563.838196:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.838197:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.838201:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135688600/0x844e5faceb5eaf93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10934 expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155563.838207:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11861 00010000:00010000:0.0:1746155563.838209:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135688600/0x844e5faceb5eaf93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10934 expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155563.838210:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123661184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.838215:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155563.838215:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135688600, rc 0) 00010000:00010000:3.0:1746155563.838222:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36800/0x844e5faceb5eaf9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10942 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155563.838230:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123660928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 63us (572us total) trans 0 rc 0/0 00002000:00010000:3.0:1746155563.838231:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d9:0x0] initial LVB size: 4954272, mtime: 0x6814382c, atime: 0x6814382b, ctime: 0x6814382c, blocks: 0x1617 00000100:00100000:0.0:1746155563.838234:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11860 00010000:00010000:3.0:1746155563.838237:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.838238:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.838241:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36800/0x844e5faceb5eaf9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10942 expref: 24 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155563.838244:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11862 00010000:00010000:3.0:1746155563.838248:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36800/0x844e5faceb5eaf9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10942 expref: 24 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155563.838248:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123661312:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.838253:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e36800, rc 0) 00010000:00010000:0.0:1746155563.838254:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155563.838259:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135689600/0x844e5faceb5eafa1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10949 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.838265:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123661184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 54us (586us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155563.838268:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155563.838269:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11861 00010000:00010000:0.0:1746155563.838270:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.838273:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135689600/0x844e5faceb5eafa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10949 expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155563.838277:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11863 00000100:00100000:3.0:1746155563.838280:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:29021:x1830976123661440:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155563.838281:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135689600/0x844e5faceb5eafa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10949 expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.838285:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155563.838287:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135689600, rc 0) 00010000:00010000:3.0:1746155563.838288:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eafa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10950 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.838296:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.838297:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.838300:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eafa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10950 expref: 29 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155563.838303:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123661312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 54us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.838307:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11862 00010000:00010000:3.0:1746155563.838311:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eafa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10950 expref: 29 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.838317:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e37000, rc 0) 00000100:00100000:3.0:1746155563.838327:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:29021:x1830976123661440:12345-192.168.202.51@tcp:101:cat.0 Request processed in 46us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.838331:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11863 00010000:00010000:2.0:1746155563.838442:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.838451:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.838457:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.838493:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155563.838525:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123660544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1037us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.838531:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5953 00010000:00010000:2.0:1746155563.838547:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.838557:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155563.838574:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155563.838947:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.838953:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.838958:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.838963:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e36200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155563.838966:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.838972:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.838980:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155563.838982:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155563.838985:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.838989:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36200/0x844e5faceb5eaf69 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839001:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37600/0x844e5faceb5eaf5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839006:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37600/0x844e5faceb5eaf5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839013:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37600/0x844e5faceb5eaf5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839017:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e37600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155563.839018:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37600/0x844e5faceb5eaf5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839023:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37600/0x844e5faceb5eaf5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839029:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155563.839031:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155563.839033:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37600/0x844e5faceb5eaf5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839038:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37600/0x844e5faceb5eaf5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839044:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eaf62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839048:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eaf62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839053:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eaf62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839057:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e36e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155563.839059:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eaf62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839062:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eaf62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839070:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801366f8500) 00010000:00010000:2.0:1746155563.839072:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155563.839074:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eaf62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839078:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eaf62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.839111:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eaf54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10918 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.839118:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eaf54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10918 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.839124:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e36400, rc 0) 00000100:00100000:2.0:1746155563.839728:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29033:x1830976123660288:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6673us (7005us total) trans 8589943883 rc 301/301 00000100:00100000:2.0:1746155563.839734:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9959 00000100:00100000:1.0:1746155563.840300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.840340:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123661696 00000100:00100000:3.0:1746155563.840345:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123661696 00000100:00100000:1.0:1746155563.840368:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.840771:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123661952 00000100:00100000:3.0:1746155563.840774:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123661952 00000100:00100000:1.0:1746155563.840789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.840790:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11864 00000100:00100000:3.0:1746155563.840795:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123661696:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155563.840804:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155563.840806:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155563.840815:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155563.840817:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2800/0x844e5faceb5eafb6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1095e expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.840832:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.840833:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746155563.840836:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155563.840839:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2800/0x844e5faceb5eafb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1095e expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.840849:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2800/0x844e5faceb5eafb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1095e expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155563.840850:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123662208 00000100:00100000:1.0:1746155563.840854:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123662208 00010000:00010000:3.0:1746155563.840857:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe2800, rc 0) 00000100:00100000:1.0:1746155563.840870:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123661568 00000100:00100000:1.0:1746155563.840872:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123661568 00000100:00100000:3.0:1746155563.840878:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123661696:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 83us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.840881:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123661824 00000100:00100000:1.0:1746155563.840882:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123661824 00000100:00100000:3.0:1746155563.840883:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11864 00000100:00100000:1.0:1746155563.840891:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123662080 00000100:00100000:3.0:1746155563.840892:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11865 00000100:00100000:1.0:1746155563.840892:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123662080 00000100:00100000:3.0:1746155563.840897:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123661952:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:2.0:1746155563.840901:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11866 00010000:00010000:3.0:1746155563.840902:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.840908:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eafbd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1096c expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.840908:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123662208:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155563.840908:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11867 00000100:00100000:1.0:1746155563.840912:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123661568:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155563.840915:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.840917:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.840918:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.840919:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.840922:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eafbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1096c expref: 15 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.840922:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eafc4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1097a expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.840923:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e21aa00/0x844e5faceb5eafcb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10957 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.840931:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eafbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1096c expref: 16 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.840932:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.840933:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.840933:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.840934:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.840937:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe3600, rc 0) 00010000:00010000:1.0:1746155563.840937:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e21aa00/0x844e5faceb5eafcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10957 expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.840938:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eafc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1097a expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.840946:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e21aa00/0x844e5faceb5eafcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10957 expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155563.840947:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1961:x1830976123661952:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 50us (579us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155563.840950:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eafc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1097a expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.840953:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e21aa00, rc 0) 00010000:00010000:2.0:1746155563.840956:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093615400, rc 0) 00000100:00100000:3.0:1746155563.840962:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11865 00000100:00100000:2.0:1746155563.840968:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123662208:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 61us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.840968:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1961:x1830976123661568:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.840971:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11868 00000100:00100000:1.0:1746155563.840974:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11867 00000100:00100000:3.0:1746155563.840975:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123661824:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155563.840980:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.840985:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e36c00/0x844e5faceb5eafd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10965 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.840997:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.840998:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.841001:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e36c00/0x844e5faceb5eafd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10965 expref: 15 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.841009:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e36c00/0x844e5faceb5eafd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10965 expref: 15 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.841016:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e36c00, rc 0) 00000100:00100000:3.0:1746155563.841026:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123661824:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.841835:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11866 00000100:00100000:2.0:1746155563.841850:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11869 00000100:00100000:2.0:1746155563.841856:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123662080:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155563.841863:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.841871:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093615e00/0x844e5faceb5eafd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10973 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.841881:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.841882:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.841886:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093615e00/0x844e5faceb5eafd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10973 expref: 15 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.841894:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093615e00/0x844e5faceb5eafd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10973 expref: 15 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.841900:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093615e00, rc 0) 00000100:00100000:2.0:1746155563.841917:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123662080:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 63us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.841923:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11869 00000100:00100000:3.0:1746155563.842200:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11868 00000100:00100000:0.0:1746155563.843196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.843220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.843675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.843893:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123662592 00000100:00100000:2.0:1746155563.843893:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123662336 00000100:00100000:3.0:1746155563.843899:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123662592 00000100:00100000:2.0:1746155563.843899:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123662336 00000100:00100000:2.0:1746155563.843923:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123662464 00000100:00100000:2.0:1746155563.843925:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123662464 00000100:00100000:3.0:1746155563.843928:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11870 00000100:00100000:3.0:1746155563.843933:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123662336:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155563.843938:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11871 00000100:00100000:2.0:1746155563.843943:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123662592:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.843944:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.843949:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.843959:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093615600/0x844e5faceb5eafe0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1098f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.843972:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca58000/0x844e5faceb5eafe7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10981 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.843974:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.843975:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.843981:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093615600/0x844e5faceb5eafe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1098f expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.843983:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.843985:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.843990:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca58000/0x844e5faceb5eafe7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10981 expref: 30 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.843992:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093615600/0x844e5faceb5eafe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1098f expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155563.843999:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca58000/0x844e5faceb5eafe7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10981 expref: 30 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.844000:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093615600, rc 0) 00010000:00010000:3.0:1746155563.844010:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca58000, rc 0) 00000100:00100000:3.0:1746155563.844026:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123662336:12345-192.168.202.51@tcp:101:cat.0 Request processed in 93us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.844027:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123662592:12345-192.168.202.51@tcp:101:cat.0 Request processed in 83us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.844031:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11870 00000100:00100000:0.0:1746155563.844047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.844069:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123662720 00000100:00100000:1.0:1746155563.844073:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123662720 00000100:00100000:2.0:1746155563.844706:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11871 00000100:00100000:2.0:1746155563.844801:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11872 00000100:00100000:2.0:1746155563.844806:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123662464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155563.844814:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155563.844822:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093615c00/0x844e5faceb5eafee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10988 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.844835:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.844837:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.844841:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093615c00/0x844e5faceb5eafee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10988 expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.844849:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093615c00/0x844e5faceb5eafee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10988 expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.844856:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093615c00, rc 0) 00000100:00100000:2.0:1746155563.844876:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123662464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 69us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.844881:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11872 00000100:00100000:1.0:1746155563.845350:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11873 00000100:00100000:1.0:1746155563.845355:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123662720:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155563.845362:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.845370:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e21b000/0x844e5faceb5eaff5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10996 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.845379:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.845380:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.845385:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e21b000/0x844e5faceb5eaff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10996 expref: 31 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.845394:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e21b000/0x844e5faceb5eaff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10996 expref: 31 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155563.845401:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e21b000, rc 0) 00000100:00100000:1.0:1746155563.845434:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123662720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 77us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.845438:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11873 00000100:00100000:0.0:1746155563.848276:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.849679:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.849752:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123662976 00000100:00100000:3.0:1746155563.849760:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123662976 00000100:00100000:3.0:1746155563.849805:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123663232 00000100:00100000:3.0:1746155563.849807:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123663232 00000100:00100000:3.0:1746155563.849824:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4494 00000100:00100000:3.0:1746155563.849831:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123662976:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155563.849862:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ca58600/0x844e5faceb5eaffc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.849876:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.849878:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.849883:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca58600/0x844e5faceb5eaffc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.849895:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca58600/0x844e5faceb5eaffc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.851049:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4495 00000100:00100000:3.0:1746155563.851055:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123663232:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155563.851073:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5eb003 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.851085:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.851086:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.851088:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5eb003 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.851097:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5eb003 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.857417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.857433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.857443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.857453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.857471:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123663744 00000100:00100000:2.0:1746155563.857478:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123663744 00000100:00100000:2.0:1746155563.857529:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123663488 00000100:00100000:2.0:1746155563.857532:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123663488 00000100:00100000:2.0:1746155563.857545:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123664000 00000100:00100000:2.0:1746155563.857546:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123664000 00000100:00100000:2.0:1746155563.859742:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123664256 00000100:00100000:2.0:1746155563.859751:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123664256 00000100:00100000:3.0:1746155563.859847:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4496 00000100:00100000:3.0:1746155563.859858:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1961:x1830976123663744:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155563.859889:0:10888:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ca58a00/0x844e5faceb5eb00a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.859902:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.859904:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.859908:0:10888:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca58a00/0x844e5faceb5eb00a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.859921:0:10888:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca58a00/0x844e5faceb5eb00a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.860970:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4497 00000100:00100000:2.0:1746155563.860978:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1961:x1830976123663488:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155563.860996:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a01d6e00/0x844e5faceb5eb011 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.861004:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.861006:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.861008:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01d6e00/0x844e5faceb5eb011 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.861016:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01d6e00/0x844e5faceb5eb011 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.861619:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4498 00000100:00100000:1.0:1746155563.861628:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+19:1961:x1830976123664000:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155563.861647:0:31253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e21ae00/0x844e5faceb5eb018 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.861654:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.861655:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.861658:0:31253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e21ae00/0x844e5faceb5eb018 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.861665:0:31253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e21ae00/0x844e5faceb5eb018 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.865102:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4499 00000100:00100000:3.0:1746155563.865115:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1961:x1830976123664256:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155563.865151:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ca58c00/0x844e5faceb5eb01f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.865163:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.865165:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.865170:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca58c00/0x844e5faceb5eb01f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.865181:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca58c00/0x844e5faceb5eb01f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.866316:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.866347:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.866370:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.866440:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123664640 00000100:00100000:3.0:1746155563.866446:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123664640 00000100:00100000:3.0:1746155563.866491:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123664768 00000100:00100000:3.0:1746155563.866494:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123664768 00000100:00100000:3.0:1746155563.866520:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123665024 00000100:00100000:3.0:1746155563.866522:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123665024 00000100:00100000:0.0:1746155563.866527:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4500 00002000:00100000:3.0:1746155563.866536:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88008ff1bb80 x1830976123665024/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155563.866536:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+21:1960:x1830976123664640:12345-192.168.202.51@tcp:3:lfs.0 00002000:00100000:3.0:1746155563.866544:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1bb80 with x1830976123665024 ext(4194304->4956159) 00002000:00010000:3.0:1746155563.866549:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ff1bb80 00010000:00010000:0.0:1746155563.866557:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135688800/0x844e5faceb5eb026 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.866559:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4501 00000100:00100000:3.0:1746155563.866564:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:1960:x1830976123664768:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155563.866567:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.866568:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.866571:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135688800/0x844e5faceb5eb026 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.866579:0:31251:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ca59400/0x844e5faceb5eb02d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.866580:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135688800/0x844e5faceb5eb026 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.866586:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.866587:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155563.866590:0:31251:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca59400/0x844e5faceb5eb02d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.866598:0:31251:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca59400/0x844e5faceb5eb02d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.867271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.867480:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123665536 00000100:00100000:3.0:1746155563.867484:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123665536 00002000:00100000:3.0:1746155563.867499:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009c28d880 x1830976123665536/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.867520:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28d880 with x1830976123665536 ext(1048576->2097151) 00002000:00010000:3.0:1746155563.867523:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28d880 00000100:00100000:3.0:1746155563.867533:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4502 00000100:00100000:3.0:1746155563.867538:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123665024:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155563.868250:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4503 00000100:00100000:3.0:1746155563.868256:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1962:x1830976123665536:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:2.0:1746155563.868322:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ca58600/0x844e5faceb5eaffc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.868330:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca58600/0x844e5faceb5eaffc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.868337:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ca58600/0x844e5faceb5eaffc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.868343:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca58600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155563.868346:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ca58600/0x844e5faceb5eaffc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.868353:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ca58600/0x844e5faceb5eaffc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.868368:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ca58600/0x844e5faceb5eaffc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.868377:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca58600/0x844e5faceb5eaffc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.868423:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+21:1961:x1830976123662976:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 18592us (20153us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.868430:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4494 00000100:00100000:2.0:1746155563.868481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.869016:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123665280 00000100:00100000:1.0:1746155563.869021:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123665280 00002000:00100000:1.0:1746155563.869040:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009c28df80 x1830976123665280/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.869048:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28df80 with x1830976123665280 ext(0->1048575) 00002000:00010000:1.0:1746155563.869051:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28df80 00000100:00100000:1.0:1746155563.869059:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4504 00000100:00100000:1.0:1746155563.869064:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123665280:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155563.871226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.871244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.871326:0:25394:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 12 min 3 max 116 00000100:00100000:2.0:1746155563.871333:0:25394:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost_io00_012' 00010000:00010000:1.0:1746155563.872034:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5eb003 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.872086:0:31249:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 12 min 3 max 116 00000100:00100000:3.0:1746155563.872093:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123665792 00000100:00100000:3.0:1746155563.872100:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123665792 00002000:00100000:3.0:1746155563.872134:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880095268000 x1830976123665792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.872143:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268000 with x1830976123665792 ext(1048576->2097151) 00002000:00010000:3.0:1746155563.872148:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095268000 00000100:00100000:3.0:1746155563.872159:0:31249:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 12 min 3 max 116 00000100:00100000:3.0:1746155563.872163:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123666048 00000100:00100000:3.0:1746155563.872165:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123666048 00002000:00100000:3.0:1746155563.872177:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880095268a80 x1830976123666048/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.872184:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268a80 with x1830976123666048 ext(1048576->2097151) 00002000:00010000:3.0:1746155563.872186:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095268a80 00000100:00100000:3.0:1746155563.872851:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4505 00000100:00100000:3.0:1746155563.872860:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1963:x1830976123665792:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:1.0:1746155563.873443:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5eb003 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.873451:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5eb003 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.873456:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca58800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155563.873460:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5eb003 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.873467:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5eb003 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.873482:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5eb003 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.873488:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5eb003 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.873566:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:1961:x1830976123663232:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 22510us (23890us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155563.873572:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4495 00000100:00100000:1.0:1746155563.873590:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4506 00000100:00100000:1.0:1746155563.873595:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123666048:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:3.0:1746155563.875679:0:10888:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ca58a00/0x844e5faceb5eb00a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.875692:0:10888:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca58a00/0x844e5faceb5eb00a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.875700:0:10888:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ca58a00/0x844e5faceb5eb00a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.875706:0:10888:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca58a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155563.875710:0:10888:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ca58a00/0x844e5faceb5eb00a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.875716:0:10888:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ca58a00/0x844e5faceb5eb00a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.875729:0:10888:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ca58a00/0x844e5faceb5eb00a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.875734:0:10888:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca58a00/0x844e5faceb5eb00a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.877378:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+19:1961:x1830976123663744:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 17514us (19961us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.877528:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4496 00010000:00010000:1.0:1746155563.886114:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008e21ae00/0x844e5faceb5eb018 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.886131:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e21ae00/0x844e5faceb5eb018 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.886138:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e21ae00/0x844e5faceb5eb018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.886145:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e21ae00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155563.886148:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e21ae00/0x844e5faceb5eb018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.886154:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e21ae00/0x844e5faceb5eb018 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.886170:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e21ae00/0x844e5faceb5eb018 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.886176:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e21ae00/0x844e5faceb5eb018 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.886337:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1961:x1830976123664000:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 24707us (28887us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155563.886346:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4498 00010000:00010000:3.0:1746155563.887852:0:31250:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ca58c00/0x844e5faceb5eb01f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.887863:0:31250:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca58c00/0x844e5faceb5eb01f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.887869:0:31250:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ca58c00/0x844e5faceb5eb01f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.887875:0:31250:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca58c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155563.887877:0:31250:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ca58c00/0x844e5faceb5eb01f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.887883:0:31250:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ca58c00/0x844e5faceb5eb01f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.887896:0:31250:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ca58c00/0x844e5faceb5eb01f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.887902:0:31250:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca58c00/0x844e5faceb5eb01f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.887964:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1961:x1830976123664256:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 22851us (30506us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.887971:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4499 00010000:00010000:3.0:1746155563.890409:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a01d6e00/0x844e5faceb5eb011 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.890422:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01d6e00/0x844e5faceb5eb011 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.890433:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a01d6e00/0x844e5faceb5eb011 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.890438:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01d6e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155563.890441:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a01d6e00/0x844e5faceb5eb011 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.890447:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a01d6e00/0x844e5faceb5eb011 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.890460:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a01d6e00/0x844e5faceb5eb011 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.890464:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01d6e00/0x844e5faceb5eb011 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.890546:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1961:x1830976123663488:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 29566us (33107us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.890554:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4497 00010000:00010000:3.0:1746155563.895937:0:31251:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ca59400/0x844e5faceb5eb02d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.895951:0:31251:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca59400/0x844e5faceb5eb02d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.895959:0:31251:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ca59400/0x844e5faceb5eb02d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.895966:0:31251:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca59400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155563.895969:0:31251:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ca59400/0x844e5faceb5eb02d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.895976:0:31251:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ca59400/0x844e5faceb5eb02d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.895991:0:31251:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ca59400/0x844e5faceb5eb02d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.895997:0:31251:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca59400/0x844e5faceb5eb02d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.896075:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976123664768:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 29506us (29722us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.896084:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4501 00010000:00010000:1.0:1746155563.898353:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135688800/0x844e5faceb5eb026 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.898368:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135688800/0x844e5faceb5eb026 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.898375:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135688800/0x844e5faceb5eb026 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.898381:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135688800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155563.898384:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135688800/0x844e5faceb5eb026 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.898391:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135688800/0x844e5faceb5eb026 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.898407:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135688800/0x844e5faceb5eb026 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.898412:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135688800/0x844e5faceb5eb026 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.899813:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1960:x1830976123664640:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 33272us (33493us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155563.899827:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4500 00000100:00100000:3.0:1746155563.903867:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123665024:12345-192.168.202.51@tcp:3:cat.0 Request processed in 36318us (37486us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155563.903879:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4502 00002000:00100000:3.0:1746155563.903890:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88008ff1bb80 x1830976123665024/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.903898:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1bb80 with x1830976123665024 ext(4194304->4956159) 00002000:00010000:3.0:1746155563.903903:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ff1bb80 00000100:00100000:3.0:1746155563.912101:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1962:x1830976123665536:12345-192.168.202.51@tcp:3:cat.0 Request processed in 43835us (44820us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.912116:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4503 00002000:00100000:3.0:1746155563.912126:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009c28d880 x1830976123665536/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.912135:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28d880 with x1830976123665536 ext(1048576->2097151) 00002000:00010000:3.0:1746155563.912139:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28d880 00000100:00100000:0.0:1746155563.913348:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.913387:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.913410:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123665280:12345-192.168.202.51@tcp:3:cat.0 Request processed in 44345us (44928us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155563.913418:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4504 00002000:00100000:1.0:1746155563.913424:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009c28df80 x1830976123665280/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155563.913432:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28df80 with x1830976123665280 ext(0->1048575) 00002000:00010000:1.0:1746155563.913436:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28df80 00000100:00100000:2.0:1746155563.913440:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123666304 00000100:00100000:2.0:1746155563.913446:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123666304 00000100:00100000:2.0:1746155563.913472:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123666560 00000100:00100000:2.0:1746155563.913474:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123666560 00000100:00100000:2.0:1746155563.913487:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9961 00000100:00100000:2.0:1746155563.913493:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29023:x1830976123666304:12345-192.168.202.51@tcp:36:lfs.0 00000100:00100000:3.0:1746155563.913520:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9962 00000100:00100000:3.0:1746155563.913528:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29033:x1830976123666560:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155563.913542:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.913545:0:19870:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746155563.913556:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.913568:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135688a00/0x844e5faceb5eaf4d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10911 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.913575:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e37a00/0x844e5faceb5eaf77 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1091f expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.913585:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.913588:0:19870:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155563.913589:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155563.913591:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155563.913597:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb034 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1099d expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.913631:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.913641:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.913648:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.913653:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155563.913662:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 285 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.913668:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135688200/0x844e5faceb5eaf3f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1090a expref: 7 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.913674:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 2/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.913679:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155563.913691:0:19870:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.913706:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135688200/0x844e5faceb5eaf3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1090a expref: 7 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.913716:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135688200/0x844e5faceb5eaf3f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1090a expref: 7 pid: 14234 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746155563.913726:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124548352:192.168.202.51@tcp:104: 00000004:00010000:2.0:1746155563.913758:0:15474:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095268380 reply state ffff880090a56000 transno 8589943884 ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155563.913764:0:15474:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746155563.913771:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 285 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.913778:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 285 pid: 27374 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746155563.913785:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124548480:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.913809:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29023:x1830976123666304:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 310us (459us total) trans 8589943884 rc 0/0 00000100:00100000:2.0:1746155563.913815:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9961 00000100:00100000:3.0:1746155563.913854:0:19870:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155563.920974:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1963:x1830976123665792:12345-192.168.202.51@tcp:3:cat.0 Request processed in 48106us (49746us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155563.920985:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4505 00002000:00100000:3.0:1746155563.920995:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880095268000 x1830976123665792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.921003:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268000 with x1830976123665792 ext(1048576->2097151) 00002000:00010000:3.0:1746155563.921009:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095268000 00000100:00100000:0.0:1746155563.922116:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.922860:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123666816 00000100:00100000:3.0:1746155563.922868:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123666816 00000100:00100000:3.0:1746155563.922912:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4000 00000100:00100000:3.0:1746155563.922918:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29021:x1830976123666816:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155563.923558:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29021:x1830976123666816:12345-192.168.202.51@tcp:35:cat.0 Request processed in 638us (1442us total) trans 8589943885 rc 0/0 00000100:00100000:3.0:1746155563.923565:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4000 00000100:00100000:2.0:1746155563.923964:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123666048:12345-192.168.202.51@tcp:3:cat.0 Request processed in 50368us (52717us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.923972:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4506 00002000:00100000:2.0:1746155563.923979:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880095268a80 x1830976123666048/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.923989:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268a80 with x1830976123666048 ext(1048576->2097151) 00002000:00010000:2.0:1746155563.923993:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095268a80 00000100:00100000:0.0:1746155563.924231:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155563.924311:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155563.924313:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123667072 00000100:00100000:2.0:1746155563.924316:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123667072 00010000:00010000:3.0:1746155563.924319:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.924324:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.924328:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ecb600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155563.924332:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.924337:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155563.924340:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9963 00000100:00100000:2.0:1746155563.924346:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29023:x1830976123667072:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155563.924348:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.924351:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155563.924353:0:3281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155563.924359:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.924360:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155563.924367:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecb600/0x844e5faceb5eb03b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155563.924371:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecae00/0x844e5faceb5eb049 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109a4 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.924404:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155563.924411:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecae00/0x844e5faceb5eb049 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109a4 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.924423:0:27374:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155563.924433:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecae00/0x844e5faceb5eb049 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109a4 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.924442:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155563.924444:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155563.924446:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155563.924451:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ecae00, rc 0) 00000100:00100000:2.0:1746155563.924737:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29023:x1830976123667072:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 136us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.924743:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9963 00000100:00100000:1.0:1746155563.924754:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.924775:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124548352:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.924784:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124548480:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.924798:0:19870:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00000100:00100000:3.0:1746155563.924851:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123667200 00000100:00100000:3.0:1746155563.924854:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123667200 00010000:00010000:3.0:1746155563.924869:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 287 pid: 27374 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746155563.924885:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5954 00000100:00100000:3.0:1746155563.924889:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1961:x1830976123667200:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155563.924897:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.924900:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 287 pid: 27374 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155563.924908:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 287 pid: 27374 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155563.924919:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce6f000/0x844e5faceb5eaf2a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10903 expref: 287 pid: 27374 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155563.924928:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.924931:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155563.924935:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155563.924940:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.924959:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:1961:x1830976123667200:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 69us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.924965:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5954 00000100:00100000:1.0:1746155563.926854:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.926901:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123666944 00000100:00100000:0.0:1746155563.926906:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123666944 00010000:00010000:0.0:1746155563.926926:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135688200/0x844e5faceb5eaf3f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1090a expref: 9 pid: 14234 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746155563.926956:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5955 00000100:00100000:0.0:1746155563.926962:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123666944:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155563.926972:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.926977:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135688200/0x844e5faceb5eaf3f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1090a expref: 9 pid: 14234 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746155563.926986:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135688200/0x844e5faceb5eaf3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1090a expref: 9 pid: 14234 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746155563.927001:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135688200/0x844e5faceb5eaf3f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1090a expref: 9 pid: 14234 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746155563.927016:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155563.927020:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155563.927030:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155563.927035:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155563.927041:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecae00/0x844e5faceb5eb049 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109a4 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.927062:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155563.927086:0:19870:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00000100:00100000:0.0:1746155563.927087:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123666944:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 125us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.927092:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5955 00010000:00010000:2.0:1746155563.927094:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00000040:00080000:2.0:1746155563.927732:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2872, 88 off240120 00000004:00080000:2.0:1746155563.927737:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693077234046ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155563.927778:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2817, 88 off235008 00000004:00080000:2.0:1746155563.927782:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693077278563ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155563.929664:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2818, 88 off235096 00000004:00080000:2.0:1746155563.929672:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693079168487ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155563.929685:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2873, 88 off240208 00000004:00080000:2.0:1746155563.929687:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693079184461ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155563.929708:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2874, 88 off240296 00000004:00080000:2.0:1746155563.929711:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693079207941ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155563.929718:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2819, 88 off235184 00000004:00080000:2.0:1746155563.929721:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693079217991ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155563.929727:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2820, 88 off235272 00000004:00080000:2.0:1746155563.929729:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693079226409ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155563.929740:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2821, 88 off235360 00000004:00080000:2.0:1746155563.929743:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693079239981ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155563.929750:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2875, 88 off240384 00000004:00080000:2.0:1746155563.929752:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693079249025ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155563.929760:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2822, 88 off235448 00000004:00080000:2.0:1746155563.929764:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693079260751ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155563.929770:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2876, 88 off240472 00000004:00080000:2.0:1746155563.929772:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693079269502ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155563.929780:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2823, 88 off235536 00000004:00080000:2.0:1746155563.929783:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693079279801ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155563.929788:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2877, 88 off240560 00000004:00080000:2.0:1746155563.929791:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693079287824ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155563.929799:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2878, 88 off240648 00000004:00080000:2.0:1746155563.929801:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693079298594ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155563.929809:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2879, 88 off240736 00000004:00080000:2.0:1746155563.929812:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693079309214ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155563.929820:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2880, 88 off240824 00000004:00080000:2.0:1746155563.929822:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693079319545ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155563.929830:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2824, 88 off235624 00000004:00080000:2.0:1746155563.929832:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693079328889ns, next at 645866785986ns, rc = 0 00000100:00100000:2.0:1746155563.930087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.930268:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123667328 00000100:00100000:3.0:1746155563.930274:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123667328 00000100:00100000:3.0:1746155563.930562:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9964 00000100:00100000:3.0:1746155563.930569:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29031:x1830976123667328:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155563.930583:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155563.930596:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109ab expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.930643:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.930652:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.930661:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.930663:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155563.930666:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecae00/0x844e5faceb5eb049 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109a4 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.930671:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237000, rc 0) 00000100:00100000:3.0:1746155563.930701:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29031:x1830976123667328:12345-192.168.202.51@tcp:101:cat.0 Request processed in 134us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.930706:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9964 00000100:00100000:1.0:1746155563.952022:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.952047:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123667584 00000100:00100000:1.0:1746155563.952055:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123667584 00000100:00100000:1.0:1746155563.952087:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9965 00000100:00100000:1.0:1746155563.952094:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29036:x1830976123667584:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155563.952112:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155563.952126:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2800/0x844e5faceb5eb057 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109b2 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.952207:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eb05e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952219:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eb05e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952227:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eb05e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952244:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021000/0x844e5faceb5eb065 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952249:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021000/0x844e5faceb5eb065 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952254:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021000/0x844e5faceb5eb065 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952338:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021200/0x844e5faceb5eb06c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952345:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021200/0x844e5faceb5eb06c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952351:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021200/0x844e5faceb5eb06c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155563.952358:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155563.952447:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021200/0x844e5faceb5eb06c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952453:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021200/0x844e5faceb5eb06c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952458:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021200/0x844e5faceb5eb06c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952462:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6021200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155563.952466:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021200/0x844e5faceb5eb06c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952471:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021200/0x844e5faceb5eb06c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952481:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155563.952483:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155563.952486:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021200/0x844e5faceb5eb06c lrc: 2/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952490:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021200/0x844e5faceb5eb06c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952499:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eb05e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952518:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eb05e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952521:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eb05e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952525:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0db3e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155563.952527:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eb05e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952531:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eb05e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952537:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155563.952539:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155563.952541:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eb05e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952545:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3e00/0x844e5faceb5eb05e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952551:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021000/0x844e5faceb5eb065 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952556:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021000/0x844e5faceb5eb065 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952561:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021000/0x844e5faceb5eb065 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952565:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6021000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155563.952567:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021000/0x844e5faceb5eb065 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952571:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021000/0x844e5faceb5eb065 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952576:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fd66d00) 00010000:00010000:1.0:1746155563.952578:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155563.952580:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021000/0x844e5faceb5eb065 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952584:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6021000/0x844e5faceb5eb065 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155563.952606:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2800/0x844e5faceb5eb057 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b2 expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.952625:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2800/0x844e5faceb5eb057 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b2 expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.952632:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db2800, rc 0) 00000100:00100000:1.0:1746155563.952679:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29036:x1830976123667584:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 585us (663us total) trans 8589943887 rc 301/301 00000100:00100000:1.0:1746155563.952688:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9965 00000001:00080000:0.0:1746155563.957562:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943882 is committed 00000001:00080000:0.0:1746155563.957573:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943886 is committed 00000004:00080000:0.0:1746155563.957576:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2017 committed 00000004:00080000:0.0:1746155563.957581:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2079 committed 00000004:00080000:0.0:1746155563.957586:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2078 committed 00000004:00080000:0.0:1746155563.957587:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2077 committed 00000004:00080000:0.0:1746155563.957588:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2076 committed 00000004:00080000:0.0:1746155563.957590:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2016 committed 00000004:00080000:0.0:1746155563.957591:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2075 committed 00000004:00080000:0.0:1746155563.957592:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2015 committed 00000004:00080000:0.0:1746155563.957593:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2074 committed 00000004:00080000:0.0:1746155563.957595:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2014 committed 00000004:00080000:0.0:1746155563.957596:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2013 committed 00000004:00080000:0.0:1746155563.957597:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2012 committed 00000004:00080000:0.0:1746155563.957598:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2073 committed 00000004:00080000:0.0:1746155563.957600:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2072 committed 00000004:00080000:0.0:1746155563.957601:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2011 committed 00000004:00080000:0.0:1746155563.957603:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2010 committed 00000004:00080000:0.0:1746155563.957604:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2071 committed 00000001:00080000:0.0:1746155563.957616:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943884 is committed 00000001:00080000:0.0:1746155563.957625:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943885 is committed 00010000:00010000:3.0:1746155563.957852:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1099d expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.957869:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155563.957872:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746155563.957875:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecae00/0x844e5faceb5eb049 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109a4 expref: 6 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.957884:0:19870:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecae00/0x844e5faceb5eb049 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109a4 expref: 6 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.957891:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecae00/0x844e5faceb5eb049 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109a4 expref: 6 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.957897:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.957904:0:19870:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.957909:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.957936:0:19870:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.957949:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124548736:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155563.958040:0:19870:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecae00/0x844e5faceb5eb049 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109a4 expref: 6 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155563.958051:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124548864:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155563.958074:0:19870:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91600 going to sleep for 11 seconds 00000100:00100000:2.0:1746155563.958761:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124548992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.958804:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.958829:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124549504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.958851:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.958869:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124550016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.958890:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.958907:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124550528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.958926:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.958951:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746155563.958957:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124548608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.958979:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.958997:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124549376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.959017:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.959035:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124549888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.959050:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.959060:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124550400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.959073:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.959088:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124549248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.959104:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.959112:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124549760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.959123:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.959131:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124550272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.959141:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.959150:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124550784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.959159:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.959168:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1746155563.959171:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124549120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.959181:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.959187:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124549632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.959196:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.959201:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124550144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.959212:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.959217:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124550656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.959227:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155563.959243:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124548992 00000100:00100000:2.0:1746155563.959249:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124548992 00000100:00100000:2.0:1746155563.959269:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124549504 00000100:00100000:2.0:1746155563.959271:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124549504 00000100:00100000:2.0:1746155563.959277:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124550016 00000100:00100000:2.0:1746155563.959278:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124550016 00000100:00100000:2.0:1746155563.959285:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124550528 00000100:00100000:2.0:1746155563.959287:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124550528 00000100:00100000:2.0:1746155563.959292:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124548608 00000100:00100000:2.0:1746155563.959293:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124548608 00000100:00100000:2.0:1746155563.959299:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124549376 00000100:00100000:2.0:1746155563.959300:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124549376 00000100:00100000:2.0:1746155563.959306:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124549888 00000100:00100000:2.0:1746155563.959307:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124549888 00000100:00100000:2.0:1746155563.959312:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124550400 00000100:00100000:2.0:1746155563.959313:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124550400 00000100:00100000:2.0:1746155563.959318:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124549248 00000100:00100000:2.0:1746155563.959319:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124549248 00000100:00100000:2.0:1746155563.959324:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124549760 00000100:00100000:2.0:1746155563.959326:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124549760 00000100:00100000:2.0:1746155563.959331:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124550272 00000100:00100000:2.0:1746155563.959332:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124550272 00000100:00100000:2.0:1746155563.959338:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124550784 00000100:00100000:2.0:1746155563.959340:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124550784 00000100:00100000:2.0:1746155563.959345:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124549120 00000100:00100000:2.0:1746155563.959346:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124549120 00000100:00100000:2.0:1746155563.959352:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124549632 00000100:00100000:2.0:1746155563.959353:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124549632 00000100:00100000:2.0:1746155563.959359:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124550144 00000100:00100000:2.0:1746155563.959361:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124550144 00000100:00100000:2.0:1746155563.959366:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124550656 00000100:00100000:2.0:1746155563.959367:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124550656 00000100:00100000:2.0:1746155563.959375:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11874 00000100:00100000:2.0:1746155563.959380:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3298:x1830976124548992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155563.959538:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155563.959541:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.959543:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.959545:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.959547:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155563.959571:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3298:x1830976124548992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (768us total) trans 21474840540 rc 0/0 00000100:00100000:2.0:1746155563.959576:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11874 00000100:00100000:2.0:1746155563.959587:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11875 00000100:00100000:2.0:1746155563.959592:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3298:x1830976124549504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.959672:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3298:x1830976124549504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (821us total) trans 21474840541 rc 0/0 00000100:00100000:2.0:1746155563.959677:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11875 00000100:00100000:2.0:1746155563.959685:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11876 00000100:00100000:2.0:1746155563.959689:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3298:x1830976124550016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155563.959766:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155563.959768:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.959770:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.959772:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.959774:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746155563.959788:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3298:x1830976124550016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (898us total) trans 17179873158 rc 0/0 00000100:00100000:2.0:1746155563.959792:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11876 00000100:00100000:2.0:1746155563.959805:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11877 00000100:00100000:2.0:1746155563.959809:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3298:x1830976124550528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.959870:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3298:x1830976124550528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (944us total) trans 17179873159 rc 0/0 00000100:00100000:2.0:1746155563.959875:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11877 00000100:00100000:2.0:1746155563.959883:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11878 00000100:00100000:2.0:1746155563.959887:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3298:x1830976124548608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155563.959942:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155563.959944:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.959945:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.959948:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.959949:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:2.0:1746155563.959963:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3298:x1830976124548608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (985us total) trans 21474840542 rc 0/0 00000100:00100000:2.0:1746155563.959968:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11878 00000100:00100000:2.0:1746155563.959975:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11879 00000100:00100000:2.0:1746155563.959979:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3298:x1830976124549376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.960035:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3298:x1830976124549376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (1018us total) trans 21474840543 rc 0/0 00000100:00100000:2.0:1746155563.960040:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11879 00000100:00100000:2.0:1746155563.960047:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11880 00000100:00100000:2.0:1746155563.960051:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3298:x1830976124549888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155563.960127:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155563.960130:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155564 -> 1746155564 00002000:00010000:2.0:1746155563.960131:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.960133:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155564 -> 1746155564 00002000:00010000:2.0:1746155563.960135:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155563.960159:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3298:x1830976124549888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (1107us total) trans 17179873160 rc 0/0 00000100:00100000:2.0:1746155563.960165:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11880 00000100:00100000:2.0:1746155563.960178:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11881 00000100:00100000:2.0:1746155563.960183:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3298:x1830976124550400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.960293:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3298:x1830976124550400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (1217us total) trans 17179873161 rc 0/0 00000100:00100000:2.0:1746155563.960299:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11881 00000100:00100000:2.0:1746155563.960312:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11882 00000100:00100000:2.0:1746155563.960318:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3296:x1830976124549248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155563.960409:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:2.0:1746155563.960413:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155563.960414:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155563.960416:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155563.960417:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:2.0:1746155563.960451:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976124549248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (1344us total) trans 21474840544 rc 0/0 00000100:00100000:2.0:1746155563.960456:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11882 00000100:00100000:2.0:1746155563.960469:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11883 00000100:00100000:2.0:1746155563.960475:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3296:x1830976124549760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.960631:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976124549760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (1505us total) trans 21474840545 rc 0/0 00000100:00100000:2.0:1746155563.960637:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11883 00000100:00100000:2.0:1746155563.960651:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11884 00000100:00100000:2.0:1746155563.960658:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3296:x1830976124550272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.960773:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3296:x1830976124550272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (1629us total) trans 17179873162 rc 0/0 00000100:00100000:2.0:1746155563.960778:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11884 00000100:00100000:2.0:1746155563.960792:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11885 00000100:00100000:2.0:1746155563.960798:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3296:x1830976124550784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.960899:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3296:x1830976124550784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (1736us total) trans 17179873163 rc 0/0 00000100:00100000:2.0:1746155563.960905:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11885 00000100:00100000:2.0:1746155563.960919:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11886 00000100:00100000:2.0:1746155563.960924:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3296:x1830976124549120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155563.961018:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:2.0:1746155563.961022:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155564 -> 1746155564 00002000:00010000:2.0:1746155563.961023:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.961025:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155564 -> 1746155564 00002000:00010000:2.0:1746155563.961027:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5655 -> 5655 00000100:00100000:2.0:1746155563.961048:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976124549120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (1866us total) trans 21474840546 rc 0/0 00000100:00100000:2.0:1746155563.961053:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11886 00000100:00100000:2.0:1746155563.961063:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11887 00000100:00100000:2.0:1746155563.961068:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3296:x1830976124549632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155563.961178:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976124549632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (1979us total) trans 21474840547 rc 0/0 00000100:00100000:2.0:1746155563.961184:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11887 00000100:00100000:2.0:1746155563.961197:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11888 00000100:00100000:2.0:1746155563.961203:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3296:x1830976124550144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155563.961294:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746155563.961297:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.961299:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.961301:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155563 -> 1746155563 00002000:00010000:2.0:1746155563.961302:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:2.0:1746155563.961329:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3296:x1830976124550144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 125us (2114us total) trans 17179873164 rc 0/0 00000100:00100000:2.0:1746155563.961334:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11888 00000100:00100000:2.0:1746155563.961348:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11889 00000100:00100000:2.0:1746155563.961354:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3296:x1830976124550656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155563.961460:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3296:x1830976124550656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (2229us total) trans 17179873165 rc 0/0 00000100:00100000:2.0:1746155563.961466:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11889 00000004:00080000:2.0:1746155563.961557:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526a300/2, rc 0, transno 21474840546 00000100:00100000:2.0:1746155563.961571:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124549120:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.961584:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c6a00/2, rc 0, transno 21474840547 00000100:00100000:2.0:1746155563.961588:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124549632:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.961597:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366c000/2, rc 0, transno 17179873164 00000100:00100000:2.0:1746155563.961601:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124550144:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155563.961620:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366d880/2, rc 0, transno 17179873165 00000100:00100000:2.0:1746155563.961623:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124550656:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155563.961631:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526b800/2, rc 0, transno 21474840544 00000100:00100000:2.0:1746155563.961634:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124549248:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.961640:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c4e00/2, rc 0, transno 21474840545 00000100:00100000:2.0:1746155563.961642:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124549760:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.961647:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366d180/2, rc 0, transno 17179873162 00000100:00100000:2.0:1746155563.961650:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124550272:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155563.961655:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a3b80/2, rc 0, transno 17179873163 00000100:00100000:2.0:1746155563.961657:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124550784:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155563.961676:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095269c00/2, rc 0, transno 21474840542 00000100:00100000:2.0:1746155563.961679:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124548608:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.961685:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526ad80/2, rc 0, transno 21474840543 00000100:00100000:2.0:1746155563.961687:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124549376:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.961692:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdef800/2, rc 0, transno 17179873160 00000100:00100000:2.0:1746155563.961694:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124549888:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155563.961699:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366df80/2, rc 0, transno 17179873161 00000100:00100000:2.0:1746155563.961701:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124550400:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155563.961707:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526bb80/2, rc 0, transno 21474840540 00000100:00100000:2.0:1746155563.961709:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124548992:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.961714:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c4700/2, rc 0, transno 21474840541 00000100:00100000:2.0:1746155563.961716:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124549504:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155563.961721:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366f100/2, rc 0, transno 17179873158 00000100:00100000:2.0:1746155563.961723:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124550016:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155563.961728:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366e300/2, rc 0, transno 17179873159 00000100:00100000:2.0:1746155563.961730:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124550528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155563.961979:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124550912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155563.962007:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155563.962045:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124550912 00000100:00100000:3.0:1746155563.962049:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124550912 00000100:00100000:3.0:1746155563.962069:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11890 00000100:00100000:3.0:1746155563.962074:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3297:x1830976124550912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155563.962158:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3297:x1830976124550912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (150us total) trans 21474840548 rc 0/0 00000100:00100000:3.0:1746155563.962163:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11890 00000004:00080000:3.0:1746155563.962189:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c7b80/2, rc 0, transno 21474840548 00000100:00100000:3.0:1746155563.962192:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124550912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155563.963783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.963792:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124548736:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155563.963800:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124548864:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155563.963820:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155563.963828:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb034 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1099d expref: 9 pid: 19870 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746155563.963848:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1099d expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155563.963874:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a236400, rc 0) 00000100:00100000:3.0:1746155563.963904:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29033:x1830976123666560:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 50377us (50516us total) trans 8589943886 rc 0/0 00000100:00100000:3.0:1746155563.963912:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9962 00000100:00100000:2.0:1746155563.963970:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123667712 00000100:00100000:2.0:1746155563.963974:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123667712 00000100:00100000:2.0:1746155563.963994:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123667840 00000100:00100000:2.0:1746155563.963995:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123667840 00000100:00100000:0.0:1746155563.963998:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4001 00000100:00100000:0.0:1746155563.964004:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29023:x1830976123667712:12345-192.168.202.51@tcp:49:lfs.0 00000100:00100000:2.0:1746155563.964006:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4002 00000100:00100000:2.0:1746155563.964009:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29031:x1830976123667840:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:0.0:1746155563.964067:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29023:x1830976123667712:12345-192.168.202.51@tcp:49:lfs.0 Request processed in 63us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.964073:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4001 00000100:00100000:2.0:1746155563.964624:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29031:x1830976123667840:12345-192.168.202.51@tcp:49:cat.0 Request processed in 611us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.964629:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4002 00000100:00100000:0.0:1746155563.966202:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.966235:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.966257:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.966269:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.966291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.966302:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.966321:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123668224 00000100:00100000:0.0:1746155563.966324:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.966327:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123668224 00000100:00100000:2.0:1746155563.966345:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123667968 00000100:00100000:3.0:1746155563.966353:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123668480 00000100:00100000:3.0:1746155563.966358:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123668480 00000100:00100000:2.0:1746155563.966359:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123667968 00000100:00100000:3.0:1746155563.966369:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123668736 00000100:00100000:3.0:1746155563.966371:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123668736 00000100:00100000:3.0:1746155563.966380:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123668096 00000100:00100000:3.0:1746155563.966382:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123668096 00000100:00100000:1.0:1746155563.966384:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123668352 00000100:00100000:1.0:1746155563.966388:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123668352 00000100:00100000:3.0:1746155563.966389:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123668608 00000100:00100000:3.0:1746155563.966391:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123668608 00000100:00100000:2.0:1746155563.966394:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4003 00000100:00100000:3.0:1746155563.966401:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11891 00000100:00100000:2.0:1746155563.966402:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29033:x1830976123667968:12345-192.168.202.51@tcp:49:multiop.0 00000100:00100000:1.0:1746155563.966405:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11892 00000100:00100000:3.0:1746155563.966406:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1960:x1830976123668224:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:1.0:1746155563.966409:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123668480:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:2.0:1746155563.966533:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29033:x1830976123667968:12345-192.168.202.51@tcp:49:multiop.0 Request processed in 98us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.966541:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4003 00002000:00010000:3.0:1746155563.966550:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155563.966550:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155563.966553:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155564 -> 1746155564 00002000:00010000:1.0:1746155563.966553:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155563 -> 1746155564 00002000:00010000:3.0:1746155563.966555:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155563 -> 1746155564 00002000:00010000:1.0:1746155563.966555:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155563 -> 1746155564 00002000:00010000:3.0:1746155563.966557:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155564 -> 1746155564 00002000:00010000:1.0:1746155563.966557:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155563 -> 1746155564 00002000:00010000:3.0:1746155563.966559:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746155563.966559:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155563.966576:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11893 00000100:00100000:2.0:1746155563.966584:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123668736:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:1.0:1746155563.966584:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1960:x1830976123668480:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 174us (326us total) trans 21474840549 rc 0/0 00000100:00100000:3.0:1746155563.966585:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123668224:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 179us (349us total) trans 17179873166 rc 0/0 00000100:00100000:1.0:1746155563.966589:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11892 00000100:00100000:3.0:1746155563.966592:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11891 00000100:00100000:1.0:1746155563.966601:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11894 00000100:00100000:3.0:1746155563.966603:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11895 00000100:00100000:1.0:1746155563.966605:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123668096:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:3.0:1746155563.966607:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123668608:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:3.0:1746155563.966640:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11896 00000100:00100000:3.0:1746155563.966644:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1960:x1830976123668352:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155563.966675:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155563.966677:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155563 -> 1746155564 00002000:00010000:1.0:1746155563.966679:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155563 -> 1746155564 00002000:00010000:1.0:1746155563.966680:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155563 -> 1746155564 00002000:00010000:1.0:1746155563.966682:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:1.0:1746155563.966697:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1960:x1830976123668096:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 91us (405us total) trans 21474840550 rc 0/0 00000100:00100000:1.0:1746155563.966702:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11894 00002000:00010000:3.0:1746155563.966707:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155563.966709:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155563 -> 1746155564 00002000:00010000:3.0:1746155563.966711:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155563 -> 1746155564 00002000:00010000:2.0:1746155563.966711:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746155563.966713:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155563 -> 1746155564 00002000:00010000:3.0:1746155563.966714:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:2.0:1746155563.966715:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155563 -> 1746155564 00002000:00010000:2.0:1746155563.966717:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155563 -> 1746155564 00002000:00010000:2.0:1746155563.966718:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155563 -> 1746155564 00002000:00010000:2.0:1746155563.966720:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746155563.966727:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1960:x1830976123668352:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 82us (424us total) trans 17179873168 rc 0/0 00000100:00100000:3.0:1746155563.966731:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11896 00000100:00100000:2.0:1746155563.966747:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123668736:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 162us (474us total) trans 17179873167 rc 0/0 00000100:00100000:2.0:1746155563.966753:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11893 00002000:00010000:3.0:1746155563.966836:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:3.0:1746155563.966838:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155564 -> 1746155564 00002000:00010000:3.0:1746155563.966840:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155563 -> 1746155564 00002000:00010000:3.0:1746155563.966842:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155564 -> 1746155564 00002000:00010000:3.0:1746155563.966843:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5655 -> 5655 00000100:00100000:3.0:1746155563.966870:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1960:x1830976123668608:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 261us (544us total) trans 21474840551 rc 0/0 00000100:00100000:3.0:1746155563.966875:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11895 00000100:00100000:1.0:1746155563.973445:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.973531:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.973636:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123669120 00000100:00100000:3.0:1746155563.973643:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123669120 00000100:00100000:0.0:1746155563.973646:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123668864 00000100:00100000:0.0:1746155563.973649:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123668864 00000100:00100000:3.0:1746155563.973675:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4004 00000100:00100000:0.0:1746155563.973675:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11897 00000100:00100000:3.0:1746155563.973681:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29023:x1830976123669120:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:0.0:1746155563.973681:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+30:29033:x1830976123668864:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155563.973694:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155563.973708:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109b9 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.973726:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135689200/0x844e5faceb5eaf07 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108f5 expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.973734:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eafc4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1097a expref: 16 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.973740:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135689600/0x844e5faceb5eafa1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10949 expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.973745:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.973747:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155563.973749:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3080192->3145727] (req 3080192->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.973772:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135689600/0x844e5faceb5eafa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10949 expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.973781:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135689600/0x844e5faceb5eafa1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10949 expref: 31 pid: 8437 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746155563.973792:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124551040:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155563.973828:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29023:x1830976123669120:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 146us (296us total) trans 8589943888 rc 0/0 00000100:00100000:3.0:1746155563.973833:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4004 00010000:00010000:0.0:1746155563.973842:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eafc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1097a expref: 16 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155563.973850:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eafc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1097a expref: 16 pid: 19959 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746155563.973857:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124551168:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155563.973884:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135689200/0x844e5faceb5eaf07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108f5 expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155563.973892:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135689200/0x844e5faceb5eaf07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108f5 expref: 33 pid: 20796 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746155563.973899:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124551296:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155563.973915:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024180 going to sleep for 11 seconds 00000100:00100000:1.0:1746155563.975766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.975930:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123669376 00000100:00100000:3.0:1746155563.975936:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123669376 00000100:00100000:3.0:1746155563.975973:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4005 00000100:00100000:3.0:1746155563.975979:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29023:x1830976123669376:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155563.976103:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29023:x1830976123669376:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 124us (341us total) trans 8589943889 rc 0/0 00000100:00100000:3.0:1746155563.976109:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4005 00000100:00100000:2.0:1746155563.976789:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124551040:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.976798:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124551168:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.976803:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124551296:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.976825:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3080192->3145727] (req 3080192->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.976836:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f292000, rc 0) 00000100:00100000:2.0:1746155563.977355:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+31:29033:x1830976123668864:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3672us (3917us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.977362:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11897 00000100:00100000:1.0:1746155563.979691:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.979999:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123669632 00000100:00100000:2.0:1746155563.980006:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123669632 00002000:00100000:2.0:1746155563.980039:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88008ff1aa00 x1830976123669632/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.980046:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1aa00 with x1830976123669632 ext(1048576->2097151) 00002000:00010000:2.0:1746155563.980051:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ff1aa00 00000100:00100000:2.0:1746155563.980078:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4507 00000100:00100000:2.0:1746155563.980084:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1961:x1830976123669632:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155563.982560:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.982594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.982616:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123669760 00000100:00100000:3.0:1746155563.982621:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123669760 00000100:00100000:1.0:1746155563.982632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155563.982642:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eafc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1097a expref: 17 pid: 19959 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746155563.982661:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123670016 00000100:00100000:3.0:1746155563.982663:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123670016 00000100:00100000:1.0:1746155563.982670:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123669888 00010000:00010000:3.0:1746155563.982671:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135689600/0x844e5faceb5eafa1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10949 expref: 33 pid: 8437 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746155563.982672:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123669888 00010000:00010000:1.0:1746155563.982683:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135689200/0x844e5faceb5eaf07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108f5 expref: 34 pid: 20796 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746155563.982684:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5956 00000100:00100000:3.0:1746155563.982689:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1961:x1830976123669760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155563.982695:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5957 00010000:00010000:3.0:1746155563.982698:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155563.982700:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1961:x1830976123670016:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.982704:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155563.982713:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eafc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1097a expref: 17 pid: 19959 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155563.982713:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135689600/0x844e5faceb5eafa1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10949 expref: 33 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155563.982722:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eafc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1097a expref: 17 pid: 19959 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746155563.982795:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5958 00000100:00100000:2.0:1746155563.982802:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123669888:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155563.982808:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155563.983435:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135689600/0x844e5faceb5eafa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10949 expref: 33 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155563.983455:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093615400/0x844e5faceb5eafc4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1097a expref: 17 pid: 19959 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746155563.983456:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135689200/0x844e5faceb5eaf07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108f5 expref: 34 pid: 20796 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155563.983464:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135689200/0x844e5faceb5eaf07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108f5 expref: 34 pid: 20796 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155563.983471:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155563.983481:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135689200/0x844e5faceb5eaf07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f108f5 expref: 34 pid: 20796 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155563.983492:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155563.983498:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1961:x1830976123669760:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 809us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155563.983518:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5956 00000100:00100000:2.0:1746155563.983519:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123669888:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 718us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.983524:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5958 00010000:00010000:1.0:1746155563.983991:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135689600/0x844e5faceb5eafa1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10949 expref: 33 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155563.984563:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.984565:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155563.984572:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.984583:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155563.984624:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.984635:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124551424:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155563.984695:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926600 going to sleep for 11 seconds 00000100:00100000:2.0:1746155563.987231:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1961:x1830976123669632:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7143us (7540us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155563.987240:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4507 00002000:00100000:2.0:1746155563.987249:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88008ff1aa00 x1830976123669632/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.987256:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1aa00 with x1830976123669632 ext(1048576->2097151) 00002000:00010000:2.0:1746155563.987261:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ff1aa00 00000100:00100000:0.0:1746155563.988122:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155563.988185:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124551424:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155563.988201:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155563.988227:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123670016:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5525us (5631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.988234:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5957 00000100:00100000:2.0:1746155563.988318:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123670272 00000100:00100000:2.0:1746155563.988323:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123670272 00002000:00100000:2.0:1746155563.988347:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3080192->3084287) req@ffff88009f883800 x1830976123670272/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.988358:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f883800 with x1830976123670272 ext(3080192->3084287) 00002000:00010000:2.0:1746155563.988361:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f883800 00000100:00100000:2.0:1746155563.988485:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4508 00000100:00100000:2.0:1746155563.988492:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123670272:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155563.988631:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123670272:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 139us (510us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155563.988636:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4508 00002000:00100000:2.0:1746155563.988641:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3080192->3084287) req@ffff88009f883800 x1830976123670272/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/4536 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155563.988647:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f883800 with x1830976123670272 ext(3080192->3084287) 00002000:00010000:2.0:1746155563.988649:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f883800 00000100:00100000:0.0:1746155563.991024:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155563.991065:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.991210:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123670528 00000100:00100000:2.0:1746155563.991215:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123670656 00000100:00100000:3.0:1746155563.991217:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123670528 00000100:00100000:2.0:1746155563.991218:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123670656 00002000:00100000:3.0:1746155563.991245:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009f881500 x1830976123670528/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746155563.991247:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11898 00002000:00100000:3.0:1746155563.991253:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881500 with x1830976123670528 ext(1048576->2097151) 00000100:00100000:2.0:1746155563.991253:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29033:x1830976123670656:12345-192.168.202.51@tcp:101:multiop.0 00002000:00010000:3.0:1746155563.991258:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f881500 00010000:00010000:2.0:1746155563.991265:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155563.991272:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4509 00000100:00100000:3.0:1746155563.991278:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123670528:12345-192.168.202.51@tcp:3:multiop.0 00010000:00010000:2.0:1746155563.991278:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109c0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.991298:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36800/0x844e5faceb5eaf9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10942 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.991305:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093615e00/0x844e5faceb5eafd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10973 expref: 17 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.991311:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eafa8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10950 expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.991316:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.991318:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.991321:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->3608575] (req 3145728->3608575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.991343:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eafa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10950 expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.991353:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eafa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10950 expref: 30 pid: 1625 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155563.991367:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124551552:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.991436:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093615e00/0x844e5faceb5eafd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10973 expref: 17 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.991443:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093615e00/0x844e5faceb5eafd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10973 expref: 17 pid: 19959 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746155563.991450:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124551680:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.991469:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36800/0x844e5faceb5eaf9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10942 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155563.991476:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36800/0x844e5faceb5eaf9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10942 expref: 25 pid: 1625 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746155563.991483:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124551808:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.991496:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155563.992954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155563.993407:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123670912 00000100:00100000:3.0:1746155563.993415:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123670912 00002000:00100000:3.0:1746155563.993447:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009f880000 x1830976123670912/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/0 e 0 to 0 dl 1746155574 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155563.993454:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f880000 with x1830976123670912 ext(1048576->2097151) 00002000:00010000:3.0:1746155563.993459:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f880000 00000100:00100000:3.0:1746155563.993490:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4510 00000100:00100000:3.0:1746155563.993497:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1961:x1830976123670912:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155563.994122:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.994135:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.994157:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155563.994193:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124551552:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.994202:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124551680:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155563.994209:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124551808:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155563.994235:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->3608575] (req 3145728->3608575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.994247:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e36400, rc 0) 00000100:00100000:2.0:1746155563.994280:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:29033:x1830976123670656:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3027us (3214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.994287:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11898 00000100:00100000:1.0:1746155563.994391:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123671040 00000100:00100000:1.0:1746155563.994394:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123671040 00010000:00010000:1.0:1746155563.994413:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eafa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10950 expref: 31 pid: 1625 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155563.994437:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123671296 00000100:00100000:1.0:1746155563.994439:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123671296 00010000:00010000:1.0:1746155563.994448:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36800/0x844e5faceb5eaf9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10942 expref: 27 pid: 1625 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746155563.994460:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123671168 00000100:00100000:1.0:1746155563.994462:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123671168 00010000:00010000:1.0:1746155563.994470:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093615e00/0x844e5faceb5eafd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10973 expref: 18 pid: 19959 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746155563.994477:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5959 00000100:00100000:0.0:1746155563.994485:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123671040:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155563.994492:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5960 00010000:00010000:0.0:1746155563.994494:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155563.994498:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1963:x1830976123671296:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155563.994522:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.994522:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eafa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10950 expref: 31 pid: 1625 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155563.994531:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36800/0x844e5faceb5eaf9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10942 expref: 27 pid: 1625 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746155563.994532:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eafa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10950 expref: 31 pid: 1625 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155563.994539:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36800/0x844e5faceb5eaf9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10942 expref: 27 pid: 1625 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746155563.994577:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5961 00000100:00100000:2.0:1746155563.994583:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1963:x1830976123671168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155563.994589:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155563.995049:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eafa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10950 expref: 31 pid: 1625 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155563.995087:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36800/0x844e5faceb5eaf9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10942 expref: 27 pid: 1625 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155563.995097:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155563.995122:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093615e00/0x844e5faceb5eafd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10973 expref: 18 pid: 19959 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746155563.995132:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093615e00/0x844e5faceb5eafd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10973 expref: 18 pid: 19959 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746155563.995143:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093615e00/0x844e5faceb5eafd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10973 expref: 18 pid: 19959 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746155563.995168:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.995169:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155563.995176:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155563.995183:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155563.995230:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123671296:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 732us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155563.995236:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5960 00010000:00010000:2.0:1746155563.995306:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155563.995317:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124551936:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155563.995352:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00010000:00010000:0.0:1746155563.995387:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155563.995410:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123671040:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 926us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155563.995415:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5959 00000100:00100000:2.0:1746155563.999660:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124551936:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155563.999683:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155563.999723:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1963:x1830976123671168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5139us (5564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155563.999734:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5961 00000100:00100000:3.0:1746155564.000111:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123670528:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8832us (9090us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155564.000119:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4509 00002000:00100000:3.0:1746155564.000128:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009f881500 x1830976123670528/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.000141:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881500 with x1830976123670528 ext(1048576->2097151) 00002000:00010000:3.0:1746155564.000145:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f881500 00000100:00100000:3.0:1746155564.001326:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123670912:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7826us (8373us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155564.001333:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4510 00002000:00100000:3.0:1746155564.001339:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009f880000 x1830976123670912/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:634/0 lens 488/440 e 0 to 0 dl 1746155574 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.001346:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f880000 with x1830976123670912 ext(1048576->2097151) 00002000:00010000:3.0:1746155564.001349:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f880000 00000100:00100000:0.0:1746155564.002985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.003053:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123671552 00000100:00100000:3.0:1746155564.003059:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123671552 00002000:00100000:3.0:1746155564.003089:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3604480->3608575) req@ffff88009f880380 x1830976123671552/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.003096:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f880380 with x1830976123671552 ext(3604480->3608575) 00002000:00010000:3.0:1746155564.003100:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f880380 00000100:00100000:3.0:1746155564.003114:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4511 00000100:00100000:3.0:1746155564.003120:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123671552:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155564.003304:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123671552:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 182us (320us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155564.003310:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4511 00002000:00100000:3.0:1746155564.003315:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3604480->3608575) req@ffff88009f880380 x1830976123671552/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.003326:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f880380 with x1830976123671552 ext(3604480->3608575) 00002000:00010000:3.0:1746155564.003329:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f880380 00000100:00100000:0.0:1746155564.007638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.007731:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123671808 00000100:00100000:3.0:1746155564.007738:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123671808 00000100:00100000:3.0:1746155564.007797:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4006 00000100:00100000:3.0:1746155564.007807:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29033:x1830976123671808:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155564.008427:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29033:x1830976123671808:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 619us (795us total) trans 8589943890 rc 0/0 00000100:00100000:3.0:1746155564.008435:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4006 00000100:00100000:0.0:1746155564.014040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.014073:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.014154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.014215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.014290:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123672448 00000100:00100000:1.0:1746155564.014290:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123672064 00000100:00100000:3.0:1746155564.014299:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123672448 00000100:00100000:1.0:1746155564.014299:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123672064 00002000:00100000:3.0:1746155564.014336:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3608576->4194303) req@ffff88009f882680 x1830976123672448/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.014336:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009f883480 x1830976123672064/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.014345:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882680 with x1830976123672448 ext(3608576->4194303) 00002000:00100000:1.0:1746155564.014345:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f883480 with x1830976123672064 ext(2097152->3145727) 00002000:00010000:1.0:1746155564.014350:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f883480 00000100:00100000:1.0:1746155564.014370:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123672576 00000100:00100000:1.0:1746155564.014372:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123672576 00002000:00100000:1.0:1746155564.014383:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3211263) req@ffff88009f882d80 x1830976123672576/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 504/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746155564.014391:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123672832 00002000:00100000:1.0:1746155564.014392:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882d80 with x1830976123672576 ext(2097152->3211263) 00000100:00100000:2.0:1746155564.014394:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123672832 00002000:00010000:1.0:1746155564.014394:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f882d80 00000100:00100000:1.0:1746155564.014407:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4512 00002000:00100000:2.0:1746155564.014409:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (3211264->4194303) req@ffff88009f881c00 x1830976123672832/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155564.014413:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123672064:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:2.0:1746155564.014416:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881c00 with x1830976123672832 ext(3211264->4194303) 00002000:00010000:2.0:1746155564.014418:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f881c00 00000100:00100000:2.0:1746155564.014432:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4513 00000100:00100000:2.0:1746155564.014437:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1961:x1830976123672576:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155564.014660:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4514 00000100:00100000:1.0:1746155564.014665:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1960:x1830976123672832:12345-192.168.202.51@tcp:3:cat.0 00002000:00010000:3.0:1746155564.014674:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f882680 00000100:00100000:3.0:1746155564.014691:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4515 00000100:00100000:3.0:1746155564.014697:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123672448:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155564.020347:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123672448:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5640us (6264us total) trans 0 rc 585728/585728 00000100:00100000:3.0:1746155564.020358:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4515 00002000:00100000:3.0:1746155564.020368:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3608576->4194303) req@ffff88009f882680 x1830976123672448/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 585728/585728 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.020377:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882680 with x1830976123672448 ext(3608576->4194303) 00002000:00010000:3.0:1746155564.020383:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f882680 00000100:00100000:2.0:1746155564.028148:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123672576:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13702us (14027us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155564.028158:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4513 00002000:00100000:2.0:1746155564.028167:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3211263) req@ffff88009f882d80 x1830976123672576/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 504/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.028181:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882d80 with x1830976123672576 ext(2097152->3211263) 00002000:00010000:2.0:1746155564.028187:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f882d80 00000100:00100000:3.0:1746155564.030953:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123672064:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16531us (16911us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155564.030963:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4512 00002000:00100000:3.0:1746155564.030972:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009f883480 x1830976123672064/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.030981:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f883480 with x1830976123672064 ext(2097152->3145727) 00002000:00010000:3.0:1746155564.030986:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f883480 00000100:00100000:1.0:1746155564.035567:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123672832:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20892us (21342us total) trans 0 rc 983040/983040 00000100:00100000:1.0:1746155564.035578:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4514 00002000:00100000:1.0:1746155564.035588:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (3211264->4194303) req@ffff88009f881c00 x1830976123672832/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 983040/983040 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.035596:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881c00 with x1830976123672832 ext(3211264->4194303) 00002000:00010000:1.0:1746155564.035602:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f881c00 00000100:00100000:0.0:1746155564.041942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.042828:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123673088 00000100:00100000:3.0:1746155564.042838:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123673088 00000100:00100000:3.0:1746155564.042891:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9966 00000100:00100000:3.0:1746155564.042899:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29041:x1830976123673088:12345-192.168.202.51@tcp:101:cat.0 00000100:00080000:1.0:1746155564.043056:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746155564.043668:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.043686:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236800/0x844e5faceb5eb088 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109c7 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.043783:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237200/0x844e5faceb5eb08f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.043795:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237200/0x844e5faceb5eb08f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.043804:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237200/0x844e5faceb5eb08f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.043815:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb096 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.043820:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.043826:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.043920:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236c00/0x844e5faceb5eb09d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.043927:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236c00/0x844e5faceb5eb09d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.043932:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236c00/0x844e5faceb5eb09d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:3.0:1746155564.043938:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155564.044013:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237200/0x844e5faceb5eb08f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044019:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237200/0x844e5faceb5eb08f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044024:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237200/0x844e5faceb5eb08f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044029:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a237200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155564.044032:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237200/0x844e5faceb5eb08f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044037:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237200/0x844e5faceb5eb08f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044046:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155564.044048:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155564.044052:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237200/0x844e5faceb5eb08f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044060:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237200/0x844e5faceb5eb08f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044087:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044091:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb096 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044095:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb096 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044099:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a236600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155564.044101:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb096 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044105:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb096 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044111:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d55ac00) 00010000:00010000:3.0:1746155564.044113:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155564.044115:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb096 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044118:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb096 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.044149:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236800/0x844e5faceb5eb088 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c7 expref: 289 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.044160:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236c00/0x844e5faceb5eb09d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c7 expref: 288 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.044171:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155564.044172:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155564.044174:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a236c00, rc 0) 00000100:00100000:3.0:1746155564.044223:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29041:x1830976123673088:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1324us (2288us total) trans 8589943891 rc 0/0 00000100:00100000:3.0:1746155564.044229:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9966 00000100:00100000:0.0:1746155564.047042:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.047173:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123673344 00000100:00100000:1.0:1746155564.047180:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123673344 00002000:00100000:1.0:1746155564.047216:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009f883b80 x1830976123673344/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.047225:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f883b80 with x1830976123673344 ext(4194304->4956159) 00002000:00010000:1.0:1746155564.047229:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f883b80 00000100:00100000:1.0:1746155564.047447:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4516 00000100:00100000:1.0:1746155564.047454:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123673344:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155564.048490:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.048546:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123673472 00000100:00100000:2.0:1746155564.048551:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123673472 00000100:00100000:2.0:1746155564.048583:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11899 00000100:00100000:2.0:1746155564.048589:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123673472:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.048598:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.048623:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eb0ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109ce expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.048661:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124552064:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.048712:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.048755:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.048770:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123673600 00000100:00100000:2.0:1746155564.048772:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123673600 00000100:00100000:2.0:1746155564.048794:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11900 00000100:00100000:2.0:1746155564.048799:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123673600:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.048805:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.048813:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e37a00/0x844e5faceb5eb0b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109d5 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.048833:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124552192:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.048850:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b480 going to sleep for 11 seconds 00000100:00080000:2.0:1746155564.048904:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746155564.048906:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155564.051357:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124552064:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155564.051383:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eb0ab lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ce expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.051394:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36e00/0x844e5faceb5eb0ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ce expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155564.051532:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124552192:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155564.051547:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e37a00/0x844e5faceb5eb0b2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109d5 expref: 34 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.051556:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e37a00/0x844e5faceb5eb0b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109d5 expref: 34 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.051565:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e37a00, rc 0) 00000100:00100000:3.0:1746155564.051600:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123673600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2800us (2843us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155564.051619:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11900 00010000:00010000:2.0:1746155564.051766:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e36e00, rc 0) 00000100:00100000:2.0:1746155564.051794:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123673472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3205us (3305us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155564.051798:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11899 00000100:00100000:1.0:1746155564.053542:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123673344:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6085us (6502us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155564.053551:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4516 00002000:00100000:1.0:1746155564.053559:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009f883b80 x1830976123673344/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.053566:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f883b80 with x1830976123673344 ext(4194304->4956159) 00002000:00010000:1.0:1746155564.053572:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f883b80 00000100:00100000:0.0:1746155564.060813:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.060866:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123673856 00000100:00100000:3.0:1746155564.060877:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123673856 00000100:00100000:3.0:1746155564.060926:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4007 00000100:00100000:3.0:1746155564.060934:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29031:x1830976123673856:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155564.061114:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29031:x1830976123673856:12345-192.168.202.51@tcp:35:cat.0 Request processed in 181us (308us total) trans 8589943892 rc 0/0 00000100:00100000:3.0:1746155564.061120:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4007 00000100:00100000:0.0:1746155564.065383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.065418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.065445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.065483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.065528:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123674112 00000100:00100000:1.0:1746155564.065536:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123674112 00002000:00100000:1.0:1746155564.065574:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009f703800 x1830976123674112/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.065583:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703800 with x1830976123674112 ext(0->1048575) 00002000:00010000:1.0:1746155564.065588:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f703800 00000100:00100000:1.0:1746155564.065601:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123674368 00000100:00100000:1.0:1746155564.065618:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123674368 00002000:00100000:1.0:1746155564.065630:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009f700a80 x1830976123674368/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.065637:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700a80 with x1830976123674368 ext(1048576->2097151) 00000100:00100000:2.0:1746155564.065639:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123674752 00002000:00010000:1.0:1746155564.065640:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f700a80 00000100:00100000:2.0:1746155564.065643:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123674752 00000100:00100000:1.0:1746155564.065654:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123674880 00000100:00100000:1.0:1746155564.065656:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123674880 00000100:00100000:3.0:1746155564.065659:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4517 00002000:00100000:2.0:1746155564.065660:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009f700700 x1830976123674752/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.065666:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009f702d80 x1830976123674880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155564.065667:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976123674112:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:2.0:1746155564.065667:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700700 with x1830976123674752 ext(1048576->2097151) 00002000:00010000:2.0:1746155564.065670:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f700700 00002000:00100000:1.0:1746155564.065672:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f702d80 with x1830976123674880 ext(1048576->2097151) 00002000:00010000:1.0:1746155564.065675:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f702d80 00000100:00100000:2.0:1746155564.065682:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4518 00000100:00100000:2.0:1746155564.065686:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976123674368:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155564.065686:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4519 00000100:00100000:1.0:1746155564.065691:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123674752:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155564.066446:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4520 00000100:00100000:0.0:1746155564.066452:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123674880:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155564.080943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.081272:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123675008 00000100:00100000:2.0:1746155564.081280:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123675008 00000100:00100000:2.0:1746155564.082173:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11901 00000100:00100000:2.0:1746155564.082182:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:29036:x1830976123675008:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155564.082196:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.082209:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109dc expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.082233:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.082240:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155564.082241:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155564.082244:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2699264->3145727] (req 2699264->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 35 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.082270:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.082280:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 23 pid: 4461 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.082290:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124552320:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155564.082359:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155564.083439:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123674752:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17744us (17988us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155564.083448:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4519 00002000:00100000:1.0:1746155564.083456:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009f700700 x1830976123674752/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.083466:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700700 with x1830976123674752 ext(1048576->2097151) 00002000:00010000:1.0:1746155564.083471:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f700700 00000100:00100000:2.0:1746155564.085388:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124552320:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.085414:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2699264->3145727] (req 2699264->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.085428:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e37400, rc 0) 00000100:00100000:2.0:1746155564.085461:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:29036:x1830976123675008:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3280us (4524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.085468:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11901 00000100:00100000:0.0:1746155564.087361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.087887:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976123674112:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22219us (22510us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155564.087899:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4517 00002000:00100000:3.0:1746155564.087909:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009f703800 x1830976123674112/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.087917:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703800 with x1830976123674112 ext(0->1048575) 00002000:00010000:3.0:1746155564.087922:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f703800 00000100:00100000:3.0:1746155564.087938:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123675136 00000100:00100000:3.0:1746155564.087943:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123675136 00002000:00100000:3.0:1746155564.087964:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3608575) req@ffff88009b883480 x1830976123675136/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.087970:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883480 with x1830976123675136 ext(3145728->3608575) 00010000:00010000:3.0:1746155564.087976:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 24 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.087988:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 24 pid: 4461 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746155564.087993:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b883480 00000100:00100000:3.0:1746155564.088009:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 689 00000100:00100000:3.0:1746155564.088015:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123675136:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155564.090721:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1963:x1830976123674880:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24261us (25230us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155564.090732:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4520 00002000:00100000:2.0:1746155564.090740:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009f702d80 x1830976123674880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.090748:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f702d80 with x1830976123674880 ext(1048576->2097151) 00002000:00010000:2.0:1746155564.090752:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f702d80 00000100:00100000:3.0:1746155564.095173:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1962:x1830976123674368:12345-192.168.202.51@tcp:3:cat.0 Request processed in 29477us (29746us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155564.095186:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4518 00002000:00100000:3.0:1746155564.095195:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009f700a80 x1830976123674368/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.095203:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700a80 with x1830976123674368 ext(1048576->2097151) 00002000:00010000:3.0:1746155564.095208:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f700a80 00000100:00100000:1.0:1746155564.101786:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123675136:12345-192.168.202.51@tcp:4:cat.0 Request processed in 13762us (14421us total) trans 21474840552 rc 0/0 00000100:00100000:1.0:1746155564.101797:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 689 00002000:00100000:1.0:1746155564.101806:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3608575) req@ffff88009b883480 x1830976123675136/t21474840552(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/448 e 0 to 0 dl 1746155575 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.101814:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883480 with x1830976123675136 ext(3145728->3608575) 00010000:00010000:1.0:1746155564.101823:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 26 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155564.101836:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 26 pid: 4461 timeout: 793 lvb_type: 0 00002000:00010000:1.0:1746155564.101842:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b883480 00010000:00010000:2.0:1746155564.102794:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155564.110825:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.111311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.111373:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123675264 00000100:00100000:2.0:1746155564.111381:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123675264 00000100:00100000:2.0:1746155564.111417:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123675392 00000100:00100000:2.0:1746155564.111419:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123675392 00000100:00100000:2.0:1746155564.111440:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11902 00000100:00100000:2.0:1746155564.111447:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123675264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.111464:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155564.111476:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11903 00010000:00010000:2.0:1746155564.111477:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eb0c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109e3 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155564.111485:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123675392:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155564.111496:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.111526:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a065a800/0x844e5faceb5eb0c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109ea expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.111539:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124552448:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155564.111553:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124552576:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.111597:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155564.112368:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.113223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.113267:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123675520 00000100:00100000:3.0:1746155564.113273:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123675520 00010000:00010000:3.0:1746155564.113296:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 26 pid: 4461 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746155564.113321:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5962 00000100:00100000:3.0:1746155564.113327:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1961:x1830976123675520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155564.113337:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155564.113353:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 26 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.113364:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 26 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.113381:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155564.113382:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155564.113388:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.113394:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.113419:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.113427:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124552704:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155564.113472:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91000 going to sleep for 11 seconds 00010000:00010000:2.0:1746155564.114191:0:4461:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.51@tcp) returned -22 from glimpse AST (req@ffff88009f3edc00 x1830976124552448) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 26 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.114208:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36400/0x844e5faceb5eb081 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3608575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c0 expref: 26 pid: 4461 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.114231:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124552448:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155564.114250:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eb0c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109e3 expref: 32 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.114259:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37000/0x844e5faceb5eb0c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109e3 expref: 32 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.114266:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e37000, rc 0) 00000100:00100000:2.0:1746155564.114290:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123675264:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2844us (3473us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155564.114297:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11902 00000100:00100000:2.0:1746155564.114358:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124552704:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155564.114367:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155564.114391:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123675520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1064us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.114397:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5962 00000100:00100000:1.0:1746155564.114579:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124552576:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155564.114591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155564.114596:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a065a800/0x844e5faceb5eb0c7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ea expref: 34 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.114605:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a065a800/0x844e5faceb5eb0c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ea expref: 34 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.114656:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a065a800, rc 0) 00000100:00100000:3.0:1746155564.114676:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123675776 00000100:00100000:3.0:1746155564.114680:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123675776 00000100:00100000:1.0:1746155564.114681:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123675392:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3198us (3370us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155564.114687:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11903 00002000:00100000:3.0:1746155564.114701:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (2699264->2703359) req@ffff88009b880000 x1830976123675776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.114709:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880000 with x1830976123675776 ext(2699264->2703359) 00002000:00010000:3.0:1746155564.114712:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b880000 00000100:00100000:3.0:1746155564.114738:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4521 00000100:00100000:3.0:1746155564.114744:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123675776:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155564.114863:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123675776:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 119us (272us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155564.114869:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4521 00002000:00100000:3.0:1746155564.114874:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (2699264->2703359) req@ffff88009b880000 x1830976123675776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.114880:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880000 with x1830976123675776 ext(2699264->2703359) 00002000:00010000:3.0:1746155564.114883:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b880000 00000100:00100000:0.0:1746155564.119831:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.120298:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123676032 00000100:00100000:2.0:1746155564.120306:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123676032 00002000:00100000:2.0:1746155564.120342:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2699263) req@ffff88009b880700 x1830976123676032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.120352:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880700 with x1830976123676032 ext(2097152->2699263) 00002000:00010000:2.0:1746155564.120356:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b880700 00000100:00100000:2.0:1746155564.120873:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4522 00000100:00100000:2.0:1746155564.120881:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123676032:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155564.121913:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.122983:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123676160 00000100:00100000:1.0:1746155564.122992:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123676160 00000100:00100000:1.0:1746155564.123042:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11904 00000100:00100000:1.0:1746155564.123048:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:29036:x1830976123676160:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155564.123062:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.123075:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109f1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.123098:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.123105:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155564.123107:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155564.123110:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->2551807] (req 2097152->2551807) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.123134:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.123144:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 29 pid: 4461 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155564.123155:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124552832:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155564.123227:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155564.127288:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124552832:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155564.127317:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->2551807] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.127332:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a065b000, rc 0) 00000100:00100000:3.0:1746155564.127347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.127370:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:29036:x1830976123676160:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4321us (5456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.127377:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11904 00000100:00100000:2.0:1746155564.127679:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123676288 00000100:00100000:2.0:1746155564.127685:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123676288 00002000:00100000:2.0:1746155564.127717:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (3080192->3145727) req@ffff88009fac6a00 x1830976123676288/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.127725:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6a00 with x1830976123676288 ext(3080192->3145727) 00010000:00010000:2.0:1746155564.127732:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 30 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.127743:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 30 pid: 4461 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746155564.127748:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac6a00 00000100:00100000:2.0:1746155564.127770:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 690 00000100:00100000:2.0:1746155564.127776:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123676288:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155564.129251:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123676032:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8365us (9422us total) trans 0 rc 602112/602112 00000100:00100000:2.0:1746155564.129260:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4522 00002000:00100000:2.0:1746155564.129266:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2699263) req@ffff88009b880700 x1830976123676032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 602112/602112 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.129274:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880700 with x1830976123676032 ext(2097152->2699263) 00002000:00010000:2.0:1746155564.129278:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b880700 00000100:00100000:3.0:1746155564.131236:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123676288:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3455us (3885us total) trans 17179873169 rc 0/0 00000100:00100000:3.0:1746155564.131247:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 690 00002000:00100000:3.0:1746155564.131254:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (3080192->3145727) req@ffff88009fac6a00 x1830976123676288/t17179873169(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/448 e 0 to 0 dl 1746155575 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.131261:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6a00 with x1830976123676288 ext(3080192->3145727) 00010000:00010000:3.0:1746155564.131269:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 32 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.131281:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 32 pid: 4461 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746155564.131287:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac6a00 00000100:00100000:0.0:1746155564.133951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.134007:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123676416 00000100:00100000:1.0:1746155564.134014:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123676416 00000100:00100000:1.0:1746155564.134056:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11905 00000100:00100000:1.0:1746155564.134063:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:29041:x1830976123676416:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155564.134080:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.134094:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109f8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.134116:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155564.134121:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->2551807] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.134127:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746155564.134129:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f8 expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.134158:0:8436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->2551807] (req 2097152->2551807) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.134170:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f8 expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.134178:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb4400, rc 0) 00000100:00100000:1.0:1746155564.134220:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:29041:x1830976123676416:12345-192.168.202.51@tcp:101:cat.0 Request processed in 156us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.134224:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11905 00000100:00100000:0.0:1746155564.142033:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.142136:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123676544 00000100:00100000:2.0:1746155564.142144:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123676544 00010000:00010000:2.0:1746155564.142175:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 32 pid: 4461 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.142209:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5963 00000100:00100000:2.0:1746155564.142216:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1963:x1830976123676544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155564.142229:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155564.142252:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 32 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.142271:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 32 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.142290:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f292000/0x844e5faceb5eb07a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109b9 expref: 32 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.142319:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.142322:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.142328:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.142335:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.142362:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.142372:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 34 pid: 8436 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.142382:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124553088:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155564.143324:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.147549:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124553088:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155564.147568:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155564.147616:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1963:x1830976123676544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5390us (5581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.147626:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5963 00000100:00100000:0.0:1746155564.151316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.151406:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123676800 00000100:00100000:3.0:1746155564.151414:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123676800 00002000:00100000:3.0:1746155564.151448:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (2547712->2551807) req@ffff88009b880380 x1830976123676800/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.151456:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880380 with x1830976123676800 ext(2547712->2551807) 00010000:00010000:3.0:1746155564.151465:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 35 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.151477:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 35 pid: 8436 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746155564.151484:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b880380 00000100:00100000:3.0:1746155564.151533:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 691 00000100:00100000:3.0:1746155564.151541:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123676800:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155564.151696:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123676800:12345-192.168.202.51@tcp:3:cat.0 Request processed in 155us (387us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155564.151702:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 691 00002000:00100000:3.0:1746155564.151707:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (2547712->2551807) req@ffff88009b880380 x1830976123676800/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746155575 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.151714:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880380 with x1830976123676800 ext(2547712->2551807) 00010000:00010000:3.0:1746155564.151719:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 35 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.151727:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 35 pid: 8436 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746155564.151733:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b880380 00000100:00100000:0.0:1746155564.157715:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.158198:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.159150:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123677312 00000100:00100000:1.0:1746155564.159159:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123677312 00000100:00100000:1.0:1746155564.159210:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4008 00000100:00100000:1.0:1746155564.159218:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea57850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29036:x1830976123677312:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155564.159388:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea57850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29036:x1830976123677312:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 170us (1189us total) trans 8589943893 rc 0/0 00000100:00100000:1.0:1746155564.159396:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4008 00000100:00100000:2.0:1746155564.159911:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123677056 00000100:00100000:2.0:1746155564.159916:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123677056 00002000:00100000:2.0:1746155564.159939:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2551807) req@ffff88009b881f80 x1830976123677056/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.159947:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881f80 with x1830976123677056 ext(2097152->2551807) 00010000:00010000:2.0:1746155564.159954:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 35 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.159966:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 35 pid: 8436 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746155564.159972:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b881f80 00000100:00100000:2.0:1746155564.159995:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 692 00000100:00100000:2.0:1746155564.160000:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976123677056:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155564.168774:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976123677056:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8764us (11057us total) trans 17179873170 rc 0/0 00000100:00100000:2.0:1746155564.168787:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 692 00002000:00100000:2.0:1746155564.168796:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2551807) req@ffff88009b881f80 x1830976123677056/t17179873170(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/448 e 0 to 0 dl 1746155575 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.168806:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881f80 with x1830976123677056 ext(2097152->2551807) 00010000:00010000:2.0:1746155564.168814:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 37 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.168829:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 37 pid: 8436 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746155564.168836:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b881f80 00000100:00100000:0.0:1746155564.173814:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.173918:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123677440 00000100:00100000:2.0:1746155564.173925:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123677440 00010000:00010000:2.0:1746155564.173956:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 37 pid: 8436 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.173993:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5964 00000100:00100000:2.0:1746155564.174000:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1962:x1830976123677440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155564.174011:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155564.174029:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 37 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.174041:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 37 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.174060:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a065b000/0x844e5faceb5eb0ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2551807) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f1 expref: 37 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.174268:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.174271:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.174277:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f8 expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.174290:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f8 expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.174317:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f8 expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.174328:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124553216:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155564.175199:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.176632:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124553216:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155564.176652:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155564.176685:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123677440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2686us (2880us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.176694:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5964 00000100:00100000:0.0:1746155564.180756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.180793:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.180831:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.180910:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123677824 00000100:00100000:1.0:1746155564.180918:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123677824 00002000:00100000:1.0:1746155564.180955:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009b882d80 x1830976123677824/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.180964:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882d80 with x1830976123677824 ext(3145728->4194303) 00002000:00010000:1.0:1746155564.180969:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b882d80 00000100:00100000:1.0:1746155564.180982:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123677952 00000100:00100000:1.0:1746155564.180985:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123677952 00002000:00100000:1.0:1746155564.180995:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009b882680 x1830976123677952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.181001:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882680 with x1830976123677952 ext(2097152->3145727) 00002000:00010000:1.0:1746155564.181003:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b882680 00000100:00100000:1.0:1746155564.181011:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123678080 00000100:00100000:1.0:1746155564.181013:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123678080 00002000:00100000:1.0:1746155564.181020:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009b882300 x1830976123678080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.181026:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882300 with x1830976123678080 ext(3145728->4194303) 00002000:00010000:1.0:1746155564.181028:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b882300 00000100:00100000:1.0:1746155564.181040:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4523 00000100:00100000:1.0:1746155564.181049:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123677824:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155564.181430:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4524 00000100:00100000:2.0:1746155564.181438:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976123677952:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155564.181445:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4525 00000100:00100000:3.0:1746155564.181453:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976123678080:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155564.197097:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976123677952:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15653us (16296us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155564.197108:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4524 00002000:00100000:2.0:1746155564.197118:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009b882680 x1830976123677952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.197126:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882680 with x1830976123677952 ext(2097152->3145727) 00002000:00010000:2.0:1746155564.197131:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b882680 00000100:00100000:3.0:1746155564.199490:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976123678080:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18031us (18651us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155564.199499:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4525 00002000:00100000:3.0:1746155564.199529:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009b882300 x1830976123678080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.199536:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882300 with x1830976123678080 ext(3145728->4194303) 00002000:00010000:3.0:1746155564.199541:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b882300 00000100:00100000:1.0:1746155564.201432:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123677824:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20381us (20678us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155564.201440:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4523 00002000:00100000:1.0:1746155564.201448:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009b882d80 x1830976123677824/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.201455:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882d80 with x1830976123677824 ext(3145728->4194303) 00002000:00010000:1.0:1746155564.201459:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b882d80 00000100:00100000:0.0:1746155564.209711:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.209760:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123678464 00000100:00100000:2.0:1746155564.209769:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123678464 00002000:00100000:2.0:1746155564.209805:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009018ad80 x1830976123678464/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.209814:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018ad80 with x1830976123678464 ext(4194304->4956159) 00002000:00010000:2.0:1746155564.209818:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009018ad80 00000100:00100000:2.0:1746155564.210591:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4526 00000100:00100000:2.0:1746155564.210599:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123678464:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155564.215681:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123678464:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5073us (5967us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155564.215692:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4526 00002000:00100000:2.0:1746155564.215703:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009018ad80 x1830976123678464/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.215711:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018ad80 with x1830976123678464 ext(4194304->4956159) 00002000:00010000:2.0:1746155564.215716:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009018ad80 00000100:00100000:0.0:1746155564.238894:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.239997:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123678720 00000100:00100000:3.0:1746155564.240005:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123678720 00000100:00100000:3.0:1746155564.240107:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4009 00000100:00100000:3.0:1746155564.240115:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29041:x1830976123678720:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155564.240628:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29041:x1830976123678720:12345-192.168.202.51@tcp:35:cat.0 Request processed in 513us (1740us total) trans 8589943894 rc 0/0 00000100:00100000:3.0:1746155564.240635:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4009 00000100:00100000:0.0:1746155564.246754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.247114:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123678976 00000100:00100000:3.0:1746155564.247122:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123678976 00000100:00100000:3.0:1746155564.247916:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9967 00000100:00100000:3.0:1746155564.247926:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29046:x1830976123678976:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155564.247947:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.247963:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237200/0x844e5faceb5eb0dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f109ff expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.248057:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb0e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248068:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb0e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248077:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb0e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248088:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236a00/0x844e5faceb5eb0ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248094:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236a00/0x844e5faceb5eb0ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248099:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236a00/0x844e5faceb5eb0ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248188:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb0f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248194:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248200:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:3.0:1746155564.248206:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155564.248270:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb0e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248275:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb0e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248280:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb0e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248285:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a236600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155564.248288:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb0e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248294:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb0e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248302:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155564.248304:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155564.248307:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb0e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248312:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236600/0x844e5faceb5eb0e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248342:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236a00/0x844e5faceb5eb0ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248346:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236a00/0x844e5faceb5eb0ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248351:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236a00/0x844e5faceb5eb0ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248354:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a236a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155564.248357:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236a00/0x844e5faceb5eb0ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248361:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236a00/0x844e5faceb5eb0ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248366:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d55ad00) 00010000:00010000:3.0:1746155564.248368:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155564.248370:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236a00/0x844e5faceb5eb0ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248374:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236a00/0x844e5faceb5eb0ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.248404:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237200/0x844e5faceb5eb0dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ff expref: 13 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.248414:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ff expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.248420:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155564.248422:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155564.248424:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a236200, rc 0) 00000100:00100000:3.0:1746155564.248469:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29046:x1830976123678976:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 546us (1727us total) trans 8589943895 rc 0/0 00000100:00100000:3.0:1746155564.248475:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9967 00000100:00100000:0.0:1746155564.285266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.286717:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123679232 00000100:00100000:2.0:1746155564.286726:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123679232 00000100:00100000:2.0:1746155564.286773:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9968 00000100:00100000:2.0:1746155564.286826:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29049:x1830976123679232:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155564.286847:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.286862:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1c00/0x844e5faceb5eb0ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a06 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.286932:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.286943:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236c00/0x844e5faceb5eb09d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c7 expref: 291 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.286950:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb0f1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ff expref: 11 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.286955:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.286977:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ff expref: 11 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.286986:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb0f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ff expref: 11 pid: 19870 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.286996:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124553344:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.287057:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236c00/0x844e5faceb5eb09d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c7 expref: 291 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.287063:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236c00/0x844e5faceb5eb09d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c7 expref: 291 pid: 19870 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.287069:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124553472:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155564.287080:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.310414:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124553344:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155564.310427:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124553472:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.310447:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155564.311281:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.311318:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.311410:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123679360 00000100:00100000:2.0:1746155564.311416:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123679360 00000100:00100000:1.0:1746155564.311445:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123679488 00000100:00100000:1.0:1746155564.311449:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123679488 00010000:00010000:2.0:1746155564.311450:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb0f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ff expref: 12 pid: 19870 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155564.311463:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236c00/0x844e5faceb5eb09d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c7 expref: 292 pid: 19870 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.311494:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5965 00000100:00100000:2.0:1746155564.311530:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123679360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155564.311547:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155564.311552:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb0f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ff expref: 12 pid: 19870 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.311560:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ff expref: 12 pid: 19870 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.311577:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5eb0f1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ff expref: 12 pid: 19870 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155564.311743:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5966 00000100:00100000:1.0:1746155564.311750:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:1962:x1830976123679488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155564.311757:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155564.311761:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236c00/0x844e5faceb5eb09d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c7 expref: 292 pid: 19870 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155564.311768:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236c00/0x844e5faceb5eb09d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c7 expref: 292 pid: 19870 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155564.311779:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236c00/0x844e5faceb5eb09d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109c7 expref: 292 pid: 19870 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155564.311791:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155564.311795:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.311801:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.311806:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.311822:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155564.311856:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1962:x1830976123679488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 106us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.311862:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5966 00010000:00010000:2.0:1746155564.311969:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155564.311972:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155564.311992:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123679360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 491us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.311998:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5965 00010000:00010000:1.0:1746155564.312424:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.312430:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155564.312445:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155564.312573:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1c00/0x844e5faceb5eb0ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a06 expref: 292 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.312584:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a06 expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.312590:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155564.312592:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155564.312594:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ad1a00, rc 0) 00000100:00100000:1.0:1746155564.312626:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29049:x1830976123679232:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 25802us (27368us total) trans 8589943896 rc 0/0 00000100:00100000:1.0:1746155564.312632:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9968 00000100:00100000:0.0:1746155564.332225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.332302:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123679744 00000100:00100000:1.0:1746155564.332309:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123679744 00000100:00100000:1.0:1746155564.332353:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9969 00000100:00100000:1.0:1746155564.332359:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29052:x1830976123679744:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155564.332379:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.332393:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5400/0x844e5faceb5eb114 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a0d expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.332472:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb11b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332483:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb11b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332491:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb11b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332522:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5800/0x844e5faceb5eb122 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332528:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5800/0x844e5faceb5eb122 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332533:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5800/0x844e5faceb5eb122 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332634:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5a00/0x844e5faceb5eb129 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332641:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5a00/0x844e5faceb5eb129 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332647:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5a00/0x844e5faceb5eb129 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155564.332655:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155564.332721:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb11b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332727:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb11b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332732:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb11b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332736:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cb5600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155564.332739:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb11b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332744:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb11b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332751:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155564.332753:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155564.332756:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb11b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332760:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb11b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332769:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5800/0x844e5faceb5eb122 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332773:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5800/0x844e5faceb5eb122 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332777:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5800/0x844e5faceb5eb122 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332781:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cb5800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155564.332782:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5800/0x844e5faceb5eb122 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332786:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5800/0x844e5faceb5eb122 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332794:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800942dc200) 00010000:00010000:1.0:1746155564.332795:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155564.332797:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5800/0x844e5faceb5eb122 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332800:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5800/0x844e5faceb5eb122 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.332827:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5400/0x844e5faceb5eb114 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a0d expref: 14 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.332836:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5a00/0x844e5faceb5eb129 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a0d expref: 13 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.332841:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155564.332843:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155564.332845:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb5a00, rc 0) 00000100:00100000:1.0:1746155564.332886:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29052:x1830976123679744:12345-192.168.202.51@tcp:101:cat.0 Request processed in 526us (668us total) trans 8589943897 rc 0/0 00000100:00100000:1.0:1746155564.332892:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9969 00000100:00100000:2.0:1746155564.337495:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.337565:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.337619:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123680000 00000100:00100000:1.0:1746155564.337630:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123680000 00000100:00100000:3.0:1746155564.337699:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123679872 00000100:00100000:3.0:1746155564.337704:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123679872 00000100:00100000:1.0:1746155564.337708:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11906 00000100:00100000:1.0:1746155564.337719:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1963:x1830976123680000:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155564.337739:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.337754:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb137 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a1b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.337783:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.337786:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.337795:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a1b expref: 32 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.337811:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a1b expref: 32 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.337822:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb5800, rc 0) 00000100:00100000:1.0:1746155564.337894:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1963:x1830976123680000:12345-192.168.202.51@tcp:101:cat.0 Request processed in 175us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.337900:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11906 00000100:00100000:3.0:1746155564.337957:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11907 00000100:00100000:3.0:1746155564.337964:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123679872:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155564.337973:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.337981:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a237600/0x844e5faceb5eb13e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a14 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.338015:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124553600:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155564.339078:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.342005:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124553600:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155564.342032:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a237600/0x844e5faceb5eb13e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a14 expref: 26 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.342044:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a237600/0x844e5faceb5eb13e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a14 expref: 26 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.342073:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237600, rc 0) 00000100:00100000:3.0:1746155564.342108:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123679872:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4144us (4541us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155564.342115:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11907 00000100:00100000:0.0:1746155564.349723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.349827:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123680256 00000100:00100000:2.0:1746155564.349837:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123680256 00002000:00100000:2.0:1746155564.349877:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009018b480 x1830976123680256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.349887:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018b480 with x1830976123680256 ext(0->1048575) 00002000:00010000:2.0:1746155564.349892:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009018b480 00000100:00100000:2.0:1746155564.349925:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4527 00000100:00100000:2.0:1746155564.349933:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123680256:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155564.367014:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123680256:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17074us (17292us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155564.367026:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4527 00002000:00100000:2.0:1746155564.367036:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009018b480 x1830976123680256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.367045:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018b480 with x1830976123680256 ext(0->1048575) 00002000:00010000:2.0:1746155564.367050:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009018b480 00000100:00100000:0.0:1746155564.396375:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.396420:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.396456:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123680640 00000100:00100000:0.0:1746155564.396464:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123680640 00000100:00100000:0.0:1746155564.396532:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9970 00000100:00100000:0.0:1746155564.396540:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29055:x1830976123680640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155564.396560:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155564.396574:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6c00/0x844e5faceb5eb145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a29 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.396674:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5eb14c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396688:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5eb14c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396697:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5eb14c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396708:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6800/0x844e5faceb5eb153 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396712:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6800/0x844e5faceb5eb153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396717:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6800/0x844e5faceb5eb153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396800:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb15a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396808:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb15a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396813:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb15a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:0.0:1746155564.396820:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155564.396888:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5eb14c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396894:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5eb14c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396898:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5eb14c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396906:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909e6a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155564.396909:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5eb14c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396913:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5eb14c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396922:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155564.396924:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155564.396927:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5eb14c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396931:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5eb14c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396943:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6800/0x844e5faceb5eb153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396947:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6800/0x844e5faceb5eb153 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396951:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6800/0x844e5faceb5eb153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396954:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909e6800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155564.396956:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6800/0x844e5faceb5eb153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396960:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6800/0x844e5faceb5eb153 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396965:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a3fa1a00) 00010000:00010000:0.0:1746155564.396967:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155564.396969:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6800/0x844e5faceb5eb153 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.396973:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6800/0x844e5faceb5eb153 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.397002:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6c00/0x844e5faceb5eb145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a29 expref: 294 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.397012:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb15a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a29 expref: 293 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.397017:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155564.397019:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155564.397021:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909e7c00, rc 0) 00000100:00100000:0.0:1746155564.397056:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:29055:x1830976123680640:12345-192.168.202.51@tcp:101:cat.0 Request processed in 518us (635us total) trans 8589943898 rc 0/0 00000100:00100000:0.0:1746155564.397062:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9970 00000100:00100000:3.0:1746155564.397334:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123680384 00000100:00100000:3.0:1746155564.397339:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123680384 00000100:00100000:3.0:1746155564.397362:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11908 00000100:00100000:3.0:1746155564.397367:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:29052:x1830976123680384:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155564.397376:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.397384:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a22 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.397402:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.397408:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155564.397410:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155564.397412:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a22 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.397434:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.397443:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 30 pid: 4461 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746155564.397453:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124553728:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155564.397522:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.406203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.406255:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123680768 00000100:00100000:2.0:1746155564.406261:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123680768 00002000:00100000:2.0:1746155564.406292:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2699264->3145727) req@ffff880090188000 x1830976123680768/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.406300:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090188000 with x1830976123680768 ext(2699264->3145727) 00010000:00010000:2.0:1746155564.406307:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 31 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.406319:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 31 pid: 4461 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746155564.406324:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090188000 00000100:00100000:2.0:1746155564.406339:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 693 00000100:00100000:2.0:1746155564.406346:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123680768:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155564.406814:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124553728:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155564.406836:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a22 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.406858:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237c00, rc 0) 00000100:00100000:3.0:1746155564.406902:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29052:x1830976123680384:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9528us (10529us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155564.406908:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11908 00000100:00100000:0.0:1746155564.408067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.408105:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123680896 00000100:00100000:3.0:1746155564.408110:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123680896 00000100:00100000:3.0:1746155564.408140:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11909 00000100:00100000:3.0:1746155564.408146:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1962:x1830976123680896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155564.408154:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.408165:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5eb16f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a30 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.408199:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124553856:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155564.408249:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.417189:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976123680768:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10834us (10984us total) trans 21474840553 rc 0/0 00000100:00100000:2.0:1746155564.417199:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 693 00002000:00100000:2.0:1746155564.417209:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2699264->3145727) req@ffff880090188000 x1830976123680768/t21474840553(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/448 e 0 to 0 dl 1746155575 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.417217:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090188000 with x1830976123680768 ext(2699264->3145727) 00010000:00010000:2.0:1746155564.417225:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 35 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.417238:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 35 pid: 4461 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746155564.417245:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090188000 00000100:00100000:3.0:1746155564.423188:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124553856:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155564.423219:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5eb16f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a30 expref: 34 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.423230:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5eb16f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a30 expref: 34 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.423257:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237a00, rc 0) 00000100:00100000:3.0:1746155564.423306:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1962:x1830976123680896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 15159us (15240us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155564.423316:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11909 00000100:00100000:0.0:1746155564.430676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.430739:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123681024 00000100:00100000:3.0:1746155564.430747:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123681024 00000100:00100000:3.0:1746155564.430823:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11910 00000100:00100000:3.0:1746155564.430831:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:29055:x1830976123681024:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155564.430844:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.430857:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a37 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.430878:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155564.430880:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155564.430884:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4947968->4956159] (req 4947968->4956159) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a37 expref: 34 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.430893:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4947968->4956159] (req 4947968->4956159) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a37 expref: 34 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.430901:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237e00, rc 0) 00000100:00100000:3.0:1746155564.431318:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:29055:x1830976123681024:12345-192.168.202.51@tcp:101:cat.0 Request processed in 486us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155564.431324:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11910 00000100:00100000:0.0:1746155564.432412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.434794:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123681152 00000100:00100000:1.0:1746155564.434803:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123681152 00010000:00010000:1.0:1746155564.434840:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 34 pid: 4461 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155564.434874:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5967 00000100:00100000:1.0:1746155564.434882:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123681152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155564.434894:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155564.434914:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 34 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155564.434926:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 34 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155564.434951:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37400/0x844e5faceb5eb0b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2699264->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109dc expref: 34 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155564.434972:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.434974:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.434980:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a22 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.434987:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a22 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.434994:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.434996:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.434998:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4947968->4956159) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a37 expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.435004:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4947968->4956159) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a37 expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.435031:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4947968->4956159) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a37 expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155564.435042:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff18700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124553984:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155564.435118:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a22 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155564.435130:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124554112:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155564.435145:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.437716:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.437790:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123681280 00000100:00100000:3.0:1746155564.437797:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123681280 00000100:00100000:3.0:1746155564.437844:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11911 00000100:00100000:3.0:1746155564.437850:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:29049:x1830976123681280:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155564.437865:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.437879:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a3e expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.437903:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135689800/0x844e5faceb5eaf85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1092d expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.437910:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093615c00/0x844e5faceb5eafee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10988 expref: 37 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.437917:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2800/0x844e5faceb5eafb6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1095e expref: 15 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.437928:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155564.437930:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155564.437933:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 37 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.437955:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2800/0x844e5faceb5eafb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1095e expref: 15 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.437966:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2800/0x844e5faceb5eafb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1095e expref: 15 pid: 29728 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746155564.437981:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124554240:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155564.438046:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093615c00/0x844e5faceb5eafee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10988 expref: 37 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.438053:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093615c00/0x844e5faceb5eafee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10988 expref: 37 pid: 8437 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746155564.438060:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124554368:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155564.438079:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135689800/0x844e5faceb5eaf85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1092d expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.438085:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135689800/0x844e5faceb5eaf85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1092d expref: 31 pid: 8437 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746155564.438091:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124554496:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155564.438102:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155564.438316:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff18700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124553984:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155564.439998:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.440008:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124554112:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155564.440025:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155564.440065:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123681152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5183us (7653us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.440074:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5967 00000100:00100000:2.0:1746155564.440142:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123681536 00000100:00100000:2.0:1746155564.440148:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123681536 00002000:00100000:2.0:1746155564.440177:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4947968->4956159) req@ffff880090189180 x1830976123681536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.440185:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189180 with x1830976123681536 ext(4947968->4956159) 00002000:00010000:2.0:1746155564.440189:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090189180 00000100:00100000:2.0:1746155564.440202:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4528 00000100:00100000:2.0:1746155564.440208:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123681536:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155564.441414:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123681536:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1204us (1419us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1746155564.441424:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4528 00002000:00100000:2.0:1746155564.441429:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4947968->4956159) req@ffff880090189180 x1830976123681536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/8632 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 8192/8192 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.441436:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189180 with x1830976123681536 ext(4947968->4956159) 00002000:00010000:2.0:1746155564.441439:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090189180 00000100:00100000:1.0:1746155564.443831:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.443850:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123681664 00000100:00100000:1.0:1746155564.443856:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123681664 00010000:00010000:1.0:1746155564.443899:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2800/0x844e5faceb5eafb6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1095e expref: 16 pid: 29728 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746155564.443921:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5968 00000100:00100000:1.0:1746155564.443926:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1963:x1830976123681664:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155564.443938:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155564.443957:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2800/0x844e5faceb5eafb6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1095e expref: 16 pid: 29728 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.443966:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2800/0x844e5faceb5eafb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1095e expref: 16 pid: 29728 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.443984:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155564.444012:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1963:x1830976123681664:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 86us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.444017:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5968 00010000:00010000:3.0:1746155564.444069:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2800/0x844e5faceb5eafb6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1095e expref: 15 pid: 29728 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746155564.444090:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124554240:192.168.202.51@tcp:104: 00000100:00080000:2.0:1746155564.444367:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155564.446919:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.446959:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.447086:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124554368:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155564.447100:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124554496:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155564.447130:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 37 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.447145:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237800, rc 0) 00000100:00100000:2.0:1746155564.447481:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123681792 00000100:00100000:2.0:1746155564.447487:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123681792 00010000:00010000:2.0:1746155564.447527:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135689800/0x844e5faceb5eaf85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1092d expref: 32 pid: 8437 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746155564.447728:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123681920 00000100:00100000:2.0:1746155564.447732:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123681920 00010000:00010000:2.0:1746155564.447741:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093615c00/0x844e5faceb5eafee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10988 expref: 38 pid: 8437 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746155564.447747:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:29049:x1830976123681280:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 9894us (10035us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155564.447755:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11911 00000100:00100000:1.0:1746155564.447846:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5969 00000100:00100000:1.0:1746155564.447853:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123681792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155564.447864:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155564.447880:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135689800/0x844e5faceb5eaf85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1092d expref: 32 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.447888:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135689800/0x844e5faceb5eaf85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1092d expref: 32 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.447904:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135689800/0x844e5faceb5eaf85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1092d expref: 32 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.447914:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155564.447931:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1961:x1830976123681792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.447936:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5969 00000100:00100000:1.0:1746155564.447946:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5970 00000100:00100000:1.0:1746155564.447950:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1962:x1830976123681920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155564.447954:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155564.447959:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093615c00/0x844e5faceb5eafee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10988 expref: 37 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.447966:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093615c00/0x844e5faceb5eafee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10988 expref: 37 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.447975:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093615c00/0x844e5faceb5eafee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10988 expref: 37 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.447982:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.447983:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.447988:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 36 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.447995:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 36 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.448016:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 36 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155564.448518:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff18700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124554624:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155564.448571:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.448738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.448925:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123682048 00000100:00100000:0.0:1746155564.448929:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123682048 00000100:00100000:0.0:1746155564.448955:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11912 00000100:00100000:0.0:1746155564.448960:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1962:x1830976123682048:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155564.448975:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155564.448984:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909e6c00/0x844e5faceb5eb184 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a45 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155564.449010:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124554752:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155564.449047:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024300 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.449200:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.449214:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.449223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.449239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.449282:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123682304 00000100:00100000:3.0:1746155564.449286:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123682304 00002000:00100000:3.0:1746155564.449306:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009f3ee300 x1830976123682304/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.449314:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ee300 with x1830976123682304 ext(2097152->3145727) 00002000:00010000:3.0:1746155564.449318:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ee300 00000100:00100000:3.0:1746155564.449328:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123682560 00000100:00100000:3.0:1746155564.449330:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123682560 00002000:00100000:3.0:1746155564.449339:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009f3ef480 x1830976123682560/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.449346:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ef480 with x1830976123682560 ext(3145728->4194303) 00002000:00010000:3.0:1746155564.449348:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ef480 00000100:00100000:3.0:1746155564.449355:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123682816 00000100:00100000:3.0:1746155564.449357:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123682816 00000100:00100000:1.0:1746155564.449364:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123682944 00002000:00100000:3.0:1746155564.449367:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009f3edc00 x1830976123682816/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155564.449368:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123682944 00002000:00100000:3.0:1746155564.449373:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3edc00 with x1830976123682816 ext(2097152->3145727) 00002000:00010000:3.0:1746155564.449376:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3edc00 00002000:00100000:1.0:1746155564.449382:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009f3ed500 x1830976123682944/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.449389:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ed500 with x1830976123682944 ext(3145728->4194303) 00002000:00010000:1.0:1746155564.449392:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3ed500 00000100:00100000:3.0:1746155564.449393:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4529 00000100:00100000:3.0:1746155564.449398:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123682304:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155564.449403:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4530 00000100:00100000:1.0:1746155564.449407:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123682560:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155564.449438:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4531 00000100:00100000:1.0:1746155564.449442:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123682816:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155564.451240:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4532 00000100:00100000:1.0:1746155564.451250:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1960:x1830976123682944:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155564.458217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.458301:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124554752:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155564.458327:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800909e6c00/0x844e5faceb5eb184 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a45 expref: 38 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155564.458341:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909e6c00/0x844e5faceb5eb184 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a45 expref: 38 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155564.458355:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909e6c00, rc 0) 00000100:00100000:0.0:1746155564.458418:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1962:x1830976123682048:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9455us (9681us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155564.458426:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11912 00000100:00100000:0.0:1746155564.458453:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123683328 00000100:00100000:0.0:1746155564.458458:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123683328 00002000:00100000:0.0:1746155564.458482:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1810432->1814527) req@ffff880090189500 x1830976123683328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.458491:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189500 with x1830976123683328 ext(1810432->1814527) 00002000:00010000:0.0:1746155564.458495:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090189500 00000100:00100000:0.0:1746155564.458537:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4533 00000100:00100000:0.0:1746155564.458544:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976123683328:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155564.458668:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976123683328:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 124us (457us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155564.458674:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4533 00002000:00100000:0.0:1746155564.458678:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1810432->1814527) req@ffff880090189500 x1830976123683328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.458685:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189500 with x1830976123683328 ext(1810432->1814527) 00002000:00010000:0.0:1746155564.458688:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090189500 00000100:00100000:1.0:1746155564.466394:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff18700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124554624:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155564.466412:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155564.466459:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123681920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 18507us (19499us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.466468:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5970 00000100:00100000:1.0:1746155564.466755:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1961:x1830976123682816:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17311us (17530us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155564.466761:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4531 00002000:00100000:1.0:1746155564.466769:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009f3edc00 x1830976123682816/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.466778:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3edc00 with x1830976123682816 ext(2097152->3145727) 00002000:00010000:1.0:1746155564.466782:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3edc00 00000100:00100000:1.0:1746155564.470809:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123682560:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21390us (21582us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155564.470821:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4530 00002000:00100000:1.0:1746155564.470831:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009f3ef480 x1830976123682560/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.470840:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ef480 with x1830976123682560 ext(3145728->4194303) 00002000:00010000:1.0:1746155564.470845:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ef480 00000100:00100000:3.0:1746155564.471554:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123682304:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22153us (22351us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155564.471561:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4529 00002000:00100000:3.0:1746155564.471567:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009f3ee300 x1830976123682304/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.471575:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ee300 with x1830976123682304 ext(2097152->3145727) 00002000:00010000:3.0:1746155564.471578:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ee300 00000100:00100000:0.0:1746155564.474394:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.474437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.474631:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123683712 00000100:00100000:3.0:1746155564.474639:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123683712 00000100:00100000:2.0:1746155564.474663:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123683456 00000100:00100000:2.0:1746155564.474668:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123683456 00000100:00100000:3.0:1746155564.474678:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4010 00000100:00100000:3.0:1746155564.474684:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:29055:x1830976123683712:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155564.474693:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11913 00000100:00100000:2.0:1746155564.474697:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:29046:x1830976123683456:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155564.474707:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.474721:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a4c expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.474742:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135688600/0x844e5faceb5eaf93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10934 expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.474750:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093615600/0x844e5faceb5eafe0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1098f expref: 35 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.474756:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e36c00/0x844e5faceb5eafd2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10965 expref: 14 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.474762:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.474763:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.474766:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1687552->2097151] (req 1687552->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 34 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.474791:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e36c00/0x844e5faceb5eafd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10965 expref: 14 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.474800:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e36c00/0x844e5faceb5eafd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10965 expref: 14 pid: 29728 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746155564.474811:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124554880:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155564.474856:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1960:x1830976123682944:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23607us (25613us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746155564.474865:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093615600/0x844e5faceb5eafe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1098f expref: 35 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155564.474865:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4532 00002000:00100000:1.0:1746155564.474872:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009f3ed500 x1830976123682944/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746155564.474873:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093615600/0x844e5faceb5eafe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1098f expref: 35 pid: 8437 timeout: 793 lvb_type: 1 00002000:00100000:1.0:1746155564.474879:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ed500 with x1830976123682944 ext(3145728->4194303) 00000100:00100000:2.0:1746155564.474881:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124555008:192.168.202.51@tcp:104: 00002000:00010000:1.0:1746155564.474883:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3ed500 00010000:00010000:2.0:1746155564.474905:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135688600/0x844e5faceb5eaf93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10934 expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.474912:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135688600/0x844e5faceb5eaf93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10934 expref: 32 pid: 8437 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746155564.474919:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124555136:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155564.474935:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.475092:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29055:x1830976123683712:12345-192.168.202.51@tcp:35:cat.0 Request processed in 407us (653us total) trans 8589943899 rc 0/0 00000100:00100000:3.0:1746155564.475099:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4010 00000100:00100000:0.0:1746155564.477558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.477694:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123683840 00000100:00100000:1.0:1746155564.477701:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123683840 00000100:00100000:1.0:1746155564.477744:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11914 00000100:00100000:1.0:1746155564.477751:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:29049:x1830976123683840:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155564.477763:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.477777:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a53 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.477800:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.477802:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.477805:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [1048576->1482751] (req 1048576->1482751) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 37 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.477815:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [1048576->1482751] (req 1048576->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 37 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.477824:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb4a00, rc 0) 00000100:00100000:1.0:1746155564.477857:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:29049:x1830976123683840:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 106us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.477863:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11914 00000100:00100000:2.0:1746155564.480911:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124554880:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155564.481762:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124555008:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155564.481829:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.481860:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.481889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.481921:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123683968 00000100:00100000:0.0:1746155564.481927:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123683968 00000100:00100000:3.0:1746155564.481938:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123684224 00000100:00100000:3.0:1746155564.481941:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123684224 00010000:00010000:3.0:1746155564.481954:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135688600/0x844e5faceb5eaf93 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10934 expref: 33 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746155564.481954:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e36c00/0x844e5faceb5eafd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10965 expref: 15 pid: 29728 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746155564.481974:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123684096 00000100:00100000:3.0:1746155564.481976:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123684096 00000100:00100000:0.0:1746155564.481980:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5971 00010000:00010000:3.0:1746155564.481983:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093615600/0x844e5faceb5eafe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1098f expref: 37 pid: 8437 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746155564.481986:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1962:x1830976123684224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155564.481995:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5972 00010000:00010000:0.0:1746155564.481996:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155564.481999:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1962:x1830976123683968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155564.482004:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155564.482013:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e36c00/0x844e5faceb5eafd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10965 expref: 15 pid: 29728 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746155564.482013:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135688600/0x844e5faceb5eaf93 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10934 expref: 33 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746155564.482021:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135688600/0x844e5faceb5eaf93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10934 expref: 33 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155564.482034:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e36c00/0x844e5faceb5eafd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10965 expref: 15 pid: 29728 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746155564.482080:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5973 00000100:00100000:2.0:1746155564.482085:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1962:x1830976123684096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155564.482093:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155564.482402:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e36c00/0x844e5faceb5eafd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10965 expref: 15 pid: 29728 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155564.482420:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155564.482463:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1962:x1830976123683968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 462us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155564.482468:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5972 00010000:00010000:3.0:1746155564.482537:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135688600/0x844e5faceb5eaf93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10934 expref: 33 pid: 8437 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746155564.482545:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124555136:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155564.482570:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [1687552->2097151] (req 1687552->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.482579:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e21a200, rc 0) 00000100:00100000:3.0:1746155564.482597:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:29046:x1830976123683456:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7900us (8211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155564.482611:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11913 00010000:00010000:2.0:1746155564.483000:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093615600/0x844e5faceb5eafe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1098f expref: 37 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746155564.483008:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093615600/0x844e5faceb5eafe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1098f expref: 37 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746155564.483021:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093615600/0x844e5faceb5eafe0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1098f expref: 37 pid: 8437 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746155564.483046:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.483048:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.483054:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.483060:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.483067:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.483068:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.483071:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.483076:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.483097:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.483108:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124555264:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155564.483171:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.483179:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124555392:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155564.483196:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746155564.483493:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155564.483658:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1962:x1830976123684224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1669us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155564.483665:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5971 00000100:00100000:1.0:1746155564.483746:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.483884:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123684352 00000100:00100000:3.0:1746155564.483889:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123684352 00000100:00100000:2.0:1746155564.484229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.484244:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123684480 00000100:00100000:2.0:1746155564.484247:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123684480 00000100:00100000:2.0:1746155564.484291:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11915 00000100:00100000:2.0:1746155564.484297:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123684480:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.484309:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.484317:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6021000/0x844e5faceb5eb199 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a61 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.484344:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124555520:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.484370:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.484375:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11916 00000100:00100000:3.0:1746155564.484382:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1960:x1830976123684352:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155564.484390:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.484396:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800901f1400/0x844e5faceb5eb1a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a5a expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.484418:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124555648:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155564.484438:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.487689:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124555264:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155564.487698:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124555392:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155564.487714:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155564.487745:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123684096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5659us (5855us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.487753:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5973 00000100:00100000:0.0:1746155564.493997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.494568:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124555648:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155564.494596:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800901f1400/0x844e5faceb5eb1a0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a5a expref: 34 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.494619:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800901f1400/0x844e5faceb5eb1a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a5a expref: 34 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.494639:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800901f1400, rc 0) 00000100:00100000:3.0:1746155564.494675:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1960:x1830976123684352:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10294us (10929us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155564.494683:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11916 00000100:00100000:2.0:1746155564.494912:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124555520:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155564.494927:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6021000/0x844e5faceb5eb199 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a61 expref: 32 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.494936:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6021000/0x844e5faceb5eb199 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a61 expref: 32 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.494950:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6021000, rc 0) 00000100:00100000:2.0:1746155564.494969:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1961:x1830976123684480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10672us (10741us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155564.494975:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11915 00000100:00100000:1.0:1746155564.495102:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123684736 00000100:00100000:1.0:1746155564.495108:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123684736 00002000:00100000:1.0:1746155564.495137:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1687552->1691647) req@ffff8800948e5500 x1830976123684736/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.495145:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5500 with x1830976123684736 ext(1687552->1691647) 00002000:00010000:1.0:1746155564.495149:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e5500 00000100:00100000:1.0:1746155564.495164:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4534 00000100:00100000:1.0:1746155564.495171:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1960:x1830976123684736:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155564.495283:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1960:x1830976123684736:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 112us (1293us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155564.495288:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4534 00002000:00100000:1.0:1746155564.495293:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1687552->1691647) req@ffff8800948e5500 x1830976123684736/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.495299:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5500 with x1830976123684736 ext(1687552->1691647) 00002000:00010000:1.0:1746155564.495301:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e5500 00000100:00100000:0.0:1746155564.495640:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.495801:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123684992 00000100:00100000:2.0:1746155564.495805:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123684992 00002000:00100000:2.0:1746155564.495821:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3db:0x0] (1478656->1482751) req@ffff8800948e4700 x1830976123684992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.495828:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4700 with x1830976123684992 ext(1478656->1482751) 00002000:00010000:2.0:1746155564.495831:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e4700 00000100:00100000:2.0:1746155564.495843:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4535 00000100:00100000:2.0:1746155564.495848:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976123684992:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155564.495921:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976123684992:12345-192.168.202.51@tcp:3:cat.0 Request processed in 72us (282us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155564.495926:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4535 00002000:00100000:2.0:1746155564.495930:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3db:0x0] (1478656->1482751) req@ffff8800948e4700 x1830976123684992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.495936:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4700 with x1830976123684992 ext(1478656->1482751) 00002000:00010000:2.0:1746155564.495939:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e4700 00000100:00100000:0.0:1746155564.498771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.499185:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123685248 00000100:00100000:1.0:1746155564.499257:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123685248 00002000:00100000:1.0:1746155564.499295:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800948e4380 x1830976123685248/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.499303:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4380 with x1830976123685248 ext(4194304->4956159) 00002000:00010000:1.0:1746155564.499307:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e4380 00000100:00100000:1.0:1746155564.499336:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4536 00000100:00100000:1.0:1746155564.499344:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123685248:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155564.500122:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.500965:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123685376 00000100:00100000:2.0:1746155564.500971:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123685376 00000100:00100000:2.0:1746155564.501014:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11917 00000100:00100000:2.0:1746155564.501021:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+28:29046:x1830976123685376:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155564.501031:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.501046:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a68 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.501072:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36000/0x844e5faceb5eaf8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1093b expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.501080:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e21b000/0x844e5faceb5eaff5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10996 expref: 32 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.501086:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eafbd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1096c expref: 16 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.501091:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.501093:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.501096:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->1576959] (req 1048576->1576959) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 29 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.501121:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eafbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1096c expref: 16 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.501131:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eafbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1096c expref: 16 pid: 29728 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746155564.501142:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124555776:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.501208:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e21b000/0x844e5faceb5eaff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10996 expref: 32 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.501216:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e21b000/0x844e5faceb5eaff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10996 expref: 32 pid: 18270 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746155564.501223:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124555904:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.501242:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36000/0x844e5faceb5eaf8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1093b expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.501248:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36000/0x844e5faceb5eaf8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1093b expref: 29 pid: 1625 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746155564.501255:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124556032:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155564.501265:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.507578:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124555776:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155564.507590:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124555904:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155564.507597:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124556032:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.507633:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->1576959] (req 1048576->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 29 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.507648:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6021a00, rc 0) 00000100:00100000:2.0:1746155564.507686:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+29:29046:x1830976123685376:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6665us (7563us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.507693:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11917 00000100:00100000:0.0:1746155564.507759:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.507880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.507905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.507957:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123685504 00000100:00100000:3.0:1746155564.507964:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123685504 00010000:00010000:3.0:1746155564.507995:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eafbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1096c expref: 17 pid: 29728 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746155564.508013:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123685632 00000100:00100000:3.0:1746155564.508015:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123685632 00010000:00010000:3.0:1746155564.508023:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36000/0x844e5faceb5eaf8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1093b expref: 29 pid: 1625 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746155564.508041:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123685760 00000100:00100000:3.0:1746155564.508042:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123685760 00010000:00010000:3.0:1746155564.508050:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e21b000/0x844e5faceb5eaff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10996 expref: 33 pid: 18270 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746155564.508062:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5974 00000100:00100000:3.0:1746155564.508068:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1963:x1830976123685504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155564.508078:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155564.508094:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eafbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1096c expref: 17 pid: 29728 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155564.508102:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eafbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1096c expref: 17 pid: 29728 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155564.508120:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3600/0x844e5faceb5eafbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1096c expref: 17 pid: 29728 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155564.508131:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155564.508148:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5975 00000100:00100000:3.0:1746155564.508151:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1963:x1830976123685504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 84us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155564.508156:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5974 00000100:00100000:0.0:1746155564.508156:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123685632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155564.508163:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155564.508167:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5976 00000100:00100000:3.0:1746155564.508171:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123685760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155564.508173:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36000/0x844e5faceb5eaf8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1093b expref: 29 pid: 1625 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155564.508176:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155564.508181:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36000/0x844e5faceb5eaf8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1093b expref: 29 pid: 1625 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155564.508191:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e21b000/0x844e5faceb5eaff5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10996 expref: 33 pid: 18270 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746155564.508196:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e36000/0x844e5faceb5eaf8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1093b expref: 29 pid: 1625 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155564.508200:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e21b000/0x844e5faceb5eaff5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10996 expref: 33 pid: 18270 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155564.508210:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e21b000/0x844e5faceb5eaff5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10996 expref: 33 pid: 18270 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746155564.508211:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155564.508212:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155564.508218:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746155564.508292:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746155564.508346:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.508356:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155564.508370:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.508374:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123685760:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 202us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155564.508379:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5976 00000100:00100000:0.0:1746155564.508423:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124556160:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155564.508665:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.508992:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123685248:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9648us (10229us total) trans 0 rc 761856/761856 00000100:00100000:0.0:1746155564.508999:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4536 00002000:00100000:0.0:1746155564.509006:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800948e4380 x1830976123685248/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.509014:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4380 with x1830976123685248 ext(4194304->4956159) 00002000:00010000:0.0:1746155564.509018:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e4380 00000100:00100000:2.0:1746155564.512006:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124556160:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155564.512023:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155564.512056:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123685632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3901us (4176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.512064:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5975 00000100:00100000:0.0:1746155564.512634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.512669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.512718:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123685888 00000100:00100000:3.0:1746155564.512724:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123685888 00000100:00100000:2.0:1746155564.512729:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123686016 00000100:00100000:2.0:1746155564.512732:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123686016 00000100:00100000:3.0:1746155564.512751:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11918 00000100:00100000:3.0:1746155564.512757:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1960:x1830976123685888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155564.512770:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.512784:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800901f1000/0x844e5faceb5eb1ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a6f expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.512823:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124556288:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155564.512867:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.512898:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11919 00000100:00100000:2.0:1746155564.512904:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1960:x1830976123686016:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.512911:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.512919:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a000/0x844e5faceb5eb1b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a76 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.512942:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124556416:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.512964:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.514560:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124556288:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155564.514582:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800901f1000/0x844e5faceb5eb1ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a6f expref: 34 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.514598:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800901f1000/0x844e5faceb5eb1ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a6f expref: 34 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.514632:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800901f1000, rc 0) 00000100:00100000:3.0:1746155564.514824:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1960:x1830976123685888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2066us (2190us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155564.514831:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11918 00000100:00100000:3.0:1746155564.514880:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124556416:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155564.514896:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a000/0x844e5faceb5eb1b5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a76 expref: 32 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.514904:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a000/0x844e5faceb5eb1b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a76 expref: 32 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.514910:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3a000, rc 0) 00000100:00100000:3.0:1746155564.515080:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1960:x1830976123686016:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2175us (2409us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155564.515086:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11919 00000100:00100000:0.0:1746155564.517156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.517556:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123686272 00000100:00100000:2.0:1746155564.517564:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123686272 00002000:00100000:2.0:1746155564.517599:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1572864->1576959) req@ffff8800948e4000 x1830976123686272/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.517617:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4000 with x1830976123686272 ext(1572864->1576959) 00002000:00010000:2.0:1746155564.517622:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e4000 00000100:00100000:2.0:1746155564.517649:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4537 00000100:00100000:2.0:1746155564.517655:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123686272:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155564.518331:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123686272:12345-192.168.202.51@tcp:3:cat.0 Request processed in 673us (1177us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155564.518338:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4537 00002000:00100000:2.0:1746155564.518344:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1572864->1576959) req@ffff8800948e4000 x1830976123686272/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.518356:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4000 with x1830976123686272 ext(1572864->1576959) 00002000:00010000:2.0:1746155564.518359:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e4000 00000100:00100000:0.0:1746155564.518587:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.518644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.518685:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123686400 00000100:00100000:2.0:1746155564.518689:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123686400 00000100:00100000:2.0:1746155564.518707:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123686528 00000100:00100000:2.0:1746155564.518709:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123686528 00000100:00100000:2.0:1746155564.518720:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11920 00000100:00100000:2.0:1746155564.518725:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1962:x1830976123686400:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.518735:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.518750:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eb1bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a7d expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.518789:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124556544:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.518849:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.518873:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11921 00000100:00100000:3.0:1746155564.518881:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1962:x1830976123686528:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155564.518889:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.518896:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800901f0c00/0x844e5faceb5eb1c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a84 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.518924:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124556672:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155564.519049:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.520929:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124556544:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155564.520955:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eb1bc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a7d expref: 34 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155564.520971:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6020600/0x844e5faceb5eb1bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a7d expref: 34 pid: 4461 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155564.521101:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.521222:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123686784 00000100:00100000:3.0:1746155564.521227:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123686784 00000100:00100000:3.0:1746155564.521261:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4011 00000100:00100000:3.0:1746155564.521267:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29046:x1830976123686784:12345-192.168.202.51@tcp:35:multiop.0 00010000:00010000:0.0:1746155564.521437:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6020600, rc 0) 00000100:00100000:0.0:1746155564.521477:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1962:x1830976123686400:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2751us (2890us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155564.521483:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11920 00000100:00100000:3.0:1746155564.521777:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29046:x1830976123686784:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 510us (677us total) trans 8589943900 rc 0/0 00000100:00100000:3.0:1746155564.521784:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4011 00000100:00100000:3.0:1746155564.521813:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124556672:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155564.521826:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800901f0c00/0x844e5faceb5eb1c3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a84 expref: 32 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.521834:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800901f0c00/0x844e5faceb5eb1c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a84 expref: 32 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.521841:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800901f0c00, rc 0) 00000100:00100000:3.0:1746155564.521856:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1962:x1830976123686528:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2977us (3212us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155564.522178:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11921 00000100:00100000:0.0:1746155564.526920:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.528266:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123687040 00000100:00100000:3.0:1746155564.528275:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123687040 00000100:00100000:3.0:1746155564.528324:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4012 00000100:00100000:3.0:1746155564.528331:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29052:x1830976123687040:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155564.528628:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29052:x1830976123687040:12345-192.168.202.51@tcp:35:cat.0 Request processed in 297us (1714us total) trans 8589943901 rc 0/0 00000100:00100000:3.0:1746155564.528634:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4012 00000100:00100000:0.0:1746155564.592397:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.593840:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123687168 00000100:00100000:1.0:1746155564.593847:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123687168 00000100:00100000:1.0:1746155564.593899:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9971 00000100:00100000:1.0:1746155564.593910:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29060:x1830976123687168:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155564.593929:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.593943:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb1ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a8b expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.593988:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb1d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.593999:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.594007:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.594019:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5e00/0x844e5faceb5eb1d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.594024:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5e00/0x844e5faceb5eb1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.594029:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5e00/0x844e5faceb5eb1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.594112:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.594124:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a06 expref: 293 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.594129:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.594154:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a06 expref: 293 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.594164:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a06 expref: 293 pid: 15474 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155564.594174:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124556800:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155564.594254:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155564.596568:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124556800:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155564.596588:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155564.598453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.598526:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123687424 00000100:00100000:3.0:1746155564.598534:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123687424 00000100:00100000:3.0:1746155564.598581:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4013 00000100:00100000:3.0:1746155564.598589:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:7661:x1830976123687424:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155564.598785:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:7661:x1830976123687424:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 196us (335us total) trans 8589943902 rc 0/0 00000100:00100000:3.0:1746155564.598791:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4013 00000100:00100000:2.0:1746155564.602491:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.603195:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123687552 00000100:00100000:0.0:1746155564.603203:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123687552 00010000:00010000:0.0:1746155564.603232:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a06 expref: 295 pid: 15474 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746155564.603268:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5977 00000100:00100000:0.0:1746155564.603276:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1961:x1830976123687552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155564.603288:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155564.603294:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a06 expref: 295 pid: 15474 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746155564.603304:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a06 expref: 295 pid: 15474 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746155564.603323:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134ad1a00/0x844e5faceb5eb106 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a06 expref: 295 pid: 15474 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746155564.604659:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155564.604666:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.604674:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.604679:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.604709:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155564.604761:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1961:x1830976123687552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1484us (2275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155564.604769:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5977 00010000:00010000:2.0:1746155564.604834:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604840:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155564.604874:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155564.604878:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155564.604890:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604899:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604907:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604912:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb1d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604917:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb1d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604921:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cb5000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155564.604924:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb1d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604929:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb1d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604938:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155564.604940:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155564.604943:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb1d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604946:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb1d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604959:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5e00/0x844e5faceb5eb1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604963:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5e00/0x844e5faceb5eb1d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604967:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5e00/0x844e5faceb5eb1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604971:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cb5e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155564.604973:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5e00/0x844e5faceb5eb1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604977:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5e00/0x844e5faceb5eb1d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604982:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800942dc200) 00010000:00010000:2.0:1746155564.604984:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155564.604987:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5e00/0x844e5faceb5eb1d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.604990:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5e00/0x844e5faceb5eb1d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.605017:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb1ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a8b expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.605026:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a8b expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.605031:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155564.605033:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155564.605035:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb4000, rc 0) 00000100:00100000:2.0:1746155564.605058:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29060:x1830976123687168:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 11149us (12668us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.605064:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9971 00000100:00100000:2.0:1746155564.607386:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.607450:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123687808 00000100:00100000:0.0:1746155564.607457:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123687808 00000100:00100000:0.0:1746155564.607622:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9972 00000100:00100000:0.0:1746155564.607631:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29063:x1830976123687808:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155564.607650:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155564.607664:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7600/0x844e5faceb5eb1e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a92 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.607749:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5eb1ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607760:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5eb1ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607768:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5eb1ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607779:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6400/0x844e5faceb5eb1f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607784:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6400/0x844e5faceb5eb1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607788:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6400/0x844e5faceb5eb1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607872:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7400/0x844e5faceb5eb1fb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607879:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7400/0x844e5faceb5eb1fb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607885:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7400/0x844e5faceb5eb1fb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155564.607892:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155564.607956:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5eb1ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607962:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5eb1ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607966:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5eb1ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607970:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909e7e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155564.607973:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5eb1ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607978:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5eb1ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607987:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155564.607989:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155564.607991:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5eb1ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.607995:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5eb1ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.608003:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6400/0x844e5faceb5eb1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.608007:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6400/0x844e5faceb5eb1f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.608010:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6400/0x844e5faceb5eb1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.608013:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909e6400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155564.608015:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6400/0x844e5faceb5eb1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.608018:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6400/0x844e5faceb5eb1f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.608022:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801366f8d00) 00010000:00010000:0.0:1746155564.608024:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155564.608025:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6400/0x844e5faceb5eb1f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.608028:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6400/0x844e5faceb5eb1f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.608054:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7600/0x844e5faceb5eb1e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a92 expref: 297 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.608064:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7400/0x844e5faceb5eb1fb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a92 expref: 296 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.608070:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155564.608071:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155564.608074:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909e7400, rc 0) 00000100:00100000:0.0:1746155564.608109:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:29063:x1830976123687808:12345-192.168.202.51@tcp:101:cat.0 Request processed in 479us (729us total) trans 8589943903 rc 0/0 00000100:00100000:0.0:1746155564.608114:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9972 00000100:00100000:0.0:1746155564.608169:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.608211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.608223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.608233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.608245:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123687936 00000100:00100000:0.0:1746155564.608248:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123687936 00000100:00100000:0.0:1746155564.608263:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123688064 00000100:00100000:0.0:1746155564.608265:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123688064 00000100:00100000:0.0:1746155564.608273:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123688320 00000100:00100000:0.0:1746155564.608275:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123688320 00000100:00100000:0.0:1746155564.608284:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123688192 00000100:00100000:0.0:1746155564.608285:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123688192 00000100:00100000:0.0:1746155564.608294:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11922 00000100:00100000:0.0:1746155564.608299:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1960:x1830976123687936:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155564.608306:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155564.608314:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800909e6c00/0x844e5faceb5eb209 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10a99 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155564.608353:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124556928:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155564.608409:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.608440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.608747:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123688448 00000100:00100000:3.0:1746155564.608751:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123688448 00000100:00100000:3.0:1746155564.608771:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11923 00000100:00100000:3.0:1746155564.608776:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123688064:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155564.608783:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.608789:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800901f0e00/0x844e5faceb5eb210 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10aa0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.608811:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124557056:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155564.608843:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.608856:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11924 00000100:00100000:3.0:1746155564.608860:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123688320:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155564.608867:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.608875:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800901f0600/0x844e5faceb5eb217 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10aae expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.608889:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155564.608891:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155564.608897:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800901f0600/0x844e5faceb5eb217 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aae expref: 18 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.608907:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800901f0600/0x844e5faceb5eb217 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aae expref: 18 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.608914:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800901f0600, rc 0) 00000100:00100000:3.0:1746155564.608929:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1960:x1830976123688320:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 69us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155564.608935:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11924 00000100:00100000:3.0:1746155564.608945:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11925 00000100:00100000:3.0:1746155564.608949:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123688192:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155564.608954:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.608960:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800901f1c00/0x844e5faceb5eb21e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10aa7 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.608977:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124557184:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.608985:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11926 00000100:00100000:2.0:1746155564.608993:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1961:x1830976123688448:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:3.0:1746155564.608995:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91000 going to sleep for 11 seconds 00010000:00010000:2.0:1746155564.609000:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.609008:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0df800/0x844e5faceb5eb225 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ab5 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.609018:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.609019:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.609023:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0df800/0x844e5faceb5eb225 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ab5 expref: 19 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.609032:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0df800/0x844e5faceb5eb225 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ab5 expref: 19 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.609038:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0df800, rc 0) 00000100:00100000:2.0:1746155564.609055:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+19:1961:x1830976123688448:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 64us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.609060:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11926 00002000:00010000:3.0:1746155564.618657:0:20200:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155564 -> 1746155565 00002000:00010000:2.0:1746155564.618657:0:1625:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime: 1746155564 -> 1746155565 00002000:00010000:3.0:1746155564.618662:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155564 -> 1746155565 00002000:00010000:2.0:1746155564.618662:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime: 1746155564 -> 1746155565 00002000:00010000:3.0:1746155564.618664:0:20200:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155564 -> 1746155565 00002000:00010000:2.0:1746155564.618664:0:1625:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime: 1746155564 -> 1746155565 00000100:00100000:3.0:1746155564.618680:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124557184:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.618680:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124557056:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155564.618704:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800901f1c00/0x844e5faceb5eb21e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aa7 expref: 18 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.618704:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800901f0e00/0x844e5faceb5eb210 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aa0 expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.618715:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800901f1c00/0x844e5faceb5eb21e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aa7 expref: 18 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.618715:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800901f0e00/0x844e5faceb5eb210 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aa0 expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.618727:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800901f1c00, rc 0) 00000100:00100000:3.0:1746155564.618766:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123688192:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 9815us (10530us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155564.618773:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11925 00000100:00100000:3.0:1746155564.618862:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.618876:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123688576 00000100:00100000:3.0:1746155564.618881:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123688576 00000100:00100000:3.0:1746155564.618901:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11927 00000100:00100000:3.0:1746155564.618906:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123688576:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155564.618917:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.618925:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800901f1e00/0x844e5faceb5eb22c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10abc expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.618956:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124557312:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155564.619146:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800901f0e00, rc 0) 00000100:00100000:2.0:1746155564.619168:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123688064:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 10388us (10953us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155564.619173:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11923 00000100:00100000:3.0:1746155564.619363:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.619690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.619741:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123688704 00000100:00100000:2.0:1746155564.619744:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123688704 00000100:00100000:2.0:1746155564.619770:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11928 00000100:00100000:2.0:1746155564.619775:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123688704:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.619781:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.619788:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eb233 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ac3 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.619808:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124557440:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.619849:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b480 going to sleep for 11 seconds 00002000:00010000:1.0:1746155564.620013:0:18270:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155564 -> 1746155565 00002000:00010000:1.0:1746155564.620015:0:18270:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155564 -> 1746155565 00000100:00100000:1.0:1746155564.620024:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124556928:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155564.620037:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800909e6c00/0x844e5faceb5eb209 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a99 expref: 16 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.620044:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800909e6c00/0x844e5faceb5eb209 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a99 expref: 16 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.620066:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909e6c00, rc 0) 00000100:00100000:1.0:1746155564.620083:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1960:x1830976123687936:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 11784us (11914us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155564.620088:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11922 00000100:00100000:2.0:1746155564.620685:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124557312:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155564.620697:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800901f1e00/0x844e5faceb5eb22c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10abc expref: 37 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.620706:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800901f1e00/0x844e5faceb5eb22c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10abc expref: 37 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.620712:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800901f1e00, rc 0) 00000100:00100000:2.0:1746155564.620730:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123688576:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1824us (1868us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155564.620734:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11927 00000100:00100000:2.0:1746155564.621893:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124557440:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155564.621913:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eb233 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ac3 expref: 33 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.621923:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a0dfa00/0x844e5faceb5eb233 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ac3 expref: 33 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.621930:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0dfa00, rc 0) 00000100:00100000:2.0:1746155564.621998:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123688704:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2220us (2307us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155564.622003:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11928 00000100:00100000:2.0:1746155564.627323:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.627431:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123688960 00000100:00100000:1.0:1746155564.627438:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123688960 00000100:00100000:1.0:1746155564.627488:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9973 00000100:00100000:1.0:1746155564.627496:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29060:x1830976123688960:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155564.627530:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.627544:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4200/0x844e5faceb5eb23a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10aca expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.627633:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.627645:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a8b expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.627652:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7400/0x844e5faceb5eb1fb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a92 expref: 295 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.627657:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.627683:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7400/0x844e5faceb5eb1fb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a92 expref: 295 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.627692:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7400/0x844e5faceb5eb1fb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a92 expref: 295 pid: 15474 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155564.627703:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124557568:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155564.629530:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155564.630693:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a8b expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.630705:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a8b expref: 11 pid: 15474 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155564.630721:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124557696:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155564.630781:0:19870:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.630836:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123689216 00000100:00100000:2.0:1746155564.630842:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123689216 00002000:00100000:2.0:1746155564.630871:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1810431) req@ffff88009286f480 x1830976123689216/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.630878:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286f480 with x1830976123689216 ext(1048576->1810431) 00002000:00010000:2.0:1746155564.630989:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286f480 00000100:00100000:2.0:1746155564.631062:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4538 00000100:00100000:2.0:1746155564.631070:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1963:x1830976123689216:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155564.634345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.634350:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.635438:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123689728 00000100:00100000:0.0:1746155564.635444:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123689728 00000100:00100000:0.0:1746155564.635481:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9974 00000100:00100000:0.0:1746155564.635486:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:29065:x1830976123689728:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155564.635513:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155564.635526:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7800/0x844e5faceb5eb248 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ad1 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.635594:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.635612:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.635620:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155564.635635:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123689472 00000100:00100000:0.0:1746155564.635637:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123689472 00002000:00100000:0.0:1746155564.635655:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1482752->1490943) req@ffff88009286c380 x1830976123689472/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.635663:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286c380 with x1830976123689472 ext(1482752->1490943) 00002000:00010000:0.0:1746155564.635667:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286c380 00000100:00100000:0.0:1746155564.635678:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4539 00000100:00100000:0.0:1746155564.635682:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976123689472:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155564.635815:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976123689472:12345-192.168.202.51@tcp:3:cat.0 Request processed in 131us (1466us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1746155564.635820:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4539 00002000:00100000:0.0:1746155564.635824:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1482752->1490943) req@ffff88009286c380 x1830976123689472/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/8632 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 8192/8192 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.635830:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286c380 with x1830976123689472 ext(1482752->1490943) 00002000:00010000:0.0:1746155564.635832:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286c380 00000100:00100000:0.0:1746155564.635894:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.635908:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123689856 00000100:00100000:0.0:1746155564.635911:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123689856 00010000:00010000:0.0:1746155564.635923:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a8b expref: 12 pid: 15474 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746155564.635945:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5978 00000100:00100000:0.0:1746155564.635950:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123689856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155564.635956:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155564.635960:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a8b expref: 12 pid: 15474 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746155564.635967:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a8b expref: 12 pid: 15474 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746155564.635981:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155564.635985:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.635990:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.635994:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155564.636009:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123689856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 59us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155564.636013:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5978 00000100:00100000:0.0:1746155564.636044:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.636054:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123689984 00000100:00100000:0.0:1746155564.636057:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123689984 00010000:00010000:0.0:1746155564.636065:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7400/0x844e5faceb5eb1fb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a92 expref: 298 pid: 15474 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746155564.636085:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5979 00000100:00100000:0.0:1746155564.636089:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1960:x1830976123689984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155564.636095:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155564.636098:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7400/0x844e5faceb5eb1fb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a92 expref: 298 pid: 15474 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746155564.636105:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7400/0x844e5faceb5eb1fb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a92 expref: 298 pid: 15474 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746155564.636115:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155564.636117:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.636122:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.636240:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7400/0x844e5faceb5eb1fb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a92 expref: 298 pid: 15474 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155564.636258:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124557568:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155564.636267:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4000/0x844e5faceb5eb1df lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a8b expref: 11 pid: 15474 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155564.636274:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124557696:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155564.638868:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155564.638880:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.638887:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155564.638891:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155564.638938:0:19870:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.641269:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155564.641323:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1960:x1830976123689984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5227us (5272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.641332:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5979 00010000:00010000:1.0:1746155564.641384:0:19870:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.641392:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:1.0:1746155564.641406:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155564.641526:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.641532:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155564.641546:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155564.641660:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7800/0x844e5faceb5eb248 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad1 expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.641681:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad1 expref: 297 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.641687:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155564.641689:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155564.641691:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800909e6000, rc 0) 00000100:00100000:2.0:1746155564.641712:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29065:x1830976123689728:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6226us (7374us total) trans 8589943904 rc 0/0 00000100:00100000:2.0:1746155564.641718:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9974 00000100:00100000:2.0:1746155564.642228:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1963:x1830976123689216:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11158us (12701us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155564.642235:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4538 00002000:00100000:2.0:1746155564.642244:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1810431) req@ffff88009286f480 x1830976123689216/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.642252:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286f480 with x1830976123689216 ext(1048576->1810431) 00002000:00010000:2.0:1746155564.642256:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286f480 00010000:00010000:1.0:1746155564.642336:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4200/0x844e5faceb5eb23a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aca expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.642347:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aca expref: 11 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.642352:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155564.642354:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155564.642355:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb4c00, rc 0) 00000100:00100000:1.0:1746155564.642374:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29060:x1830976123688960:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 14880us (15057us total) trans 8589943905 rc 0/0 00000100:00100000:1.0:1746155564.642379:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9973 00000100:00100000:0.0:1746155564.648756:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.648814:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123690112 00000100:00100000:1.0:1746155564.648822:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123690112 00000100:00100000:1.0:1746155564.648874:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9975 00000100:00100000:1.0:1746155564.648881:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29060:x1830976123690112:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155564.648902:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.648915:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5e00/0x844e5faceb5eb264 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ad8 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.648978:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.648993:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aca expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.649000:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad1 expref: 296 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.649005:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 5/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.649029:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad1 expref: 296 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.649039:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad1 expref: 296 pid: 15474 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155564.649049:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124557824:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155564.649131:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aca expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.649139:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aca expref: 12 pid: 19870 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155564.650052:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124557952:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155564.650267:0:19870:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.652695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.652762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.652789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.652845:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123690240 00000100:00100000:2.0:1746155564.652853:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123690240 00000100:00100000:2.0:1746155564.652887:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11929 00000100:00100000:2.0:1746155564.652893:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:29063:x1830976123690240:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.652909:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.652923:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10adf expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.652945:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 37 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.652954:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.652959:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746155564.652962:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746155564.652964:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 5/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10adf expref: 37 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.652988:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.652998:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 30 pid: 4461 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.653009:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124558080:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155564.653050:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123690368 00000100:00100000:3.0:1746155564.653055:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123690368 00010000:00010000:3.0:1746155564.653074:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad1 expref: 297 pid: 15474 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.653077:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 37 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.653084:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 37 pid: 8436 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.653091:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124558208:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155564.653092:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123690496 00000100:00100000:3.0:1746155564.653094:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123690496 00010000:00010000:3.0:1746155564.653101:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aca expref: 13 pid: 19870 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.653106:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.653114:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5980 00000100:00100000:3.0:1746155564.653120:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1962:x1830976123690368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155564.653128:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155564.653133:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad1 expref: 297 pid: 15474 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.653141:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad1 expref: 297 pid: 15474 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.653158:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155564.653162:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00000100:00100000:1.0:1746155564.653167:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5981 00010000:00010000:3.0:1746155564.653168:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.653173:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00000100:00100000:1.0:1746155564.653174:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1963:x1830976123690496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155564.653177:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155564.653181:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155564.653185:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aca expref: 13 pid: 19870 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746155564.653197:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1962:x1830976123690368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 77us (434us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155564.653197:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aca expref: 13 pid: 19870 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746155564.653202:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5980 00010000:00010000:1.0:1746155564.653208:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155564.653211:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.653217:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.653222:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.653232:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155564.653246:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1963:x1830976123690496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 73us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.653250:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5981 00010000:00010000:1.0:1746155564.653281:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6000/0x844e5faceb5eb24f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad1 expref: 296 pid: 15474 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155564.653295:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124557824:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155564.653303:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4c00/0x844e5faceb5eb241 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aca expref: 12 pid: 19870 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746155564.653310:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976124557952:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155564.653323:0:19870:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.653332:0:19870:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.653336:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:1.0:1746155564.653379:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:1.0:1746155564.653383:0:19870:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155564.653396:0:19870:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155564.653419:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5e00/0x844e5faceb5eb264 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad8 expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.653428:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad8 expref: 11 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.653434:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155564.653436:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155564.653438:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb4e00, rc 0) 00000100:00100000:1.0:1746155564.653458:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29060:x1830976123690112:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4578us (4710us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.653463:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9975 00000100:00100000:2.0:1746155564.656549:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124558080:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155564.656778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.656831:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123690752 00000100:00100000:2.0:1746155564.656836:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123690752 00000100:00100000:2.0:1746155564.656875:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11930 00000100:00100000:2.0:1746155564.656880:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123690752:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155564.656894:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.656906:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a0de200/0x844e5faceb5eb279 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ae6 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.656944:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124558336:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.657338:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.658183:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.658379:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123691008 00000100:00100000:1.0:1746155564.658383:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123691008 00000100:00100000:1.0:1746155564.658418:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11931 00000100:00100000:1.0:1746155564.658423:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123691008:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155564.658432:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.658441:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb280 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10af4 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155564.658466:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124558464:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.658529:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124558208:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.658549:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10adf expref: 37 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.658559:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94c800, rc 0) 00000100:00100000:2.0:1746155564.658903:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:29063:x1830976123690240:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6009us (6213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.658909:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11929 00000100:00100000:1.0:1746155564.659050:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.662187:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.662231:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.662324:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123690880 00000100:00100000:2.0:1746155564.662332:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123690880 00000100:00100000:3.0:1746155564.662460:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123690624 00000100:00100000:3.0:1746155564.662464:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123690624 00002000:00100000:3.0:1746155564.662489:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1687552->2097151) req@ffff88009286f100 x1830976123690624/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.662498:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286f100 with x1830976123690624 ext(1687552->2097151) 00010000:00010000:3.0:1746155564.662535:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 31 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.662547:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 31 pid: 4461 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746155564.662553:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009286f100 00000100:00100000:3.0:1746155564.662571:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 694 00000100:00100000:3.0:1746155564.662578:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1962:x1830976123690624:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155564.662699:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11932 00000100:00100000:2.0:1746155564.662705:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1961:x1830976123690880:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155564.662714:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.662728:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c94ce00/0x844e5faceb5eb287 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10aed expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.662767:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124558592:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.662838:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b480 going to sleep for 11 seconds 00002000:00010000:2.0:1746155564.662866:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155564 -> 1746155565 00000100:00100000:2.0:1746155564.663067:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124558336:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155564.663087:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a0de200/0x844e5faceb5eb279 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ae6 expref: 18 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.663096:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0de200/0x844e5faceb5eb279 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ae6 expref: 18 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.663107:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a0de200, rc 0) 00000100:00100000:2.0:1746155564.663126:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1961:x1830976123690752:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 6246us (6349us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155564.663132:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11930 00000100:00100000:2.0:1746155564.663955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.664170:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124558464:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155564.664187:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb280 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10af4 expref: 18 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.664197:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cb5600/0x844e5faceb5eb280 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10af4 expref: 18 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.664215:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb5600, rc 0) 00000100:00100000:1.0:1746155564.664235:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123691008:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5812us (6053us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155564.664240:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11931 00000100:00100000:0.0:1746155564.664301:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123691136 00000100:00100000:0.0:1746155564.664305:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123691136 00002000:00100000:0.0:1746155564.664321:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1482751) req@ffff88009f3edf80 x1830976123691136/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.664327:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3edf80 with x1830976123691136 ext(1048576->1482751) 00010000:00010000:0.0:1746155564.664332:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 37 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746155564.664339:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 37 pid: 8436 timeout: 793 lvb_type: 0 00002000:00010000:0.0:1746155564.664344:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f3edf80 00000100:00100000:0.0:1746155564.664355:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 695 00000100:00100000:0.0:1746155564.664359:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976123691136:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155564.672656:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.672817:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123691264 00000100:00100000:1.0:1746155564.672826:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123691264 00000100:00100000:1.0:1746155564.672917:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11933 00000100:00100000:1.0:1746155564.672925:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29065:x1830976123691264:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155564.672940:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.672956:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10afb expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.672982:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37c00/0x844e5faceb5eaf7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10926 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.672993:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca58000/0x844e5faceb5eafe7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10981 expref: 33 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.673000:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e21aa00/0x844e5faceb5eafcb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10957 expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.673005:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.673007:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.673010:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [151552->520191] (req 151552->520191) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.673033:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e21aa00/0x844e5faceb5eafcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10957 expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.673042:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e21aa00/0x844e5faceb5eafcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10957 expref: 16 pid: 8438 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746155564.673051:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124558720:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155564.673627:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca58000/0x844e5faceb5eafe7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10981 expref: 33 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.673635:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca58000/0x844e5faceb5eafe7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10981 expref: 33 pid: 1625 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746155564.673642:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124558848:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155564.673980:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37c00/0x844e5faceb5eaf7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10926 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155564.673989:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37c00/0x844e5faceb5eaf7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10926 expref: 25 pid: 1625 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746155564.673996:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124558976:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155564.674153:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.676664:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124558592:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155564.676691:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c94ce00/0x844e5faceb5eb287 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aed expref: 16 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.676702:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c94ce00/0x844e5faceb5eb287 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aed expref: 16 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.676717:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94ce00, rc 0) 00000100:00100000:2.0:1746155564.676760:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123690880:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 14054us (14579us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155564.676767:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11932 00000100:00100000:1.0:1746155564.709893:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124558720:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155564.709939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.709956:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123691648 00000100:00100000:1.0:1746155564.709961:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123691648 00010000:00010000:1.0:1746155564.709988:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e21aa00/0x844e5faceb5eafcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10957 expref: 17 pid: 8438 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746155564.710084:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124558848:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155564.710093:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124558976:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155564.710117:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [151552->520191] (req 151552->520191) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.710130:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb4800, rc 0) 00000100:00100000:1.0:1746155564.710360:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5982 00000100:00100000:1.0:1746155564.710368:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123691648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155564.710389:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:29065:x1830976123691264:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 37464us (37740us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155564.710396:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11933 00000100:00100000:3.0:1746155564.710402:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.710414:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123691904 00000100:00100000:3.0:1746155564.710417:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123691904 00010000:00010000:3.0:1746155564.710429:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37c00/0x844e5faceb5eaf7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10926 expref: 26 pid: 1625 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746155564.710443:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5983 00000100:00100000:3.0:1746155564.710448:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123691904:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155564.710457:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155564.710474:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37c00/0x844e5faceb5eaf7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10926 expref: 26 pid: 1625 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155564.710483:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37c00/0x844e5faceb5eaf7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10926 expref: 26 pid: 1625 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155564.710521:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e37c00/0x844e5faceb5eaf7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10926 expref: 26 pid: 1625 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746155564.710533:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155564.710548:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123691904:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 100us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155564.710553:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5983 00000100:00100000:0.0:1746155564.710574:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155564.710622:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155564.710631:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e21aa00/0x844e5faceb5eafcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10957 expref: 17 pid: 8438 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.710638:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e21aa00/0x844e5faceb5eafcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10957 expref: 17 pid: 8438 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.710649:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e21aa00/0x844e5faceb5eafcb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10957 expref: 17 pid: 8438 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.710672:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155564.710687:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1960:x1830976123691648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 320us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.710692:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5982 00000100:00100000:1.0:1746155564.710700:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123691776 00000100:00100000:1.0:1746155564.710702:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123691776 00010000:00010000:1.0:1746155564.710709:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca58000/0x844e5faceb5eafe7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10981 expref: 33 pid: 1625 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746155564.711114:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5984 00000100:00100000:1.0:1746155564.711119:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123691776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155564.711126:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155564.711133:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca58000/0x844e5faceb5eafe7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10981 expref: 33 pid: 1625 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.711141:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca58000/0x844e5faceb5eafe7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10981 expref: 33 pid: 1625 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.711151:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca58000/0x844e5faceb5eafe7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10981 expref: 33 pid: 1625 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746155564.711162:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.711163:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155564.711169:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.711180:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155564.711202:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155564.711212:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124559104:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155564.712903:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.720363:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.720407:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123691520 00000100:00100000:3.0:1746155564.720417:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123691520 00000100:00100000:3.0:1746155564.720459:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9976 00000100:00100000:3.0:1746155564.720466:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29060:x1830976123691520:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:2.0:1746155564.721813:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124559104:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155564.721826:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155564.721859:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123691776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10739us (11285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.721866:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5984 00000100:00100000:2.0:1746155564.721951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.722004:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123692160 00000100:00100000:2.0:1746155564.722007:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123692160 00002000:00100000:2.0:1746155564.722029:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (151552->155647) req@ffff88009f3ee680 x1830976123692160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.722037:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ee680 with x1830976123692160 ext(151552->155647) 00002000:00010000:2.0:1746155564.722041:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ee680 00000100:00100000:2.0:1746155564.722054:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4540 00000100:00100000:2.0:1746155564.722059:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123692160:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155564.722140:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123692160:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 81us (189us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155564.722145:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4540 00010000:00010000:3.0:1746155564.722149:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746155564.722150:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (151552->155647) req@ffff88009f3ee680 x1830976123692160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.722156:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ee680 with x1830976123692160 ext(151552->155647) 00002000:00010000:2.0:1746155564.722158:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ee680 00010000:00010000:3.0:1746155564.722165:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb295 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b02 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.722233:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb29c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.722245:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb29c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.722254:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb29c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.722273:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb29c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.722278:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb29c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.722284:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb29c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.722289:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e21b600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155564.722292:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb29c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.722296:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb29c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.722304:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155564.722306:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155564.722308:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb29c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.722312:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb29c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.722333:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb295 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b02 expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.722339:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb295 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b02 expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.722344:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e21b800, rc 0) 00000100:00100000:3.0:1746155564.722362:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29060:x1830976123691520:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1897us (2006us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155564.722368:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9976 00000100:00100000:0.0:1746155564.727311:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1962:x1830976123690624:12345-192.168.202.51@tcp:4:cat.0 Request processed in 64725us (65071us total) trans 17179873171 rc 0/0 00000100:00100000:0.0:1746155564.727323:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 694 00002000:00100000:0.0:1746155564.727333:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1687552->2097151) req@ffff88009286f100 x1830976123690624/t17179873171(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/448 e 0 to 0 dl 1746155575 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.727342:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286f100 with x1830976123690624 ext(1687552->2097151) 00010000:00010000:0.0:1746155564.727350:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 33 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746155564.727371:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 33 pid: 4461 timeout: 793 lvb_type: 0 00002000:00010000:0.0:1746155564.727378:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009286f100 00000100:00100000:1.0:1746155564.728100:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976123691136:12345-192.168.202.51@tcp:4:cat.0 Request processed in 63738us (64144us total) trans 17179873172 rc 0/0 00000100:00100000:1.0:1746155564.728106:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 695 00002000:00100000:1.0:1746155564.728111:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1482751) req@ffff88009f3edf80 x1830976123691136/t17179873172(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/448 e 0 to 0 dl 1746155575 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.728118:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3edf80 with x1830976123691136 ext(1048576->1482751) 00010000:00010000:1.0:1746155564.728123:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 39 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155564.728130:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 39 pid: 8436 timeout: 793 lvb_type: 0 00002000:00010000:1.0:1746155564.728135:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f3edf80 00000100:00100000:0.0:1746155564.734647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.734727:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123692288 00000100:00100000:2.0:1746155564.734735:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123692288 00010000:00010000:2.0:1746155564.734766:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 33 pid: 4461 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.734836:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5985 00000100:00100000:2.0:1746155564.734843:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1963:x1830976123692288:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155564.734855:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155564.734875:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 33 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.734885:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 33 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.734905:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e21a200/0x844e5faceb5eb18b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1490944->18446744073709551615] (req 1687552->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a4c expref: 33 pid: 4461 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.735614:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155564.735876:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1963:x1830976123692288:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1032us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.735883:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5985 00000100:00100000:3.0:1746155564.736803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.738393:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123692672 00000100:00100000:0.0:1746155564.738403:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123692672 00000100:00100000:0.0:1746155564.738452:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4014 00000100:00100000:0.0:1746155564.738459:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29060:x1830976123692672:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:0.0:1746155564.738669:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:29060:x1830976123692672:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 210us (1866us total) trans 8589943906 rc 0/0 00000100:00100000:0.0:1746155564.738676:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4014 00000100:00100000:0.0:1746155564.739261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.740217:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.740292:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123692800 00000100:00100000:2.0:1746155564.740297:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123692800 00010000:00010000:2.0:1746155564.740319:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 39 pid: 8436 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.742614:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5986 00000100:00100000:2.0:1746155564.742629:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976123692800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155564.742648:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155564.742671:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 39 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.742685:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 39 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.742704:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cb4a00/0x844e5faceb5eb192 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1490943] (req 1048576->1482751) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a53 expref: 39 pid: 8436 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.742718:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.742720:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.742725:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10adf expref: 38 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.742733:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10adf expref: 38 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.742760:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10adf expref: 38 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.742768:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124559232:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155564.742997:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123692928 00000100:00100000:1.0:1746155564.743003:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123692928 00002000:00100000:1.0:1746155564.743030:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d6:0x0] (516096->520191) req@ffff88009286c000 x1830976123692928/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.743045:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286c000 with x1830976123692928 ext(516096->520191) 00002000:00010000:1.0:1746155564.743049:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286c000 00000100:00100000:1.0:1746155564.743062:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4541 00000100:00100000:1.0:1746155564.743067:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123692928:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155564.743455:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b480 going to sleep for 11 seconds 00000100:00100000:1.0:1746155564.743551:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123692928:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 481us (4288us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155564.743558:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4541 00002000:00100000:1.0:1746155564.743563:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d6:0x0] (516096->520191) req@ffff88009286c000 x1830976123692928/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.743569:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286c000 with x1830976123692928 ext(516096->520191) 00002000:00010000:1.0:1746155564.743571:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286c000 00000100:00100000:0.0:1746155564.747903:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.747989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.748070:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124559232:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155564.748085:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155564.748119:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976123692800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5495us (7902us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.748132:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5986 00000100:00100000:3.0:1746155564.748279:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123693440 00000100:00100000:3.0:1746155564.748285:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123693440 00000100:00100000:3.0:1746155564.748312:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4015 00000100:00100000:1.0:1746155564.748313:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123693184 00000100:00100000:1.0:1746155564.748316:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123693184 00000100:00100000:3.0:1746155564.748318:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:29065:x1830976123693440:12345-192.168.202.51@tcp:35:multiop.0 00002000:00100000:1.0:1746155564.748337:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880090188700 x1830976123693184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.748345:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090188700 with x1830976123693184 ext(1048576->2097151) 00002000:00010000:1.0:1746155564.748350:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090188700 00000100:00100000:1.0:1746155564.748362:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4542 00000100:00100000:1.0:1746155564.748367:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976123693184:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155564.748455:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29065:x1830976123693440:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 137us (465us total) trans 8589943907 rc 0/0 00000100:00100000:3.0:1746155564.748460:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4015 00000100:00100000:1.0:1746155564.757328:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.757552:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976123693184:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9183us (9655us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155564.757562:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4542 00002000:00100000:3.0:1746155564.757571:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880090188700 x1830976123693184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.757580:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090188700 with x1830976123693184 ext(1048576->2097151) 00002000:00010000:3.0:1746155564.757585:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090188700 00000100:00100000:3.0:1746155564.757619:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123693696 00000100:00100000:3.0:1746155564.757624:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123693696 00000100:00100000:3.0:1746155564.758031:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9977 00000100:00100000:3.0:1746155564.758039:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29067:x1830976123693696:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155564.758057:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.758072:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21aa00/0x844e5faceb5eb2a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b09 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.758156:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21a800/0x844e5faceb5eb2aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758167:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21a800/0x844e5faceb5eb2aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758178:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21a800/0x844e5faceb5eb2aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758187:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb2b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758191:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758196:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758273:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b000/0x844e5faceb5eb2b8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758280:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b000/0x844e5faceb5eb2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758286:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b000/0x844e5faceb5eb2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:3.0:1746155564.758292:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155564.758354:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21a800/0x844e5faceb5eb2aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758360:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21a800/0x844e5faceb5eb2aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758365:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21a800/0x844e5faceb5eb2aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758368:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e21a800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155564.758372:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21a800/0x844e5faceb5eb2aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758377:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21a800/0x844e5faceb5eb2aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758385:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155564.758387:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155564.758390:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21a800/0x844e5faceb5eb2aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758394:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21a800/0x844e5faceb5eb2aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758420:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758424:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb2b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758428:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb2b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758431:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e21b800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155564.758433:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb2b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758437:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb2b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758442:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d55a000) 00010000:00010000:3.0:1746155564.758444:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155564.758445:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb2b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758449:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b800/0x844e5faceb5eb2b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155564.758477:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21aa00/0x844e5faceb5eb2a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b09 expref: 18 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.758486:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b000/0x844e5faceb5eb2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b09 expref: 17 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.758491:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155564.758492:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155564.758494:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e21b000, rc 0) 00000100:00100000:3.0:1746155564.758538:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29067:x1830976123693696:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 501us (1218us total) trans 8589943908 rc 0/0 00000100:00100000:3.0:1746155564.758544:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9977 00000100:00100000:0.0:1746155564.764398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.764486:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123693952 00000100:00100000:2.0:1746155564.764494:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123693952 00000100:00100000:2.0:1746155564.764571:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9978 00000100:00100000:2.0:1746155564.764579:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29071:x1830976123693952:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.764598:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.764627:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539ca00/0x844e5faceb5eb2c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b10 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.764704:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539cc00/0x844e5faceb5eb2cd lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.764715:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539cc00/0x844e5faceb5eb2cd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155564.764724:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539cc00/0x844e5faceb5eb2cd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155564.764732:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155564.764843:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539ca00/0x844e5faceb5eb2c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b10 expref: 20 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.764868:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539cc00/0x844e5faceb5eb2cd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b10 expref: 19 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.764876:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155564.764879:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746155564.764882:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a539cc00, rc 0) 00000100:00100000:2.0:1746155564.764932:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29071:x1830976123693952:12345-192.168.202.51@tcp:101:cat.0 Request processed in 352us (543us total) trans 8589943909 rc 0/0 00000100:00100000:2.0:1746155564.764939:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9978 00000100:00100000:3.0:1746155564.765600:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.765653:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123694080 00000100:00100000:3.0:1746155564.765658:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123694080 00000100:00100000:3.0:1746155564.765690:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11934 00000100:00100000:3.0:1746155564.765698:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29063:x1830976123694080:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155564.765709:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.765721:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b17 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.765743:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.765750:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155564.765752:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155564.765755:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b17 expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.765782:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.765794:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 24 pid: 10591 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746155564.765805:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124559360:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155564.765866:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.768599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.768636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.768666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.768756:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123694208 00000100:00100000:1.0:1746155564.768763:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123694208 00000100:00100000:1.0:1746155564.768788:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123694336 00000100:00100000:1.0:1746155564.768790:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123694336 00000100:00100000:1.0:1746155564.768801:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123694464 00000100:00100000:1.0:1746155564.768802:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123694464 00000100:00100000:1.0:1746155564.768813:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11935 00000100:00100000:1.0:1746155564.768819:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123694208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155564.768831:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.768845:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094caf400/0x844e5faceb5eb2e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b1e expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155564.768883:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124559488:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155564.768940:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155564.768955:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11936 00000100:00100000:1.0:1746155564.768960:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1960:x1830976123694336:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155564.768966:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155564.768974:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094cafa00/0x844e5faceb5eb2e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b25 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.769035:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11937 00000100:00100000:2.0:1746155564.769042:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1961:x1830976123694464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.769048:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.769055:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a539ce00/0x844e5faceb5eb2f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b2c expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.769064:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.769066:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.769071:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a539ce00/0x844e5faceb5eb2f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b2c expref: 35 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.769085:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a539ce00/0x844e5faceb5eb2f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b2c expref: 35 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.769093:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a539ce00, rc 0) 00000100:00100000:2.0:1746155564.769115:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1961:x1830976123694464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 74us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.769120:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11937 00000100:00100000:1.0:1746155564.770655:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124559616:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155564.770721:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.771044:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124559360:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.771072:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b17 expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.771088:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e21b600, rc 0) 00000100:00100000:2.0:1746155564.771112:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:29063:x1830976123694080:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5415us (5514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.771121:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11934 00000100:00100000:1.0:1746155564.771390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.771453:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123694592 00000100:00100000:3.0:1746155564.771463:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123694592 00002000:00100000:3.0:1746155564.771494:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1576959) req@ffff88008ff19880 x1830976123694592/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.771524:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff19880 with x1830976123694592 ext(1048576->1576959) 00010000:00010000:3.0:1746155564.771530:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 27 pid: 10591 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.771540:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 27 pid: 10591 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746155564.771546:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ff19880 00000100:00100000:3.0:1746155564.771563:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 696 00000100:00100000:3.0:1746155564.771568:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123694592:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155564.782940:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124559616:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155564.782969:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094cafa00/0x844e5faceb5eb2e9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b25 expref: 34 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155564.782985:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094cafa00/0x844e5faceb5eb2e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b25 expref: 34 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155564.782998:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cafa00, rc 0) 00000100:00100000:0.0:1746155564.783030:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1960:x1830976123694336:12345-192.168.202.51@tcp:101:cat.0 Request processed in 14069us (14392us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155564.783037:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11936 00002000:00010000:2.0:1746155564.783328:0:20200:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime: 1746155564 -> 1746155565 00002000:00010000:2.0:1746155564.783332:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime: 1746155564 -> 1746155565 00002000:00010000:2.0:1746155564.783333:0:20200:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime: 1746155564 -> 1746155565 00000100:00100000:2.0:1746155564.783345:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124559488:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155564.783360:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094caf400/0x844e5faceb5eb2e2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b1e expref: 28 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.783369:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094caf400/0x844e5faceb5eb2e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b1e expref: 28 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.783378:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094caf400, rc 0) 00000100:00100000:2.0:1746155564.783399:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123694208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 14579us (14804us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155564.783404:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11935 00000100:00100000:1.0:1746155564.791161:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.791579:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123694720 00000100:00100000:2.0:1746155564.791589:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123694720 00000100:00100000:2.0:1746155564.791643:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11938 00000100:00100000:2.0:1746155564.791651:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+27:29071:x1830976123694720:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.791664:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.791677:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b33 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.791700:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.791712:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155564.791713:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155564.791716:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b33 expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.791740:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.791750:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 32 pid: 18270 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.791759:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124559744:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155564.791817:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.792641:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123694592:12345-192.168.202.51@tcp:4:cat.0 Request processed in 21070us (21249us total) trans 21474840554 rc 0/0 00000100:00100000:3.0:1746155564.792653:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 696 00002000:00100000:3.0:1746155564.792660:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1576959) req@ffff88008ff19880 x1830976123694592/t21474840554(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/448 e 0 to 0 dl 1746155575 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.792668:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff19880 with x1830976123694592 ext(1048576->1576959) 00010000:00010000:3.0:1746155564.792674:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 29 pid: 10591 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.792683:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 29 pid: 10591 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746155564.792689:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ff19880 00000100:00100000:2.0:1746155564.796366:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124559744:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.796391:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b33 expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.796406:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a539d200, rc 0) 00000100:00100000:2.0:1746155564.796461:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+28:29071:x1830976123694720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4808us (5306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.796469:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11938 00000100:00100000:0.0:1746155564.799360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.799439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.799674:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123694848 00000100:00100000:3.0:1746155564.799681:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123694848 00002000:00100000:3.0:1746155564.799715:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d6:0x0] (151552->520191) req@ffff88012b6c0a80 x1830976123694848/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.799724:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c0a80 with x1830976123694848 ext(151552->520191) 00010000:00010000:3.0:1746155564.799732:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 33 pid: 18270 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.799743:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 33 pid: 18270 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746155564.799750:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b6c0a80 00000100:00100000:3.0:1746155564.799767:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 697 00000100:00100000:3.0:1746155564.799773:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123694848:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155564.800634:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123694976 00000100:00100000:2.0:1746155564.800638:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123694976 00010000:00010000:2.0:1746155564.800659:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 28 pid: 10591 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746155564.800693:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5987 00000100:00100000:2.0:1746155564.800699:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123694976:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155564.800708:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155564.800721:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 28 pid: 10591 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.800730:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 28 pid: 10591 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.800749:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6021a00/0x844e5faceb5eb1a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1576959) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a68 expref: 28 pid: 10591 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746155564.800763:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.800765:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.800770:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b17 expref: 34 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.800777:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b17 expref: 34 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.800802:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b17 expref: 34 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155564.800811:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124559872:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155564.800864:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.808533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.808783:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123695232 00000100:00100000:1.0:1746155564.808790:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123695232 00002000:00100000:1.0:1746155564.808826:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012b6c3800 x1830976123695232/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.808835:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c3800 with x1830976123695232 ext(1048576->2097151) 00002000:00010000:1.0:1746155564.808840:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c3800 00000100:00100000:1.0:1746155564.808868:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4543 00000100:00100000:1.0:1746155564.808877:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1963:x1830976123695232:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155564.811352:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124559872:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155564.811370:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155564.811404:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123694976:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10704us (12048us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155564.811413:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5987 00000100:00100000:1.0:1746155564.814219:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1963:x1830976123694848:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 14439us (14774us total) trans 21474840555 rc 0/0 00000100:00100000:1.0:1746155564.814229:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 697 00002000:00100000:1.0:1746155564.814238:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d6:0x0] (151552->520191) req@ffff88012b6c0a80 x1830976123694848/t21474840555(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/448 e 0 to 0 dl 1746155575 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.814246:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c0a80 with x1830976123694848 ext(151552->520191) 00010000:00010000:1.0:1746155564.814253:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 37 pid: 18270 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746155564.814267:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 37 pid: 18270 timeout: 793 lvb_type: 0 00002000:00010000:1.0:1746155564.814273:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b6c0a80 00000100:00100000:1.0:1746155564.833353:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1963:x1830976123695232:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 24469us (24819us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155564.833363:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4543 00002000:00100000:1.0:1746155564.833372:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012b6c3800 x1830976123695232/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.833381:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c3800 with x1830976123695232 ext(1048576->2097151) 00002000:00010000:1.0:1746155564.833386:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c3800 00000100:00100000:0.0:1746155564.834015:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.834066:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123695360 00000100:00100000:3.0:1746155564.834072:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123695360 00010000:00010000:3.0:1746155564.834095:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 35 pid: 18270 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746155564.834127:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5988 00000100:00100000:3.0:1746155564.834134:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123695360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155564.834144:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155564.834159:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 35 pid: 18270 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.834170:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 35 pid: 18270 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.834188:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb28e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 151552->520191) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10afb expref: 35 pid: 18270 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746155564.834213:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155564.834215:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155564.834221:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b33 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.834234:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b33 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.834261:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b33 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.834272:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124560000:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155564.834324:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.838560:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124560000:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155564.838584:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155564.838645:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123695360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4508us (4627us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155564.838656:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5988 00000100:00100000:0.0:1746155564.844342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.844369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.844391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.844417:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123695744 00000100:00100000:0.0:1746155564.844423:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123695744 00002000:00100000:0.0:1746155564.844457:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012b6c2a00 x1830976123695744/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.844465:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c2a00 with x1830976123695744 ext(0->1048575) 00002000:00010000:0.0:1746155564.844471:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c2a00 00000100:00100000:0.0:1746155564.844483:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123695872 00000100:00100000:0.0:1746155564.844485:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123695872 00002000:00100000:0.0:1746155564.844494:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012b6c2680 x1830976123695872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.844500:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c2680 with x1830976123695872 ext(2097152->3145727) 00002000:00010000:0.0:1746155564.844524:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c2680 00000100:00100000:0.0:1746155564.844533:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123696000 00000100:00100000:0.0:1746155564.844535:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123696000 00002000:00100000:0.0:1746155564.844545:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012b6c0000 x1830976123696000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.844595:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c0000 with x1830976123696000 ext(3145728->4194303) 00002000:00010000:0.0:1746155564.844597:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c0000 00000100:00100000:0.0:1746155564.844618:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4544 00000100:00100000:0.0:1746155564.844624:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123695744:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155564.845767:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4545 00000100:00100000:0.0:1746155564.845775:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1962:x1830976123695872:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155564.846768:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4546 00000100:00100000:0.0:1746155564.846775:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123696000:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155564.870005:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123695744:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25373us (25660us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155564.870015:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4544 00002000:00100000:2.0:1746155564.870024:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012b6c2a00 x1830976123695744/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.870033:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c2a00 with x1830976123695744 ext(0->1048575) 00002000:00010000:2.0:1746155564.870038:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c2a00 00000100:00100000:1.0:1746155564.871794:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123695872:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26015us (27418us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155564.871806:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4545 00002000:00100000:1.0:1746155564.871812:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012b6c2680 x1830976123695872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.871819:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c2680 with x1830976123695872 ext(2097152->3145727) 00002000:00010000:1.0:1746155564.871823:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c2680 00000100:00100000:0.0:1746155564.883177:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.883224:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123696256 00000100:00100000:2.0:1746155564.883231:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123696256 00000100:00100000:2.0:1746155564.883266:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11939 00000100:00100000:2.0:1746155564.883273:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+33:29071:x1830976123696256:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.883286:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.883300:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b3a expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.883320:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 37 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.883327:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155564.883329:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155564.883332:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b3a expref: 34 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.883358:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 37 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.883368:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 37 pid: 4461 timeout: 794 lvb_type: 0 00000100:00100000:2.0:1746155564.883380:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124560128:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155564.884726:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.884831:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976123696000:12345-192.168.202.51@tcp:3:cat.0 Request processed in 38051us (40434us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155564.884842:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4546 00002000:00100000:3.0:1746155564.884852:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012b6c0000 x1830976123696000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.884862:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c0000 with x1830976123696000 ext(3145728->4194303) 00002000:00010000:3.0:1746155564.884866:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c0000 00000100:00100000:2.0:1746155564.886992:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124560128:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.887015:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b3a expref: 34 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.887032:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a226e00, rc 0) 00000100:00100000:2.0:1746155564.887582:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+34:29071:x1830976123696256:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4307us (4411us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.887589:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11939 00000100:00100000:1.0:1746155564.888021:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.888333:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123696384 00000100:00100000:3.0:1746155564.888339:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123696384 00002000:00100000:3.0:1746155564.888374:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1810432->2097151) req@ffff88008ff1b100 x1830976123696384/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155564.888387:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1b100 with x1830976123696384 ext(1810432->2097151) 00010000:00010000:3.0:1746155564.888394:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 38 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746155564.888405:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 38 pid: 4461 timeout: 794 lvb_type: 0 00002000:00010000:3.0:1746155564.888410:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ff1b100 00000100:00100000:3.0:1746155564.888592:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 698 00000100:00100000:3.0:1746155564.888607:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976123696384:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155564.908569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.908625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.908647:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123696512 00000100:00100000:2.0:1746155564.908654:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123696512 00000100:00100000:2.0:1746155564.908683:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123696640 00000100:00100000:2.0:1746155564.908685:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123696640 00000100:00100000:2.0:1746155564.908698:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11940 00000100:00100000:2.0:1746155564.908704:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123696512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155564.908718:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.908732:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a227400/0x844e5faceb5eb305 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b41 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.908750:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.908752:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.908759:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a227400/0x844e5faceb5eb305 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b41 expref: 35 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.908774:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a227400/0x844e5faceb5eb305 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b41 expref: 35 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.908784:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a227400, rc 0) 00000100:00100000:3.0:1746155564.908885:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11941 00000100:00100000:3.0:1746155564.908893:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1963:x1830976123696640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155564.908900:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.908908:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca06c00/0x844e5faceb5eb30c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b48 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.908946:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124560256:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155564.909563:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1963:x1830976123696512:12345-192.168.202.51@tcp:101:cat.0 Request processed in 857us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.909569:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11940 00000100:00100000:3.0:1746155564.909635:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.912044:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976123696384:12345-192.168.202.51@tcp:4:cat.0 Request processed in 23440us (24018us total) trans 17179873173 rc 0/0 00000100:00100000:0.0:1746155564.912055:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 698 00002000:00100000:0.0:1746155564.912064:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1810432->2097151) req@ffff88008ff1b100 x1830976123696384/t17179873173(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/448 e 0 to 0 dl 1746155575 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.912072:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1b100 with x1830976123696384 ext(1810432->2097151) 00010000:00010000:0.0:1746155564.912080:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 42 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155564.912092:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 42 pid: 4461 timeout: 794 lvb_type: 0 00002000:00010000:0.0:1746155564.912098:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ff1b100 00000100:00100000:0.0:1746155564.921378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155564.921470:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123696768 00000100:00100000:2.0:1746155564.921479:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123696768 00000100:00100000:2.0:1746155564.921535:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11942 00000100:00100000:2.0:1746155564.921543:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+34:29067:x1830976123696768:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155564.921559:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155564.921575:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b4f expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.921610:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f8 expref: 41 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.921619:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a0df800/0x844e5faceb5eb225 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ab5 expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.921744:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb137 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a1b expref: 35 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.921753:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.921755:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.921759:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 35 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.921783:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a1b expref: 35 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.921793:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a1b expref: 35 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155564.921804:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124560384:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.922032:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a0df800/0x844e5faceb5eb225 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ab5 expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.922040:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a0df800/0x844e5faceb5eb225 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ab5 expref: 14 pid: 19959 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155564.922047:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124560512:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.922073:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f8 expref: 41 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.922081:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f8 expref: 41 pid: 8436 timeout: 794 lvb_type: 0 00000100:00100000:2.0:1746155564.922088:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124560640:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155564.922104:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155564.927747:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124560256:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155564.927781:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca06c00/0x844e5faceb5eb30c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b48 expref: 41 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.927794:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca06c00/0x844e5faceb5eb30c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b48 expref: 41 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.928439:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca06c00, rc 0) 00000100:00100000:3.0:1746155564.929833:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1963:x1830976123696640:12345-192.168.202.51@tcp:101:cat.0 Request processed in 20936us (21202us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155564.929841:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11941 00000100:00100000:0.0:1746155564.932836:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.932888:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.932955:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123696896 00000100:00100000:1.0:1746155564.932967:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123696896 00010000:00010000:1.0:1746155564.933003:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb137 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a1b expref: 36 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:1.0:1746155564.933031:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123697024 00000100:00100000:1.0:1746155564.933033:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123697024 00010000:00010000:1.0:1746155564.933048:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a0df800/0x844e5faceb5eb225 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ab5 expref: 15 pid: 19959 timeout: 794 lvb_type: 1 00000100:00100000:1.0:1746155564.933068:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5989 00000100:00100000:1.0:1746155564.933074:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1963:x1830976123696896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155564.933084:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155564.933104:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb137 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a1b expref: 36 pid: 8436 timeout: 794 lvb_type: 1 00010000:00010000:1.0:1746155564.933113:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a1b expref: 36 pid: 8436 timeout: 794 lvb_type: 1 00010000:00010000:1.0:1746155564.933136:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155564.933174:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1963:x1830976123696896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 100us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.933179:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5989 00000100:00100000:1.0:1746155564.933195:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5990 00000100:00100000:1.0:1746155564.933199:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1963:x1830976123697024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155564.933203:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155564.933209:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a0df800/0x844e5faceb5eb225 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ab5 expref: 15 pid: 19959 timeout: 794 lvb_type: 1 00010000:00010000:1.0:1746155564.933220:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a0df800/0x844e5faceb5eb225 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ab5 expref: 15 pid: 19959 timeout: 794 lvb_type: 1 00010000:00010000:1.0:1746155564.933228:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155564.933242:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1963:x1830976123697024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155564.933247:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5990 00010000:00010000:2.0:1746155564.933374:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb137 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a1b expref: 35 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155564.933387:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124560384:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.933399:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a0df800/0x844e5faceb5eb225 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ab5 expref: 14 pid: 19959 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155564.933405:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124560512:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155564.933411:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124560640:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155564.933433:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 34 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.933445:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a227800, rc 0) 00000100:00100000:2.0:1746155564.933460:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+34:29067:x1830976123696768:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 11919us (12091us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.933469:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11942 00000100:00100000:0.0:1746155564.935101:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.935305:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123697152 00000100:00100000:3.0:1746155564.935311:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123697152 00010000:00010000:3.0:1746155564.935330:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 40 pid: 4461 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155564.935347:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5991 00000100:00100000:3.0:1746155564.935351:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976123697152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155564.935359:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155564.935372:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 40 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746155564.935380:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 40 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746155564.935395:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5eb17d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a3e expref: 40 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746155564.935407:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155564.935409:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155564.935414:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b3a expref: 33 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.935426:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b3a expref: 33 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.935452:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b3a expref: 33 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.935461:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124560768:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155564.935525:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.935700:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.935754:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123697408 00000100:00100000:1.0:1746155564.935757:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123697408 00002000:00100000:1.0:1746155564.935779:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4947967) req@ffff88013089b480 x1830976123697408/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.935787:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089b480 with x1830976123697408 ext(4194304->4947967) 00002000:00010000:1.0:1746155564.935790:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089b480 00000100:00100000:1.0:1746155564.935802:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4547 00000100:00100000:1.0:1746155564.935807:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123697408:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155564.940281:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123697408:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4466us (4574us total) trans 0 rc 753664/753664 00000100:00100000:1.0:1746155564.940293:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4547 00002000:00100000:1.0:1746155564.940302:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4947967) req@ffff88013089b480 x1830976123697408/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.940310:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089b480 with x1830976123697408 ext(4194304->4947967) 00002000:00010000:1.0:1746155564.940315:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089b480 00000100:00100000:0.0:1746155564.956152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.956184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155564.956240:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123697792 00000100:00100000:1.0:1746155564.956248:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123697792 00000100:00100000:2.0:1746155564.956287:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123697536 00000100:00100000:2.0:1746155564.956291:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123697536 00002000:00100000:1.0:1746155564.956291:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880130898e00 x1830976123697792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.956301:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898e00 with x1830976123697792 ext(1048576->2097151) 00002000:00010000:1.0:1746155564.956305:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130898e00 00000100:00100000:2.0:1746155564.956317:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11943 00000100:00100000:2.0:1746155564.956323:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976123697536:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155564.956330:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4548 00010000:00010000:2.0:1746155564.956335:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155564.956335:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1960:x1830976123697792:12345-192.168.202.51@tcp:3:multiop.0 00010000:00010000:2.0:1746155564.956348:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a226a00/0x844e5faceb5eb31a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b56 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155564.956366:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.956367:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155564.956375:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a226a00/0x844e5faceb5eb31a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b56 expref: 41 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.956388:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a226a00/0x844e5faceb5eb31a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b56 expref: 41 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155564.956397:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a226a00, rc 0) 00000100:00100000:2.0:1746155564.956433:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976123697536:12345-192.168.202.51@tcp:101:cat.0 Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155564.956439:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11943 00000100:00100000:3.0:1746155564.957161:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124560768:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155564.957176:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155564.957213:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976123697152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 21859us (22114us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155564.957220:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5991 00000100:00100000:0.0:1746155564.957891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.957919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.957951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.957971:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123698304 00000100:00100000:0.0:1746155564.957974:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123698304 00010000:00010000:0.0:1746155564.957990:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f8 expref: 40 pid: 8436 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155564.958006:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5992 00000100:00100000:0.0:1746155564.958011:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1962:x1830976123698304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155564.958019:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155564.958034:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f8 expref: 40 pid: 8436 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155564.958043:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f8 expref: 40 pid: 8436 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155564.958058:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb0d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109f8 expref: 40 pid: 8436 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155564.958071:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155564.958072:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155564.958076:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 34 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.958083:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 34 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.958105:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 34 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155564.958116:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124560896:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155564.958165:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.958419:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123697920 00000100:00100000:2.0:1746155564.958423:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123697920 00002000:00100000:2.0:1746155564.958441:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88013089a680 x1830976123697920/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.958448:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089a680 with x1830976123697920 ext(1048576->2097151) 00002000:00010000:2.0:1746155564.958451:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013089a680 00000100:00100000:2.0:1746155564.958464:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4549 00000100:00100000:2.0:1746155564.958469:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1961:x1830976123697920:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155564.961961:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124560896:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155564.961977:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155564.962007:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1962:x1830976123698304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3996us (4054us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155564.962016:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5992 00000100:00100000:0.0:1746155564.962057:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.962117:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123698560 00000100:00100000:0.0:1746155564.962122:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123698560 00002000:00100000:0.0:1746155564.962144:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2744320->2748415) req@ffff880130899f80 x1830976123698560/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/0 e 0 to 0 dl 1746155575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.962152:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899f80 with x1830976123698560 ext(2744320->2748415) 00002000:00010000:0.0:1746155564.962156:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899f80 00000100:00100000:0.0:1746155564.962167:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4550 00000100:00100000:0.0:1746155564.962171:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+38:1960:x1830976123698560:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155564.962261:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+38:1960:x1830976123698560:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 89us (203us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155564.962262:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123698176 00000100:00100000:3.0:1746155564.962266:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123698176 00000100:00100000:0.0:1746155564.962266:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4550 00002000:00100000:0.0:1746155564.962270:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2744320->2748415) req@ffff880130899f80 x1830976123698560/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/4536 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155564.962277:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899f80 with x1830976123698560 ext(2744320->2748415) 00002000:00010000:0.0:1746155564.962279:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899f80 00000100:00100000:3.0:1746155564.962288:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11944 00000100:00100000:3.0:1746155564.962293:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976123698176:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155564.962302:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.962314:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a539c400/0x844e5faceb5eb321 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b5d expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.962349:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124561024:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155564.962386:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91a80 going to sleep for 11 seconds 00002000:00010000:3.0:1746155564.964630:0:20200:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime: 1746155564 -> 1746155565 00002000:00010000:3.0:1746155564.964637:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime: 1746155564 -> 1746155565 00002000:00010000:3.0:1746155564.964639:0:20200:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime: 1746155564 -> 1746155565 00000100:00100000:3.0:1746155564.964657:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124561024:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155564.964679:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a539c400/0x844e5faceb5eb321 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b5d expref: 40 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.964689:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a539c400/0x844e5faceb5eb321 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b5d expref: 40 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.964714:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a539c400, rc 0) 00000100:00100000:3.0:1746155564.964744:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976123698176:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2450us (6824us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155564.964751:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11944 00000100:00100000:0.0:1746155564.974850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.976387:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123698688 00000100:00100000:3.0:1746155564.976395:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123698688 00000100:00100000:3.0:1746155564.976430:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11945 00000100:00100000:3.0:1746155564.976437:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976123698688:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155564.976453:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.976467:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0679e00/0x844e5faceb5eb328 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b64 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155564.976538:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124561152:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155564.976608:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155564.977099:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1961:x1830976123697920:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 18627us (19206us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155564.977107:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4549 00002000:00100000:2.0:1746155564.977116:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88013089a680 x1830976123697920/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155564.977123:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089a680 with x1830976123697920 ext(1048576->2097151) 00002000:00010000:2.0:1746155564.977128:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013089a680 00000100:00100000:1.0:1746155564.980125:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1960:x1830976123697792:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 23782us (23932us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155564.980134:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4548 00002000:00100000:1.0:1746155564.980142:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880130898e00 x1830976123697792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:635/0 lens 488/440 e 0 to 0 dl 1746155575 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155564.980150:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898e00 with x1830976123697792 ext(1048576->2097151) 00002000:00010000:1.0:1746155564.980155:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130898e00 00000100:00100000:3.0:1746155564.981841:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124561152:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155564.981868:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0679e00/0x844e5faceb5eb328 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b64 expref: 40 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.981886:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0679e00/0x844e5faceb5eb328 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b64 expref: 40 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.981915:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0679e00, rc 0) 00000100:00100000:3.0:1746155564.981955:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976123698688:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5517us (7111us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155564.981961:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11945 00000100:00100000:0.0:1746155564.991654:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155564.991701:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155564.991729:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123698816 00000100:00100000:3.0:1746155564.991737:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123698816 00000100:00100000:3.0:1746155564.991778:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123698944 00000100:00100000:3.0:1746155564.991780:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123698944 00000100:00100000:3.0:1746155564.991802:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11946 00000100:00100000:3.0:1746155564.991808:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+28:29067:x1830976123698816:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155564.991823:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155564.991836:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b6b expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.991859:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a22 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.991867:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800901f0600/0x844e5faceb5eb217 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aae expref: 15 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.991874:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4947968->4956159) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a37 expref: 34 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.991885:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155564.991886:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155564.991890:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->3653631] (req 3145728->3653631) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 29 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.991912:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4947968->4956159) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a37 expref: 34 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.991921:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4947968->4956159) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a37 expref: 34 pid: 4461 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155564.991932:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124561280:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155564.991995:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800901f0600/0x844e5faceb5eb217 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aae expref: 15 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155564.992003:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800901f0600/0x844e5faceb5eb217 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aae expref: 15 pid: 20200 timeout: 794 lvb_type: 1 00000100:00100000:3.0:1746155564.992010:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124561408:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155564.992027:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a22 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155564.992034:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a22 expref: 29 pid: 4461 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155564.992047:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124561536:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155564.992057:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155564.992187:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11947 00000100:00100000:0.0:1746155564.992194:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+29:29071:x1830976123698944:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155564.992201:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155564.992207:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eb336 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b72 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.992217:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155564.992218:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155564.992223:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eb336 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b72 expref: 30 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.992234:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eb336 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b72 expref: 30 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155564.992246:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f19f600, rc 0) 00000100:00100000:0.0:1746155564.992266:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+30:29071:x1830976123698944:12345-192.168.202.51@tcp:101:cat.0 Request processed in 73us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155564.992271:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11947 00000100:00100000:0.0:1746155565.003228:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.003314:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.003342:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.003363:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123699328 00000100:00100000:1.0:1746155565.003370:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123699456 00000100:00100000:0.0:1746155565.003371:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123699328 00000100:00100000:1.0:1746155565.003374:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123699456 00010000:00010000:1.0:1746155565.003410:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4947968->4956159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a37 expref: 35 pid: 4461 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.003436:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5993 00000100:00100000:2.0:1746155565.003438:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123699200 00000100:00100000:2.0:1746155565.003442:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123699200 00000100:00100000:1.0:1746155565.003444:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123699456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.003456:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155565.003462:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4016 00000100:00100000:2.0:1746155565.003466:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29063:x1830976123699200:12345-192.168.202.51@tcp:35:cat.0 00010000:00010000:1.0:1746155565.003474:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4947968->4956159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a37 expref: 35 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.003484:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4947968->4956159) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a37 expref: 35 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.003521:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155565.003553:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123699456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 110us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.003559:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5993 00000100:00100000:2.0:1746155565.003641:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:29063:x1830976123699200:12345-192.168.202.51@tcp:35:cat.0 Request processed in 174us (422us total) trans 8589943910 rc 0/0 00000100:00100000:2.0:1746155565.003646:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4016 00000100:00100000:2.0:1746155565.003708:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.003724:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123699584 00000100:00100000:2.0:1746155565.003727:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123699584 00010000:00010000:0.0:1746155565.003873:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800901f0600/0x844e5faceb5eb217 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aae expref: 16 pid: 20200 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.003890:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5994 00000100:00100000:0.0:1746155565.003895:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1961:x1830976123699328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.003902:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.003910:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800901f0600/0x844e5faceb5eb217 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aae expref: 16 pid: 20200 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.003917:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800901f0600/0x844e5faceb5eb217 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aae expref: 16 pid: 20200 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.003927:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.003941:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1961:x1830976123699328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 47us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.003946:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5994 00000100:00080000:0.0:1746155565.004006:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746155565.004066:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a237e00/0x844e5faceb5eb176 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4947968->4956159) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a37 expref: 35 pid: 4461 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.004082:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124561280:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.004091:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800901f0600/0x844e5faceb5eb217 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10aae expref: 15 pid: 20200 timeout: 794 lvb_type: 1 00000100:00100000:3.0:1746155565.004098:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124561408:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155565.004106:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124561536:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.004126:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->3653631] (req 3145728->3653631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 30 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.004134:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0678600, rc 0) 00000100:00100000:3.0:1746155565.004152:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+30:29067:x1830976123698816:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 12345us (12507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.004157:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11946 00010000:00010000:2.0:1746155565.004183:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a22 expref: 29 pid: 4461 timeout: 794 lvb_type: 0 00000100:00100000:2.0:1746155565.004197:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5995 00000100:00100000:2.0:1746155565.004202:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123699584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155565.004208:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155565.004215:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a22 expref: 29 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.004223:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a22 expref: 29 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.004234:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a237c00/0x844e5faceb5eb168 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a22 expref: 29 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.004242:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.004244:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.004249:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.004443:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.004468:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155565.004477:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124561664:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155565.004549:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.005588:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.005629:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123699840 00000100:00100000:3.0:1746155565.005633:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123699840 00000100:00100000:3.0:1746155565.005664:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9979 00000100:00100000:3.0:1746155565.005669:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:29075:x1830976123699840:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155565.005679:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.005692:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679a00/0x844e5faceb5eb33d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b79 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.005767:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679800/0x844e5faceb5eb344 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.005777:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679800/0x844e5faceb5eb344 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.005787:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679800/0x844e5faceb5eb344 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.005798:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0678000/0x844e5faceb5eb34b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.005804:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0678000/0x844e5faceb5eb34b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.005809:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0678000/0x844e5faceb5eb34b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.005889:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679e00/0x844e5faceb5eb352 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.005897:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679e00/0x844e5faceb5eb352 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.005902:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679e00/0x844e5faceb5eb352 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:3.0:1746155565.005909:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155565.005968:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679800/0x844e5faceb5eb344 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.005974:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679800/0x844e5faceb5eb344 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.005980:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679800/0x844e5faceb5eb344 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.005984:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0679800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155565.005987:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679800/0x844e5faceb5eb344 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.005993:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679800/0x844e5faceb5eb344 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.006001:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155565.006003:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155565.006006:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679800/0x844e5faceb5eb344 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.006011:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679800/0x844e5faceb5eb344 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.006018:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0678000/0x844e5faceb5eb34b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.006023:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0678000/0x844e5faceb5eb34b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.006027:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0678000/0x844e5faceb5eb34b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.006030:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0678000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155565.006032:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0678000/0x844e5faceb5eb34b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.006037:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0678000/0x844e5faceb5eb34b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.006046:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d55a300) 00010000:00010000:3.0:1746155565.006048:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155565.006050:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0678000/0x844e5faceb5eb34b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.006053:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0678000/0x844e5faceb5eb34b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.006081:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679a00/0x844e5faceb5eb33d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b79 expref: 301 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.006089:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679e00/0x844e5faceb5eb352 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b79 expref: 300 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.006094:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155565.006096:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155565.006097:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0679e00, rc 0) 00000100:00100000:3.0:1746155565.006137:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:29075:x1830976123699840:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 466us (549us total) trans 8589943911 rc 0/0 00000100:00100000:3.0:1746155565.006142:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9979 00000100:00100000:2.0:1746155565.007221:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124561664:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155565.007235:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155565.007266:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123699584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3062us (3556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.007273:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5995 00000100:00100000:0.0:1746155565.010188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.010488:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123700096 00000100:00100000:1.0:1746155565.010496:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123700096 00002000:00100000:1.0:1746155565.010551:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3649536->3653631) req@ffff88009fb69500 x1830976123700096/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.010559:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69500 with x1830976123700096 ext(3649536->3653631) 00002000:00010000:1.0:1746155565.010564:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb69500 00000100:00100000:1.0:1746155565.010840:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4551 00000100:00100000:1.0:1746155565.010848:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123700096:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155565.010991:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123700096:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 143us (809us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155565.011000:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4551 00002000:00100000:1.0:1746155565.011006:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3649536->3653631) req@ffff88009fb69500 x1830976123700096/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.011012:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69500 with x1830976123700096 ext(3649536->3653631) 00002000:00010000:1.0:1746155565.011015:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb69500 00000100:00100000:0.0:1746155565.012563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.012635:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123700352 00000100:00100000:2.0:1746155565.012640:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123700352 00000100:00100000:2.0:1746155565.012685:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4017 00000100:00100000:2.0:1746155565.012691:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29067:x1830976123700352:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155565.012830:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29067:x1830976123700352:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 139us (270us total) trans 8589943912 rc 0/0 00000100:00100000:2.0:1746155565.012836:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4017 00000100:00080000:1.0:1746155565.012926:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155565.017847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.017917:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123700608 00000100:00100000:2.0:1746155565.017924:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123700608 00002000:00100000:2.0:1746155565.017955:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009fb68e00 x1830976123700608/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.017964:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68e00 with x1830976123700608 ext(1048576->2097151) 00002000:00010000:2.0:1746155565.017968:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb68e00 00000100:00100000:2.0:1746155565.017992:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4552 00000100:00100000:2.0:1746155565.017998:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123700608:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155565.026592:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.026839:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123700608:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8840us (8998us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155565.026848:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4552 00002000:00100000:2.0:1746155565.026858:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009fb68e00 x1830976123700608/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.026867:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68e00 with x1830976123700608 ext(1048576->2097151) 00002000:00010000:2.0:1746155565.026871:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb68e00 00000100:00100000:3.0:1746155565.027092:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123700736 00000100:00100000:3.0:1746155565.027098:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123700736 00000100:00100000:3.0:1746155565.027128:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11948 00000100:00100000:3.0:1746155565.027133:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:29075:x1830976123700736:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155565.027144:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.027156:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b80 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.027191:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 33 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.027197:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.027198:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.027201:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2179072->2555903] (req 2179072->2555903) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 40 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.027222:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 33 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.027231:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 33 pid: 19959 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.027239:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124561792:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155565.027290:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.029558:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124561792:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.029582:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2179072->2555903] (req 2179072->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 40 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.029594:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0678000, rc 0) 00000100:00100000:3.0:1746155565.029761:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:29075:x1830976123700736:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2626us (3174us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.029768:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11948 00000100:00100000:0.0:1746155565.031351:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.031424:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123700864 00000100:00100000:2.0:1746155565.031430:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123700864 00000100:00080000:1.0:1746155565.031596:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:2.0:1746155565.031660:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2744320->3145727) req@ffff88009fb68a80 x1830976123700864/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.031669:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68a80 with x1830976123700864 ext(2744320->3145727) 00010000:00010000:2.0:1746155565.031676:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 34 pid: 19959 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.031687:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 34 pid: 19959 timeout: 794 lvb_type: 0 00002000:00010000:2.0:1746155565.031692:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb68a80 00000100:00100000:2.0:1746155565.031717:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 699 00000100:00100000:2.0:1746155565.031723:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1962:x1830976123700864:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155565.038744:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1962:x1830976123700864:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 7008us (7384us total) trans 17179873174 rc 0/0 00000100:00100000:2.0:1746155565.038755:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 699 00002000:00100000:2.0:1746155565.038765:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2744320->3145727) req@ffff88009fb68a80 x1830976123700864/t17179873174(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/448 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.038773:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68a80 with x1830976123700864 ext(2744320->3145727) 00010000:00010000:2.0:1746155565.038781:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 36 pid: 19959 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.038793:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 36 pid: 19959 timeout: 794 lvb_type: 0 00002000:00010000:2.0:1746155565.038799:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb68a80 00000100:00100000:0.0:1746155565.049988:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.050030:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.053562:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123701248 00000100:00100000:3.0:1746155565.053574:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123701248 00010000:00010000:3.0:1746155565.057103:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 36 pid: 19959 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.057157:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5996 00000100:00100000:3.0:1746155565.057169:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1962:x1830976123701248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155565.057183:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155565.057200:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 36 pid: 19959 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746155565.057210:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 36 pid: 19959 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746155565.057230:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a227800/0x844e5faceb5eb313 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b4f expref: 36 pid: 19959 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746155565.057247:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.057249:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.057255:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 39 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.057262:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 39 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.057291:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 39 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155565.057301:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124561920:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155565.057369:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.057395:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123701120 00000100:00100000:3.0:1746155565.057401:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123701120 00002000:00100000:3.0:1746155565.057429:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009fb68380 x1830976123701120/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.057437:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68380 with x1830976123701120 ext(2097152->3145727) 00002000:00010000:3.0:1746155565.057441:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb68380 00000100:00100000:3.0:1746155565.057458:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4553 00000100:00100000:3.0:1746155565.057463:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123701120:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155565.066100:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124561920:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155565.066118:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.066152:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1962:x1830976123701248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8986us (16119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.066161:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5996 00000100:00100000:0.0:1746155565.066215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.071792:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123701504 00000100:00100000:3.0:1746155565.071802:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123701504 00002000:00100000:3.0:1746155565.071838:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2179072->2183167) req@ffff88009fb6aa00 x1830976123701504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.071847:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6aa00 with x1830976123701504 ext(2179072->2183167) 00002000:00010000:3.0:1746155565.071851:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6aa00 00000100:00100000:3.0:1746155565.071872:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4554 00000100:00100000:3.0:1746155565.071877:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976123701504:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155565.072014:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976123701504:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 135us (5798us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155565.072020:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4554 00002000:00100000:3.0:1746155565.072024:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2179072->2183167) req@ffff88009fb6aa00 x1830976123701504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.072031:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6aa00 with x1830976123701504 ext(2179072->2183167) 00002000:00010000:3.0:1746155565.072033:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6aa00 00000100:00100000:0.0:1746155565.076346:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123701120:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18875us (26358us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155565.076363:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4553 00002000:00100000:0.0:1746155565.076372:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009fb68380 x1830976123701120/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.076381:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68380 with x1830976123701120 ext(2097152->3145727) 00002000:00010000:0.0:1746155565.076391:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb68380 00000100:00100000:0.0:1746155565.081932:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.081952:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123701760 00000100:00100000:0.0:1746155565.081959:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123701760 00002000:00100000:0.0:1746155565.081997:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2551808->2555903) req@ffff88009fb6a680 x1830976123701760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.082011:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6a680 with x1830976123701760 ext(2551808->2555903) 00002000:00010000:0.0:1746155565.082015:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6a680 00000100:00100000:0.0:1746155565.082032:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4555 00000100:00100000:0.0:1746155565.082038:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1963:x1830976123701760:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155565.083304:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1963:x1830976123701760:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1261us (1373us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155565.083314:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4555 00002000:00100000:0.0:1746155565.083351:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2551808->2555903) req@ffff88009fb6a680 x1830976123701760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.083359:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6a680 with x1830976123701760 ext(2551808->2555903) 00002000:00010000:0.0:1746155565.083362:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6a680 00000100:00100000:0.0:1746155565.083729:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.086512:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123701888 00000100:00100000:2.0:1746155565.086523:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123701888 00000100:00100000:2.0:1746155565.086561:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11949 00000100:00100000:2.0:1746155565.086567:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+35:29071:x1830976123701888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155565.086581:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.086596:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b87 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.086629:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 39 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.086641:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155565.086642:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155565.086645:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b87 expref: 36 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155565.086846:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.087256:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123702144 00000100:00100000:3.0:1746155565.087260:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123702144 00000100:00100000:3.0:1746155565.087279:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4018 00000100:00100000:3.0:1746155565.087284:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:29075:x1830976123702144:12345-192.168.202.51@tcp:35:multiop.0 00010000:00010000:2.0:1746155565.087361:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 39 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.087372:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 39 pid: 20200 timeout: 794 lvb_type: 0 00000100:00100000:2.0:1746155565.087382:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124562048:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155565.087422:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:29075:x1830976123702144:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 137us (576us total) trans 8589943913 rc 0/0 00000100:00100000:3.0:1746155565.087427:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4018 00000100:00100000:2.0:1746155565.087431:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.096594:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.096626:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123702272 00000100:00100000:0.0:1746155565.096632:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123702272 00002000:00100000:0.0:1746155565.096663:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (2179072->2555903) req@ffff88009fb6bb80 x1830976123702272/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.096673:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6bb80 with x1830976123702272 ext(2179072->2555903) 00010000:00010000:0.0:1746155565.096681:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 40 pid: 20200 timeout: 794 lvb_type: 0 00000100:00100000:2.0:1746155565.096683:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124562048:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.096693:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 40 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.096704:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b87 expref: 36 pid: 20200 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155565.096704:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb6bb80 00010000:00010000:2.0:1746155565.096718:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a227200, rc 0) 00000100:00100000:0.0:1746155565.096719:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 700 00000100:00100000:0.0:1746155565.096726:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976123702272:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155565.096755:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+36:29071:x1830976123701888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10188us (13026us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.096761:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11949 00000100:00100000:0.0:1746155565.103548:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976123702272:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 6815us (6952us total) trans 17179873175 rc 0/0 00000100:00100000:0.0:1746155565.103559:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 700 00002000:00100000:0.0:1746155565.103568:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (2179072->2555903) req@ffff88009fb6bb80 x1830976123702272/t17179873175(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/448 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.103576:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6bb80 with x1830976123702272 ext(2179072->2555903) 00010000:00010000:0.0:1746155565.103585:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 42 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.103608:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 42 pid: 20200 timeout: 794 lvb_type: 0 00002000:00010000:0.0:1746155565.103615:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb6bb80 00010000:00010000:3.0:1746155565.104642:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155565.112794:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.112851:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123702400 00000100:00100000:0.0:1746155565.112861:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123702400 00010000:00010000:0.0:1746155565.112895:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 42 pid: 20200 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.112927:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5997 00000100:00100000:0.0:1746155565.112936:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1963:x1830976123702400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.112951:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.112973:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 42 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.112984:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 42 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.113005:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0678000/0x844e5faceb5eb360 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2179072->2555903) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b80 expref: 42 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.113018:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.113019:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.113025:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b87 expref: 35 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.113032:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b87 expref: 35 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.113059:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b87 expref: 35 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155565.113070:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124562176:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155565.113141:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.120397:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124562176:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155565.120415:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.120450:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1963:x1830976123702400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7514us (7665us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.120460:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5997 00000100:00100000:0.0:1746155565.135008:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.135029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.135049:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.135140:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123702656 00000100:00100000:0.0:1746155565.135148:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123702656 00002000:00100000:0.0:1746155565.135185:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009fb68000 x1830976123702656/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.135194:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68000 with x1830976123702656 ext(2097152->3145727) 00002000:00010000:0.0:1746155565.135199:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb68000 00000100:00100000:0.0:1746155565.135211:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123702912 00000100:00100000:0.0:1746155565.135214:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123702912 00002000:00100000:0.0:1746155565.135222:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012b6c3480 x1830976123702912/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.135227:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c3480 with x1830976123702912 ext(3145728->4194303) 00002000:00010000:0.0:1746155565.135229:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b6c3480 00000100:00100000:0.0:1746155565.135235:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123703168 00000100:00100000:0.0:1746155565.135236:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123703168 00002000:00100000:0.0:1746155565.135243:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3653632->4194303) req@ffff88012b6c2d80 x1830976123703168/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.135248:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c2d80 with x1830976123703168 ext(3653632->4194303) 00002000:00010000:0.0:1746155565.135251:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c2d80 00000100:00100000:0.0:1746155565.135259:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4556 00000100:00100000:0.0:1746155565.135264:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+37:1961:x1830976123702656:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155565.136261:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4557 00000100:00100000:0.0:1746155565.136267:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+38:1961:x1830976123702912:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155565.138042:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4558 00000100:00100000:0.0:1746155565.138050:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123703168:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155565.182322:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.182347:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123703424 00000100:00100000:0.0:1746155565.182352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.182355:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123703424 00000100:00100000:3.0:1746155565.182387:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123703552 00000100:00100000:3.0:1746155565.182389:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123703552 00000100:00100000:0.0:1746155565.182984:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9980 00000100:00100000:1.0:1746155565.182990:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9981 00000100:00100000:0.0:1746155565.182993:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29080:x1830976123703424:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:1.0:1746155565.182996:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:29082:x1830976123703552:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00080000:3.0:1746155565.183001:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746155565.183011:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.183011:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155565.183025:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094caf600/0x844e5faceb5eb375 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b95 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.183025:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dae600/0x844e5faceb5eb36e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b8e expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.183068:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafa00/0x844e5faceb5eb37c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.183078:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafa00/0x844e5faceb5eb37c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.183087:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafa00/0x844e5faceb5eb37c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.183089:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.183097:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094caf800/0x844e5faceb5eb38a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.183098:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad8 expref: 13 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.183102:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094caf800/0x844e5faceb5eb38a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.183105:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b000/0x844e5faceb5eb2b8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b09 expref: 21 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.183108:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094caf800/0x844e5faceb5eb38a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.183111:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679e00/0x844e5faceb5eb352 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b79 expref: 300 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.183115:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155565.183137:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679e00/0x844e5faceb5eb352 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b79 expref: 300 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.183150:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679e00/0x844e5faceb5eb352 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b79 expref: 300 pid: 19870 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.183159:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124562304:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155565.183180:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.183185:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.183188:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.183195:0:20364:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.183202:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.184622:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b000/0x844e5faceb5eb2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b09 expref: 21 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.184634:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b000/0x844e5faceb5eb2b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b09 expref: 21 pid: 19870 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.184643:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124562432:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.184693:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad8 expref: 13 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.184700:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad8 expref: 13 pid: 19870 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.184707:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124562560:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155565.184723:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.185154:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+38:1961:x1830976123702656:12345-192.168.202.51@tcp:3:cat.0 Request processed in 49888us (50152us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155565.185162:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4556 00002000:00100000:0.0:1746155565.185178:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009fb68000 x1830976123702656/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.185192:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68000 with x1830976123702656 ext(2097152->3145727) 00002000:00010000:0.0:1746155565.185196:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb68000 00000100:00100000:0.0:1746155565.194695:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1961:x1830976123702912:12345-192.168.202.51@tcp:3:cat.0 Request processed in 58421us (59658us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155565.194705:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4557 00002000:00100000:0.0:1746155565.194716:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012b6c3480 x1830976123702912/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.194724:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c3480 with x1830976123702912 ext(3145728->4194303) 00002000:00010000:0.0:1746155565.194730:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b6c3480 00000100:00100000:0.0:1746155565.198661:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.198677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.198699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.198759:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124562304:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155565.198768:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124562432:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155565.198775:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124562560:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.198796:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155565.198819:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123703680 00000100:00100000:0.0:1746155565.198824:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123703680 00010000:00010000:0.0:1746155565.198848:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679e00/0x844e5faceb5eb352 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b79 expref: 301 pid: 19870 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.198865:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123703808 00000100:00100000:0.0:1746155565.198867:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123703808 00010000:00010000:0.0:1746155565.198875:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b000/0x844e5faceb5eb2b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b09 expref: 22 pid: 19870 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.198886:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123703936 00000100:00100000:0.0:1746155565.198887:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123703936 00010000:00010000:0.0:1746155565.198894:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad8 expref: 14 pid: 19870 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.198907:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5998 00000100:00100000:0.0:1746155565.198913:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1963:x1830976123703680:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.198930:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.198935:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679e00/0x844e5faceb5eb352 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b79 expref: 301 pid: 19870 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.198944:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679e00/0x844e5faceb5eb352 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b79 expref: 301 pid: 19870 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.198965:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0679e00/0x844e5faceb5eb352 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b79 expref: 301 pid: 19870 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.198976:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155565.198980:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155565.198988:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.198992:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155565.199000:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.199004:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.199035:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1963:x1830976123703680:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 122us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.199040:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5998 00000100:00100000:0.0:1746155565.199054:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5999 00000100:00100000:0.0:1746155565.199059:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123703808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.199064:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.199068:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b000/0x844e5faceb5eb2b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b09 expref: 22 pid: 19870 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.199074:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b000/0x844e5faceb5eb2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b09 expref: 22 pid: 19870 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.199083:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e21b000/0x844e5faceb5eb2b8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b09 expref: 22 pid: 19870 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.199090:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155565.199093:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155565.199097:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.199101:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155565.199109:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.199113:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.199124:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123703808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 66us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.199129:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5999 00000100:00100000:0.0:1746155565.199137:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6000 00000100:00100000:0.0:1746155565.199141:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976123703936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.199146:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.199150:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad8 expref: 14 pid: 19870 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.199156:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad8 expref: 14 pid: 19870 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.199165:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4e00/0x844e5faceb5eb26b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ad8 expref: 14 pid: 19870 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.199171:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155565.199174:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155565.199179:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155565.199186:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155565.199194:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.199198:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.199202:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.199216:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.199229:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976123703936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.199233:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6000 00000100:00100000:0.0:1746155565.199393:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123703168:12345-192.168.202.51@tcp:3:cat.0 Request processed in 61345us (64343us total) trans 0 rc 540672/540672 00000100:00100000:0.0:1746155565.199400:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4558 00002000:00100000:0.0:1746155565.199408:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (3653632->4194303) req@ffff88012b6c2d80 x1830976123703168/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 540672/540672 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.199415:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c2d80 with x1830976123703168 ext(3653632->4194303) 00002000:00010000:0.0:1746155565.199419:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c2d80 00010000:00010000:1.0:1746155565.199563:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.199570:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155565.199586:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155565.199699:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dae600/0x844e5faceb5eb36e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b8e expref: 22 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.199713:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b8e expref: 21 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.199720:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b8e expref: 21 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.199726:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d7e400, rc 0) 00000100:00100000:1.0:1746155565.199747:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29080:x1830976123703424:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 16756us (17433us total) trans 8589943914 rc 0/0 00000100:00100000:1.0:1746155565.199753:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9980 00000100:00100000:0.0:1746155565.227836:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.227905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.227931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.227954:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123704192 00000100:00100000:0.0:1746155565.227961:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123704192 00002000:00100000:0.0:1746155565.227997:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009c211c00 x1830976123704192/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.228011:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211c00 with x1830976123704192 ext(4194304->4956159) 00002000:00010000:0.0:1746155565.228016:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c211c00 00000100:00100000:0.0:1746155565.228033:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4559 00000100:00100000:0.0:1746155565.228051:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123704192:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155565.228539:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123704576 00000100:00100000:0.0:1746155565.228544:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123704576 00000100:00100000:3.0:1746155565.234426:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9982 00000100:00100000:3.0:1746155565.234441:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:29085:x1830976123704576:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.234466:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.234484:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01efe00/0x844e5faceb5eb39f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10b9c expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.234583:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eee00/0x844e5faceb5eb3a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234605:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eee00/0x844e5faceb5eb3a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234616:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eee00/0x844e5faceb5eb3a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234625:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5eb3ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234634:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5eb3ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234639:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5eb3ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234718:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ef000/0x844e5faceb5eb3b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234725:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ef000/0x844e5faceb5eb3b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234730:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ef000/0x844e5faceb5eb3b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:3.0:1746155565.234737:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155565.234793:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eee00/0x844e5faceb5eb3a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234799:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eee00/0x844e5faceb5eb3a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234804:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eee00/0x844e5faceb5eb3a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234809:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01eee00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155565.234812:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eee00/0x844e5faceb5eb3a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234817:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eee00/0x844e5faceb5eb3a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234825:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155565.234827:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155565.234831:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eee00/0x844e5faceb5eb3a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234835:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eee00/0x844e5faceb5eb3a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234849:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5eb3ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234854:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5eb3ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234858:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5eb3ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234862:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01ee600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155565.234864:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5eb3ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234868:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5eb3ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234872:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800942dc600) 00010000:00010000:3.0:1746155565.234874:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155565.234876:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5eb3ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234880:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5eb3ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155565.234902:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01efe00/0x844e5faceb5eb39f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b9c expref: 303 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.234915:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ef000/0x844e5faceb5eb3b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b9c expref: 302 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.234921:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155565.234923:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155565.234925:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155565.234930:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155565.234934:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01ef000, rc 0) 00000100:00100000:3.0:1746155565.234979:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:29085:x1830976123704576:12345-192.168.202.51@tcp:101:cat.0 Request processed in 544us (7074us total) trans 8589943915 rc 0/0 00000100:00100000:3.0:1746155565.234984:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9982 00000100:00100000:0.0:1746155565.235231:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123704320 00000100:00100000:0.0:1746155565.235238:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123704320 00010000:00010000:0.0:1746155565.235254:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b8e expref: 21 pid: 15474 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.235271:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6001 00000100:00100000:0.0:1746155565.235276:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123704320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.235283:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.235287:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b8e expref: 21 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.235295:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b8e expref: 21 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.235305:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5eb383 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b8e expref: 21 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.235315:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155565.235318:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.235327:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.235332:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.235346:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.235363:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123704320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (7431us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.235367:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6001 00010000:00010000:1.0:1746155565.239698:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239708:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155565.239746:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:1.0:1746155565.239750:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155565.239764:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239773:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239781:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafa00/0x844e5faceb5eb37c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239786:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafa00/0x844e5faceb5eb37c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239791:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafa00/0x844e5faceb5eb37c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239796:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094cafa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155565.239799:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafa00/0x844e5faceb5eb37c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239808:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafa00/0x844e5faceb5eb37c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239819:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155565.239821:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155565.239824:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafa00/0x844e5faceb5eb37c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239828:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafa00/0x844e5faceb5eb37c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239837:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094caf800/0x844e5faceb5eb38a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239840:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094caf800/0x844e5faceb5eb38a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239844:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094caf800/0x844e5faceb5eb38a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239848:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094caf800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155565.239850:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094caf800/0x844e5faceb5eb38a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239853:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094caf800/0x844e5faceb5eb38a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239858:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800942dc600) 00010000:00010000:1.0:1746155565.239859:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155565.239861:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094caf800/0x844e5faceb5eb38a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239866:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094caf800/0x844e5faceb5eb38a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.239896:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094caf600/0x844e5faceb5eb375 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b95 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.239907:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b95 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.239913:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155565.239914:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155565.239916:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094cafc00, rc 0) 00000100:00100000:1.0:1746155565.239968:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:29082:x1830976123703552:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 56970us (57613us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.239976:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9981 00000100:00100000:0.0:1746155565.252449:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.252465:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.252482:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.252520:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.252743:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123704192:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24691us (24912us total) trans 0 rc 761856/761856 00000100:00100000:0.0:1746155565.252753:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4559 00002000:00100000:0.0:1746155565.252762:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009c211c00 x1830976123704192/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.252770:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211c00 with x1830976123704192 ext(4194304->4956159) 00002000:00010000:0.0:1746155565.252776:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c211c00 00000100:00100000:0.0:1746155565.252799:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123704832 00000100:00100000:0.0:1746155565.252804:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123704832 00000100:00100000:0.0:1746155565.252824:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123704704 00000100:00100000:0.0:1746155565.252825:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123704704 00000100:00100000:0.0:1746155565.252834:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123705088 00000100:00100000:0.0:1746155565.252835:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123705088 00000100:00100000:0.0:1746155565.252846:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11950 00000100:00100000:0.0:1746155565.252852:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1960:x1830976123704832:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155565.252864:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.252876:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10baa expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.252892:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.252893:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.252899:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 42 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.252912:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 42 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.252920:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9a00, rc 0) 00000100:00100000:0.0:1746155565.252934:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976123704832:12345-192.168.202.51@tcp:101:cat.0 Request processed in 82us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.252938:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11950 00000100:00100000:0.0:1746155565.252949:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11951 00000100:00100000:0.0:1746155565.252953:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123704704:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155565.252959:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.252966:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5eb3c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ba3 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155565.252992:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124562688:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155565.253039:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.253096:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11952 00000100:00100000:0.0:1746155565.253101:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1960:x1830976123705088:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155565.253107:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.253112:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe9600/0x844e5faceb5eb3d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10bb1 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.253120:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.253121:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.253125:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9600/0x844e5faceb5eb3d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb1 expref: 16 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.253133:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9600/0x844e5faceb5eb3d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb1 expref: 16 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.253138:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9600, rc 0) 00000100:00100000:0.0:1746155565.253154:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1960:x1830976123705088:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 53us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.253158:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11952 00000100:00100000:0.0:1746155565.253569:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123704960 00000100:00100000:0.0:1746155565.253572:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123704960 00000100:00100000:0.0:1746155565.253595:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 580 00000100:00100000:0.0:1746155565.253610:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:1960:x1830976123704960:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.253618:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.253634:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ef000/0x844e5faceb5eb3b4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b9c expref: 302 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.253645:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155565.253649:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.253666:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1960:x1830976123704960:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 56us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.253671:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 580 00000100:00100000:0.0:1746155565.255123:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.255140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.255153:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.255165:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.255184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.255200:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123705216 00000100:00100000:0.0:1746155565.255205:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123705216 00000100:00100000:0.0:1746155565.255224:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123705344 00000100:00100000:0.0:1746155565.255226:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123705344 00000100:00100000:0.0:1746155565.255233:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123705472 00000100:00100000:0.0:1746155565.255234:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123705472 00000100:00100000:0.0:1746155565.255241:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123705600 00000100:00100000:0.0:1746155565.255242:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123705600 00000100:00100000:0.0:1746155565.255248:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123705728 00000100:00100000:0.0:1746155565.255249:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123705728 00000100:00100000:0.0:1746155565.255258:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11953 00000100:00100000:0.0:1746155565.255262:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1961:x1830976123705216:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155565.255272:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.255282:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe8200/0x844e5faceb5eb3d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10bb8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.255296:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.255297:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.255304:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8200/0x844e5faceb5eb3d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb8 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.255314:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8200/0x844e5faceb5eb3d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb8 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.255321:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8200, rc 0) 00000100:00100000:0.0:1746155565.255343:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1961:x1830976123705216:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.255347:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11953 00000100:00100000:0.0:1746155565.255362:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11954 00000100:00100000:0.0:1746155565.255366:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1960:x1830976123705344:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155565.255370:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.255374:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5eb3de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10bbf expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.255381:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.255382:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.255385:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5eb3de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bbf expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.255392:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5eb3de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bbf expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.255398:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8000, rc 0) 00000100:00100000:0.0:1746155565.255407:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123705344:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 41us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.255411:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11954 00000100:00100000:0.0:1746155565.255418:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11955 00000100:00100000:0.0:1746155565.255421:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1961:x1830976123705472:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155565.255429:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.255435:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe8400/0x844e5faceb5eb3e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10bc6 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.255443:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.255444:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.255447:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe8400/0x844e5faceb5eb3e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bc6 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.255454:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fe8400/0x844e5faceb5eb3e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bc6 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.255459:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8400, rc 0) 00000100:00100000:0.0:1746155565.255468:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1961:x1830976123705472:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 46us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.255471:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11955 00000100:00100000:0.0:1746155565.255477:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11956 00000100:00100000:0.0:1746155565.255481:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123705600:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155565.255484:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.255488:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5eb3ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10bcd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155565.255521:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11957 00000100:00100000:0.0:1746155565.255525:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1960:x1830976123705728:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155565.255529:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.255533:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4d28a00/0x844e5faceb5eb3f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10bd4 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.255541:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.255542:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.255545:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d28a00/0x844e5faceb5eb3f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bd4 expref: 17 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.255552:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d28a00/0x844e5faceb5eb3f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bd4 expref: 17 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.255557:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d28a00, rc 0) 00000100:00100000:0.0:1746155565.255567:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123705728:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 42us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.255571:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11957 00000100:00100000:0.0:1746155565.255728:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124562816:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155565.255767:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.267320:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:0.0:1746155565.267611:0:4461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime: 1746155564 -> 1746155565 00002000:00010000:0.0:1746155565.267615:0:4461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155564 -> 1746155565 00002000:00010000:0.0:1746155565.267617:0:4461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime: 1746155564 -> 1746155565 00000100:00100000:0.0:1746155565.267634:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124562688:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155565.267671:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5eb3c9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ba3 expref: 35 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.267684:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5eb3c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ba3 expref: 35 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.267698:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9c00, rc 0) 00000100:00100000:0.0:1746155565.267734:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123704704:12345-192.168.202.51@tcp:101:cat.0 Request processed in 14780us (15267us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155565.267741:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11951 00000100:00100000:0.0:1746155565.267763:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123705856 00000100:00100000:0.0:1746155565.267768:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123705856 00000100:00100000:0.0:1746155565.267790:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11958 00000100:00100000:0.0:1746155565.267796:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+36:29080:x1830976123705856:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155565.267808:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.267820:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10bdb expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.267840:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10adf expref: 41 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.267848:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5eb3de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bbf expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.267855:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a539ce00/0x844e5faceb5eb2f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b2c expref: 37 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.267861:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.267863:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.267866:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1658880->2097151] (req 1658880->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 37 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.267893:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a539ce00/0x844e5faceb5eb2f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b2c expref: 37 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.267903:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a539ce00/0x844e5faceb5eb2f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b2c expref: 37 pid: 19959 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.267914:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124562944:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.267956:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5eb3de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bbf expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.267963:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5eb3de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bbf expref: 16 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.267971:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124563072:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.267989:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10adf expref: 41 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.267996:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10adf expref: 41 pid: 19959 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.268003:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124563200:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155565.268016:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.268097:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124562816:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155565.268119:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5eb3ec lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bcd expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.268127:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5eb3ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bcd expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.268135:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8800, rc 0) 00000100:00100000:0.0:1746155565.268154:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1960:x1830976123705600:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 12671us (12987us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155565.268160:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11956 00000100:00100000:0.0:1746155565.277954:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.277990:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.278002:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.278021:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.278039:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123705984 00000100:00100000:0.0:1746155565.278046:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123705984 00010000:00010000:0.0:1746155565.278075:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5eb3de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bbf expref: 17 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.278096:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123706112 00000100:00100000:0.0:1746155565.278098:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123706112 00010000:00010000:0.0:1746155565.278106:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10adf expref: 42 pid: 19959 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.278116:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123706496 00000100:00100000:0.0:1746155565.278118:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123706496 00010000:00010000:0.0:1746155565.278125:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a539ce00/0x844e5faceb5eb2f0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b2c expref: 38 pid: 19959 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.278143:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6002 00000100:00100000:0.0:1746155565.278149:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1963:x1830976123705984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.278160:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746155565.278176:0:22680:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746155565.278182:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5eb3de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bbf expref: 17 pid: 8436 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.278191:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5eb3de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bbf expref: 17 pid: 8436 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.278211:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.278244:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1963:x1830976123705984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.278250:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6002 00000100:00100000:0.0:1746155565.278264:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6003 00000100:00100000:0.0:1746155565.278268:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1963:x1830976123706112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.278274:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.278280:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10adf expref: 42 pid: 19959 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.278287:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10adf expref: 42 pid: 19959 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.278297:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.278311:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1963:x1830976123706112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 42us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.278316:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6003 00000100:00100000:0.0:1746155565.278327:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6004 00000100:00100000:0.0:1746155565.278331:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+38:1962:x1830976123706496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.278336:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.278342:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a539ce00/0x844e5faceb5eb2f0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b2c expref: 38 pid: 19959 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.278349:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a539ce00/0x844e5faceb5eb2f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b2c expref: 38 pid: 19959 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.278358:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.278360:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.278365:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 38 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.278372:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 38 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.278394:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 38 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155565.278403:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124563328:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155565.278437:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a403c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746155565.278546:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a539ce00/0x844e5faceb5eb2f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b2c expref: 38 pid: 19959 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.278560:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124562944:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.278567:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5eb3de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bbf expref: 16 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.278574:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124563072:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.278580:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c94c800/0x844e5faceb5eb272 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10adf expref: 41 pid: 19959 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.278587:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124563200:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.278618:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 37 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.278626:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f196600, rc 0) 00000100:00100000:0.0:1746155565.278643:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+37:29080:x1830976123705856:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 10848us (11331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.278649:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11958 00000100:00100000:1.0:1746155565.279218:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123706368 00000100:00100000:1.0:1746155565.279222:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123706368 00000100:00100000:1.0:1746155565.279246:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9983 00000100:00100000:1.0:1746155565.279251:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:29082:x1830976123706368:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155565.279264:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155565.279275:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094caee00/0x844e5faceb5eb401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10be2 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.279340:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094caec00/0x844e5faceb5eb408 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.279350:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b95 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.279356:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094caec00/0x844e5faceb5eb408 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.279373:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b95 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.279382:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b95 expref: 13 pid: 20364 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.279390:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124563456:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155565.282913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.282978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.282998:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123706752 00000100:00100000:0.0:1746155565.283004:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123706752 00002000:00100000:0.0:1746155565.283035:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880130899880 x1830976123706752/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.283044:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899880 with x1830976123706752 ext(0->1048575) 00002000:00010000:0.0:1746155565.283049:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130899880 00000100:00100000:0.0:1746155565.283061:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123707264 00000100:00100000:0.0:1746155565.283063:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123707264 00002000:00100000:0.0:1746155565.283074:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880130899c00 x1830976123707264/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.283080:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899c00 with x1830976123707264 ext(1048576->2097151) 00002000:00010000:0.0:1746155565.283082:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899c00 00000100:00100000:0.0:1746155565.283093:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4560 00000100:00100000:0.0:1746155565.283099:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123706752:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155565.284885:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4561 00000100:00100000:0.0:1746155565.284897:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1960:x1830976123707264:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155565.285108:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.288356:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.288382:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.288398:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123707136 00000100:00100000:0.0:1746155565.288404:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123707136 00002000:00100000:0.0:1746155565.288435:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1658880->1662975) req@ffff880090188a80 x1830976123707136/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.288444:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090188a80 with x1830976123707136 ext(1658880->1662975) 00002000:00010000:0.0:1746155565.288449:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090188a80 00000100:00100000:0.0:1746155565.288463:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4562 00000100:00100000:0.0:1746155565.288470:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+37:1962:x1830976123707136:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155565.288620:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+37:1962:x1830976123707136:12345-192.168.202.51@tcp:3:cat.0 Request processed in 149us (236us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155565.288625:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4562 00002000:00100000:0.0:1746155565.288632:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1658880->1662975) req@ffff880090188a80 x1830976123707136/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.288638:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090188a80 with x1830976123707136 ext(1658880->1662975) 00002000:00010000:0.0:1746155565.288640:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090188a80 00000100:00100000:0.0:1746155565.288669:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123707392 00000100:00100000:0.0:1746155565.288671:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123707392 00010000:00010000:0.0:1746155565.288685:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b95 expref: 14 pid: 20364 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.288701:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6005 00000100:00100000:0.0:1746155565.288706:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1962:x1830976123707392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.288715:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.288719:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b95 expref: 14 pid: 20364 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.288728:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b95 expref: 14 pid: 20364 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.288745:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155565.288750:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094caec00/0x844e5faceb5eb408 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.288758:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094caec00/0x844e5faceb5eb408 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.288764:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094caec00/0x844e5faceb5eb408 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.288775:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.288792:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1962:x1830976123707392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 86us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.288797:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6005 00000100:00100000:0.0:1746155565.288902:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124563328:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155565.288915:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.288930:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1962:x1830976123706496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10599us (10909us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.288935:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6004 00010000:00010000:1.0:1746155565.291364:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafc00/0x844e5faceb5eb391 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b95 expref: 13 pid: 20364 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.291380:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124563456:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155565.291394:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094caec00/0x844e5faceb5eb408 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.291401:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094caec00/0x844e5faceb5eb408 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.291404:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094caec00/0x844e5faceb5eb408 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155565.291420:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155565.291541:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094caee00/0x844e5faceb5eb401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10be2 expref: 14 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.291554:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094caec00/0x844e5faceb5eb408 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10be2 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.291561:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155565.291564:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155565.291567:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094caec00, rc 0) 00000100:00100000:1.0:1746155565.291624:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:29082:x1830976123706368:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 12371us (13674us total) trans 8589943916 rc 0/0 00000100:00100000:1.0:1746155565.291631:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9983 00000100:00100000:0.0:1746155565.297524:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123706752:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14400us (14592us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155565.297535:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4560 00002000:00100000:0.0:1746155565.297563:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880130899880 x1830976123706752/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.297572:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899880 with x1830976123706752 ext(0->1048575) 00002000:00010000:0.0:1746155565.297578:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130899880 00000100:00100000:0.0:1746155565.300026:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1960:x1830976123707264:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15128us (17043us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155565.300036:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4561 00002000:00100000:0.0:1746155565.300044:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880130899c00 x1830976123707264/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.300053:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899c00 with x1830976123707264 ext(1048576->2097151) 00002000:00010000:0.0:1746155565.300198:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899c00 00000100:00100000:1.0:1746155565.304953:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.305265:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123707648 00000100:00100000:0.0:1746155565.305273:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123707648 00000100:00100000:0.0:1746155565.305307:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9984 00000100:00100000:0.0:1746155565.305314:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:29082:x1830976123707648:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155565.305332:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.305335:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746155565.305355:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094caec00/0x844e5faceb5eb408 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10be2 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.305370:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155565.305374:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155565.305382:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601c00/0x844e5faceb5eb416 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10be9 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.305450:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601a00/0x844e5faceb5eb41d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.305460:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601a00/0x844e5faceb5eb41d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.305467:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601a00/0x844e5faceb5eb41d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.305476:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601a00/0x844e5faceb5eb41d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.305481:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601a00/0x844e5faceb5eb41d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.305485:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601a00/0x844e5faceb5eb41d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.305490:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f601a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155565.305493:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601a00/0x844e5faceb5eb41d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.305517:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601a00/0x844e5faceb5eb41d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.305524:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155565.305526:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155565.305529:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601a00/0x844e5faceb5eb41d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.305533:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601a00/0x844e5faceb5eb41d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155565.305552:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601c00/0x844e5faceb5eb416 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10be9 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.305558:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f601c00/0x844e5faceb5eb416 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10be9 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.305563:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f601c00, rc 0) 00000100:00100000:0.0:1746155565.305607:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:29082:x1830976123707648:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 283us (650us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155565.305613:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9984 00000100:00100000:1.0:1746155565.307241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.307277:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123707776 00000100:00100000:0.0:1746155565.307282:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123707776 00000100:00100000:0.0:1746155565.307308:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11959 00000100:00100000:0.0:1746155565.307317:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+28:29080:x1830976123707776:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155565.307327:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.307339:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10bf0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.307363:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b17 expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.307370:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe8400/0x844e5faceb5eb3e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bc6 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.307376:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eb336 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b72 expref: 29 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.307382:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.307383:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.307386:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.307407:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eb336 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b72 expref: 29 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.307416:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eb336 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b72 expref: 29 pid: 18270 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.307427:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124563584:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.307476:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fe8400/0x844e5faceb5eb3e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bc6 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.307484:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fe8400/0x844e5faceb5eb3e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bc6 expref: 16 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.307491:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124563712:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.307527:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b17 expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.307535:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b17 expref: 33 pid: 18270 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.307542:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124563840:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155565.307555:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a406c0 going to sleep for 11 seconds 00000001:00080000:3.0:1746155565.310688:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873173 is committed 00000001:00080000:3.0:1746155565.310699:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873171 is committed 00000001:00080000:3.0:1746155565.310705:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873151 is committed 00000001:00080000:3.0:1746155565.310709:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873143 is committed 00000001:00080000:3.0:1746155565.310736:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873157 is committed 00000001:00080000:3.0:1746155565.310758:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873174 is committed 00000001:00080000:3.0:1746155565.310768:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873167 is committed 00000001:00080000:3.0:1746155565.310771:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873165 is committed 00000001:00080000:3.0:1746155565.310847:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873168 is committed 00000100:00100000:0.0:1746155565.312573:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009018aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124563584:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155565.312585:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124563712:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155565.317077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.317107:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.317187:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123708288 00000100:00100000:2.0:1746155565.317188:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.317193:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123708288 00000100:00100000:2.0:1746155565.317202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.317222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.317227:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11960 00000100:00100000:3.0:1746155565.317234:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29085:x1830976123708288:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155565.317258:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123708416 00000100:00100000:1.0:1746155565.317261:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123708416 00000100:00100000:0.0:1746155565.317295:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124563840:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.317322:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->1077247] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.317337:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f601600, rc 0) 00010000:00010000:1.0:1746155565.317346:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eb336 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b72 expref: 30 pid: 18270 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.317360:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123708544 00000100:00100000:1.0:1746155565.317362:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123708544 00010000:00010000:1.0:1746155565.317370:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b17 expref: 34 pid: 18270 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.317370:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+30:29080:x1830976123707776:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 10056us (10132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.317375:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11959 00000100:00100000:1.0:1746155565.317380:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123708160 00000100:00100000:1.0:1746155565.317381:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123708160 00010000:00010000:1.0:1746155565.317388:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe8400/0x844e5faceb5eb3e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bc6 expref: 17 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.317394:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6006 00000100:00100000:0.0:1746155565.317399:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123708416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155565.317415:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.317429:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10bf7 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.317448:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 7 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.317455:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.317456:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.317459:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf7 expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.317483:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 7 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.317624:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.317644:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eb336 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b72 expref: 29 pid: 18270 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.317654:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eb336 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b72 expref: 29 pid: 18270 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.317669:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f19f600/0x844e5faceb5eb336 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b72 expref: 29 pid: 18270 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.317678:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.317694:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123708416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 295us (587us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155565.317725:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 7 pid: 4461 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.317737:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124563968:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155565.317785:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337300 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.317798:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123708032 00000100:00100000:3.0:1746155565.317801:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123708032 00000100:00100000:3.0:1746155565.317823:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4019 00000100:00100000:3.0:1746155565.317828:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:29082:x1830976123708032:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:1.0:1746155565.317887:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6007 00000100:00100000:1.0:1746155565.317891:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976123708544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.317902:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.317910:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b17 expref: 34 pid: 18270 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.317921:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b17 expref: 34 pid: 18270 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.317931:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e21b600/0x844e5faceb5eb2db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b17 expref: 34 pid: 18270 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.317939:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155565.317950:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:29082:x1830976123708032:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 122us (762us total) trans 8589943917 rc 0/0 00000100:00100000:1.0:1746155565.317950:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1962:x1830976123708544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 59us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.317958:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4019 00000100:00100000:1.0:1746155565.317960:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6007 00000100:00100000:1.0:1746155565.317969:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6008 00000100:00100000:1.0:1746155565.317973:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1962:x1830976123708160:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.317979:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.317985:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fe8400/0x844e5faceb5eb3e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bc6 expref: 17 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.318016:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6006 00010000:00010000:1.0:1746155565.318094:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fe8400/0x844e5faceb5eb3e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bc6 expref: 17 pid: 8436 timeout: 794 lvb_type: 1 00010000:00010000:1.0:1746155565.318104:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe8400/0x844e5faceb5eb3e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bc6 expref: 17 pid: 8436 timeout: 794 lvb_type: 1 00010000:00010000:1.0:1746155565.318119:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.318120:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.318125:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.318132:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.318427:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155565.318437:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124564096:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155565.318625:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.322400:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124563968:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155565.322405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.322428:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123708672 00010000:00010000:3.0:1746155565.322429:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf7 expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155565.322434:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123708672 00010000:00010000:3.0:1746155565.322443:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903d2000, rc 0) 00002000:00100000:0.0:1746155565.322466:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1658880->2097151) req@ffff88009018b800 x1830976123708672/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.322473:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018b800 with x1830976123708672 ext(1658880->2097151) 00000100:00100000:3.0:1746155565.322480:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29085:x1830976123708288:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5247us (5409us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155565.322480:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 8 pid: 4461 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.322487:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11960 00010000:00010000:0.0:1746155565.322489:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 8 pid: 4461 timeout: 794 lvb_type: 0 00002000:00010000:0.0:1746155565.322494:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009018b800 00000100:00100000:0.0:1746155565.322518:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 701 00000100:00100000:0.0:1746155565.322525:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123708672:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155565.322757:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124564096:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155565.322767:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155565.322786:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1962:x1830976123708160:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4813us (5564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.322793:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6008 00000100:00100000:0.0:1746155565.324655:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.325009:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123708928 00000100:00100000:1.0:1746155565.325016:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123708928 00002000:00100000:1.0:1746155565.325042:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d8:0x0] (1073152->1077247) req@ffff880090188e00 x1830976123708928/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.325051:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090188e00 with x1830976123708928 ext(1073152->1077247) 00002000:00010000:1.0:1746155565.325055:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090188e00 00000100:00100000:1.0:1746155565.325069:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4563 00000100:00100000:1.0:1746155565.325075:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123708928:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155565.325194:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123708928:12345-192.168.202.51@tcp:3:cat.0 Request processed in 118us (542us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155565.325203:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4563 00002000:00100000:1.0:1746155565.325208:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d8:0x0] (1073152->1077247) req@ffff880090188e00 x1830976123708928/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.325215:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090188e00 with x1830976123708928 ext(1073152->1077247) 00002000:00010000:1.0:1746155565.325218:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090188e00 00000001:00080000:3.0:1746155565.325941:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840552 is committed 00000001:00080000:3.0:1746155565.325956:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840508 is committed 00000001:00080000:3.0:1746155565.325966:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840490 is committed 00000001:00080000:3.0:1746155565.325973:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840555 is committed 00000001:00080000:3.0:1746155565.325981:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840550 is committed 00000001:00080000:3.0:1746155565.325985:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840539 is committed 00000001:00080000:3.0:1746155565.326042:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840547 is committed 00000001:00080000:3.0:1746155565.326093:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840554 is committed 00000001:00080000:3.0:1746155565.326099:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840551 is committed 00000001:00080000:3.0:1746155565.326103:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840548 is committed 00000100:00100000:1.0:1746155565.330211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.330667:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123709184 00000100:00100000:2.0:1746155565.330674:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123709184 00000100:00100000:2.0:1746155565.331201:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4020 00000100:00100000:2.0:1746155565.331209:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea57450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29080:x1830976123709184:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155565.331314:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123708672:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8788us (8909us total) trans 17179873176 rc 0/0 00000100:00100000:0.0:1746155565.331322:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 701 00002000:00100000:0.0:1746155565.331330:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1658880->2097151) req@ffff88009018b800 x1830976123708672/t17179873176(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/448 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.331338:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018b800 with x1830976123708672 ext(1658880->2097151) 00010000:00010000:0.0:1746155565.331345:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 10 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.331684:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 10 pid: 4461 timeout: 794 lvb_type: 0 00002000:00010000:0.0:1746155565.331691:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009018b800 00000100:00100000:2.0:1746155565.331850:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea57450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29080:x1830976123709184:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 641us (1645us total) trans 8589943918 rc 0/0 00000100:00100000:2.0:1746155565.331856:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4020 00000100:00100000:1.0:1746155565.334807:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.335444:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123709440 00000100:00100000:0.0:1746155565.335455:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123709440 00000100:00100000:0.0:1746155565.336888:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.336942:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123709568 00000100:00100000:1.0:1746155565.336947:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123709568 00010000:00010000:1.0:1746155565.336971:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 10 pid: 4461 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.336991:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6009 00000100:00100000:1.0:1746155565.336997:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123709568:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.337009:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.337027:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 10 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.337038:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 10 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.337056:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f196600/0x844e5faceb5eb3fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1658880->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bdb expref: 10 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.337068:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.337070:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.337075:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf7 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.337082:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf7 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.337106:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf7 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155565.337115:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124564224:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155565.337182:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155565.337196:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9985 00000100:00100000:1.0:1746155565.337202:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:29088:x1830976123709440:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155565.337218:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155565.337231:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafe00/0x844e5faceb5eb432 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10bfe expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.337689:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae600/0x844e5faceb5eb439 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337700:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae600/0x844e5faceb5eb439 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337708:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae600/0x844e5faceb5eb439 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337719:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae000/0x844e5faceb5eb440 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337727:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae000/0x844e5faceb5eb440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337731:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae000/0x844e5faceb5eb440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337817:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094caea00/0x844e5faceb5eb447 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337825:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094caea00/0x844e5faceb5eb447 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337831:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094caea00/0x844e5faceb5eb447 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155565.337838:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155565.337908:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae600/0x844e5faceb5eb439 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337914:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae600/0x844e5faceb5eb439 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337920:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae600/0x844e5faceb5eb439 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337925:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094cae600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155565.337928:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae600/0x844e5faceb5eb439 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337933:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae600/0x844e5faceb5eb439 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337942:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155565.337945:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155565.337948:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae600/0x844e5faceb5eb439 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337952:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae600/0x844e5faceb5eb439 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337961:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae000/0x844e5faceb5eb440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337966:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae000/0x844e5faceb5eb440 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337970:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae000/0x844e5faceb5eb440 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337974:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094cae000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155565.337976:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae000/0x844e5faceb5eb440 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337981:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae000/0x844e5faceb5eb440 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337986:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51e00) 00010000:00010000:1.0:1746155565.337988:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155565.337990:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae000/0x844e5faceb5eb440 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.337993:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cae000/0x844e5faceb5eb440 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.338026:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094cafe00/0x844e5faceb5eb432 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bfe expref: 304 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.338039:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094caea00/0x844e5faceb5eb447 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bfe expref: 303 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.338045:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155565.338047:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155565.338049:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094caea00, rc 0) 00000100:00100000:1.0:1746155565.338123:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:29088:x1830976123709440:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 920us (3322us total) trans 8589943919 rc 0/0 00000100:00100000:1.0:1746155565.338130:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9985 00000100:00100000:1.0:1746155565.349074:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124564224:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155565.349093:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155565.349143:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123709568:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 12144us (12258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.349152:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6009 00000100:00100000:0.0:1746155565.352624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.352773:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123709824 00000100:00100000:2.0:1746155565.352782:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123709824 00002000:00100000:2.0:1746155565.352827:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009018aa00 x1830976123709824/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.352993:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018aa00 with x1830976123709824 ext(1048576->2097151) 00002000:00010000:2.0:1746155565.353000:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009018aa00 00000100:00100000:2.0:1746155565.353080:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4564 00000100:00100000:2.0:1746155565.353090:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123709824:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155565.372784:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123709824:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19688us (20161us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155565.372796:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4564 00002000:00100000:3.0:1746155565.372807:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009018aa00 x1830976123709824/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.372816:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018aa00 with x1830976123709824 ext(1048576->2097151) 00002000:00010000:3.0:1746155565.372823:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009018aa00 00000100:00100000:0.0:1746155565.374652:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.376637:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123709952 00000100:00100000:3.0:1746155565.376647:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123709952 00000100:00100000:3.0:1746155565.376703:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11961 00000100:00100000:3.0:1746155565.376711:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+11:29088:x1830976123709952:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155565.376726:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.376740:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c05 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.376765:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 7 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.376772:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.376774:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.376777:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2801664->3145727] (req 2801664->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.376802:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 7 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.376813:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 7 pid: 20200 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.376824:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124564352:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155565.379284:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.381465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.381532:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123710080 00000100:00100000:2.0:1746155565.381541:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123710080 00000100:00100000:3.0:1746155565.381643:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11962 00000100:00100000:3.0:1746155565.381651:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:29085:x1830976123710080:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.381666:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.381680:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c0c expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.381704:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 7 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.381711:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.381713:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.381715:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c0c expref: 14 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.381739:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 7 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.381747:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 7 pid: 4461 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.381758:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124564480:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155565.381831:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.382943:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124564352:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.382966:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2801664->3145727] (req 2801664->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.382978:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903d2800, rc 0) 00000100:00100000:3.0:1746155565.383004:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:29088:x1830976123709952:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6294us (8357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.383011:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11961 00000100:00100000:3.0:1746155565.383090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.383252:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123710208 00000100:00100000:2.0:1746155565.383256:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123710208 00002000:00100000:2.0:1746155565.383281:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3653631) req@ffff88009fac4e00 x1830976123710208/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.383288:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4e00 with x1830976123710208 ext(3145728->3653631) 00010000:00010000:2.0:1746155565.383293:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 8 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.383306:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 8 pid: 20200 timeout: 794 lvb_type: 0 00002000:00010000:2.0:1746155565.383312:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac4e00 00000100:00100000:2.0:1746155565.383323:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 702 00000100:00100000:2.0:1746155565.383328:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1960:x1830976123710208:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155565.384302:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.384342:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123710336 00000100:00100000:1.0:1746155565.384346:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123710336 00002000:00100000:1.0:1746155565.384363:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1077247) req@ffff880130899180 x1830976123710336/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155565.384368:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124564480:192.168.202.51@tcp:104: 00002000:00100000:1.0:1746155565.384370:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899180 with x1830976123710336 ext(1048576->1077247) 00010000:00010000:1.0:1746155565.384375:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 10 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746155565.384383:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c0c expref: 13 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.384383:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 10 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746155565.384392:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133832800, rc 0) 00002000:00010000:1.0:1746155565.384392:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130899180 00000100:00100000:1.0:1746155565.384417:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 703 00000100:00100000:1.0:1746155565.384423:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123710336:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155565.384539:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:29085:x1830976123710080:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2888us (3079us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.384544:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11962 00000100:00100000:1.0:1746155565.390989:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123710336:12345-192.168.202.51@tcp:4:cat.0 Request processed in 6557us (6679us total) trans 21474840556 rc 0/0 00000100:00100000:1.0:1746155565.390998:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 703 00002000:00100000:1.0:1746155565.391008:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1077247) req@ffff880130899180 x1830976123710336/t21474840556(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/448 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.391016:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899180 with x1830976123710336 ext(1048576->1077247) 00010000:00010000:1.0:1746155565.391024:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 12 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.391035:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 12 pid: 4461 timeout: 794 lvb_type: 0 00002000:00010000:1.0:1746155565.391040:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130899180 00000100:00100000:3.0:1746155565.392916:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123710208:12345-192.168.202.51@tcp:4:cat.0 Request processed in 9580us (9819us total) trans 21474840557 rc 0/0 00000100:00100000:3.0:1746155565.392924:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 702 00002000:00100000:3.0:1746155565.392931:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3653631) req@ffff88009fac4e00 x1830976123710208/t21474840557(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/448 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.392939:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4e00 with x1830976123710208 ext(3145728->3653631) 00010000:00010000:3.0:1746155565.392946:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 12 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746155565.392956:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 12 pid: 20200 timeout: 794 lvb_type: 0 00002000:00010000:3.0:1746155565.392961:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac4e00 00000100:00100000:0.0:1746155565.403731:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.405851:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123710464 00000100:00100000:1.0:1746155565.405860:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123710464 00010000:00010000:1.0:1746155565.405893:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 12 pid: 4461 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.405935:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6010 00000100:00100000:1.0:1746155565.405942:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123710464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.405957:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.405976:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 12 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.405986:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 12 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.406005:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f601600/0x844e5faceb5eb424 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1077247) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf0 expref: 12 pid: 4461 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.406035:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.406038:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.406044:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c0c expref: 12 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.406051:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c0c expref: 12 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.406081:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c0c expref: 12 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155565.406091:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124564608:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155565.406175:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.408301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.408383:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123710592 00000100:00100000:1.0:1746155565.408390:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123710592 00010000:00010000:1.0:1746155565.408414:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 12 pid: 20200 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.408440:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6011 00000100:00100000:1.0:1746155565.408446:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123710592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.408455:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.408470:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 12 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.408479:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 12 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.408494:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0678600/0x844e5faceb5eb32f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b6b expref: 12 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.408529:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.408531:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.408536:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.408543:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.408568:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155565.408578:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124564736:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155565.408652:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155565.409311:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124564608:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155565.409431:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155565.409825:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123710464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3882us (6098us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.409831:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6010 00000100:00100000:1.0:1746155565.411735:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124564736:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155565.411750:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155565.411781:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123710592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3333us (3484us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.411789:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6011 00000100:00100000:0.0:1746155565.412856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.412929:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123710848 00000100:00100000:3.0:1746155565.412936:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123710848 00002000:00100000:3.0:1746155565.413049:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012b6c1500 x1830976123710848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.413058:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c1500 with x1830976123710848 ext(1048576->2097151) 00002000:00010000:3.0:1746155565.413062:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c1500 00000100:00100000:3.0:1746155565.413111:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4565 00000100:00100000:3.0:1746155565.413119:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976123710848:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155565.415306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.415753:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123711104 00000100:00100000:1.0:1746155565.415759:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123711104 00002000:00100000:1.0:1746155565.415786:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2801664->2805759) req@ffff88012b6c3100 x1830976123711104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.415794:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c3100 with x1830976123711104 ext(2801664->2805759) 00002000:00010000:1.0:1746155565.415798:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c3100 00000100:00100000:1.0:1746155565.415820:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4566 00000100:00100000:1.0:1746155565.415826:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976123711104:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155565.415916:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976123711104:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 90us (613us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155565.415921:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4566 00002000:00100000:1.0:1746155565.415925:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2801664->2805759) req@ffff88012b6c3100 x1830976123711104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.415931:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c3100 with x1830976123711104 ext(2801664->2805759) 00002000:00010000:1.0:1746155565.415934:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c3100 00000100:00100000:3.0:1746155565.424546:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976123710848:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11418us (11681us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155565.424558:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4565 00002000:00100000:3.0:1746155565.424569:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012b6c1500 x1830976123710848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.424579:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c1500 with x1830976123710848 ext(1048576->2097151) 00002000:00010000:3.0:1746155565.424584:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c1500 00000100:00100000:0.0:1746155565.425988:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.426048:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123711232 00000100:00100000:3.0:1746155565.426055:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123711232 00000100:00100000:3.0:1746155565.426083:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11963 00000100:00100000:3.0:1746155565.426089:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29088:x1830976123711232:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155565.426101:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.426115:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c13 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.426137:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b87 expref: 8 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.426150:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d28a00/0x844e5faceb5eb3f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bd4 expref: 6 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.426157:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.426162:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.426164:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.426167:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->2191359] (req 2097152->2191359) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.426188:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.426197:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 23 pid: 4461 timeout: 794 lvb_type: 1 00000100:00100000:3.0:1746155565.426207:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124564864:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.427542:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4d28a00/0x844e5faceb5eb3f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bd4 expref: 6 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.427555:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d28a00/0x844e5faceb5eb3f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bd4 expref: 6 pid: 18270 timeout: 794 lvb_type: 1 00000100:00100000:3.0:1746155565.427565:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124564992:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.428287:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b87 expref: 8 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.428298:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b87 expref: 8 pid: 20200 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.428306:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124565120:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155565.428331:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.434266:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124564864:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155565.437549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.437589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.437655:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123711488 00000100:00100000:0.0:1746155565.437661:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123711488 00010000:00010000:0.0:1746155565.437690:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d28a00/0x844e5faceb5eb3f3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bd4 expref: 7 pid: 18270 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.437711:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123711360 00000100:00100000:0.0:1746155565.437712:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123711360 00010000:00010000:0.0:1746155565.437721:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b87 expref: 9 pid: 20200 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.437735:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6012 00000100:00100000:0.0:1746155565.437741:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123711488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.437751:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.437769:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4d28a00/0x844e5faceb5eb3f3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bd4 expref: 7 pid: 18270 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.437779:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4d28a00/0x844e5faceb5eb3f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bd4 expref: 7 pid: 18270 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.437799:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.437839:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123711488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.437845:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6012 00000100:00100000:0.0:1746155565.437858:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6013 00000100:00100000:0.0:1746155565.437863:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1962:x1830976123711360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.437869:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.437876:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b87 expref: 9 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.437884:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b87 expref: 9 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.437894:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.437907:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1962:x1830976123711360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 43us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.437912:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6013 00010000:00010000:3.0:1746155565.438249:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d28a00/0x844e5faceb5eb3f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bd4 expref: 6 pid: 18270 timeout: 794 lvb_type: 1 00000100:00100000:3.0:1746155565.438274:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124564992:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.438283:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a227200/0x844e5faceb5eb367 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b87 expref: 8 pid: 20200 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.438290:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124565120:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.438315:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->2191359] (req 2097152->2191359) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.438323:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd4d200, rc 0) 00000100:00100000:3.0:1746155565.438344:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29088:x1830976123711232:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 12255us (12359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.438349:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11963 00000100:00100000:1.0:1746155565.442734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.443031:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123711744 00000100:00100000:3.0:1746155565.443038:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123711744 00002000:00100000:3.0:1746155565.443076:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3489791) req@ffff88008ff1a300 x1830976123711744/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 504/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.443086:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1a300 with x1830976123711744 ext(2097152->3489791) 00002000:00010000:3.0:1746155565.443091:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ff1a300 00000100:00100000:3.0:1746155565.443119:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4567 00000100:00100000:3.0:1746155565.443127:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976123711744:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155565.443934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.444115:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123712000 00000100:00100000:1.0:1746155565.444119:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123712000 00002000:00100000:1.0:1746155565.444137:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (3489792->4194303) req@ffff88012b6c1f80 x1830976123712000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.444144:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c1f80 with x1830976123712000 ext(3489792->4194303) 00002000:00010000:1.0:1746155565.444147:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c1f80 00000100:00100000:1.0:1746155565.444171:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4568 00000100:00100000:1.0:1746155565.444176:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123712000:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155565.446103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.446168:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123712256 00000100:00100000:0.0:1746155565.446173:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123712256 00002000:00100000:0.0:1746155565.446195:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88008ff1ad80 x1830976123712256/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.446203:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1ad80 with x1830976123712256 ext(2097152->3145727) 00010000:00010000:0.0:1746155565.446209:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 23 pid: 4461 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.446220:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 23 pid: 4461 timeout: 794 lvb_type: 1 00002000:00010000:0.0:1746155565.446226:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ff1ad80 00000100:00100000:0.0:1746155565.446239:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 704 00000100:00100000:0.0:1746155565.446245:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123712256:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155565.446400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.446422:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123712512 00000100:00100000:2.0:1746155565.446425:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123712512 00002000:00100000:2.0:1746155565.446438:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009f3ed180 x1830976123712512/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.446444:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ed180 with x1830976123712512 ext(3145728->4194303) 00010000:00010000:2.0:1746155565.446448:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 24 pid: 4461 timeout: 794 lvb_type: 1 00010000:00010000:2.0:1746155565.446455:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 24 pid: 4461 timeout: 794 lvb_type: 1 00002000:00010000:2.0:1746155565.446460:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f3ed180 00000100:00100000:2.0:1746155565.446470:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 705 00000100:00100000:2.0:1746155565.446474:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123712512:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155565.456034:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123711744:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12899us (13298us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155565.456046:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4567 00002000:00100000:3.0:1746155565.456835:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3489791) req@ffff88008ff1a300 x1830976123711744/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 504/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.456844:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1a300 with x1830976123711744 ext(2097152->3489791) 00002000:00010000:3.0:1746155565.456850:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ff1a300 00000100:00100000:1.0:1746155565.459051:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976123712000:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14869us (15113us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746155565.459061:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4568 00002000:00100000:1.0:1746155565.459070:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (3489792->4194303) req@ffff88012b6c1f80 x1830976123712000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.459079:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c1f80 with x1830976123712000 ext(3489792->4194303) 00002000:00010000:1.0:1746155565.459084:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c1f80 00000100:00100000:2.0:1746155565.460951:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123712256:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14701us (14847us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155565.460959:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 704 00002000:00100000:2.0:1746155565.460966:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88008ff1ad80 x1830976123712256/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.460973:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1ad80 with x1830976123712256 ext(2097152->3145727) 00010000:00010000:2.0:1746155565.460980:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 25 pid: 4461 timeout: 794 lvb_type: 1 00010000:00010000:2.0:1746155565.460991:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 25 pid: 4461 timeout: 794 lvb_type: 1 00002000:00010000:2.0:1746155565.460997:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ff1ad80 00000100:00100000:0.0:1746155565.466835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.466913:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123712640 00000100:00100000:3.0:1746155565.466922:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123712640 00000100:00100000:3.0:1746155565.466968:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11964 00000100:00100000:3.0:1746155565.466976:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:29085:x1830976123712640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.466990:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.467004:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c1a expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.467023:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.467029:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->2191359] (req 2097152->2191359) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.467039:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.467042:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c1a expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.467072:0:29728:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->2191359] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.467083:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c1a expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.467092:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce6f200, rc 0) 00000100:00100000:3.0:1746155565.467143:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:29085:x1830976123712640:12345-192.168.202.51@tcp:101:cat.0 Request processed in 167us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.467152:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11964 00000100:00100000:2.0:1746155565.467721:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123712512:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21245us (21319us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155565.467729:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 705 00002000:00100000:2.0:1746155565.467737:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009f3ed180 x1830976123712512/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.467745:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ed180 with x1830976123712512 ext(3145728->4194303) 00010000:00010000:2.0:1746155565.467751:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 24 pid: 4461 timeout: 794 lvb_type: 1 00010000:00010000:2.0:1746155565.467761:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 24 pid: 4461 timeout: 794 lvb_type: 1 00002000:00010000:2.0:1746155565.467766:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f3ed180 00000100:00100000:0.0:1746155565.477845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.477905:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123712768 00000100:00100000:1.0:1746155565.477913:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123712768 00010000:00010000:1.0:1746155565.477942:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 24 pid: 4461 timeout: 794 lvb_type: 1 00000100:00100000:1.0:1746155565.477978:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6014 00000100:00100000:1.0:1746155565.477985:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123712768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.477998:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.478016:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 24 pid: 4461 timeout: 794 lvb_type: 1 00010000:00010000:1.0:1746155565.478027:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 24 pid: 4461 timeout: 794 lvb_type: 1 00010000:00010000:1.0:1746155565.478044:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9a00/0x844e5faceb5eb3c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10baa expref: 24 pid: 4461 timeout: 794 lvb_type: 1 00010000:00010000:1.0:1746155565.478080:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.478082:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.478088:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.478095:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.478122:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.478132:0:7063:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 23 pid: 29728 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.478143:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124565376:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155565.478222:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.480636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.480712:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124565376:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155565.480726:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.480754:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123712768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2769us (2916us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.480762:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6014 00000100:00100000:1.0:1746155565.480840:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123713024 00000100:00100000:1.0:1746155565.480845:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123713024 00000100:00100000:1.0:1746155565.480881:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9986 00000100:00100000:1.0:1746155565.480887:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29092:x1830976123713024:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155565.480906:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155565.480921:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542be00/0x844e5faceb5eb471 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c21 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.481000:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.481012:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094caea00/0x844e5faceb5eb447 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bfe expref: 302 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.481018:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.481041:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094caea00/0x844e5faceb5eb447 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bfe expref: 302 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.481049:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094caea00/0x844e5faceb5eb447 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bfe expref: 302 pid: 15474 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.481059:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124565504:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155565.481112:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c8500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.482537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.482581:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123713152 00000100:00100000:2.0:1746155565.482586:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123713152 00010000:00010000:2.0:1746155565.482614:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094caea00/0x844e5faceb5eb447 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bfe expref: 303 pid: 15474 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.482615:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124565504:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155565.482627:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155565.482633:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6015 00000100:00100000:2.0:1746155565.482639:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:1963:x1830976123713152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155565.482647:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155565.482651:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094caea00/0x844e5faceb5eb447 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bfe expref: 303 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.482659:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094caea00/0x844e5faceb5eb447 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bfe expref: 303 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.482674:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094caea00/0x844e5faceb5eb447 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bfe expref: 303 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.482698:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155565.482702:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155565.482708:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155565.482714:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155565.482734:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155565.482752:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155565.482758:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:1963:x1830976123713152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 118us (224us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155565.482758:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155565.482764:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6015 00000004:00200000:1.0:1746155565.482770:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155565.482866:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542be00/0x844e5faceb5eb471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c21 expref: 24 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.482881:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c21 expref: 23 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.482887:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155565.482890:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155565.482892:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a542a800, rc 0) 00000100:00100000:1.0:1746155565.482993:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29092:x1830976123713024:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2105us (2361us total) trans 8589943920 rc 0/0 00000100:00100000:1.0:1746155565.482998:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9986 00000100:00100000:0.0:1746155565.486119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.486245:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123713408 00000100:00100000:2.0:1746155565.486256:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123713408 00002000:00100000:2.0:1746155565.486350:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (2187264->2191359) req@ffff88013089b100 x1830976123713408/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.486359:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089b100 with x1830976123713408 ext(2187264->2191359) 00010000:00010000:2.0:1746155565.486368:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 23 pid: 29728 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.486382:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 23 pid: 29728 timeout: 794 lvb_type: 0 00002000:00010000:2.0:1746155565.486389:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013089b100 00000100:00100000:2.0:1746155565.486875:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 706 00000100:00100000:2.0:1746155565.486885:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123713408:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155565.487067:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123713408:12345-192.168.202.51@tcp:3:cat.0 Request processed in 182us (955us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155565.487074:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 706 00002000:00100000:2.0:1746155565.487081:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (2187264->2191359) req@ffff88013089b100 x1830976123713408/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.487087:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089b100 with x1830976123713408 ext(2187264->2191359) 00010000:00010000:2.0:1746155565.487093:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 23 pid: 29728 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.487104:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 23 pid: 29728 timeout: 794 lvb_type: 0 00002000:00010000:2.0:1746155565.487109:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013089b100 00000100:00100000:0.0:1746155565.491820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.491890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.491946:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123713920 00000100:00100000:1.0:1746155565.491954:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123713920 00002000:00100000:1.0:1746155565.491988:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2191359) req@ffff88009c211880 x1830976123713920/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.491996:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211880 with x1830976123713920 ext(2097152->2191359) 00010000:00010000:1.0:1746155565.492003:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 23 pid: 29728 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.492015:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 23 pid: 29728 timeout: 794 lvb_type: 0 00002000:00010000:1.0:1746155565.492027:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c211880 00000100:00100000:1.0:1746155565.492054:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 707 00000100:00100000:1.0:1746155565.492061:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123713920:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155565.492177:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123713792 00000100:00100000:2.0:1746155565.492183:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123713792 00000100:00100000:2.0:1746155565.493014:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4021 00000100:00100000:2.0:1746155565.493021:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:29088:x1830976123713792:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155565.493155:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:29088:x1830976123713792:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 134us (1343us total) trans 8589943921 rc 0/0 00000100:00100000:2.0:1746155565.493161:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4021 00000100:00100000:1.0:1746155565.498478:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123713920:12345-192.168.202.51@tcp:4:cat.0 Request processed in 6408us (6580us total) trans 17179873177 rc 0/0 00000100:00100000:1.0:1746155565.498489:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 707 00002000:00100000:1.0:1746155565.498500:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2191359) req@ffff88009c211880 x1830976123713920/t17179873177(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/448 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.498547:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211880 with x1830976123713920 ext(2097152->2191359) 00010000:00010000:1.0:1746155565.498556:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 25 pid: 29728 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.498570:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 25 pid: 29728 timeout: 794 lvb_type: 0 00002000:00010000:1.0:1746155565.498576:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c211880 00000100:00100000:2.0:1746155565.498749:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.498799:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.498839:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.498868:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123714048 00000100:00100000:2.0:1746155565.498873:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123714048 00000100:00100000:2.0:1746155565.498897:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123714176 00000100:00100000:2.0:1746155565.498899:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123714176 00000100:00100000:2.0:1746155565.498909:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123714304 00000100:00100000:2.0:1746155565.498911:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123714304 00000100:00100000:2.0:1746155565.498925:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11965 00000100:00100000:2.0:1746155565.498931:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1963:x1830976123714048:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155565.498935:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11966 00010000:00010000:2.0:1746155565.498943:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155565.498945:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123714176:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.498954:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.498956:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5eb486 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c28 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.498962:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fe00/0x844e5faceb5eb48d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c2f expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.498972:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.498973:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.498974:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.498976:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.498980:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5eb486 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c28 expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.498981:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fe00/0x844e5faceb5eb48d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c2f expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.498992:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5eb486 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c28 expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.498993:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fe00/0x844e5faceb5eb48d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c2f expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.499002:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0e00, rc 0) 00000100:00100000:2.0:1746155565.499022:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1963:x1830976123714048:12345-192.168.202.51@tcp:101:cat.0 Request processed in 91us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.499027:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11965 00000100:00100000:2.0:1746155565.499037:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11967 00000100:00100000:2.0:1746155565.499042:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123714304:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155565.499047:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.499054:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb494 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c36 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155565.499082:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124565632:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155565.499117:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdc00 going to sleep for 11 seconds 00010000:00010000:3.0:1746155565.499216:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce6fe00, rc 0) 00000100:00100000:3.0:1746155565.499238:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123714176:12345-192.168.202.51@tcp:101:cat.0 Request processed in 296us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.499243:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11966 00000100:00100000:0.0:1746155565.500969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.501139:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123714432 00000100:00100000:1.0:1746155565.501145:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123714432 00000100:00100000:1.0:1746155565.501489:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11968 00000100:00100000:1.0:1746155565.501496:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1962:x1830976123714432:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155565.501646:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155565.501657:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a7c9400/0x844e5faceb5eb49b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c3d expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155565.501692:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124565760:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155565.501739:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c8500c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155565.503352:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124565632:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155565.503374:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb494 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c36 expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.503384:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb494 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c36 expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.503407:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1e00, rc 0) 00000100:00100000:2.0:1746155565.503674:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123714304:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4630us (4832us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155565.503680:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11967 00000100:00100000:0.0:1746155565.504370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.504450:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124565760:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155565.504466:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a7c9400/0x844e5faceb5eb49b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c3d expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155565.504475:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a7c9400/0x844e5faceb5eb49b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c3d expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155565.504485:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a7c9400, rc 0) 00000100:00100000:1.0:1746155565.504518:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1962:x1830976123714432:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3021us (3550us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155565.504523:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11968 00000100:00100000:2.0:1746155565.504606:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123714560 00000100:00100000:2.0:1746155565.504611:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123714560 00010000:00010000:2.0:1746155565.504630:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 25 pid: 29728 timeout: 794 lvb_type: 0 00000100:00100000:2.0:1746155565.504659:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6016 00000100:00100000:2.0:1746155565.504665:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123714560:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155565.504674:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155565.504684:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 25 pid: 29728 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.504692:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 25 pid: 29728 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.504707:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5eb463 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c13 expref: 25 pid: 29728 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.504717:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.504719:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.504725:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c1a expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.504732:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c1a expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.504755:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c1a expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155565.504769:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124565888:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155565.505207:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.511588:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.511728:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123714944 00000100:00100000:1.0:1746155565.511736:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123714944 00002000:00100000:1.0:1746155565.511773:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009c212300 x1830976123714944/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.511782:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212300 with x1830976123714944 ext(1048576->2097151) 00002000:00010000:1.0:1746155565.511787:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c212300 00000100:00100000:1.0:1746155565.511817:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4569 00000100:00100000:1.0:1746155565.511824:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123714944:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155565.512974:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124565888:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155565.512990:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155565.513016:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123714560:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8351us (8647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.513023:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6016 00000100:00100000:0.0:1746155565.515782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.515822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.515887:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123715200 00000100:00100000:3.0:1746155565.515894:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123715200 00002000:00100000:3.0:1746155565.515929:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009c213b80 x1830976123715200/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.515938:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213b80 with x1830976123715200 ext(1048576->2097151) 00002000:00010000:3.0:1746155565.515942:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c213b80 00000100:00100000:3.0:1746155565.516003:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123715456 00000100:00100000:3.0:1746155565.516005:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123715456 00002000:00100000:3.0:1746155565.516017:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009c210a80 x1830976123715456/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.516023:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210a80 with x1830976123715456 ext(2097152->3145727) 00002000:00010000:3.0:1746155565.516026:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c210a80 00000100:00100000:3.0:1746155565.516406:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4570 00000100:00100000:3.0:1746155565.516414:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123715200:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155565.518318:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4571 00000100:00100000:2.0:1746155565.518342:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123715456:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155565.520062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.520420:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123715712 00000100:00100000:1.0:1746155565.520428:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123715712 00002000:00100000:1.0:1746155565.520459:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009c211f80 x1830976123715712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.520469:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211f80 with x1830976123715712 ext(3145728->4194303) 00002000:00010000:1.0:1746155565.520474:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c211f80 00000100:00100000:1.0:1746155565.520516:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4572 00000100:00100000:1.0:1746155565.520523:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123715712:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155565.525427:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123714944:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13593us (13838us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155565.525438:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4569 00002000:00100000:1.0:1746155565.525448:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009c212300 x1830976123714944/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.525457:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212300 with x1830976123714944 ext(1048576->2097151) 00002000:00010000:1.0:1746155565.525462:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c212300 00000100:00100000:2.0:1746155565.533858:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123715456:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15524us (18026us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155565.533868:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4571 00002000:00100000:2.0:1746155565.533877:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009c210a80 x1830976123715456/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.533886:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210a80 with x1830976123715456 ext(2097152->3145727) 00002000:00010000:2.0:1746155565.533891:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c210a80 00000100:00100000:3.0:1746155565.533942:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123715200:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17528us (18166us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155565.533949:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4570 00002000:00100000:3.0:1746155565.533955:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009c213b80 x1830976123715200/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.533966:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213b80 with x1830976123715200 ext(1048576->2097151) 00002000:00010000:3.0:1746155565.533969:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c213b80 00000100:00100000:1.0:1746155565.534678:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123715712:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14153us (14619us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155565.534684:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4572 00002000:00100000:1.0:1746155565.534689:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009c211f80 x1830976123715712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.534695:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211f80 with x1830976123715712 ext(3145728->4194303) 00002000:00010000:1.0:1746155565.534697:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c211f80 00000100:00100000:0.0:1746155565.543276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.543393:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123715968 00000100:00100000:1.0:1746155565.543401:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123715968 00002000:00100000:1.0:1746155565.543435:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009c210e00 x1830976123715968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.543448:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210e00 with x1830976123715968 ext(4194304->4956159) 00002000:00010000:1.0:1746155565.543452:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c210e00 00000100:00100000:1.0:1746155565.543479:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4573 00000100:00100000:1.0:1746155565.543485:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976123715968:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155565.545477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.545713:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.545776:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123716096 00000100:00100000:2.0:1746155565.545782:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123716096 00000100:00100000:2.0:1746155565.545816:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123716224 00000100:00100000:2.0:1746155565.545818:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123716224 00000100:00100000:2.0:1746155565.545831:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11969 00000100:00100000:2.0:1746155565.545838:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123716096:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155565.545849:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.545863:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5eb4a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c44 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155565.545903:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124566016:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155565.545961:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155565.545977:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11970 00000100:00100000:2.0:1746155565.545982:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123716224:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155565.545989:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.545996:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb4a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c4b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.546006:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.546008:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.546014:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb4a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c4b expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.546026:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb4a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c4b expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.546034:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1e00, rc 0) 00000100:00100000:2.0:1746155565.546054:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123716224:12345-192.168.202.51@tcp:101:cat.0 Request processed in 71us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.546059:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11970 00002000:00010000:2.0:1746155565.549273:0:4461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155565 -> 1746155566 00000100:00100000:2.0:1746155565.549296:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124566016:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155565.549321:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5eb4a2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c44 expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.549340:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5eb4a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c44 expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.549353:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0400, rc 0) 00000100:00100000:2.0:1746155565.550961:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123716096:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5117us (5483us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155565.550970:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11969 00000100:00100000:1.0:1746155565.554153:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976123715968:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10658us (10874us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155565.554163:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4573 00002000:00100000:1.0:1746155565.554172:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009c210e00 x1830976123715968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.554181:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210e00 with x1830976123715968 ext(4194304->4956159) 00002000:00010000:1.0:1746155565.554185:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c210e00 00000100:00100000:0.0:1746155565.554499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.554555:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123716352 00000100:00100000:2.0:1746155565.554562:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123716352 00000100:00100000:2.0:1746155565.554593:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11971 00000100:00100000:2.0:1746155565.554609:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29095:x1830976123716352:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155565.554621:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.555477:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c52 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.555529:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.555537:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155565.555539:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155565.555543:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c52 expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.555567:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.555582:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 12 pid: 10591 timeout: 794 lvb_type: 0 00000100:00100000:2.0:1746155565.555593:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124566144:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155565.555648:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.561113:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124566144:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.561141:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c52 expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.561156:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0000, rc 0) 00000100:00100000:3.0:1746155565.561194:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29095:x1830976123716352:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6585us (6697us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.561202:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11971 00000100:00100000:0.0:1746155565.563926:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.564111:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123716480 00000100:00100000:2.0:1746155565.564119:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123716480 00002000:00100000:2.0:1746155565.564155:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (2801664->3145727) req@ffff88009fb6b480 x1830976123716480/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.564163:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b480 with x1830976123716480 ext(2801664->3145727) 00010000:00010000:2.0:1746155565.564171:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 13 pid: 10591 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.564183:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 13 pid: 10591 timeout: 794 lvb_type: 0 00002000:00010000:2.0:1746155565.564189:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb6b480 00000100:00100000:2.0:1746155565.565329:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 708 00000100:00100000:2.0:1746155565.565336:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976123716480:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155565.566121:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.566165:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123716608 00000100:00100000:3.0:1746155565.566170:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123716608 00000100:00100000:3.0:1746155565.566209:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11972 00000100:00100000:3.0:1746155565.566215:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976123716608:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.566223:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.566235:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fc00/0x844e5faceb5eb4b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c59 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155565.566271:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124566272:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155565.566319:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155565.572329:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124566272:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155565.572358:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fc00/0x844e5faceb5eb4b7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c59 expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155565.572370:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fc00/0x844e5faceb5eb4b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c59 expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155565.572383:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce6fc00, rc 0) 00000100:00100000:1.0:1746155565.572415:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976123716608:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6200us (6295us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155565.572421:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11972 00000100:00100000:3.0:1746155565.573469:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976123716480:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8131us (9546us total) trans 21474840558 rc 0/0 00000100:00100000:3.0:1746155565.573477:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 708 00002000:00100000:3.0:1746155565.573484:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (2801664->3145727) req@ffff88009fb6b480 x1830976123716480/t21474840558(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/448 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.573493:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b480 with x1830976123716480 ext(2801664->3145727) 00010000:00010000:3.0:1746155565.573499:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 15 pid: 10591 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746155565.573542:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 15 pid: 10591 timeout: 794 lvb_type: 0 00002000:00010000:3.0:1746155565.573548:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb6b480 00000100:00100000:0.0:1746155565.573916:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.573952:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123716736 00000100:00100000:1.0:1746155565.573957:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123716736 00000100:00100000:1.0:1746155565.573994:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11973 00000100:00100000:1.0:1746155565.573999:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:29085:x1830976123716736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155565.574011:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155565.574023:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c60 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.574039:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155565.574041:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155565.574045:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4952064->5242879] (req 4952064->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.574054:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4952064->5242879] (req 4952064->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.574062:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb39e00, rc 0) 00000100:00100000:1.0:1746155565.574091:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:29085:x1830976123716736:12345-192.168.202.51@tcp:101:cat.0 Request processed in 91us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.574097:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11973 00000100:00100000:0.0:1746155565.580398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.582488:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123716864 00000100:00100000:2.0:1746155565.582497:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123716864 00010000:00010000:2.0:1746155565.582545:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 16 pid: 10591 timeout: 794 lvb_type: 0 00000100:00100000:2.0:1746155565.582607:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6017 00000100:00100000:2.0:1746155565.582617:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f247480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976123716864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155565.582632:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155565.582654:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 16 pid: 10591 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.582666:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 16 pid: 10591 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.582688:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903d2800/0x844e5faceb5eb455 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2801664->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c05 expref: 16 pid: 10591 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.582716:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.582719:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.582727:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c52 expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.582735:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c52 expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.582743:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.582744:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.582748:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 15 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.582753:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 15 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.582785:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 15 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155565.582797:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124566400:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155565.582914:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c52 expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155565.582926:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124566528:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155565.582954:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd780 going to sleep for 11 seconds 00000100:00100000:2.0:1746155565.585428:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124566400:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155565.585442:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124566528:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155565.585459:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155565.587412:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f247480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976123716864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4791us (7018us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.587423:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6017 00000100:00100000:0.0:1746155565.589554:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.589627:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123717120 00000100:00100000:3.0:1746155565.589634:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123717120 00002000:00100000:3.0:1746155565.589667:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (4952064->4956159) req@ffff88009f245880 x1830976123717120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.589676:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f245880 with x1830976123717120 ext(4952064->4956159) 00002000:00010000:3.0:1746155565.589681:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f245880 00000100:00100000:3.0:1746155565.589707:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4574 00000100:00100000:3.0:1746155565.589714:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976123717120:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155565.589861:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976123717120:12345-192.168.202.51@tcp:3:cat.0 Request processed in 147us (360us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155565.589867:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4574 00002000:00100000:3.0:1746155565.589872:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (4952064->4956159) req@ffff88009f245880 x1830976123717120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.589879:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f245880 with x1830976123717120 ext(4952064->4956159) 00002000:00010000:3.0:1746155565.589882:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f245880 00000100:00100000:0.0:1746155565.596214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.596356:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123717504 00000100:00100000:3.0:1746155565.596365:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123717504 00002000:00100000:3.0:1746155565.596402:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009f247b80 x1830976123717504/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.596411:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f247b80 with x1830976123717504 ext(3145728->4194303) 00002000:00010000:3.0:1746155565.596415:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f247b80 00000100:00100000:3.0:1746155565.596442:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4575 00000100:00100000:3.0:1746155565.596449:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123717504:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155565.596542:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.596585:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123717888 00000100:00100000:0.0:1746155565.596589:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123717888 00002000:00100000:0.0:1746155565.596617:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800948e5c00 x1830976123717888/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.596624:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5c00 with x1830976123717888 ext(2097152->3145727) 00002000:00010000:0.0:1746155565.596628:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e5c00 00000100:00100000:0.0:1746155565.596654:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4576 00000100:00100000:0.0:1746155565.596661:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123717888:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155565.603792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.603822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.604467:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123718144 00000100:00100000:0.0:1746155565.604475:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123718144 00002000:00100000:0.0:1746155565.604530:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009f3ec380 x1830976123718144/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.604539:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ec380 with x1830976123718144 ext(3145728->4194303) 00002000:00010000:0.0:1746155565.604544:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3ec380 00000100:00100000:0.0:1746155565.604568:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123717376 00000100:00100000:0.0:1746155565.604571:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123717376 00002000:00100000:0.0:1746155565.604583:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009f3ec700 x1830976123717376/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.604589:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ec700 with x1830976123717376 ext(2097152->3145727) 00002000:00010000:0.0:1746155565.604592:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ec700 00000100:00100000:0.0:1746155565.604627:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4577 00000100:00100000:0.0:1746155565.604634:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123718144:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155565.605140:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4578 00000100:00100000:3.0:1746155565.605150:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123717376:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155565.610118:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.610180:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123718400 00000100:00100000:3.0:1746155565.610188:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123718400 00000100:00100000:3.0:1746155565.610897:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4022 00000100:00100000:3.0:1746155565.610906:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:29085:x1830976123718400:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155565.611313:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:29085:x1830976123718400:12345-192.168.202.51@tcp:35:cat.0 Request processed in 407us (1201us total) trans 8589943922 rc 0/0 00000100:00100000:3.0:1746155565.611320:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4022 00000100:00100000:3.0:1746155565.612872:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976123717504:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16420us (16660us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155565.612880:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4575 00002000:00100000:3.0:1746155565.612890:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009f247b80 x1830976123717504/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.612899:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f247b80 with x1830976123717504 ext(3145728->4194303) 00002000:00010000:3.0:1746155565.612903:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f247b80 00000100:00100000:1.0:1746155565.617142:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123717888:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20473us (20592us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155565.617153:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4576 00002000:00100000:1.0:1746155565.617162:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800948e5c00 x1830976123717888/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.617170:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5c00 with x1830976123717888 ext(2097152->3145727) 00002000:00010000:1.0:1746155565.617175:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e5c00 00000100:00100000:3.0:1746155565.620295:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123717376:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15140us (16463us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155565.620305:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4578 00002000:00100000:3.0:1746155565.620315:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009f3ec700 x1830976123717376/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.620323:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ec700 with x1830976123717376 ext(2097152->3145727) 00002000:00010000:3.0:1746155565.620327:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ec700 00000100:00100000:1.0:1746155565.624924:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123718144:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20282us (21131us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155565.624934:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4577 00002000:00100000:1.0:1746155565.624944:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009f3ec380 x1830976123718144/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.624952:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ec380 with x1830976123718144 ext(3145728->4194303) 00002000:00010000:1.0:1746155565.624957:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3ec380 00000100:00100000:0.0:1746155565.634163:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.634286:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123718656 00000100:00100000:1.0:1746155565.634294:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123718656 00000100:00100000:1.0:1746155565.634340:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9987 00000100:00100000:1.0:1746155565.634347:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:29098:x1830976123718656:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155565.634369:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155565.634384:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094484e00/0x844e5faceb5eb4c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c67 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.634467:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eb4cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634478:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eb4cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634486:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eb4cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634495:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094484600/0x844e5faceb5eb4d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634499:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094484600/0x844e5faceb5eb4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634609:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094484600/0x844e5faceb5eb4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634712:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094484400/0x844e5faceb5eb4da lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634720:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094484400/0x844e5faceb5eb4da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634726:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094484400/0x844e5faceb5eb4da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155565.634734:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155565.634808:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eb4cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634814:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eb4cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634819:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eb4cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634823:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094484c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155565.634826:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eb4cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634831:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eb4cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634840:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155565.634842:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155565.634846:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eb4cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.634854:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094484c00/0x844e5faceb5eb4cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.635942:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094484600/0x844e5faceb5eb4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.635948:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094484600/0x844e5faceb5eb4d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.635953:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094484600/0x844e5faceb5eb4d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.635957:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094484600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155565.635959:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094484600/0x844e5faceb5eb4d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.635963:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094484600/0x844e5faceb5eb4d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.635970:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51900) 00010000:00010000:1.0:1746155565.635972:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155565.635974:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094484600/0x844e5faceb5eb4d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.635978:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094484600/0x844e5faceb5eb4d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.636014:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094484e00/0x844e5faceb5eb4c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c67 expref: 307 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.636023:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094484400/0x844e5faceb5eb4da lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c67 expref: 306 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.636033:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155565.636034:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155565.636036:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094484400, rc 0) 00000100:00100000:1.0:1746155565.636095:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:29098:x1830976123718656:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1747us (1938us total) trans 8589943923 rc 0/0 00000100:00100000:1.0:1746155565.636101:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9987 00000100:00100000:0.0:1746155565.637922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.637984:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123718912 00000100:00100000:1.0:1746155565.637990:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123718912 00002000:00100000:1.0:1746155565.638020:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009f247800 x1830976123718912/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.638027:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f247800 with x1830976123718912 ext(4194304->4956159) 00002000:00010000:1.0:1746155565.638031:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f247800 00000100:00100000:1.0:1746155565.638057:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4579 00000100:00100000:1.0:1746155565.638064:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123718912:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155565.638919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.638996:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123719040 00000100:00100000:2.0:1746155565.639001:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123719040 00000100:00100000:2.0:1746155565.639029:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11974 00000100:00100000:2.0:1746155565.639034:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29092:x1830976123719040:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155565.639044:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.639058:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c6e expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.639079:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b3a expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.639087:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8200/0x844e5faceb5eb3d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb8 expref: 5 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.639094:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a226a00/0x844e5faceb5eb31a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b56 expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.639099:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.639101:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.639104:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1347584->2097151] (req 1347584->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.639127:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a226a00/0x844e5faceb5eb31a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b56 expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.639137:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a226a00/0x844e5faceb5eb31a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b56 expref: 23 pid: 19959 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155565.639148:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124566656:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155565.639256:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe8200/0x844e5faceb5eb3d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb8 expref: 5 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.639264:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8200/0x844e5faceb5eb3d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb8 expref: 5 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155565.639272:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124566784:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155565.639295:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b3a expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.639302:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b3a expref: 11 pid: 20200 timeout: 794 lvb_type: 0 00000100:00100000:2.0:1746155565.639308:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124566912:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155565.639320:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155565.641309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.641451:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123719168 00000100:00100000:3.0:1746155565.641456:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123719168 00000100:00100000:3.0:1746155565.641494:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 581 00000100:00100000:3.0:1746155565.641498:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:1962:x1830976123719168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155565.641521:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155565.641638:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094484400/0x844e5faceb5eb4da lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c67 expref: 306 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.641666:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155565.641670:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155565.641707:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:1962:x1830976123719168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 207us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.641713:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 581 00000100:00100000:0.0:1746155565.643054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.643089:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.643105:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.643121:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123719296 00000100:00100000:0.0:1746155565.643125:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123719296 00010000:00010000:0.0:1746155565.643145:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a226a00/0x844e5faceb5eb31a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b56 expref: 24 pid: 19959 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.643162:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123719552 00000100:00100000:0.0:1746155565.643164:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123719552 00010000:00010000:0.0:1746155565.643172:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b3a expref: 12 pid: 20200 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.643183:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123719424 00000100:00100000:0.0:1746155565.643185:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123719424 00010000:00010000:0.0:1746155565.643193:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8200/0x844e5faceb5eb3d7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb8 expref: 6 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:1.0:1746155565.643195:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6018 00000100:00100000:1.0:1746155565.643202:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123719296:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155565.643206:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6019 00000100:00100000:0.0:1746155565.643210:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123719552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.643211:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.643217:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.643227:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b3a expref: 12 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.643229:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a226a00/0x844e5faceb5eb31a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b56 expref: 24 pid: 19959 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.643235:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b3a expref: 12 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.643277:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a226a00/0x844e5faceb5eb31a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b56 expref: 24 pid: 19959 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155565.643291:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124566656:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155565.643298:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124566784:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155565.643298:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a226a00/0x844e5faceb5eb31a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b56 expref: 24 pid: 19959 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155565.643303:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124566912:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155565.643313:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155565.643324:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1347584->2097151] (req 1347584->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.643333:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1000, rc 0) 00000100:00100000:1.0:1746155565.643338:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123719296:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 137us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.643343:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6018 00000100:00100000:2.0:1746155565.643350:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29092:x1830976123719040:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4316us (4432us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.643355:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11974 00000100:00100000:1.0:1746155565.643358:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6020 00000100:00100000:1.0:1746155565.643363:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976123719424:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.643370:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.643378:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fe8200/0x844e5faceb5eb3d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb8 expref: 6 pid: 8436 timeout: 794 lvb_type: 1 00010000:00010000:1.0:1746155565.643385:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fe8200/0x844e5faceb5eb3d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb8 expref: 6 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155565.643388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155565.643395:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8200/0x844e5faceb5eb3d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb8 expref: 6 pid: 8436 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155565.643402:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123719680 00000100:00100000:2.0:1746155565.643404:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123719680 00010000:00010000:1.0:1746155565.643411:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155565.643419:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9988 00000100:00100000:2.0:1746155565.643423:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:29100:x1830976123719680:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:1.0:1746155565.643423:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1961:x1830976123719424:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 60us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.643427:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6020 00010000:00010000:2.0:1746155565.643437:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.643446:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5eb4ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c75 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.643737:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a226e00/0x844e5faceb5eb2fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b3a expref: 11 pid: 20200 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.643749:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.643751:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.643755:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.643762:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.643782:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155565.643791:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f244700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124567040:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155565.643831:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a403c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746155565.643871:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5eb4f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155565.643880:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5eb4f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155565.643887:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5eb4f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155565.643896:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5eb4fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155565.643900:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5eb4fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155565.643905:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5eb4fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155565.643980:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155565.643987:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c21 expref: 22 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.643992:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155565.644004:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c21 expref: 22 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.644013:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c21 expref: 22 pid: 15474 timeout: 794 lvb_type: 0 00000100:00100000:2.0:1746155565.644020:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124567168:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155565.644035:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155565.646517:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123718912:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8432us (8576us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155565.646529:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4579 00002000:00100000:1.0:1746155565.646538:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009f247800 x1830976123718912/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.646546:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f247800 with x1830976123718912 ext(4194304->4956159) 00002000:00010000:1.0:1746155565.646551:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f247800 00000100:00100000:1.0:1746155565.649669:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f244700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124567040:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155565.649685:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155565.649716:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123719552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6504us (6626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.649731:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6019 00000100:00100000:2.0:1746155565.649973:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124567168:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155565.649990:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155565.650629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.650725:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123719936 00000100:00100000:1.0:1746155565.650730:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123719936 00002000:00100000:1.0:1746155565.650757:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1347584->1351679) req@ffff88009f246680 x1830976123719936/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.650765:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f246680 with x1830976123719936 ext(1347584->1351679) 00002000:00010000:1.0:1746155565.650769:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f246680 00000100:00100000:1.0:1746155565.651843:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4580 00000100:00100000:1.0:1746155565.651852:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123719936:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155565.651991:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123719936:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 140us (1363us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155565.651998:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4580 00002000:00100000:1.0:1746155565.652003:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1347584->1351679) req@ffff88009f246680 x1830976123719936/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.652018:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f246680 with x1830976123719936 ext(1347584->1351679) 00002000:00010000:1.0:1746155565.652021:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f246680 00000100:00100000:0.0:1746155565.656019:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.656094:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123720064 00000100:00100000:1.0:1746155565.656101:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123720064 00010000:00010000:1.0:1746155565.656129:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c21 expref: 23 pid: 15474 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.656148:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6021 00000100:00100000:1.0:1746155565.656153:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123720064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.656162:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.656167:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c21 expref: 23 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.656176:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c21 expref: 23 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.656190:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a542a800/0x844e5faceb5eb478 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c21 expref: 23 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.656216:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155565.656221:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.656228:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155565.656234:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656634:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656640:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155565.656673:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155565.656676:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155565.656688:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656696:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656704:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5eb4f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656709:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5eb4f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656714:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5eb4f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656718:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb0c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155565.656721:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5eb4f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656726:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5eb4f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656733:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155565.656735:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155565.656737:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5eb4f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656740:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5eb4f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656759:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5eb4fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656763:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5eb4fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656770:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5eb4fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656774:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb1800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155565.656775:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5eb4fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656779:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5eb4fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656783:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9c00) 00010000:00010000:3.0:1746155565.656785:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155565.656786:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5eb4fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656790:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5eb4fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.656814:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5eb4ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c75 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.656822:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c75 expref: 14 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.656827:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155565.656828:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155565.656830:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0600, rc 0) 00000100:00100000:3.0:1746155565.656868:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:29100:x1830976123719680:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 13444us (13479us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.656874:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9988 00010000:00010000:1.0:1746155565.657054:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155565.657084:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123720064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 930us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.657090:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6021 00000100:00100000:0.0:1746155565.658439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.658499:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123720192 00000100:00100000:2.0:1746155565.658535:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123720192 00000100:00100000:2.0:1746155565.658576:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11975 00000100:00100000:2.0:1746155565.658583:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:29098:x1830976123720192:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155565.658605:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.658619:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c7c expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.658639:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c0c expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.658646:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fe00/0x844e5faceb5eb48d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c2f expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.658652:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.658653:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.658656:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1642496->1900543] (req 1642496->1900543) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.658679:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fe00/0x844e5faceb5eb48d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c2f expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.658689:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fe00/0x844e5faceb5eb48d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c2f expref: 11 pid: 8438 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155565.658699:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124567296:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155565.658760:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c0c expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.658768:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c0c expref: 16 pid: 29728 timeout: 794 lvb_type: 0 00000100:00100000:2.0:1746155565.658777:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124567424:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155565.658793:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.662093:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.662154:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123720320 00000100:00100000:1.0:1746155565.662162:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123720320 00000100:00100000:2.0:1746155565.662173:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124567296:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155565.662182:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124567424:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155565.662188:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fe00/0x844e5faceb5eb48d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c2f expref: 12 pid: 8438 timeout: 794 lvb_type: 1 00010000:00010000:2.0:1746155565.662202:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1642496->1900543] (req 1642496->1900543) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155565.662209:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6022 00010000:00010000:2.0:1746155565.662214:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913d9200, rc 0) 00000100:00100000:1.0:1746155565.662216:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123720320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.662229:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.662246:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fe00/0x844e5faceb5eb48d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c2f expref: 12 pid: 8438 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155565.662247:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:29098:x1830976123720192:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3664us (3809us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155565.662255:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fe00/0x844e5faceb5eb48d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c2f expref: 12 pid: 8438 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155565.662256:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11975 00010000:00010000:1.0:1746155565.662272:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ce6fe00/0x844e5faceb5eb48d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c2f expref: 12 pid: 8438 timeout: 794 lvb_type: 1 00010000:00010000:1.0:1746155565.662300:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155565.662318:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123720320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 102us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.662323:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6022 00000100:00100000:0.0:1746155565.663242:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.663330:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123720448 00000100:00100000:1.0:1746155565.663334:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123720448 00010000:00010000:1.0:1746155565.663347:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c0c expref: 16 pid: 29728 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.663362:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6023 00000100:00100000:1.0:1746155565.663366:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123720448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.663373:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.663381:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c0c expref: 16 pid: 29728 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.663390:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c0c expref: 16 pid: 29728 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.663401:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5eb45c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c0c expref: 16 pid: 29728 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.663421:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.663422:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.663428:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.663435:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.663458:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155565.663468:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124567552:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155565.663932:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.664389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.664415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.664436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.664457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.664475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.664550:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123720576 00000100:00100000:2.0:1746155565.664554:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123720576 00000100:00100000:2.0:1746155565.664573:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123720704 00000100:00100000:2.0:1746155565.664575:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123720704 00000100:00100000:2.0:1746155565.664583:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123720832 00000100:00100000:2.0:1746155565.664585:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123720832 00000100:00100000:2.0:1746155565.664604:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123720960 00000100:00100000:2.0:1746155565.664605:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123720960 00000100:00100000:2.0:1746155565.664614:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123721088 00000100:00100000:2.0:1746155565.664616:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123721088 00000100:00100000:2.0:1746155565.664626:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11976 00000100:00100000:2.0:1746155565.664631:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123720576:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155565.664641:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.664652:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913d8600/0x844e5faceb5eb512 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c83 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155565.664679:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124567680:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155565.664715:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd780 going to sleep for 11 seconds 00000100:00100000:2.0:1746155565.664728:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11977 00000100:00100000:2.0:1746155565.664733:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123720704:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155565.664739:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.664745:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913d9c00/0x844e5faceb5eb519 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c8a expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.664754:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.664756:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.664761:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913d9c00/0x844e5faceb5eb519 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c8a expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.664772:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913d9c00/0x844e5faceb5eb519 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c8a expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.664779:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913d9c00, rc 0) 00000100:00100000:2.0:1746155565.664793:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123720704:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 60us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.664797:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11977 00000100:00100000:2.0:1746155565.664807:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11978 00000100:00100000:2.0:1746155565.664811:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123720832:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155565.664817:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.664823:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913d8000/0x844e5faceb5eb520 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c91 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155565.664841:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124567808:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155565.664856:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155565.664868:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11979 00000100:00100000:2.0:1746155565.664873:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123720960:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155565.664878:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.664883:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913d9800/0x844e5faceb5eb527 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c98 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.664892:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.664894:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.664898:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913d9800/0x844e5faceb5eb527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c98 expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.664906:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913d9800/0x844e5faceb5eb527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c98 expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.664913:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913d9800, rc 0) 00000100:00100000:2.0:1746155565.664924:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123720960:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 51us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.664928:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11979 00000100:00100000:2.0:1746155565.664936:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11980 00000100:00100000:2.0:1746155565.664940:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123721088:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155565.664945:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.664950:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913d9a00/0x844e5faceb5eb52e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10c9f expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.664958:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.664959:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.664963:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913d9a00/0x844e5faceb5eb52e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c9f expref: 9 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.664971:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913d9a00/0x844e5faceb5eb52e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c9f expref: 9 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.664977:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913d9a00, rc 0) 00000100:00100000:2.0:1746155565.664987:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123721088:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 47us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.664995:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11980 00000100:00100000:0.0:1746155565.667059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.667077:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123721216 00000100:00100000:0.0:1746155565.667082:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123721216 00000100:00100000:0.0:1746155565.667119:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11981 00000100:00100000:0.0:1746155565.667125:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29092:x1830976123721216:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155565.667138:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.667149:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ca6 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.667171:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf7 expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.667178:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913d9c00/0x844e5faceb5eb519 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c8a expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.667184:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5eb486 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c28 expref: 11 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.667189:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.667190:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155565.667196:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->1179647] (req 1048576->1179647) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155565.667215:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5eb486 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c28 expref: 11 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.667224:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5eb486 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c28 expref: 11 pid: 4461 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.667239:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124567936:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.667298:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913d9c00/0x844e5faceb5eb519 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c8a expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746155565.667305:0:20796:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155565 -> 1746155566 00010000:00010000:0.0:1746155565.667306:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913d9c00/0x844e5faceb5eb519 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c8a expref: 8 pid: 20796 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.667313:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124568064:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155565.667321:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124567808:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155565.667336:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf7 expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.667342:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913d8000/0x844e5faceb5eb520 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c91 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155565.667343:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf7 expref: 22 pid: 10591 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.667350:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124568192:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155565.667351:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913d8000/0x844e5faceb5eb520 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c91 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.667364:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913d8000, rc 0) 00000100:00100000:0.0:1746155565.667365:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155565.667386:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123720832:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 2573us (2947us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155565.667391:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11978 00000100:00100000:1.0:1746155565.667578:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124567552:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155565.667589:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155565.667623:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976123720448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4255us (4381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.667630:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6023 00002000:00010000:2.0:1746155565.667694:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155565 -> 1746155566 00000100:00100000:2.0:1746155565.667706:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124567680:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155565.667718:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913d8600/0x844e5faceb5eb512 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c83 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.667726:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913d8600/0x844e5faceb5eb512 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c83 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.667732:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913d8600, rc 0) 00000100:00100000:2.0:1746155565.667746:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123720576:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 3116us (3358us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155565.667754:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11976 00000100:00100000:0.0:1746155565.668149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.668351:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123721472 00000100:00100000:1.0:1746155565.668355:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123721472 00002000:00100000:1.0:1746155565.668377:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1642496->1646591) req@ffff880130c9ea00 x1830976123721472/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.668385:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ea00 with x1830976123721472 ext(1642496->1646591) 00002000:00010000:1.0:1746155565.668389:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9ea00 00000100:00100000:3.0:1746155565.668811:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4581 00000100:00100000:3.0:1746155565.668821:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123721472:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155565.668953:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123721472:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 135us (803us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155565.668960:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4581 00002000:00100000:3.0:1746155565.668965:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1642496->1646591) req@ffff880130c9ea00 x1830976123721472/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.668972:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ea00 with x1830976123721472 ext(1642496->1646591) 00002000:00010000:3.0:1746155565.668975:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9ea00 00000100:00100000:0.0:1746155565.670675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.670826:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.670846:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123721600 00000100:00100000:0.0:1746155565.670850:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123721600 00010000:00010000:0.0:1746155565.670868:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913d9c00/0x844e5faceb5eb519 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c8a expref: 7 pid: 20796 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.670892:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123721728 00000100:00100000:0.0:1746155565.670894:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123721728 00010000:00010000:0.0:1746155565.670902:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5eb486 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c28 expref: 12 pid: 4461 timeout: 794 lvb_type: 1 00000100:00100000:0.0:1746155565.670913:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6024 00000100:00100000:0.0:1746155565.670919:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123721600:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.670927:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.670943:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913d9c00/0x844e5faceb5eb519 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c8a expref: 7 pid: 20796 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.670952:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913d9c00/0x844e5faceb5eb519 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c8a expref: 7 pid: 20796 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.670970:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.670995:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123721600:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 76us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.671001:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6024 00000100:00100000:0.0:1746155565.671012:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6025 00000100:00100000:0.0:1746155565.671016:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123721728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.671022:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.671029:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5eb486 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c28 expref: 12 pid: 4461 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.671041:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5eb486 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c28 expref: 12 pid: 4461 timeout: 794 lvb_type: 1 00010000:00010000:0.0:1746155565.671051:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.671063:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123721728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 46us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.671067:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6025 00010000:00010000:2.0:1746155565.671385:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5eb486 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c28 expref: 11 pid: 4461 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155565.671396:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124567936:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155565.671406:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913d9c00/0x844e5faceb5eb519 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c8a expref: 6 pid: 20796 timeout: 794 lvb_type: 1 00000100:00100000:2.0:1746155565.671414:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124568064:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155565.671421:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124568192:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155565.671442:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->1179647] (req 1048576->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 10 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.671451:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c83e00, rc 0) 00000100:00100000:2.0:1746155565.671469:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29092:x1830976123721216:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4345us (4417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.671475:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11981 00000100:00100000:1.0:1746155565.671845:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.672146:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.672182:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123721856 00000100:00100000:1.0:1746155565.672186:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123721856 00010000:00010000:1.0:1746155565.672201:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf7 expref: 23 pid: 10591 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.672213:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123722112 00000100:00100000:3.0:1746155565.672216:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123722112 00000100:00100000:1.0:1746155565.672229:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6026 00000100:00100000:1.0:1746155565.672233:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123721856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.672239:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.672247:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf7 expref: 23 pid: 10591 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.672255:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf7 expref: 23 pid: 10591 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.672454:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800903d2000/0x844e5faceb5eb42b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bf7 expref: 23 pid: 10591 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.672463:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9989 00010000:00010000:1.0:1746155565.672464:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.672466:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155565.672468:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:29100:x1830976123722112:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155565.672472:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 9 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.672478:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 9 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.672481:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.672493:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4a00/0x844e5faceb5eb53c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10cad expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.672516:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 9 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155565.672527:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124568320:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155565.672588:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb543 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.672609:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c75 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.672615:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb543 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.672631:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c75 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.672640:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c75 expref: 15 pid: 15474 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.672648:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124568448:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155565.673226:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.673227:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.678489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.678523:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123722368 00000100:00100000:0.0:1746155565.678529:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123722368 00010000:00010000:0.0:1746155565.678555:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c75 expref: 16 pid: 15474 timeout: 794 lvb_type: 0 00000100:00100000:0.0:1746155565.678576:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6027 00000100:00100000:0.0:1746155565.678583:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1963:x1830976123722368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155565.678687:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155565.678694:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c75 expref: 16 pid: 15474 timeout: 794 lvb_type: 0 00000100:00100000:3.0:1746155565.678702:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124568448:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155565.678704:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c75 expref: 16 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.678721:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5eb504 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c75 expref: 16 pid: 15474 timeout: 794 lvb_type: 0 00010000:00010000:3.0:1746155565.678723:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb543 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155565.678747:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155565.678751:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb543 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155565.678758:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb543 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155565.678764:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb543 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155565.678784:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155565.678808:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb543 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.678814:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb543 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155565.678815:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1963:x1830976123722368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 232us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.678820:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6027 00000004:00200000:3.0:1746155565.678829:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000100:00100000:0.0:1746155565.678851:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.678918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155565.678941:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4a00/0x844e5faceb5eb53c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cad expref: 16 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.678955:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb543 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cad expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.678961:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155565.678963:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155565.678965:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb4800, rc 0) 00000100:00100000:3.0:1746155565.678985:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:29100:x1830976123722112:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 6517us (7141us total) trans 8589943924 rc 0/0 00000100:00100000:3.0:1746155565.678994:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9989 00000100:00100000:1.0:1746155565.679060:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124568320:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155565.679068:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155565.679098:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123721856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6864us (6951us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.679104:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6026 00000100:00100000:2.0:1746155565.679122:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123722496 00000100:00100000:2.0:1746155565.679125:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123722496 00002000:00100000:2.0:1746155565.679145:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1896448->1900543) req@ffff880130c9ca80 x1830976123722496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746155565.679146:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123722752 00000100:00100000:1.0:1746155565.679149:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123722752 00002000:00100000:2.0:1746155565.679153:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ca80 with x1830976123722496 ext(1896448->1900543) 00002000:00010000:2.0:1746155565.679156:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9ca80 00002000:00100000:1.0:1746155565.679164:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1175552->1179647) req@ffff880130c9f100 x1830976123722752/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746155565.679168:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4582 00000100:00100000:2.0:1746155565.679172:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123722496:12345-192.168.202.51@tcp:3:multiop.0 00002000:00100000:1.0:1746155565.679176:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9f100 with x1830976123722752 ext(1175552->1179647) 00002000:00010000:1.0:1746155565.679190:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9f100 00000100:00100000:1.0:1746155565.679202:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4583 00000100:00100000:1.0:1746155565.679208:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123722752:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155565.679290:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123722752:12345-192.168.202.51@tcp:3:cat.0 Request processed in 82us (371us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155565.679291:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123722496:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 116us (438us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155565.679295:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4583 00000100:00100000:2.0:1746155565.679298:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4582 00002000:00100000:1.0:1746155565.679300:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1175552->1179647) req@ffff880130c9f100 x1830976123722752/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.679303:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1896448->1900543) req@ffff880130c9ca80 x1830976123722496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155565.679306:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9f100 with x1830976123722752 ext(1175552->1179647) 00002000:00010000:1.0:1746155565.679309:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9f100 00002000:00100000:2.0:1746155565.679310:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ca80 with x1830976123722496 ext(1896448->1900543) 00002000:00010000:2.0:1746155565.679316:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9ca80 00000100:00100000:0.0:1746155565.682275:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.682430:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123723008 00000100:00100000:3.0:1746155565.682436:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123723008 00000100:00100000:3.0:1746155565.682472:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9990 00000100:00100000:3.0:1746155565.682478:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:29100:x1830976123723008:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155565.682493:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.682495:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746155565.682532:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb543 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cad expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.682543:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155565.682546:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155565.682554:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb551 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10cb4 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.682632:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb558 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.682641:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb558 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.682648:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb558 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.682656:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb558 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.682660:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb558 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.682668:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb558 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.682672:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cb4400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155565.682675:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb558 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.682680:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb558 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.682684:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155565.682686:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155565.682688:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb558 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.682692:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb558 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.682705:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb551 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cb4 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.682711:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb551 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cb4 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.682716:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb5000, rc 0) 00000100:00100000:3.0:1746155565.682748:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:29100:x1830976123723008:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 270us (479us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155565.682752:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9990 00000100:00100000:1.0:1746155565.683791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.684573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.684623:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123723392 00000100:00100000:2.0:1746155565.684629:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123723392 00000100:00100000:3.0:1746155565.684641:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123723520 00000100:00100000:3.0:1746155565.684644:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123723520 00000100:00100000:2.0:1746155565.684667:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4023 00000100:00100000:3.0:1746155565.684671:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4024 00000100:00100000:2.0:1746155565.684673:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29092:x1830976123723392:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155565.684675:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:29098:x1830976123723520:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155565.685218:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:29098:x1830976123723520:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 541us (644us total) trans 8589943926 rc 0/0 00000100:00100000:2.0:1746155565.685218:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29092:x1830976123723392:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 544us (1428us total) trans 8589943925 rc 0/0 00000100:00100000:2.0:1746155565.685224:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4023 00000100:00100000:3.0:1746155565.685459:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4024 00000100:00100000:2.0:1746155565.687896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.688404:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123723776 00000100:00100000:3.0:1746155565.688411:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123723776 00000100:00100000:3.0:1746155565.688612:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4025 00000100:00100000:3.0:1746155565.688620:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:29100:x1830976123723776:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:3.0:1746155565.689070:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:29100:x1830976123723776:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 450us (1176us total) trans 8589943927 rc 0/0 00000100:00100000:3.0:1746155565.689077:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4025 00000100:00100000:0.0:1746155565.776936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.779989:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123723904 00000100:00100000:2.0:1746155565.779999:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123723904 00000100:00100000:2.0:1746155565.780053:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11982 00000100:00100000:2.0:1746155565.780060:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123723904:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155565.780076:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.780090:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913d8000/0x844e5faceb5eb55f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10cbb expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155565.780139:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124568576:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155565.780246:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd000 going to sleep for 11 seconds 00002000:00010000:2.0:1746155565.784017:0:19959:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155565 -> 1746155566 00002000:00010000:2.0:1746155565.784023:0:19959:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155565 -> 1746155566 00000100:00100000:2.0:1746155565.784042:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124568576:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155565.784067:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913d8000/0x844e5faceb5eb55f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cbb expref: 12 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.784078:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913d8000/0x844e5faceb5eb55f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cbb expref: 12 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155565.784092:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913d8000, rc 0) 00000100:00100000:2.0:1746155565.784135:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123723904:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4075us (7206us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155565.784142:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11982 00000100:00100000:0.0:1746155565.790743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.790792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.790869:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123724160 00000100:00100000:3.0:1746155565.790877:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123724160 00002000:00100000:3.0:1746155565.790919:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1347583) req@ffff880130c9fb80 x1830976123724160/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.790928:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9fb80 with x1830976123724160 ext(1048576->1347583) 00002000:00010000:3.0:1746155565.790933:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9fb80 00000100:00100000:3.0:1746155565.790961:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123724288 00000100:00100000:3.0:1746155565.790964:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123724288 00002000:00100000:3.0:1746155565.790976:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3db:0x0] (1179648->2097151) req@ffff880130c9d180 x1830976123724288/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.790981:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9d180 with x1830976123724288 ext(1179648->2097151) 00002000:00010000:3.0:1746155565.790984:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9d180 00000100:00100000:3.0:1746155565.791000:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4584 00000100:00100000:3.0:1746155565.791007:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123724160:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155565.791746:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4585 00000100:00100000:2.0:1746155565.791756:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123724288:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155565.797155:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123724160:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6139us (6409us total) trans 0 rc 299008/299008 00000100:00100000:3.0:1746155565.797165:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4584 00002000:00100000:3.0:1746155565.797175:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1347583) req@ffff880130c9fb80 x1830976123724160/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 299008/299008 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.797184:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9fb80 with x1830976123724160 ext(1048576->1347583) 00002000:00010000:3.0:1746155565.797189:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9fb80 00000100:00100000:2.0:1746155565.809018:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123724288:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17257us (18218us total) trans 0 rc 917504/917504 00000100:00100000:2.0:1746155565.809028:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4585 00002000:00100000:2.0:1746155565.809037:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1179648->2097151) req@ffff880130c9d180 x1830976123724288/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 917504/917504 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.809046:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9d180 with x1830976123724288 ext(1179648->2097151) 00002000:00010000:2.0:1746155565.809051:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9d180 00000100:00100000:3.0:1746155565.810899:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746155565.810914:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124568704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746155565.810956:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155565.811011:0:10389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124568704 00000100:00100000:1.0:1746155565.811017:0:10389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124568704 00000100:00100000:0.0:1746155565.811049:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746155565.811053:0:10389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1746155565.811055:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124568832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746155565.811058:0:10389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1830976124568704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746155565.811074:0:10389:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 429064192 pending 5111808 free 3847225344 avail 3845128192 00000100:00100000:0.0:1746155565.811076:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155565.811099:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124568832 00000100:00100000:1.0:1746155565.811100:0:10389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1830976124568704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155565.811101:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124568832 00000100:00100000:1.0:1746155565.811105:0:10389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1746155565.811114:0:10389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1746155565.811118:0:10389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830976124568832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746155565.811129:0:10389:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 3407872 granted 432340992 pending 5111808 free 3850371072 avail 3823108096 00000100:00100000:1.0:1746155565.811148:0:10389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830976124568832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.811152:0:10389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1746155565.811173:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746155565.811175:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746155565.811215:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840548 gen 2 00000004:00080000:3.0:1746155565.811221:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc5500, transno 21474840505 00000004:00080000:3.0:1746155565.811239:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8df80, transno 21474840506 00000004:00080000:3.0:1746155565.811241:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b6c3b80, transno 21474840507 00000004:00080000:3.0:1746155565.811244:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8e680, transno 21474840508 00000004:00080000:3.0:1746155565.811245:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130898700, transno 21474840509 00000004:00080000:3.0:1746155565.811247:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8e300, transno 21474840510 00000004:00080000:3.0:1746155565.811249:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fef0000, transno 21474840511 00000004:00080000:3.0:1746155565.811251:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fef3b80, transno 21474840512 00000004:00080000:3.0:1746155565.811253:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc7800, transno 21474840513 00000004:00080000:3.0:1746155565.811254:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc6d80, transno 21474840517 00000004:00080000:3.0:1746155565.811256:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdce300, transno 21474840518 00000004:00080000:3.0:1746155565.811258:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a44380, transno 21474840519 00000004:00080000:3.0:1746155565.811260:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdced80, transno 21474840520 00000004:00080000:3.0:1746155565.811261:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3eea00, transno 21474840521 00000004:00080000:3.0:1746155565.811264:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c213800, transno 21474840522 00000004:00080000:3.0:1746155565.811266:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a46300, transno 21474840523 00000004:00080000:3.0:1746155565.811268:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac6300, transno 21474840524 00000004:00080000:3.0:1746155565.811269:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdcc000, transno 21474840525 00000004:00080000:3.0:1746155565.811271:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdef480, transno 21474840531 00000004:00080000:3.0:1746155565.811273:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdeca80, transno 21474840532 00000004:00080000:3.0:1746155565.811274:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cded500, transno 21474840533 00000004:00080000:3.0:1746155565.811276:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdee680, transno 21474840534 00000004:00080000:3.0:1746155565.811278:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cded880, transno 21474840535 00000004:00080000:3.0:1746155565.811279:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdee300, transno 21474840536 00000004:00080000:3.0:1746155565.811281:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdec380, transno 21474840537 00000004:00080000:3.0:1746155565.811282:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdece00, transno 21474840538 00000004:00080000:3.0:1746155565.811284:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdec000, transno 21474840539 00000004:00080000:3.0:1746155565.811285:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526bb80, transno 21474840540 00000004:00080000:3.0:1746155565.811287:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c4700, transno 21474840541 00000004:00080000:3.0:1746155565.811289:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095269c00, transno 21474840542 00000004:00080000:3.0:1746155565.811291:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526ad80, transno 21474840543 00000004:00080000:3.0:1746155565.811293:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526b800, transno 21474840544 00000004:00080000:3.0:1746155565.811295:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c4e00, transno 21474840545 00000004:00080000:3.0:1746155565.811297:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526a300, transno 21474840546 00000004:00080000:3.0:1746155565.811298:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c6a00, transno 21474840547 00000004:00080000:3.0:1746155565.811300:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c7b80, transno 21474840548 00000100:00100000:3.0:1746155565.811309:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124568704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746155565.811364:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873165 gen 2 00000004:00080000:0.0:1746155565.811367:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a46a00, transno 17179873122 00000004:00080000:0.0:1746155565.811383:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910db100, transno 17179873123 00000004:00080000:0.0:1746155565.811386:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094868000, transno 17179873124 00000004:00080000:0.0:1746155565.811388:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f703b80, transno 17179873125 00000004:00080000:0.0:1746155565.811390:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a47100, transno 17179873126 00000004:00080000:0.0:1746155565.811392:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910d9880, transno 17179873127 00000004:00080000:0.0:1746155565.811394:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f700e00, transno 17179873128 00000004:00080000:0.0:1746155565.811396:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910d9500, transno 17179873129 00000004:00080000:0.0:1746155565.811398:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131496680, transno 17179873133 00000004:00080000:0.0:1746155565.811400:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131495500, transno 17179873134 00000004:00080000:0.0:1746155565.811401:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131497100, transno 17179873135 00000004:00080000:0.0:1746155565.811403:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131495f80, transno 17179873136 00000004:00080000:0.0:1746155565.811405:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26d880, transno 17179873137 00000004:00080000:0.0:1746155565.811407:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131495c00, transno 17179873138 00000004:00080000:0.0:1746155565.811409:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26fb80, transno 17179873139 00000004:00080000:0.0:1746155565.811411:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131496d80, transno 17179873140 00000004:00080000:0.0:1746155565.811413:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6d8700, transno 17179873150 00000004:00080000:0.0:1746155565.811414:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6db800, transno 17179873151 00000004:00080000:0.0:1746155565.811416:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6d9500, transno 17179873152 00000004:00080000:0.0:1746155565.811418:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6d8000, transno 17179873153 00000004:00080000:0.0:1746155565.811420:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6d9180, transno 17179873154 00000004:00080000:0.0:1746155565.811421:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dbb80, transno 17179873155 00000004:00080000:0.0:1746155565.811424:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6db100, transno 17179873156 00000004:00080000:0.0:1746155565.811425:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6d9880, transno 17179873157 00000004:00080000:0.0:1746155565.811427:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366f100, transno 17179873158 00000004:00080000:0.0:1746155565.811429:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366e300, transno 17179873159 00000004:00080000:0.0:1746155565.811431:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdef800, transno 17179873160 00000004:00080000:0.0:1746155565.811433:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366df80, transno 17179873161 00000004:00080000:0.0:1746155565.811435:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366d180, transno 17179873162 00000004:00080000:0.0:1746155565.811437:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a3b80, transno 17179873163 00000004:00080000:0.0:1746155565.811439:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366c000, transno 17179873164 00000004:00080000:0.0:1746155565.811440:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366d880, transno 17179873165 00000100:00100000:0.0:1746155565.811447:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124568832:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1746155565.811782:0:14277:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 32 done 00000004:00080000:1.0:1746155565.812055:0:14274:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 36 done 00000100:00100000:0.0:1746155565.817003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.817073:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123724544 00000100:00100000:2.0:1746155565.817080:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123724544 00000100:00100000:2.0:1746155565.817118:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11983 00000100:00100000:2.0:1746155565.817124:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29107:x1830976123724544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155565.817139:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155565.817152:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10cc2 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.817176:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.817183:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155565.817185:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155565.817188:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc2 expref: 12 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.817212:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.817223:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 14 pid: 10591 timeout: 794 lvb_type: 0 00000100:00100000:2.0:1746155565.817233:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124568960:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155565.817312:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.824157:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.824186:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976124568960:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155565.824190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155565.824213:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc2 expref: 12 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155565.824223:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123724672 00010000:00010000:3.0:1746155565.824228:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913d8e00, rc 0) 00000100:00100000:0.0:1746155565.824228:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123724672 00002000:00100000:0.0:1746155565.824260:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1642496->1900543) req@ffff880094f0b100 x1830976123724672/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.824268:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0b100 with x1830976123724672 ext(1642496->1900543) 00010000:00010000:0.0:1746155565.824274:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 15 pid: 10591 timeout: 794 lvb_type: 0 00010000:00010000:0.0:1746155565.824286:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 15 pid: 10591 timeout: 794 lvb_type: 0 00002000:00010000:0.0:1746155565.824292:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f0b100 00000100:00100000:0.0:1746155565.824316:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 709 00000100:00100000:0.0:1746155565.824323:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976123724672:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155565.824932:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29107:x1830976123724544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7806us (7939us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.824939:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11983 00000100:00100000:3.0:1746155565.824963:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123724928 00000100:00100000:3.0:1746155565.824966:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123724928 00000100:00100000:3.0:1746155565.825111:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9991 00000100:00100000:3.0:1746155565.825118:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29109:x1830976123724928:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155565.825130:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.825143:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4600/0x844e5faceb5eb56d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10cc9 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.825210:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb574 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.825221:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb574 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.825230:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb574 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155565.825237:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155565.825660:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4600/0x844e5faceb5eb56d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc9 expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.825686:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb574 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc9 expref: 25 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.825692:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155565.825695:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155565.825697:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb5c00, rc 0) 00000100:00100000:3.0:1746155565.827809:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:29109:x1830976123724928:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2685us (3653us total) trans 8589943928 rc 0/0 00000100:00100000:3.0:1746155565.827817:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9991 00000100:00100000:2.0:1746155565.836539:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976123724672:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 12208us (12340us total) trans 21474840559 rc 0/0 00000100:00100000:2.0:1746155565.836549:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 709 00002000:00100000:2.0:1746155565.836559:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1642496->1900543) req@ffff880094f0b100 x1830976123724672/t21474840559(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/448 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.836567:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0b100 with x1830976123724672 ext(1642496->1900543) 00010000:00010000:2.0:1746155565.836575:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 17 pid: 10591 timeout: 794 lvb_type: 0 00010000:00010000:2.0:1746155565.836589:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 17 pid: 10591 timeout: 794 lvb_type: 0 00002000:00010000:2.0:1746155565.836608:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f0b100 00000100:00100000:0.0:1746155565.842582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.842666:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123725184 00000100:00100000:3.0:1746155565.842673:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123725184 00000100:00100000:3.0:1746155565.842710:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9992 00000100:00100000:3.0:1746155565.842718:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:29112:x1830976123725184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.842736:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.842751:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb582 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10cd0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.842842:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb589 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.842854:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.842862:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.842872:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb590 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.842877:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.842881:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.842979:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5400/0x844e5faceb5eb597 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.842987:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5400/0x844e5faceb5eb597 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.842993:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5400/0x844e5faceb5eb597 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155565.843001:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155565.843079:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb589 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843085:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb589 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843090:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb589 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843094:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cb4400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155565.843097:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb589 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843102:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb589 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843111:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155565.843114:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155565.843117:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843122:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843140:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843144:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb590 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843151:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843154:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cb5000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155565.843156:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843159:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb590 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843164:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009c823500) 00010000:00010000:3.0:1746155565.843166:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155565.843167:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb590 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843172:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5000/0x844e5faceb5eb590 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155565.843201:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb4800/0x844e5faceb5eb582 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cd0 expref: 309 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.843211:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5400/0x844e5faceb5eb597 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cd0 expref: 308 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.843217:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155565.843219:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155565.843220:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb5400, rc 0) 00000100:00100000:3.0:1746155565.843260:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+308:29112:x1830976123725184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 542us (684us total) trans 8589943929 rc 0/0 00000100:00100000:3.0:1746155565.843265:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9992 00000100:00100000:0.0:1746155565.845144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.845237:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123725312 00000100:00100000:1.0:1746155565.845243:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123725312 00010000:00010000:1.0:1746155565.845266:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 17 pid: 10591 timeout: 794 lvb_type: 0 00000100:00100000:1.0:1746155565.845286:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6028 00000100:00100000:1.0:1746155565.845292:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123725312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.845301:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.845316:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 17 pid: 10591 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.845325:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 17 pid: 10591 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.845341:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb50b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->1900543) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c7c expref: 17 pid: 10591 timeout: 794 lvb_type: 0 00010000:00010000:1.0:1746155565.845364:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.845366:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.845372:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc2 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.845380:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc2 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.845405:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc2 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155565.845414:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124569088:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155565.845617:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.849880:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.849942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.849966:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.849985:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123725568 00000100:00100000:0.0:1746155565.849991:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123725568 00000100:00100000:0.0:1746155565.850020:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123725696 00000100:00100000:0.0:1746155565.850023:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123725696 00000100:00100000:0.0:1746155565.850036:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11984 00000100:00100000:0.0:1746155565.850043:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123725568:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155565.850058:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155565.850072:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094484c00/0x844e5faceb5eb5a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10cd7 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155565.850112:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124569216:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155565.850174:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.850206:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.850297:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123725824 00000100:00100000:3.0:1746155565.850301:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123725824 00000100:00100000:3.0:1746155565.850319:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11985 00000100:00100000:3.0:1746155565.850324:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123725696:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.850330:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.850336:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb5ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10cde expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155565.850357:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124569344:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155565.850379:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.850391:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11986 00000100:00100000:3.0:1746155565.850396:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976123725824:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.850403:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.850410:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb5b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ce5 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.850420:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.850422:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.850428:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb5b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ce5 expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.850441:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb5b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ce5 expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.850450:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb4400, rc 0) 00000100:00100000:3.0:1746155565.850468:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976123725824:12345-192.168.202.51@tcp:101:cat.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.850477:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11986 00000100:00100000:1.0:1746155565.850620:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124569088:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155565.850633:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155565.850651:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123725312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5361us (5516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.850657:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6028 00000100:00100000:1.0:1746155565.850668:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123725440 00000100:00100000:1.0:1746155565.850670:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123725440 00000100:00100000:1.0:1746155565.850687:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 582 00000100:00100000:1.0:1746155565.850692:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+308:1960:x1830976123725440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.850699:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.850714:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5400/0x844e5faceb5eb597 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cd0 expref: 308 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.850724:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155565.850727:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155565.850738:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+307:1960:x1830976123725440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 46us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.850744:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 582 00000100:00100000:0.0:1746155565.852722:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.852859:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123726080 00000100:00100000:2.0:1746155565.852864:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123726080 00002000:00100000:2.0:1746155565.852894:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880094f0ad80 x1830976123726080/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.852903:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0ad80 with x1830976123726080 ext(1048576->2097151) 00002000:00010000:2.0:1746155565.852907:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f0ad80 00000100:00100000:2.0:1746155565.852926:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4586 00000100:00100000:2.0:1746155565.852933:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123726080:12345-192.168.202.51@tcp:3:cat.0 00002000:00010000:1.0:1746155565.853576:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155565 -> 1746155566 00002000:00010000:1.0:1746155565.853580:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155565 -> 1746155566 00000100:00100000:1.0:1746155565.853601:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124569216:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155565.853623:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094484c00/0x844e5faceb5eb5a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cd7 expref: 25 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155565.853633:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094484c00/0x844e5faceb5eb5a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cd7 expref: 25 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155565.853641:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094484c00, rc 0) 00000100:00100000:1.0:1746155565.854167:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123725568:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4122us (4222us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155565.854173:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11984 00002000:00010000:3.0:1746155565.857562:0:1625:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime: 1746155565 -> 1746155566 00002000:00010000:3.0:1746155565.857568:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime: 1746155565 -> 1746155566 00002000:00010000:3.0:1746155565.857570:0:1625:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime: 1746155565 -> 1746155566 00000100:00100000:3.0:1746155565.857588:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124569344:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155565.857624:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb5ac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cde expref: 23 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.857636:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cb5800/0x844e5faceb5eb5ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cde expref: 23 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.857658:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb5800, rc 0) 00000100:00100000:3.0:1746155565.857692:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123725696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7366us (7724us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155565.857699:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11985 00000100:00100000:2.0:1746155565.865831:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123726080:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12889us (13105us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155565.865841:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4586 00002000:00100000:2.0:1746155565.865851:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880094f0ad80 x1830976123726080/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.865859:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0ad80 with x1830976123726080 ext(1048576->2097151) 00002000:00010000:2.0:1746155565.865864:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f0ad80 00000100:00100000:0.0:1746155565.868204:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.868280:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123726208 00000100:00100000:3.0:1746155565.868287:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123726208 00000100:00100000:3.0:1746155565.868331:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11987 00000100:00100000:3.0:1746155565.868338:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29112:x1830976123726208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.868352:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.868367:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10cec expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.868390:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.868402:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.868404:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.868407:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cec expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.868431:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.868443:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 9 pid: 10591 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155565.868452:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124569472:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155565.868536:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.871853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.871941:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123726336 00000100:00100000:2.0:1746155565.871947:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123726336 00002000:00100000:2.0:1746155565.871980:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1347584->2097151) req@ffff880094f08e00 x1830976123726336/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.871989:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08e00 with x1830976123726336 ext(1347584->2097151) 00010000:00010000:2.0:1746155565.871996:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 10 pid: 10591 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155565.872008:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 10 pid: 10591 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746155565.872014:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f08e00 00000100:00100000:2.0:1746155565.872030:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 710 00000100:00100000:2.0:1746155565.872037:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123726336:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155565.872832:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124569472:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.872856:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cec expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.872868:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c9f800, rc 0) 00000100:00100000:3.0:1746155565.875238:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29112:x1830976123726208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6156us (6296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.875249:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11987 00000100:00100000:0.0:1746155565.877051:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.877113:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123726464 00000100:00100000:3.0:1746155565.877119:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123726464 00000100:00100000:3.0:1746155565.877157:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11988 00000100:00100000:3.0:1746155565.877163:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123726464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.877178:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.877192:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c9f400/0x844e5faceb5eb5c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10cf3 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155565.877230:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124569600:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155565.877294:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.881581:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124569600:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155565.881628:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c9f400/0x844e5faceb5eb5c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cf3 expref: 13 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.881643:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c9f400/0x844e5faceb5eb5c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cf3 expref: 13 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.881682:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c9f400, rc 0) 00000100:00100000:3.0:1746155565.881736:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123726464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4569us (4684us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155565.881744:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11988 00000100:00100000:0.0:1746155565.886186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.886278:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123726592 00000100:00100000:3.0:1746155565.886284:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123726592 00000100:00100000:3.0:1746155565.886317:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11989 00000100:00100000:3.0:1746155565.886323:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123726592:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.886337:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.886349:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c9f600/0x844e5faceb5eb5c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10cfa expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155565.886388:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124569728:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155565.886449:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.892170:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124569728:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155565.892208:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c9f600/0x844e5faceb5eb5c8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cfa expref: 13 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.892223:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c9f600/0x844e5faceb5eb5c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cfa expref: 13 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.892261:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c9f600, rc 0) 00000100:00100000:3.0:1746155565.892330:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123726592:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6003us (6148us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155565.892338:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11989 00000100:00100000:2.0:1746155565.896252:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123726336:12345-192.168.202.51@tcp:4:cat.0 Request processed in 24207us (24398us total) trans 17179873178 rc 0/0 00000100:00100000:2.0:1746155565.896262:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 710 00002000:00100000:2.0:1746155565.896273:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1347584->2097151) req@ffff880094f08e00 x1830976123726336/t17179873178(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/448 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.896282:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08e00 with x1830976123726336 ext(1347584->2097151) 00010000:00010000:2.0:1746155565.896290:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 12 pid: 10591 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155565.896301:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 12 pid: 10591 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746155565.896312:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f08e00 00000100:00100000:3.0:1746155565.896970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.896992:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123726720 00000100:00100000:3.0:1746155565.896997:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123726720 00000100:00100000:3.0:1746155565.897035:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11990 00000100:00100000:3.0:1746155565.897043:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123726720:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.897055:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.897065:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a065ba00/0x844e5faceb5eb5cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d01 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155565.897104:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124569856:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155565.897156:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.900677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.900774:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124569856:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155565.900803:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a065ba00/0x844e5faceb5eb5cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d01 expref: 13 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.900815:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a065ba00/0x844e5faceb5eb5cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d01 expref: 13 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.900825:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a065ba00, rc 0) 00000100:00100000:3.0:1746155565.900874:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123726720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3831us (3904us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155565.900881:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11990 00000100:00100000:2.0:1746155565.901016:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123726848 00000100:00100000:2.0:1746155565.901023:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123726848 00010000:00010000:2.0:1746155565.901052:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 12 pid: 10591 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746155565.901077:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6029 00000100:00100000:2.0:1746155565.901084:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123726848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155565.901100:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155565.901115:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 12 pid: 10591 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155565.901126:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 12 pid: 10591 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155565.901143:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb4e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c6e expref: 12 pid: 10591 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155565.901159:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.901161:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.901167:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cec expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.901174:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cec expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.901208:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cec expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155565.901219:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124569984:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155565.901270:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155565.911112:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.911195:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123727104 00000100:00100000:3.0:1746155565.911203:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123727104 00002000:00100000:3.0:1746155565.911242:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094f08a80 x1830976123727104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.911251:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08a80 with x1830976123727104 ext(1048576->2097151) 00002000:00010000:3.0:1746155565.911255:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f08a80 00000100:00100000:3.0:1746155565.911271:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4587 00000100:00100000:3.0:1746155565.911277:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123727104:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155565.911535:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124569984:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155565.911549:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155565.911582:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123726848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10499us (10911us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.911588:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6029 00000100:00100000:0.0:1746155565.919490:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.919639:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123727360 00000100:00100000:1.0:1746155565.919646:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123727360 00000100:00100000:1.0:1746155565.919683:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9993 00000100:00100000:1.0:1746155565.919690:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+307:29114:x1830976123727360:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155565.919711:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155565.919726:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4a00/0x844e5faceb5eb5d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d08 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.919811:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eb5dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.919821:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eb5dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.919830:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eb5dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.919841:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5e00/0x844e5faceb5eb5e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.919845:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5e00/0x844e5faceb5eb5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.919850:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5e00/0x844e5faceb5eb5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.919929:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eb5eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.919936:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eb5eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.919942:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eb5eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155565.919949:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155565.920014:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eb5dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920019:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eb5dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920024:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eb5dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920028:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdd5000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155565.920031:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eb5dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920037:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eb5dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920045:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155565.920048:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155565.920050:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eb5dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920054:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eb5dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155565.920435:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123727104:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9157us (9329us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155565.920443:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4587 00002000:00100000:3.0:1746155565.920451:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094f08a80 x1830976123727104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.920459:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08a80 with x1830976123727104 ext(1048576->2097151) 00002000:00010000:3.0:1746155565.920463:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f08a80 00010000:00010000:1.0:1746155565.920733:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5e00/0x844e5faceb5eb5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920741:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5e00/0x844e5faceb5eb5e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920747:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5e00/0x844e5faceb5eb5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920751:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdd5e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155565.920754:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5e00/0x844e5faceb5eb5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920758:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5e00/0x844e5faceb5eb5e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920765:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51a00) 00010000:00010000:1.0:1746155565.920767:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155565.920770:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5e00/0x844e5faceb5eb5e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920774:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5e00/0x844e5faceb5eb5e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155565.920804:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4a00/0x844e5faceb5eb5d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d08 expref: 310 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.920814:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eb5eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d08 expref: 309 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.920820:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155565.920822:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155565.920824:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4400, rc 0) 00000100:00100000:1.0:1746155565.920858:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:29114:x1830976123727360:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1168us (1377us total) trans 8589943930 rc 0/0 00000100:00100000:1.0:1746155565.920864:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9993 00000100:00100000:0.0:1746155565.925467:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.925831:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123727488 00000100:00100000:2.0:1746155565.925838:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123727488 00000100:00100000:2.0:1746155565.925880:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 583 00000100:00100000:2.0:1746155565.925887:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:1963:x1830976123727488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155565.925900:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155565.925921:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eb5eb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d08 expref: 309 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.926083:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155565.926087:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155565.926130:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+308:1963:x1830976123727488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 243us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.926136:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 583 00000100:00100000:2.0:1746155565.929950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.930271:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155565.930322:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123727616 00000100:00100000:1.0:1746155565.930329:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123727616 00000100:00100000:3.0:1746155565.930355:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123727744 00000100:00100000:3.0:1746155565.930358:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123727744 00000100:00100000:1.0:1746155565.930371:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11991 00000100:00100000:1.0:1746155565.930421:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:29114:x1830976123727616:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155565.930436:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155565.930449:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d0f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.930474:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc2 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.930481:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb5b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ce5 expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155565.930491:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.930492:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155565.930496:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1564672->1662975] (req 1564672->1662975) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.930540:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb5b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ce5 expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155565.930551:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb5b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ce5 expref: 18 pid: 8438 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746155565.930561:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124570112:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155565.930639:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc2 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.930646:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc2 expref: 11 pid: 19959 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155565.930653:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124570240:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155565.930670:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.930881:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11992 00000100:00100000:3.0:1746155565.930887:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29112:x1830976123727744:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155565.930895:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.930903:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d16 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.930917:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 10 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.930922:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.930923:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155565.930926:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d16 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.930939:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 10 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.930947:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 10 pid: 19959 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155565.930955:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124570368:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155565.930990:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155565.936602:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124570112:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155565.936617:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124570240:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155565.936642:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1564672->1662975] (req 1564672->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155565.936663:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd5c00, rc 0) 00000100:00100000:1.0:1746155565.936703:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:29114:x1830976123727616:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6283us (6759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.936710:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11991 00000100:00100000:3.0:1746155565.937756:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124570368:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.937778:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d16 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.937794:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a065ac00, rc 0) 00000100:00100000:3.0:1746155565.937812:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:29112:x1830976123727744:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6926us (7542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.937817:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11992 00000100:00100000:0.0:1746155565.938236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.938274:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.938441:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123727872 00000100:00100000:2.0:1746155565.938449:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123727872 00000100:00100000:0.0:1746155565.938467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155565.938478:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb5b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ce5 expref: 18 pid: 8438 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746155565.938554:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123728000 00000100:00100000:2.0:1746155565.938559:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123728000 00010000:00010000:2.0:1746155565.938573:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc2 expref: 12 pid: 19959 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155565.938581:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6030 00000100:00100000:1.0:1746155565.938588:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976123727872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.938609:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155565.938617:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6031 00010000:00010000:1.0:1746155565.938628:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb5b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ce5 expref: 18 pid: 8438 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746155565.938634:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123728000:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155565.938638:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb5b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ce5 expref: 18 pid: 8438 timeout: 795 lvb_type: 1 00010000:00010000:2.0:1746155565.938645:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155565.938657:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb5b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ce5 expref: 18 pid: 8438 timeout: 795 lvb_type: 1 00010000:00010000:2.0:1746155565.938659:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc2 expref: 12 pid: 19959 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155565.938668:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc2 expref: 12 pid: 19959 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155565.938712:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123728128 00000100:00100000:3.0:1746155565.938716:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123728128 00002000:00100000:3.0:1746155565.938740:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1179647) req@ffff8800a0a8a300 x1830976123728128/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155565.938748:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a8a300 with x1830976123728128 ext(1048576->1179647) 00010000:00010000:3.0:1746155565.938753:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 11 pid: 19959 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155565.938763:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 11 pid: 19959 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746155565.938768:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0a8a300 00010000:00010000:1.0:1746155565.938931:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155565.938945:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb566 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc2 expref: 12 pid: 19959 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155565.938953:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123727872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 365us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155565.938959:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6030 00000100:00100000:0.0:1746155565.939080:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 711 00010000:00010000:2.0:1746155565.939271:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.939273:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155565.939279:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.939290:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155565.939314:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155565.939322:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124570496:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155565.939369:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155565.939611:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123728128:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155565.941953:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124570496:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155565.941972:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155565.942875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.942918:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123728384 00000100:00100000:2.0:1746155565.942924:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123728384 00002000:00100000:2.0:1746155565.942953:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1564672->1568767) req@ffff8800a0a8b800 x1830976123728384/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.942962:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a8b800 with x1830976123728384 ext(1564672->1568767) 00002000:00010000:2.0:1746155565.942965:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a8b800 00000100:00100000:3.0:1746155565.942979:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123728000:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4354us (4511us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155565.942985:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4588 00000100:00100000:3.0:1746155565.942987:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6031 00000100:00100000:2.0:1746155565.942991:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123728384:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155565.943119:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123728384:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 126us (350us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155565.943125:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4588 00002000:00100000:2.0:1746155565.943129:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1564672->1568767) req@ffff8800a0a8b800 x1830976123728384/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.943136:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a8b800 with x1830976123728384 ext(1564672->1568767) 00002000:00010000:2.0:1746155565.943139:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a8b800 00000100:00100000:2.0:1746155565.944842:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976123728128:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5751us (6562us total) trans 17179873179 rc 0/0 00000100:00100000:2.0:1746155565.944850:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 711 00002000:00100000:2.0:1746155565.944856:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1179647) req@ffff8800a0a8a300 x1830976123728128/t17179873179(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:636/0 lens 488/448 e 0 to 0 dl 1746155576 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.944864:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a8a300 with x1830976123728128 ext(1048576->1179647) 00010000:00010000:2.0:1746155565.944872:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 13 pid: 19959 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155565.944886:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 13 pid: 19959 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746155565.944892:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0a8a300 00000100:00100000:3.0:1746155565.947854:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.949249:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123728640 00000100:00100000:2.0:1746155565.949256:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123728640 00002000:00100000:2.0:1746155565.949293:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d8:0x0] (1658880->1662975) req@ffff88009fac6d80 x1830976123728640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.949301:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6d80 with x1830976123728640 ext(1658880->1662975) 00002000:00010000:2.0:1746155565.949306:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac6d80 00000100:00100000:2.0:1746155565.949334:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4589 00000100:00100000:2.0:1746155565.949341:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123728640:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155565.949969:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123728640:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 626us (2120us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155565.949975:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4589 00002000:00100000:2.0:1746155565.949981:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d8:0x0] (1658880->1662975) req@ffff88009fac6d80 x1830976123728640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/4536 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.949989:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6d80 with x1830976123728640 ext(1658880->1662975) 00002000:00010000:2.0:1746155565.949991:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac6d80 00000100:00100000:0.0:1746155565.952684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.952730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.953144:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123729024 00000100:00100000:2.0:1746155565.953152:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123729024 00000100:00100000:2.0:1746155565.953185:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4026 00000100:00100000:2.0:1746155565.953192:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+308:29114:x1830976123729024:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155565.953375:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:29114:x1830976123729024:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 183us (644us total) trans 8589943931 rc 0/0 00000100:00100000:2.0:1746155565.953382:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4026 00000100:00100000:3.0:1746155565.953621:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123728768 00000100:00100000:3.0:1746155565.953625:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123728768 00010000:00010000:3.0:1746155565.953644:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 13 pid: 19959 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155565.953664:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6032 00000100:00100000:3.0:1746155565.953669:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976123728768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155565.953678:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155565.953693:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 13 pid: 19959 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155565.953703:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 13 pid: 19959 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155565.953721:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c83e00/0x844e5faceb5eb535 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ca6 expref: 13 pid: 19959 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155565.953736:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.953738:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.953743:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d16 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.953751:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d16 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.953777:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d16 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155565.953787:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124570624:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155565.953835:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:3.0:1746155565.959900:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124570624:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155565.959923:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155565.959986:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123728768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6314us (7306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155565.959996:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6032 00000100:00100000:0.0:1746155565.964402:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155565.966513:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123729408 00000100:00100000:2.0:1746155565.966523:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123729408 00002000:00100000:2.0:1746155565.966557:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800a0a8bb80 x1830976123729408/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 504/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.966566:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a8bb80 with x1830976123729408 ext(1048576->2097151) 00002000:00010000:2.0:1746155565.966570:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a8bb80 00000100:00100000:2.0:1746155565.966588:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4590 00000100:00100000:2.0:1746155565.966606:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976123729408:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155565.967696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155565.969181:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123729536 00000100:00100000:0.0:1746155565.969189:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123729536 00002000:00100000:0.0:1746155565.969220:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff8800948e5f80 x1830976123729536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/0 e 0 to 0 dl 1746155576 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155565.969229:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5f80 with x1830976123729536 ext(1048576->2097151) 00002000:00010000:0.0:1746155565.969233:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e5f80 00000100:00100000:0.0:1746155565.969254:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4591 00000100:00100000:0.0:1746155565.969260:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123729536:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155565.979762:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976123729408:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13149us (15358us total) trans 0 rc 950272/950272 00000100:00100000:2.0:1746155565.979773:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4590 00002000:00100000:2.0:1746155565.979783:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800a0a8bb80 x1830976123729408/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 504/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 950272/950272 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.979791:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a8bb80 with x1830976123729408 ext(1048576->2097151) 00002000:00010000:2.0:1746155565.979797:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a8bb80 00000100:00100000:2.0:1746155565.984500:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123729536:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 15186us (16752us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155565.984685:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4591 00002000:00100000:2.0:1746155565.984700:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff8800948e5f80 x1830976123729536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:636/0 lens 488/440 e 0 to 0 dl 1746155576 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155565.984708:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5f80 with x1830976123729536 ext(1048576->2097151) 00002000:00010000:2.0:1746155565.984714:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e5f80 00000100:00100000:0.0:1746155565.993621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155565.998644:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123729664 00000100:00100000:3.0:1746155565.998661:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123729664 00000100:00100000:3.0:1746155565.998729:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11993 00000100:00100000:3.0:1746155565.998738:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29109:x1830976123729664:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155565.998756:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155565.998772:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d1d expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.998801:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c52 expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.998809:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913d9800/0x844e5faceb5eb527 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c98 expref: 7 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.998816:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.998823:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.998825:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155565.998829:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.998860:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.998871:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 16 pid: 4461 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155565.998883:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124570752:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.998984:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913d9800/0x844e5faceb5eb527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c98 expref: 7 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155565.998992:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913d9800/0x844e5faceb5eb527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c98 expref: 7 pid: 29728 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746155565.999000:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124570880:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155565.999027:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c52 expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155565.999035:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c52 expref: 12 pid: 4461 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155565.999041:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124571008:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155565.999059:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:3.0:1746155566.005650:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124570752:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155566.005662:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124570880:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155566.005668:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124571008:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155566.005699:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.005714:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009048b400, rc 0) 00000100:00100000:3.0:1746155566.005770:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29109:x1830976123729664:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7033us (12156us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.005780:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11993 00000100:00100000:0.0:1746155566.007116:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.009384:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123729920 00000100:00100000:3.0:1746155566.009394:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123729920 00010000:00010000:3.0:1746155566.009448:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913d9800/0x844e5faceb5eb527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c98 expref: 8 pid: 29728 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746155566.009474:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6033 00000100:00100000:3.0:1746155566.009483:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123729920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155566.009496:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155566.009530:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913d9800/0x844e5faceb5eb527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c98 expref: 8 pid: 29728 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746155566.009541:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913d9800/0x844e5faceb5eb527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c98 expref: 8 pid: 29728 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746155566.009559:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913d9800/0x844e5faceb5eb527 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c98 expref: 8 pid: 29728 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746155566.009586:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155566.009629:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123729920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 149us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.009635:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6033 00000100:00080000:1.0:1746155566.009773:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746155566.010105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.010407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.010462:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123730048 00000100:00100000:2.0:1746155566.010466:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123730048 00002000:00100000:2.0:1746155566.010656:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009fac6300 x1830976123730048/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.010664:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6300 with x1830976123730048 ext(2097152->3145727) 00010000:00010000:2.0:1746155566.010670:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 17 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.010678:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 17 pid: 4461 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746155566.010683:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac6300 00000100:00100000:2.0:1746155566.010693:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123730304 00000100:00100000:2.0:1746155566.010695:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123730304 00002000:00100000:2.0:1746155566.010703:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009fac7800 x1830976123730304/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.010709:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7800 with x1830976123730304 ext(3145728->4194303) 00010000:00010000:2.0:1746155566.010712:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 18 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.010719:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 18 pid: 4461 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746155566.010723:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac7800 00000100:00080000:1.0:1746155566.010786:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155566.011443:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 712 00000100:00100000:2.0:1746155566.011450:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976123730048:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155566.011450:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 713 00000100:00100000:0.0:1746155566.011498:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123730304:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155566.012639:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.012658:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123730432 00000100:00100000:3.0:1746155566.012663:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123730432 00010000:00010000:3.0:1746155566.012683:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c52 expref: 12 pid: 4461 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155566.012700:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6034 00000100:00100000:3.0:1746155566.012705:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123730432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155566.012713:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155566.012723:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c52 expref: 12 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.012731:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c52 expref: 12 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.012748:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb4b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c52 expref: 12 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.012761:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155566.012789:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123730432:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 83us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.012794:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6034 00000100:00100000:2.0:1746155566.025028:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123730304:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13561us (14612us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155566.025038:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 713 00002000:00100000:2.0:1746155566.025047:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009fac7800 x1830976123730304/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.025056:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7800 with x1830976123730304 ext(3145728->4194303) 00010000:00010000:2.0:1746155566.025064:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 19 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.025078:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 19 pid: 4461 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746155566.025086:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac7800 00000100:00100000:2.0:1746155566.027058:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976123730048:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15602us (16947us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155566.027067:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 712 00002000:00100000:2.0:1746155566.027075:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009fac6300 x1830976123730048/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.027082:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6300 with x1830976123730048 ext(2097152->3145727) 00010000:00010000:2.0:1746155566.027089:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 17 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.027101:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 17 pid: 4461 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746155566.027107:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac6300 00000100:00100000:0.0:1746155566.032419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.032543:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123730560 00000100:00100000:3.0:1746155566.032552:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123730560 00000100:00100000:3.0:1746155566.034220:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11994 00000100:00100000:3.0:1746155566.034231:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:29112:x1830976123730560:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155566.034247:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155566.034261:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c29ac00/0x844e5faceb5eb60e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d24 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.034284:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.034285:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.034291:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c29ac00/0x844e5faceb5eb60e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d24 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.034303:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c29ac00/0x844e5faceb5eb60e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d24 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.034312:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c29ac00, rc 0) 00000100:00100000:3.0:1746155566.034351:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:29112:x1830976123730560:12345-192.168.202.51@tcp:101:cat.0 Request processed in 124us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.034357:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11994 00000100:00100000:0.0:1746155566.040097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.041356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.041658:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123730944 00000100:00100000:2.0:1746155566.041665:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123730944 00002000:00100000:2.0:1746155566.041700:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (4055040->4194303) req@ffff8800a0a89f80 x1830976123730944/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.041708:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a89f80 with x1830976123730944 ext(4055040->4194303) 00002000:00010000:2.0:1746155566.041713:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a89f80 00000100:00100000:2.0:1746155566.041737:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4592 00000100:00100000:2.0:1746155566.041745:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976123730944:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155566.043646:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123730816 00000100:00100000:3.0:1746155566.043654:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123730816 00010000:00010000:3.0:1746155566.043682:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 20 pid: 4461 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155566.043711:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6035 00000100:00100000:3.0:1746155566.043717:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976123730816:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155566.043728:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155566.043744:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 20 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.043754:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 20 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.043775:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb39e00/0x844e5faceb5eb4be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c60 expref: 20 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.043806:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.043808:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.043814:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.043821:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.043849:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155566.043859:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124571136:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155566.043921:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.043978:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976123730944:12345-192.168.202.51@tcp:3:cat.0 Request processed in 2232us (2622us total) trans 0 rc 139264/139264 00000100:00100000:1.0:1746155566.043985:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4592 00002000:00100000:1.0:1746155566.043992:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (4055040->4194303) req@ffff8800a0a89f80 x1830976123730944/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 139264/139264 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.044002:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a89f80 with x1830976123730944 ext(4055040->4194303) 00002000:00010000:1.0:1746155566.044005:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a89f80 00000100:00100000:3.0:1746155566.045147:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124571136:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155566.045164:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155566.045194:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976123730816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1477us (5105us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.045200:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6035 00000100:00100000:0.0:1746155566.046102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.046247:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123731200 00000100:00100000:1.0:1746155566.046252:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123731200 00002000:00100000:1.0:1746155566.046282:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3100672->3104767) req@ffff8800a0a88000 x1830976123731200/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.046290:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a88000 with x1830976123731200 ext(3100672->3104767) 00002000:00010000:1.0:1746155566.046294:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a88000 00000100:00100000:1.0:1746155566.046308:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4593 00000100:00100000:1.0:1746155566.046313:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123731200:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155566.046448:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123731200:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 134us (349us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155566.046454:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4593 00002000:00100000:1.0:1746155566.046459:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3100672->3104767) req@ffff8800a0a88000 x1830976123731200/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.046465:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a88000 with x1830976123731200 ext(3100672->3104767) 00002000:00010000:1.0:1746155566.046468:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a88000 00000100:00100000:0.0:1746155566.048245:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.048391:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123731328 00000100:00100000:1.0:1746155566.048397:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123731328 00000100:00100000:1.0:1746155566.048430:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11995 00000100:00100000:1.0:1746155566.048437:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123731328:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155566.048449:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.048463:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a236200/0x844e5faceb5eb615 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d2b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.048492:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a236200/0x844e5faceb5eb615 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d2b expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.048517:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a236200/0x844e5faceb5eb615 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d2b expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.048530:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a236200, rc 0) 00000100:00100000:1.0:1746155566.048562:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123731328:12345-192.168.202.51@tcp:101:cat.0 Request processed in 124us (321us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155566.048567:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11995 00000100:00100000:0.0:1746155566.049757:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.051099:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123731456 00000100:00100000:1.0:1746155566.051105:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123731456 00000100:00100000:1.0:1746155566.051150:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11996 00000100:00100000:1.0:1746155566.051156:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29109:x1830976123731456:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155566.051170:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.051184:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d32 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.051204:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c1a expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.051216:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913d9a00/0x844e5faceb5eb52e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c9f expref: 5 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.051222:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb4a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c4b expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.051229:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.051230:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.051233:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->2945023] (req 2097152->2945023) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.051257:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb4a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c4b expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.051266:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb4a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c4b expref: 13 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746155566.051276:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124571264:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.051340:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913d9a00/0x844e5faceb5eb52e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c9f expref: 5 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.051348:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913d9a00/0x844e5faceb5eb52e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c9f expref: 5 pid: 29728 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746155566.051355:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124571392:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.051373:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c1a expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.051380:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c1a expref: 23 pid: 29728 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155566.051386:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124571520:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155566.051396:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.062065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.062127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.062155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.062168:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123731840 00000100:00100000:3.0:1746155566.062175:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123731840 00000100:00100000:1.0:1746155566.062181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.062194:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123731968 00000100:00100000:1.0:1746155566.062197:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123731968 00010000:00010000:3.0:1746155566.062204:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb4a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c4b expref: 14 pid: 8436 timeout: 795 lvb_type: 1 00010000:00010000:1.0:1746155566.062217:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913d9a00/0x844e5faceb5eb52e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c9f expref: 6 pid: 29728 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746155566.062233:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123732096 00000100:00100000:3.0:1746155566.062245:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6036 00000100:00100000:3.0:1746155566.062252:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123731840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155566.062264:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155566.062282:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb4a9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c4b expref: 14 pid: 8436 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746155566.062291:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb4a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c4b expref: 14 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746155566.062311:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123732096 00010000:00010000:3.0:1746155566.062312:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155566.062325:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c1a expref: 24 pid: 29728 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155566.062341:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6037 00000100:00100000:3.0:1746155566.062345:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123731840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 93us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.062347:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1960:x1830976123731968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155566.062351:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6036 00010000:00010000:1.0:1746155566.062353:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155566.062361:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913d9a00/0x844e5faceb5eb52e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c9f expref: 6 pid: 29728 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746155566.062366:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6038 00000100:00100000:3.0:1746155566.062371:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123732096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155566.062373:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913d9a00/0x844e5faceb5eb52e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c9f expref: 6 pid: 29728 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746155566.062376:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155566.062383:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155566.062385:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c1a expref: 24 pid: 29728 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.062392:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c1a expref: 24 pid: 29728 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155566.062399:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1960:x1830976123731968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 53us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.062404:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6037 00010000:00010000:3.0:1746155566.062407:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.062408:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.062414:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.062421:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746155566.062423:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746155566.062445:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155566.062455:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124571648:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155566.062492:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00010000:00010000:2.0:1746155566.062632:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb4a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c4b expref: 13 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746155566.062742:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123731712 00000100:00100000:0.0:1746155566.062746:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123731712 00002000:00100000:0.0:1746155566.062767:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800948e5180 x1830976123731712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155566.062775:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5180 with x1830976123731712 ext(4194304->4956159) 00002000:00010000:0.0:1746155566.062779:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e5180 00000100:00100000:0.0:1746155566.062798:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4594 00000100:00100000:0.0:1746155566.062804:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123731712:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155566.062840:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124571264:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155566.062854:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913d9a00/0x844e5faceb5eb52e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c9f expref: 5 pid: 29728 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746155566.062862:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124571392:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155566.062871:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ce6f200/0x844e5faceb5eb46a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10c1a expref: 24 pid: 29728 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746155566.062878:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124571520:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155566.062898:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.062905:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a236c00, rc 0) 00000100:00100000:2.0:1746155566.062926:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29109:x1830976123731456:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 11770us (13171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.062932:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11996 00000100:00100000:2.0:1746155566.071679:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123731712:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8864us (9613us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155566.071692:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4594 00002000:00100000:2.0:1746155566.071704:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800948e5180 x1830976123731712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.071713:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5180 with x1830976123731712 ext(4194304->4956159) 00002000:00010000:2.0:1746155566.071718:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e5180 00000100:00100000:2.0:1746155566.072335:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124571648:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155566.072350:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155566.072379:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123732096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10007us (10197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.072385:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6038 00000100:00100000:0.0:1746155566.076575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.076664:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123732352 00000100:00100000:2.0:1746155566.076672:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123732352 00002000:00100000:2.0:1746155566.076708:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3dc:0x0] (2940928->2945023) req@ffff8800a0a89500 x1830976123732352/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.076717:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a89500 with x1830976123732352 ext(2940928->2945023) 00002000:00010000:2.0:1746155566.076721:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a89500 00000100:00100000:2.0:1746155566.076748:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4595 00000100:00100000:2.0:1746155566.076755:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123732352:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155566.076916:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123732352:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 160us (346us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155566.076922:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4595 00002000:00100000:2.0:1746155566.076927:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3dc:0x0] (2940928->2945023) req@ffff8800a0a89500 x1830976123732352/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.076932:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a89500 with x1830976123732352 ext(2940928->2945023) 00002000:00010000:2.0:1746155566.076935:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a89500 00000100:00100000:0.0:1746155566.077239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.077576:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.077644:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123732480 00000100:00100000:1.0:1746155566.077648:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123732480 00000100:00100000:1.0:1746155566.077665:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123732608 00000100:00100000:1.0:1746155566.077666:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123732608 00000100:00100000:1.0:1746155566.077677:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11997 00000100:00100000:1.0:1746155566.077682:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976123732480:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155566.077690:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.077703:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2400/0x844e5faceb5eb623 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d39 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.077724:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2400/0x844e5faceb5eb623 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d39 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.077732:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2400/0x844e5faceb5eb623 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d39 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.077743:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b2400, rc 0) 00000100:00100000:1.0:1746155566.077763:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976123732480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 81us (525us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155566.077769:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11997 00000100:00100000:1.0:1746155566.077778:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11998 00000100:00100000:1.0:1746155566.077782:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123732608:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155566.077788:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.077795:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5eb62a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d40 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155566.077822:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124571776:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155566.077858:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850300 going to sleep for 11 seconds 00002000:00010000:1.0:1746155566.081268:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime: 1746155565 -> 1746155566 00002000:00010000:1.0:1746155566.081274:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime: 1746155565 -> 1746155566 00002000:00010000:1.0:1746155566.081276:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime: 1746155565 -> 1746155566 00000100:00100000:1.0:1746155566.081296:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124571776:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155566.081320:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5eb62a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d40 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.081331:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5eb62a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d40 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.081340:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b3000, rc 0) 00000100:00100000:1.0:1746155566.081375:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123732608:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3590us (3798us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155566.081381:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11998 00000100:00100000:0.0:1746155566.091695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.091742:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123732736 00000100:00100000:0.0:1746155566.091742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.091750:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123732736 00000100:00100000:2.0:1746155566.091778:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123732864 00000100:00100000:2.0:1746155566.091785:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123732864 00000100:00100000:2.0:1746155566.091826:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11999 00000100:00100000:2.0:1746155566.091833:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976123732864:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155566.091848:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.091860:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a539c000/0x844e5faceb5eb631 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d4e expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155566.091900:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124571904:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155566.091963:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfde40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.092169:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12000 00000100:00100000:1.0:1746155566.092174:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123732736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155566.092181:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.092188:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2400/0x844e5faceb5eb638 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d47 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.092203:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2400/0x844e5faceb5eb638 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d47 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.092211:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2400/0x844e5faceb5eb638 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d47 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.092221:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b2400, rc 0) 00000100:00100000:1.0:1746155566.092242:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123732736:12345-192.168.202.51@tcp:101:cat.0 Request processed in 68us (555us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155566.092246:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12000 00000100:00100000:3.0:1746155566.096436:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124571904:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155566.096465:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a539c000/0x844e5faceb5eb631 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d4e expref: 24 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.096478:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a539c000/0x844e5faceb5eb631 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d4e expref: 24 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.096488:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a539c000, rc 0) 00000100:00100000:3.0:1746155566.096552:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976123732864:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4718us (4808us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155566.096559:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11999 00000100:00100000:0.0:1746155566.106686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.106897:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123733120 00000100:00100000:1.0:1746155566.106905:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123733120 00000100:00100000:1.0:1746155566.106958:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4027 00000100:00100000:1.0:1746155566.106964:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:29112:x1830976123733120:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155566.107120:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+310:29112:x1830976123733120:12345-192.168.202.51@tcp:35:cat.0 Request processed in 156us (441us total) trans 8589943932 rc 0/0 00000100:00100000:1.0:1746155566.107132:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4027 00000100:00080000:0.0:1746155566.107133:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746155566.107153:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155566.134125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.134379:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.134454:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.134532:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123733248 00000100:00100000:1.0:1746155566.134540:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123733248 00000100:00100000:1.0:1746155566.134570:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123733376 00000100:00100000:1.0:1746155566.134573:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123733376 00000100:00100000:1.0:1746155566.134584:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123733504 00000100:00100000:1.0:1746155566.134586:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123733504 00000100:00100000:1.0:1746155566.134613:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12001 00000100:00100000:1.0:1746155566.134620:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123733248:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155566.134622:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12002 00000100:00100000:3.0:1746155566.134629:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123733376:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155566.134634:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155566.134637:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155566.134648:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5eb646 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d5c expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.134648:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3c00/0x844e5faceb5eb63f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d55 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.134665:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.134665:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.134667:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.134667:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.134674:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5eb646 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d5c expref: 15 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.134674:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3c00/0x844e5faceb5eb63f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d55 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.134687:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5eb646 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d5c expref: 15 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.134687:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3c00/0x844e5faceb5eb63f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d55 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.134695:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090d06000, rc 0) 00010000:00010000:1.0:1746155566.134695:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b3c00, rc 0) 00000100:00100000:3.0:1746155566.134733:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123733376:12345-192.168.202.51@tcp:101:cat.0 Request processed in 104us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.134738:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12002 00000100:00100000:0.0:1746155566.134744:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12003 00000100:00100000:0.0:1746155566.134751:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123733504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155566.134758:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155566.134766:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094484600/0x844e5faceb5eb64d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d63 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155566.134797:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124572032:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155566.134842:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976123733248:12345-192.168.202.51@tcp:101:cat.0 Request processed in 222us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.134847:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12001 00000100:00100000:1.0:1746155566.137703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.137787:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155566.137858:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123733632 00000100:00100000:2.0:1746155566.137865:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123733632 00000100:00100000:2.0:1746155566.137896:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12004 00000100:00100000:2.0:1746155566.137902:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123733632:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155566.137915:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.137928:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a539c000/0x844e5faceb5eb654 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d6a expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.137950:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a539c000/0x844e5faceb5eb654 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d6a expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.137958:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a539c000/0x844e5faceb5eb654 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d6a expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.137969:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a539c000, rc 0) 00000100:00100000:2.0:1746155566.138006:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123733632:12345-192.168.202.51@tcp:101:cat.0 Request processed in 104us (308us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155566.138010:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12004 00000100:00100000:1.0:1746155566.146862:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124572032:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155566.146889:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094484600/0x844e5faceb5eb64d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d63 expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.146901:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094484600/0x844e5faceb5eb64d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d63 expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.146915:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094484600, rc 0) 00000100:00100000:1.0:1746155566.148938:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123733504:12345-192.168.202.51@tcp:101:cat.0 Request processed in 14179us (14474us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155566.148947:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12003 00000100:00100000:0.0:1746155566.161671:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.163140:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123733888 00000100:00100000:2.0:1746155566.163149:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123733888 00002000:00100000:2.0:1746155566.163185:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009451df80 x1830976123733888/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.163193:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451df80 with x1830976123733888 ext(1048576->2097151) 00002000:00010000:2.0:1746155566.163198:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451df80 00000100:00100000:2.0:1746155566.163222:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4596 00000100:00100000:2.0:1746155566.163230:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976123733888:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155566.164573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.164645:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123734144 00000100:00100000:1.0:1746155566.164649:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123734144 00002000:00100000:1.0:1746155566.164670:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009451c380 x1830976123734144/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.164678:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451c380 with x1830976123734144 ext(1048576->2097151) 00002000:00010000:1.0:1746155566.164682:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451c380 00000100:00100000:1.0:1746155566.164696:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4597 00000100:00100000:1.0:1746155566.164702:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123734144:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155566.175842:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123733888:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12604us (14168us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155566.175853:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4596 00002000:00100000:2.0:1746155566.175862:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009451df80 x1830976123733888/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.175869:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451df80 with x1830976123733888 ext(1048576->2097151) 00002000:00010000:2.0:1746155566.175873:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451df80 00000100:00100000:1.0:1746155566.184537:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123734144:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19827us (19959us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155566.184546:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4597 00002000:00100000:1.0:1746155566.184556:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009451c380 x1830976123734144/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.184563:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451c380 with x1830976123734144 ext(1048576->2097151) 00002000:00010000:1.0:1746155566.184568:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451c380 00000100:00100000:2.0:1746155566.195329:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.195910:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.195970:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123734528 00000100:00100000:0.0:1746155566.195977:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123734528 00000100:00100000:0.0:1746155566.196014:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9994 00000100:00100000:0.0:1746155566.196021:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f388450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+310:29124:x1830976123734528:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155566.196041:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155566.196055:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094484800/0x844e5faceb5eb65b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d78 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155566.196143:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eb662 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155566.196145:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123734272 00000100:00100000:1.0:1746155566.196149:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123734272 00010000:00010000:0.0:1746155566.196154:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eb662 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196162:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eb662 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155566.196172:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12005 00010000:00010000:0.0:1746155566.196172:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485200/0x844e5faceb5eb669 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155566.196177:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29121:x1830976123734272:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155566.196177:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094485200/0x844e5faceb5eb669 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196182:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094485200/0x844e5faceb5eb669 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.196185:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.196193:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d71 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.196209:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.196215:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155566.196217:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155566.196220:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d71 expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.196243:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.196253:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 16 pid: 8436 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155566.196264:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124572160:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155566.196267:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485c00/0x844e5faceb5eb677 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196275:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094485c00/0x844e5faceb5eb677 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196280:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094485c00/0x844e5faceb5eb677 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155566.196286:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000100:00100000:1.0:1746155566.196335:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00010000:00010000:0.0:1746155566.196351:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eb662 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196357:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eb662 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196365:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eb662 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196369:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094485000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155566.196373:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eb662 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196378:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eb662 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196387:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155566.196389:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155566.196392:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eb662 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196396:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094485000/0x844e5faceb5eb662 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196408:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485200/0x844e5faceb5eb669 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196414:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094485200/0x844e5faceb5eb669 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196419:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094485200/0x844e5faceb5eb669 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196422:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094485200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155566.196424:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094485200/0x844e5faceb5eb669 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196428:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094485200/0x844e5faceb5eb669 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196437:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800942dc900) 00010000:00010000:0.0:1746155566.196439:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155566.196441:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094485200/0x844e5faceb5eb669 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155566.196444:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094485200/0x844e5faceb5eb669 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.197949:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094484800/0x844e5faceb5eb65b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d78 expref: 313 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.197970:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094485c00/0x844e5faceb5eb677 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d78 expref: 312 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.197976:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155566.197979:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155566.197981:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094485c00, rc 0) 00000100:00100000:1.0:1746155566.198030:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f388450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:29124:x1830976123734528:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2008us (2120us total) trans 8589943933 rc 0/0 00000100:00100000:1.0:1746155566.198037:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9994 00000100:00100000:0.0:1746155566.199916:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.199998:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124572160:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.200018:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d71 expref: 12 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.200030:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b3800, rc 0) 00000100:00100000:1.0:1746155566.200056:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29121:x1830976123734272:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3878us (4734us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.200062:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12005 00000100:00100000:2.0:1746155566.201901:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123734656 00000100:00100000:2.0:1746155566.201909:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123734656 00002000:00100000:2.0:1746155566.201943:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1564672->1662975) req@ffff88009451c700 x1830976123734656/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.201952:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451c700 with x1830976123734656 ext(1564672->1662975) 00010000:00010000:2.0:1746155566.201958:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 17 pid: 8436 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.201969:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 17 pid: 8436 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746155566.201975:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451c700 00000100:00100000:2.0:1746155566.202005:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 714 00000100:00100000:2.0:1746155566.202012:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123734656:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155566.205650:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.206063:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123734784 00000100:00100000:3.0:1746155566.206071:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123734784 00000100:00100000:2.0:1746155566.207814:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123734656:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5796us (7895us total) trans 21474840560 rc 0/0 00000100:00100000:2.0:1746155566.207827:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 714 00002000:00100000:2.0:1746155566.207835:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1564672->1662975) req@ffff88009451c700 x1830976123734656/t21474840560(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/448 e 0 to 0 dl 1746155577 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.207843:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451c700 with x1830976123734656 ext(1564672->1662975) 00010000:00010000:2.0:1746155566.207851:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 19 pid: 8436 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.207864:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 19 pid: 8436 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746155566.207870:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451c700 00000100:00100000:3.0:1746155566.208119:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 584 00000100:00100000:3.0:1746155566.208129:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1962:x1830976123734784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155566.208141:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155566.208160:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094485c00/0x844e5faceb5eb677 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d78 expref: 312 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.208176:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155566.208180:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155566.208197:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+311:1962:x1830976123734784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 70us (2555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.208202:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 584 00000100:00100000:0.0:1746155566.216257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.216319:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123734912 00000100:00100000:1.0:1746155566.216326:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123734912 00010000:00010000:1.0:1746155566.216354:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 19 pid: 8436 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155566.216535:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6039 00000100:00100000:1.0:1746155566.216544:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123734912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155566.216557:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155566.216633:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 19 pid: 8436 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746155566.216644:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 19 pid: 8436 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746155566.216665:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5eb5f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->1662975) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d0f expref: 19 pid: 8436 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746155566.217271:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.217273:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.217280:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d71 expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.217288:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d71 expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.217318:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d71 expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155566.217330:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976124572288:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155566.218895:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.224404:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976124572288:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155566.224423:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155566.224464:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976123734912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7920us (8213us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.224474:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6039 00000100:00100000:0.0:1746155566.225231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.225630:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123735168 00000100:00100000:3.0:1746155566.225637:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123735168 00002000:00100000:3.0:1746155566.225671:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009451e300 x1830976123735168/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.225679:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451e300 with x1830976123735168 ext(1048576->2097151) 00002000:00010000:3.0:1746155566.225683:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451e300 00000100:00100000:3.0:1746155566.225698:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4598 00000100:00100000:3.0:1746155566.225704:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123735168:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155566.240742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.241033:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123735424 00000100:00100000:1.0:1746155566.241041:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123735424 00000100:00100000:1.0:1746155566.241091:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9995 00000100:00100000:1.0:1746155566.241099:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+311:29128:x1830976123735424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155566.241122:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.241137:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fab600/0x844e5faceb5eb685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d7f expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.241218:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5eb68c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241228:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5eb68c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241236:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5eb68c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241248:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faac00/0x844e5faceb5eb693 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241252:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faac00/0x844e5faceb5eb693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241257:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faac00/0x844e5faceb5eb693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241340:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fab400/0x844e5faceb5eb69a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241347:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fab400/0x844e5faceb5eb69a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241352:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fab400/0x844e5faceb5eb69a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155566.241358:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155566.241422:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5eb68c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241430:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5eb68c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241434:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5eb68c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241439:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5fabc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155566.241441:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5eb68c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241446:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5eb68c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241455:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155566.241457:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155566.241460:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5eb68c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241465:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5eb68c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241479:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faac00/0x844e5faceb5eb693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241483:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faac00/0x844e5faceb5eb693 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241488:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faac00/0x844e5faceb5eb693 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241491:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5faac00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155566.241493:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faac00/0x844e5faceb5eb693 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241500:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faac00/0x844e5faceb5eb693 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241525:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51600) 00010000:00010000:1.0:1746155566.241527:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155566.241529:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faac00/0x844e5faceb5eb693 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241533:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faac00/0x844e5faceb5eb693 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.241562:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fab600/0x844e5faceb5eb685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d7f expref: 314 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.241571:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fab400/0x844e5faceb5eb69a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d7f expref: 313 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.241576:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155566.241578:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155566.241579:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fab400, rc 0) 00000100:00100000:1.0:1746155566.241630:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+313:29128:x1830976123735424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 531us (896us total) trans 8589943934 rc 0/0 00000100:00100000:1.0:1746155566.241636:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9995 00000100:00100000:3.0:1746155566.242238:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123735168:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16533us (17008us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155566.242245:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4598 00002000:00100000:3.0:1746155566.242252:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009451e300 x1830976123735168/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.242260:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451e300 with x1830976123735168 ext(1048576->2097151) 00002000:00010000:3.0:1746155566.242263:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451e300 00000100:00100000:1.0:1746155566.256910:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.257084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.257103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.257123:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.257148:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.257157:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123735552 00000100:00100000:1.0:1746155566.257163:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123735936 00000100:00100000:3.0:1746155566.257164:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123735552 00000100:00100000:1.0:1746155566.257166:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123735936 00000100:00100000:3.0:1746155566.257195:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12006 00000100:00100000:1.0:1746155566.257199:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 585 00000100:00100000:3.0:1746155566.257202:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976123735552:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155566.257204:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+313:1960:x1830976123735936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155566.257215:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.257215:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155566.257228:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eb6a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d86 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.257233:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fab400/0x844e5faceb5eb69a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d7f expref: 313 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.257245:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.257247:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.257249:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155566.257252:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155566.257254:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eb6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d86 expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.257266:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eb6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d86 expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.257275:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f62800, rc 0) 00000100:00100000:1.0:1746155566.257283:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1960:x1830976123735936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.257289:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 585 00000100:00100000:3.0:1746155566.257293:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123735552:12345-192.168.202.51@tcp:101:cat.0 Request processed in 91us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.257298:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12006 00000100:00100000:3.0:1746155566.257310:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123735680 00000100:00100000:3.0:1746155566.257312:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123735680 00000100:00100000:3.0:1746155566.257322:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123735808 00000100:00100000:3.0:1746155566.257324:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123735808 00000100:00100000:3.0:1746155566.257407:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123736064 00000100:00100000:3.0:1746155566.257410:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123736064 00000100:00100000:3.0:1746155566.257440:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12007 00000100:00100000:3.0:1746155566.257446:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123735680:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155566.257446:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12008 00010000:00010000:3.0:1746155566.257451:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155566.257453:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976123735808:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155566.257460:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c173e00/0x844e5faceb5eb6af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d8d expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.257461:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.257469:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a539c800/0x844e5faceb5eb6b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d94 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.257473:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c173e00/0x844e5faceb5eb6af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d8d expref: 20 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.257485:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c173e00/0x844e5faceb5eb6af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d8d expref: 20 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.257495:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c173e00, rc 0) 00000100:00100000:2.0:1746155566.257516:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124572416:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155566.257527:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123735680:12345-192.168.202.51@tcp:101:cat.0 Request processed in 81us (441us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155566.257532:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12007 00000100:00100000:3.0:1746155566.257542:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12009 00000100:00100000:3.0:1746155566.257547:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29121:x1830976123736064:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155566.257553:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155566.257558:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd540 going to sleep for 11 seconds 00010000:00010000:3.0:1746155566.257559:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10d9b expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.257572:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.257577:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155566.257579:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155566.257581:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d9b expref: 13 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.257606:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.257616:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 13 pid: 1625 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155566.257624:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124572544:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155566.257644:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.261493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.261623:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124572544:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155566.261646:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d9b expref: 13 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.261660:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c173000, rc 0) 00000100:00100000:3.0:1746155566.261707:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123736192 00000100:00100000:2.0:1746155566.261708:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29121:x1830976123736064:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4159us (4583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.261713:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123736192 00000100:00100000:2.0:1746155566.261715:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12009 00002000:00100000:3.0:1746155566.261744:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3100672->3145727) req@ffff88009451ce00 x1830976123736192/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.261752:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451ce00 with x1830976123736192 ext(3100672->3145727) 00010000:00010000:3.0:1746155566.261757:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 13 pid: 1625 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.261767:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 13 pid: 1625 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746155566.261772:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451ce00 00000100:00100000:0.0:1746155566.261782:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124572416:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155566.261787:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 715 00000100:00100000:3.0:1746155566.261793:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976123736192:12345-192.168.202.51@tcp:4:cat.0 00010000:00010000:0.0:1746155566.261801:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a539c800/0x844e5faceb5eb6b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d94 expref: 24 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155566.261831:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a539c800/0x844e5faceb5eb6b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d94 expref: 24 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155566.261850:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a539c800, rc 0) 00000100:00100000:0.0:1746155566.261869:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976123735808:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4417us (4764us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155566.261873:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12008 00000100:00100000:3.0:1746155566.267022:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976123736192:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5221us (5529us total) trans 21474840561 rc 0/0 00000100:00100000:3.0:1746155566.267032:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 715 00002000:00100000:3.0:1746155566.267042:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3100672->3145727) req@ffff88009451ce00 x1830976123736192/t21474840561(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/448 e 0 to 0 dl 1746155577 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.267050:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451ce00 with x1830976123736192 ext(3100672->3145727) 00010000:00010000:3.0:1746155566.267058:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 15 pid: 1625 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.267071:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 15 pid: 1625 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746155566.267078:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451ce00 00000100:00100000:0.0:1746155566.275735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.278981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.279072:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123736320 00000100:00100000:1.0:1746155566.279079:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123736320 00010000:00010000:1.0:1746155566.279108:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 15 pid: 1625 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155566.279184:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6040 00000100:00100000:1.0:1746155566.279192:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1962:x1830976123736320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155566.279203:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155566.279208:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123736576 00000100:00100000:3.0:1746155566.279211:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123736576 00002000:00010000:1.0:1746155566.279218:0:9789:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155565 -> 1746155566 00010000:00010000:1.0:1746155566.279223:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 15 pid: 1625 timeout: 795 lvb_type: 0 00002000:00100000:3.0:1746155566.279233:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009451fb80 x1830976123736576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746155566.279233:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 15 pid: 1625 timeout: 795 lvb_type: 0 00002000:00100000:3.0:1746155566.279241:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451fb80 with x1830976123736576 ext(1048576->2097151) 00002000:00010000:3.0:1746155566.279245:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451fb80 00010000:00010000:1.0:1746155566.279255:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5eb607 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d1d expref: 15 pid: 1625 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155566.279258:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4599 00000100:00100000:3.0:1746155566.279262:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123736576:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:1.0:1746155566.279299:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.279301:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.279307:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d9b expref: 14 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.279314:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d9b expref: 14 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.279341:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d9b expref: 14 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155566.279351:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124572672:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155566.279415:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.318037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.318072:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.318089:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123736832 00000100:00100000:2.0:1746155566.318090:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123737088 00000100:00100000:2.0:1746155566.318096:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123737088 00000100:00100000:0.0:1746155566.318096:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123736832 00002000:00100000:2.0:1746155566.318125:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009451ca80 x1830976123737088/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155566.318125:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009451d500 x1830976123736832/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.318134:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451ca80 with x1830976123737088 ext(3145728->4194303) 00002000:00100000:0.0:1746155566.318134:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d500 with x1830976123736832 ext(2097152->3145727) 00002000:00010000:2.0:1746155566.318139:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451ca80 00002000:00010000:0.0:1746155566.318139:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451d500 00000100:00100000:0.0:1746155566.318167:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4600 00000100:00100000:2.0:1746155566.318173:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4601 00000100:00100000:0.0:1746155566.318175:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123736832:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155566.318179:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123737088:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155566.318658:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124572672:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155566.318675:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155566.318708:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123736320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 39518us (42981us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.318716:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6040 00000100:00100000:0.0:1746155566.319813:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123736576:12345-192.168.202.51@tcp:3:cat.0 Request processed in 40545us (40835us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155566.319820:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4599 00002000:00100000:0.0:1746155566.319827:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009451fb80 x1830976123736576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155566.319834:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451fb80 with x1830976123736576 ext(1048576->2097151) 00002000:00010000:0.0:1746155566.319838:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451fb80 00000100:00100000:0.0:1746155566.335288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.335348:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123737344 00000100:00100000:2.0:1746155566.335356:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123737344 00000100:00100000:2.0:1746155566.335398:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12010 00000100:00100000:2.0:1746155566.335405:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:29128:x1830976123737344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155566.335420:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.335433:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a539c200/0x844e5faceb5eb6c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10da2 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.335452:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155566.335454:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155566.335460:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a539c200/0x844e5faceb5eb6c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da2 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.335471:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a539c200/0x844e5faceb5eb6c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da2 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.335484:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a539c200, rc 0) 00000100:00100000:2.0:1746155566.335546:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29128:x1830976123737344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 141us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.335551:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12010 00000100:00100000:2.0:1746155566.338478:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123736832:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20295us (20440us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155566.338487:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4600 00002000:00100000:2.0:1746155566.338496:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009451d500 x1830976123736832/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.339391:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d500 with x1830976123736832 ext(2097152->3145727) 00002000:00010000:2.0:1746155566.339396:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451d500 00000100:00100000:2.0:1746155566.347100:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123737088:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28912us (29018us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155566.347109:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4601 00002000:00100000:2.0:1746155566.347118:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009451ca80 x1830976123737088/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.347127:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451ca80 with x1830976123737088 ext(3145728->4194303) 00002000:00010000:2.0:1746155566.347132:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451ca80 00000100:00100000:0.0:1746155566.366981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.367081:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123737472 00000100:00100000:2.0:1746155566.367089:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123737472 00000100:00100000:2.0:1746155566.367136:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12011 00000100:00100000:2.0:1746155566.367143:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29124:x1830976123737472:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155566.367159:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.367173:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10da9 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.367195:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b33 expref: 13 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.367202:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9600/0x844e5faceb5eb3d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb1 expref: 6 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.367207:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a227400/0x844e5faceb5eb305 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b41 expref: 21 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.367212:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155566.367214:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155566.367216:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [413696->1048575] (req 413696->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.367239:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a227400/0x844e5faceb5eb305 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b41 expref: 21 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.367249:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a227400/0x844e5faceb5eb305 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b41 expref: 21 pid: 4461 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746155566.367258:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124572800:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155566.367361:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fe9600/0x844e5faceb5eb3d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb1 expref: 6 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.367369:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9600/0x844e5faceb5eb3d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb1 expref: 6 pid: 18270 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746155566.367377:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124572928:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155566.367417:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b33 expref: 13 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.367425:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b33 expref: 13 pid: 20200 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746155566.367432:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124573056:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155566.367449:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.369827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.369873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.369949:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123737728 00000100:00100000:3.0:1746155566.369956:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123737728 00002000:00100000:3.0:1746155566.369991:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (3993600->4194303) req@ffff88009451f480 x1830976123737728/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.369999:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451f480 with x1830976123737728 ext(3993600->4194303) 00002000:00010000:3.0:1746155566.370003:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451f480 00000100:00100000:3.0:1746155566.370015:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123737600 00000100:00100000:3.0:1746155566.370017:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123737600 00002000:00100000:3.0:1746155566.370023:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (2945024->3993599) req@ffff88009451ea00 x1830976123737600/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.370029:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451ea00 with x1830976123737600 ext(2945024->3993599) 00002000:00010000:3.0:1746155566.370030:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451ea00 00000100:00100000:3.0:1746155566.370040:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4602 00000100:00100000:3.0:1746155566.370045:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123737728:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155566.370374:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4603 00000100:00100000:3.0:1746155566.370380:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123737600:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155566.378294:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.378383:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123738112 00000100:00100000:2.0:1746155566.378390:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123738112 00002000:00100000:2.0:1746155566.378423:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009451e680 x1830976123738112/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.378432:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451e680 with x1830976123738112 ext(2097152->3145727) 00002000:00010000:2.0:1746155566.378436:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451e680 00000100:00100000:2.0:1746155566.378452:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4604 00000100:00100000:2.0:1746155566.378459:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123738112:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155566.387481:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123737728:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17427us (17654us total) trans 0 rc 200704/200704 00000100:00100000:3.0:1746155566.387490:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4602 00002000:00100000:3.0:1746155566.387499:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (3993600->4194303) req@ffff88009451f480 x1830976123737728/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 200704/200704 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.387529:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451f480 with x1830976123737728 ext(3993600->4194303) 00002000:00010000:3.0:1746155566.387535:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451f480 00000100:00100000:2.0:1746155566.389115:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124572800:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155566.389124:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124572928:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155566.389131:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124573056:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155566.389156:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [413696->1048575] (req 413696->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.389174:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a539c400, rc 0) 00000100:00100000:2.0:1746155566.389199:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29124:x1830976123737472:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 22057us (22225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.389205:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12011 00000100:00100000:0.0:1746155566.394475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.394538:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.394562:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.394585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.394649:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123738240 00000100:00100000:0.0:1746155566.394655:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123738240 00010000:00010000:0.0:1746155566.394680:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a227400/0x844e5faceb5eb305 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b41 expref: 23 pid: 4461 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746155566.394698:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123738368 00000100:00100000:0.0:1746155566.394700:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123738368 00010000:00010000:0.0:1746155566.394706:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9600/0x844e5faceb5eb3d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb1 expref: 7 pid: 18270 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746155566.394715:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123738624 00000100:00100000:0.0:1746155566.394717:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123738624 00010000:00010000:0.0:1746155566.394723:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b33 expref: 14 pid: 20200 timeout: 795 lvb_type: 0 00000100:00100000:0.0:1746155566.394733:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6041 00000100:00100000:0.0:1746155566.394738:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976123738240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155566.394749:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155566.394765:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a227400/0x844e5faceb5eb305 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b41 expref: 23 pid: 4461 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746155566.394773:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a227400/0x844e5faceb5eb305 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b41 expref: 23 pid: 4461 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746155566.394789:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a227400/0x844e5faceb5eb305 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b41 expref: 23 pid: 4461 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746155566.394802:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155566.394830:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123738240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 92us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155566.394836:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6041 00000100:00100000:0.0:1746155566.394848:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6042 00000100:00100000:0.0:1746155566.394852:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123738368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155566.394856:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155566.394861:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fe9600/0x844e5faceb5eb3d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb1 expref: 7 pid: 18270 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746155566.394868:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fe9600/0x844e5faceb5eb3d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb1 expref: 7 pid: 18270 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746155566.394882:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9600/0x844e5faceb5eb3d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10bb1 expref: 7 pid: 18270 timeout: 795 lvb_type: 1 00010000:00010000:0.0:1746155566.394899:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155566.394909:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1963:x1830976123738368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155566.394913:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6042 00000100:00100000:0.0:1746155566.394921:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6043 00000100:00100000:0.0:1746155566.394924:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976123738624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155566.394929:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155566.394933:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b33 expref: 14 pid: 20200 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746155566.394940:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b33 expref: 14 pid: 20200 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746155566.394949:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a539d200/0x844e5faceb5eb2f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b33 expref: 14 pid: 20200 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746155566.394955:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155566.394957:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155566.394962:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155566.394968:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155566.394989:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155566.394998:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124573184:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155566.395047:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.395533:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976123737600:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25152us (25658us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155566.395539:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4603 00002000:00100000:0.0:1746155566.395546:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3dc:0x0] (2945024->3993599) req@ffff88009451ea00 x1830976123737600/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155566.395554:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451ea00 with x1830976123737600 ext(2945024->3993599) 00002000:00010000:0.0:1746155566.395557:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451ea00 00000100:00100000:0.0:1746155566.395922:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123738112:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 17462us (17634us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155566.395930:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4604 00002000:00100000:0.0:1746155566.395935:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009451e680 x1830976123738112/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155566.395941:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451e680 with x1830976123738112 ext(2097152->3145727) 00002000:00010000:0.0:1746155566.395944:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451e680 00000100:00100000:3.0:1746155566.396031:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123738496 00000100:00100000:3.0:1746155566.396035:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123738496 00000100:00100000:3.0:1746155566.396069:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9996 00000100:00100000:3.0:1746155566.396079:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:29129:x1830976123738496:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155566.396097:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155566.396108:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0fe00/0x844e5faceb5eb6d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10db0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.396147:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0ea00/0x844e5faceb5eb6d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.396156:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0ea00/0x844e5faceb5eb6d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.396162:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0ea00/0x844e5faceb5eb6d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.396171:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5eb6e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.396175:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5eb6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.396179:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5eb6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.396250:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.396258:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb574 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc9 expref: 24 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.396264:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.396281:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb574 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc9 expref: 24 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.396289:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb574 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc9 expref: 24 pid: 15474 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155566.396297:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124573312:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155566.396332:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155566.399061:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124573184:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155566.399080:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155566.399122:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976123738624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4196us (4535us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.399131:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6043 00000100:00100000:1.0:1746155566.402695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.404411:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123738752 00000100:00100000:2.0:1746155566.404420:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123738752 00000100:00100000:3.0:1746155566.405527:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12012 00000100:00100000:3.0:1746155566.405539:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29128:x1830976123738752:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155566.405555:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155566.405571:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10db7 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.405602:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.405608:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155566.405610:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155566.405612:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db7 expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.405637:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.405645:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 13 pid: 1625 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155566.405654:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124573440:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155566.405727:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ecea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.406291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.406318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.406358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.406380:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123738880 00000100:00100000:1.0:1746155566.406385:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123738880 00010000:00010000:1.0:1746155566.406405:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb574 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc9 expref: 25 pid: 15474 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155566.406423:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6044 00000100:00100000:1.0:1746155566.406428:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123738880:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155566.406436:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155566.406441:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb574 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc9 expref: 25 pid: 15474 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746155566.406449:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb574 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc9 expref: 25 pid: 15474 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746155566.406465:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155566.406469:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155566.406475:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155566.406481:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155566.406491:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155566.406529:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123738880:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 101us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.406535:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6044 00010000:00010000:3.0:1746155566.406663:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5c00/0x844e5faceb5eb574 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cc9 expref: 24 pid: 15474 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155566.406676:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124573312:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155566.406690:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406697:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406704:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155566.406736:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155566.406739:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155566.406750:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406758:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406764:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0ea00/0x844e5faceb5eb6d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406769:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0ea00/0x844e5faceb5eb6d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406774:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0ea00/0x844e5faceb5eb6d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406779:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd0ea00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155566.406782:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0ea00/0x844e5faceb5eb6d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406787:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0ea00/0x844e5faceb5eb6d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406794:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155566.406796:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155566.406798:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0ea00/0x844e5faceb5eb6d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406802:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0ea00/0x844e5faceb5eb6d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406809:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5eb6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406814:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5eb6e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406817:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5eb6e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406820:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd0e600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155566.406822:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5eb6e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406826:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5eb6e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406830:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009c823100) 00010000:00010000:3.0:1746155566.406832:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155566.406833:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5eb6e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406837:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5eb6e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.406861:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0fe00/0x844e5faceb5eb6d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db0 expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.406869:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db0 expref: 16 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.406874:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155566.406876:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155566.406878:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd0f200, rc 0) 00000100:00100000:3.0:1746155566.406903:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:29129:x1830976123738496:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 10824us (12339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.406908:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9996 00000100:00100000:2.0:1746155566.406987:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123739264 00000100:00100000:2.0:1746155566.406991:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123739264 00000100:00100000:2.0:1746155566.407011:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12013 00000100:00100000:2.0:1746155566.407016:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123739264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155566.407024:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.407033:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca07200/0x844e5faceb5eb6f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10dbe expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155566.407060:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124573568:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155566.407099:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfda80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155566.407120:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123739136 00000100:00100000:2.0:1746155566.407123:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123739136 00002000:00100000:2.0:1746155566.407142:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (413696->417791) req@ffff8800948e6300 x1830976123739136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.407155:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e6300 with x1830976123739136 ext(413696->417791) 00002000:00010000:2.0:1746155566.407158:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e6300 00000100:00100000:2.0:1746155566.407169:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4605 00000100:00100000:2.0:1746155566.407173:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976123739136:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155566.407326:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976123739136:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 152us (1007us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155566.407331:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4605 00002000:00100000:2.0:1746155566.407337:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (413696->417791) req@ffff8800948e6300 x1830976123739136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.407342:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e6300 with x1830976123739136 ext(413696->417791) 00002000:00010000:2.0:1746155566.407345:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e6300 00000100:00100000:1.0:1746155566.410102:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.410161:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123739392 00000100:00100000:0.0:1746155566.410168:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123739392 00002000:00100000:0.0:1746155566.410200:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2945023) req@ffff8800948e7100 x1830976123739392/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155566.410208:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e7100 with x1830976123739392 ext(2097152->2945023) 00010000:00010000:0.0:1746155566.410214:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 14 pid: 1625 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746155566.410225:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 14 pid: 1625 timeout: 795 lvb_type: 0 00002000:00010000:0.0:1746155566.410230:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800948e7100 00000100:00100000:0.0:1746155566.410258:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 716 00000100:00100000:0.0:1746155566.410265:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123739392:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155566.410954:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124573440:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155566.410977:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db7 expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.410988:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5daee00, rc 0) 00000100:00100000:3.0:1746155566.411008:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:29128:x1830976123738752:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5474us (8323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.411014:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12012 00000100:00100000:0.0:1746155566.414877:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.414908:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.414938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.415017:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123739520 00000100:00100000:1.0:1746155566.415024:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123739520 00000100:00100000:1.0:1746155566.415048:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123739648 00000100:00100000:1.0:1746155566.415049:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123739648 00000100:00100000:1.0:1746155566.415058:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123739776 00000100:00100000:1.0:1746155566.415059:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123739776 00000100:00100000:1.0:1746155566.415070:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12014 00000100:00100000:1.0:1746155566.415076:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1960:x1830976123739520:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155566.415089:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.415101:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ecb000/0x844e5faceb5eb6fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10dc5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155566.415139:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124573696:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155566.415194:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.415209:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12015 00000100:00100000:1.0:1746155566.415213:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1960:x1830976123739648:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155566.415219:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.415226:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ecaa00/0x844e5faceb5eb703 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10dcc expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.415236:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.415237:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.415244:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ecaa00/0x844e5faceb5eb703 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dcc expref: 7 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.415255:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ecaa00/0x844e5faceb5eb703 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dcc expref: 7 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.415264:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ecaa00, rc 0) 00000100:00100000:1.0:1746155566.415280:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123739648:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 66us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.415284:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12015 00000100:00100000:1.0:1746155566.415296:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12016 00000100:00100000:1.0:1746155566.415300:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1960:x1830976123739776:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155566.415304:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.415308:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ecb800/0x844e5faceb5eb70a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10dd3 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.415314:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.415315:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.415319:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ecb800/0x844e5faceb5eb70a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dd3 expref: 7 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.415326:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ecb800/0x844e5faceb5eb70a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dd3 expref: 7 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.415331:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ecb800, rc 0) 00000100:00100000:1.0:1746155566.415340:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123739776:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 40us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.415343:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12016 00002000:00010000:2.0:1746155566.415461:0:4461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime: 1746155565 -> 1746155566 00002000:00010000:2.0:1746155566.415464:0:4461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime: 1746155565 -> 1746155566 00002000:00010000:2.0:1746155566.415466:0:4461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime: 1746155565 -> 1746155566 00000100:00100000:2.0:1746155566.415482:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124573568:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155566.415526:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca07200/0x844e5faceb5eb6f5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dbe expref: 14 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.415534:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca07200/0x844e5faceb5eb6f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dbe expref: 14 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.415545:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca07200, rc 0) 00000100:00100000:2.0:1746155566.415564:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123739264:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8548us (9206us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155566.415569:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12013 00000100:00100000:0.0:1746155566.422750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.422847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.422876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.422896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.422954:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123739904 00000100:00100000:1.0:1746155566.422961:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123739904 00000100:00100000:1.0:1746155566.422991:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123740032 00000100:00100000:1.0:1746155566.422993:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123740032 00000100:00100000:1.0:1746155566.423003:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123740160 00000100:00100000:1.0:1746155566.423004:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123740160 00000100:00100000:1.0:1746155566.423013:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123740288 00000100:00100000:1.0:1746155566.423015:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123740288 00000100:00100000:1.0:1746155566.423033:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12017 00000100:00100000:1.0:1746155566.423041:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123739904:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155566.423058:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.423072:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ecb400/0x844e5faceb5eb711 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10dda expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.423092:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.423095:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.423104:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ecb400/0x844e5faceb5eb711 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dda expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.423124:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ecb400/0x844e5faceb5eb711 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dda expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.423134:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ecb400, rc 0) 00000100:00100000:1.0:1746155566.423170:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123739904:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 130us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.423176:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12017 00000100:00100000:1.0:1746155566.423189:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12018 00000100:00100000:1.0:1746155566.423194:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123740032:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155566.423199:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.423205:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093eca600/0x844e5faceb5eb718 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10de1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.423215:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.423216:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.423221:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093eca600/0x844e5faceb5eb718 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10de1 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.423230:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093eca600/0x844e5faceb5eb718 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10de1 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.423236:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eca600, rc 0) 00000100:00100000:1.0:1746155566.423258:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123740032:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 63us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.423262:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12018 00000100:00100000:1.0:1746155566.423271:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12019 00000100:00100000:1.0:1746155566.423275:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123740160:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155566.423281:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.423289:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093eca400/0x844e5faceb5eb71f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10de8 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155566.423320:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124573824:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155566.423368:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.423385:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12020 00000100:00100000:1.0:1746155566.423390:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:29124:x1830976123740288:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155566.423397:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.423403:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10def expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.423416:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cec expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.423427:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ecaa00/0x844e5faceb5eb703 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dcc expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.423433:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3c00/0x844e5faceb5eb63f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d55 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.423437:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.423438:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.423441:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->1249279] (req 1048576->1249279) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.423454:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3c00/0x844e5faceb5eb63f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d55 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.423461:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3c00/0x844e5faceb5eb63f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d55 expref: 15 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746155566.423468:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124573952:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.423489:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ecaa00/0x844e5faceb5eb703 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dcc expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.423496:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ecaa00/0x844e5faceb5eb703 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dcc expref: 8 pid: 9235 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746155566.423525:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124574080:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.423553:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cec expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.423559:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cec expref: 25 pid: 1625 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155566.423565:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124574208:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155566.423577:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.424736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.424837:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124573696:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155566.424857:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ecb000/0x844e5faceb5eb6fc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dc5 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.424867:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ecb000/0x844e5faceb5eb6fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dc5 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.424877:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ecb000, rc 0) 00000100:00100000:1.0:1746155566.424901:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123739520:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 9824us (10031us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155566.424905:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12014 00000100:00100000:3.0:1746155566.424983:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123740544 00000100:00100000:3.0:1746155566.424988:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123740544 00002000:00100000:3.0:1746155566.425011:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012cdcce00 x1830976123740544/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.425019:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcce00 with x1830976123740544 ext(4194304->4956159) 00002000:00010000:3.0:1746155566.425023:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcce00 00000100:00100000:3.0:1746155566.425036:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4606 00000100:00100000:3.0:1746155566.425042:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123740544:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155566.429138:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123739392:12345-192.168.202.51@tcp:4:cat.0 Request processed in 18866us (19034us total) trans 17179873180 rc 0/0 00000100:00100000:2.0:1746155566.429147:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 716 00002000:00100000:2.0:1746155566.429156:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2945023) req@ffff8800948e7100 x1830976123739392/t17179873180(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/448 e 0 to 0 dl 1746155577 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.429164:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e7100 with x1830976123739392 ext(2097152->2945023) 00010000:00010000:2.0:1746155566.429172:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 16 pid: 1625 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.429183:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 16 pid: 1625 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746155566.429188:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800948e7100 00000100:00100000:0.0:1746155566.435032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.435043:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.435063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.435214:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124573824:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155566.435241:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093eca400/0x844e5faceb5eb71f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10de8 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.435252:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093eca400/0x844e5faceb5eb71f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10de8 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.435265:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eca400, rc 0) 00000100:00100000:1.0:1746155566.435302:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123740160:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 12025us (12424us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155566.435309:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12019 00000100:00100000:1.0:1746155566.435808:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123740672 00000100:00100000:1.0:1746155566.435812:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123740672 00010000:00010000:1.0:1746155566.435830:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cec expref: 26 pid: 1625 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155566.435845:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123740928 00000100:00100000:1.0:1746155566.435846:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123740928 00010000:00010000:1.0:1746155566.435853:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ecaa00/0x844e5faceb5eb703 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dcc expref: 7 pid: 9235 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746155566.435862:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123740800 00000100:00100000:1.0:1746155566.435863:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123740800 00010000:00010000:1.0:1746155566.435870:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3c00/0x844e5faceb5eb63f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d55 expref: 16 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746155566.435880:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6045 00000100:00100000:1.0:1746155566.435886:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123740672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155566.435896:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155566.435906:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cec expref: 26 pid: 1625 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746155566.435914:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cec expref: 26 pid: 1625 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746155566.435932:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155566.435949:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123740672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 63us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.435954:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6045 00000100:00100000:1.0:1746155566.435964:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6046 00000100:00100000:1.0:1746155566.435968:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123740928:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155566.435974:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155566.435980:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ecaa00/0x844e5faceb5eb703 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dcc expref: 7 pid: 9235 timeout: 795 lvb_type: 1 00010000:00010000:1.0:1746155566.435987:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ecaa00/0x844e5faceb5eb703 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dcc expref: 7 pid: 9235 timeout: 795 lvb_type: 1 00010000:00010000:1.0:1746155566.435995:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155566.436007:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123740928:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 39us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.436011:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6046 00000100:00100000:1.0:1746155566.436019:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6047 00000100:00100000:1.0:1746155566.436023:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123740800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155566.436028:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155566.436034:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3c00/0x844e5faceb5eb63f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d55 expref: 16 pid: 8436 timeout: 795 lvb_type: 1 00010000:00010000:1.0:1746155566.436041:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3c00/0x844e5faceb5eb63f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d55 expref: 16 pid: 8436 timeout: 795 lvb_type: 1 00010000:00010000:1.0:1746155566.436051:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.436053:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.436058:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.436065:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.436091:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155566.436101:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124574336:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155566.436136:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746155566.436155:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3c00/0x844e5faceb5eb63f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d55 expref: 16 pid: 8436 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746155566.436162:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124573952:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.436168:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ecaa00/0x844e5faceb5eb703 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dcc expref: 6 pid: 9235 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746155566.436174:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124574080:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.436180:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c9f800/0x844e5faceb5eb5ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10cec expref: 25 pid: 1625 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155566.436187:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124574208:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.436203:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 24 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.436208:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eca800, rc 0) 00000100:00100000:1.0:1746155566.436219:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:29124:x1830976123740288:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 12830us (13323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.436223:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12020 00000100:00100000:0.0:1746155566.441764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.441834:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123741056 00000100:00100000:3.0:1746155566.441842:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123741056 00010000:00010000:3.0:1746155566.441870:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 16 pid: 1625 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155566.441909:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6048 00000100:00100000:3.0:1746155566.441916:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123741056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155566.441929:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155566.441946:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 16 pid: 1625 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.441956:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 16 pid: 1625 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.441974:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5eb61c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2945023) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d32 expref: 16 pid: 1625 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.441988:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.441990:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.441996:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db7 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.442003:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db7 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.442030:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db7 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155566.442040:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124574464:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155566.442658:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ecea80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155566.444998:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123740544:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19950us (20258us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155566.445008:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4606 00002000:00100000:3.0:1746155566.445016:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012cdcce00 x1830976123740544/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.445024:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcce00 with x1830976123740544 ext(4194304->4956159) 00002000:00010000:3.0:1746155566.445029:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcce00 00000100:00100000:1.0:1746155566.445352:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124574336:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155566.445368:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155566.445391:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976123740800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9367us (10327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.445398:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6047 00000100:00100000:3.0:1746155566.447657:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.447679:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123741312 00000100:00100000:3.0:1746155566.447685:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123741312 00000100:00100000:3.0:1746155566.447726:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9997 00000100:00100000:3.0:1746155566.447732:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:29129:x1830976123741312:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155566.447748:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155566.447763:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e200/0x844e5faceb5eb72d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10df6 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.447841:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5daf000/0x844e5faceb5eb734 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.447854:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db0 expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.447860:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5daf000/0x844e5faceb5eb734 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.447885:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db0 expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.447895:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db0 expref: 17 pid: 15474 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155566.447906:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124574592:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155566.447959:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155566.447993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.448009:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123741568 00000100:00100000:3.0:1746155566.448012:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123741568 00002000:00100000:3.0:1746155566.448034:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1245184->1249279) req@ffff88009fac7480 x1830976123741568/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.448042:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7480 with x1830976123741568 ext(1245184->1249279) 00002000:00010000:3.0:1746155566.448046:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac7480 00000100:00100000:3.0:1746155566.450122:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4607 00000100:00100000:3.0:1746155566.450133:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976123741568:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155566.450273:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976123741568:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 142us (2278us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155566.450279:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4607 00002000:00100000:3.0:1746155566.450285:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1245184->1249279) req@ffff88009fac7480 x1830976123741568/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.450292:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7480 with x1830976123741568 ext(1245184->1249279) 00002000:00010000:3.0:1746155566.450296:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac7480 00000100:00100000:3.0:1746155566.450366:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124574464:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155566.450379:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155566.450398:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123741056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8483us (8645us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.450404:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6048 00000100:00100000:0.0:1746155566.452776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.452833:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123741696 00000100:00100000:1.0:1746155566.452840:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123741696 00000100:00100000:1.0:1746155566.452885:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12021 00000100:00100000:1.0:1746155566.452891:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123741696:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155566.452905:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.452918:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913f1000/0x844e5faceb5eb73b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10dfd expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155566.452959:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124574720:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155566.453028:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.454652:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.454819:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123741824 00000100:00100000:2.0:1746155566.454824:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123741824 00000100:00100000:2.0:1746155566.454853:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12022 00000100:00100000:2.0:1746155566.454859:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976123741824:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155566.454869:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.454881:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cbaca00/0x844e5faceb5eb742 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e04 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155566.454911:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124574848:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155566.454949:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfda80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155566.458233:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124574592:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155566.458253:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5daf000/0x844e5faceb5eb734 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155566.458900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.458922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.459803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.459849:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.459922:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124574720:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155566.459942:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913f1000/0x844e5faceb5eb73b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dfd expref: 14 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.459958:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913f1000/0x844e5faceb5eb73b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dfd expref: 14 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.459969:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913f1000, rc 0) 00000100:00100000:1.0:1746155566.460005:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123741696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7114us (7233us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155566.460011:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12021 00000100:00100000:1.0:1746155566.460030:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123741952 00000100:00100000:1.0:1746155566.460034:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123741952 00000100:00100000:3.0:1746155566.460172:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123742080 00000100:00100000:3.0:1746155566.460175:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123742080 00010000:00010000:3.0:1746155566.460197:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db0 expref: 18 pid: 15474 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155566.460216:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6049 00000100:00100000:3.0:1746155566.460223:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1961:x1830976123742080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155566.460232:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155566.460237:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db0 expref: 18 pid: 15474 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.460246:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db0 expref: 18 pid: 15474 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.460259:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5eb6e7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db0 expref: 18 pid: 15474 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.460271:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155566.460275:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5daf000/0x844e5faceb5eb734 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.460283:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5daf000/0x844e5faceb5eb734 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.460288:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5daf000/0x844e5faceb5eb734 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.460305:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155566.460322:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1961:x1830976123742080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 99us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.460327:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6049 00010000:00010000:3.0:1746155566.460342:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5daf000/0x844e5faceb5eb734 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155566.460347:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5daf000/0x844e5faceb5eb734 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155566.460359:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155566.460461:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e200/0x844e5faceb5eb72d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10df6 expref: 18 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.460471:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5daf000/0x844e5faceb5eb734 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10df6 expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.460476:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155566.460479:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155566.460480:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5daf000, rc 0) 00000100:00100000:3.0:1746155566.460499:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:29129:x1830976123741312:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 12768us (12848us total) trans 8589943935 rc 0/0 00000100:00100000:3.0:1746155566.460522:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9997 00000100:00100000:3.0:1746155566.460653:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124574848:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155566.460668:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cbaca00/0x844e5faceb5eb742 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e04 expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.460679:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cbaca00/0x844e5faceb5eb742 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e04 expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.460686:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbaca00, rc 0) 00000100:00100000:3.0:1746155566.460704:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123741824:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5846us (6056us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155566.460709:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12022 00000100:00100000:3.0:1746155566.460728:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123742592 00000100:00100000:3.0:1746155566.460730:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123742592 00002000:00100000:3.0:1746155566.460748:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800944afb80 x1830976123742592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.460755:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944afb80 with x1830976123742592 ext(2097152->3145727) 00002000:00010000:3.0:1746155566.460759:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944afb80 00000100:00100000:3.0:1746155566.460772:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4608 00000100:00100000:3.0:1746155566.460776:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123742592:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155566.462447:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123742336 00000100:00100000:3.0:1746155566.462453:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123742336 00000100:00100000:3.0:1746155566.462479:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4028 00000100:00100000:3.0:1746155566.462484:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:29124:x1830976123742336:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155566.462630:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+313:29124:x1830976123742336:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 144us (2826us total) trans 8589943936 rc 0/0 00000100:00100000:3.0:1746155566.462635:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4028 00000100:00100000:1.0:1746155566.462802:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12023 00000100:00100000:1.0:1746155566.462808:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123741952:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155566.462816:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.462827:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913f0600/0x844e5faceb5eb750 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e0b expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.462841:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.462843:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.462849:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913f0600/0x844e5faceb5eb750 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e0b expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.462861:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913f0600/0x844e5faceb5eb750 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e0b expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.462869:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913f0600, rc 0) 00000100:00100000:1.0:1746155566.462888:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123741952:12345-192.168.202.51@tcp:101:cat.0 Request processed in 80us (3989us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.462895:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12023 00000100:00100000:2.0:1746155566.469908:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.469946:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.470036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.470086:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123743104 00000100:00100000:3.0:1746155566.470116:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123743104 00000100:00100000:2.0:1746155566.470165:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123743360 00000100:00100000:2.0:1746155566.470168:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123743360 00000100:00100000:1.0:1746155566.470244:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9998 00000100:00100000:1.0:1746155566.470256:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:29129:x1830976123743360:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155566.470281:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.470284:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746155566.470305:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5daf000/0x844e5faceb5eb734 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10df6 expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.470330:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155566.470334:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155566.470343:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5eb757 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e12 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.470410:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5eb75e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.470420:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5eb75e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.470427:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5eb75e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.470435:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5eb75e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.470440:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5eb75e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.470445:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5eb75e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.470452:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913f0400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155566.470455:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5eb75e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.470460:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5eb75e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.470466:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155566.470468:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155566.470470:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5eb75e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.470474:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5eb75e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.470492:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5eb757 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e12 expref: 17 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.470498:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5eb757 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e12 expref: 17 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.470525:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913f0200, rc 0) 00000100:00100000:1.0:1746155566.470557:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:29129:x1830976123743360:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 306us (521us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155566.470562:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9998 00002000:00100000:3.0:1746155566.470678:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4055039) req@ffff88009286c700 x1830976123743104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.470686:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286c700 with x1830976123743104 ext(3145728->4055039) 00002000:00010000:3.0:1746155566.470689:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286c700 00000100:00100000:3.0:1746155566.470699:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123742976 00000100:00100000:3.0:1746155566.470701:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123742976 00002000:00100000:3.0:1746155566.470712:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009286e300 x1830976123742976/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.470718:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286e300 with x1830976123742976 ext(3145728->4194303) 00002000:00010000:3.0:1746155566.470721:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286e300 00000100:00100000:3.0:1746155566.470728:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4609 00000100:00100000:3.0:1746155566.470733:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123743104:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155566.471633:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4610 00000100:00100000:3.0:1746155566.471640:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123742976:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155566.472891:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123742592:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12110us (13037us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155566.472898:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4608 00002000:00100000:3.0:1746155566.472905:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800944afb80 x1830976123742592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.472911:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944afb80 with x1830976123742592 ext(2097152->3145727) 00002000:00010000:3.0:1746155566.472915:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944afb80 00000100:00100000:0.0:1746155566.473529:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.473584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.474027:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123743488 00000100:00100000:2.0:1746155566.474033:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123743488 00000100:00100000:2.0:1746155566.474065:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123743616 00000100:00100000:2.0:1746155566.474067:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123743616 00000100:00100000:2.0:1746155566.474085:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12024 00000100:00100000:2.0:1746155566.474090:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123743488:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155566.474101:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.474114:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5eb765 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e19 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155566.474150:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124574976:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155566.474202:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.474254:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12025 00000100:00100000:1.0:1746155566.474261:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123743616:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155566.474267:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.474276:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5eb76c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e20 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155566.474299:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124575104:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155566.474320:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.475447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.476830:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.476943:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123743872 00000100:00100000:2.0:1746155566.476950:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123743872 00000100:00100000:2.0:1746155566.476984:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4029 00000100:00100000:2.0:1746155566.476989:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:29129:x1830976123743872:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:2.0:1746155566.477143:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:29129:x1830976123743872:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 153us (1698us total) trans 8589943937 rc 0/0 00000100:00100000:2.0:1746155566.477149:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4029 00000100:00100000:2.0:1746155566.477197:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124574976:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155566.477218:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5eb765 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e19 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.477228:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5eb765 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e19 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.477237:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc9e00, rc 0) 00000100:00100000:2.0:1746155566.477254:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123743488:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3163us (3726us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155566.477259:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12024 00000100:00100000:2.0:1746155566.477270:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123744000 00000100:00100000:2.0:1746155566.477272:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123744000 00000100:00100000:2.0:1746155566.477291:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12026 00000100:00100000:2.0:1746155566.477295:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29131:x1830976123744000:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155566.477303:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.477312:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e27 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.477327:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.477333:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155566.477335:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155566.477337:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [487424->1048575] (req 487424->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.477355:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.477365:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 21 pid: 4461 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746155566.477379:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124575232:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155566.477417:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.478455:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124575104:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155566.478472:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5eb76c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e20 expref: 16 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.478480:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5eb76c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e20 expref: 16 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.478488:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913f0c00, rc 0) 00000100:00100000:1.0:1746155566.478527:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123743616:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4266us (4942us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155566.478532:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12025 00000100:00100000:1.0:1746155566.487813:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.488191:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123743104:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 17454us (18294us total) trans 0 rc 909312/909312 00000100:00100000:3.0:1746155566.488204:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4609 00002000:00100000:3.0:1746155566.488213:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4055039) req@ffff88009286c700 x1830976123743104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 909312/909312 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.488220:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286c700 with x1830976123743104 ext(3145728->4055039) 00002000:00010000:3.0:1746155566.488226:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009286c700 00000100:00100000:3.0:1746155566.488244:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123744128 00000100:00100000:3.0:1746155566.488249:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123744128 00002000:00100000:3.0:1746155566.488270:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d6:0x0] (413696->1048575) req@ffff88008ff1b800 x1830976123744128/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.488277:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1b800 with x1830976123744128 ext(413696->1048575) 00010000:00010000:3.0:1746155566.488283:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 20 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.488295:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 20 pid: 4461 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746155566.488301:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ff1b800 00000100:00100000:2.0:1746155566.488700:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124575232:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155566.488718:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [487424->1048575] (req 487424->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.488728:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc8800, rc 0) 00000100:00100000:2.0:1746155566.488745:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29131:x1830976123744000:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 11450us (11920us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.488751:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12026 00000100:00100000:3.0:1746155566.489352:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 717 00000100:00100000:3.0:1746155566.489359:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123744128:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155566.490144:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123742976:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 18504us (20199us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155566.490149:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4610 00002000:00100000:3.0:1746155566.490155:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009286e300 x1830976123742976/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.490167:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286e300 with x1830976123742976 ext(3145728->4194303) 00002000:00010000:3.0:1746155566.490171:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286e300 00000100:00100000:0.0:1746155566.501421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.501741:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123744256 00000100:00100000:2.0:1746155566.501749:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123744256 00000100:00100000:2.0:1746155566.501784:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12027 00000100:00100000:2.0:1746155566.501790:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123744256:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155566.501804:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.501817:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8c00/0x844e5faceb5eb77a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e2e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155566.501855:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124575360:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155566.501916:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155566.506499:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124575360:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155566.506541:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8c00/0x844e5faceb5eb77a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e2e expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.506559:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8c00/0x844e5faceb5eb77a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e2e expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.506577:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc8c00, rc 0) 00000100:00100000:2.0:1746155566.507805:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123744256:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6010us (6388us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155566.507813:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12027 00000100:00100000:3.0:1746155566.508247:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123744128:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 18888us (20441us total) trans 21474840562 rc 0/0 00000100:00100000:3.0:1746155566.508256:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 717 00002000:00100000:3.0:1746155566.508263:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d6:0x0] (413696->1048575) req@ffff88008ff1b800 x1830976123744128/t21474840562(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/448 e 0 to 0 dl 1746155577 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.508272:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1b800 with x1830976123744128 ext(413696->1048575) 00010000:00010000:3.0:1746155566.508279:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 22 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.508291:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 22 pid: 4461 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746155566.508297:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ff1b800 00000100:00100000:1.0:1746155566.511972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.512478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.512537:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123744384 00000100:00100000:0.0:1746155566.512544:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123744384 00010000:00010000:0.0:1746155566.512573:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 22 pid: 4461 timeout: 795 lvb_type: 0 00000100:00100000:0.0:1746155566.512619:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6050 00000100:00100000:0.0:1746155566.512626:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123744384:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155566.512637:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155566.512655:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 22 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746155566.512667:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 22 pid: 4461 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746155566.512686:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a539c400/0x844e5faceb5eb6cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 413696->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da9 expref: 22 pid: 4461 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746155566.512788:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123744512 00000100:00100000:2.0:1746155566.512792:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123744512 00000100:00100000:2.0:1746155566.512811:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12028 00000100:00100000:2.0:1746155566.512816:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123744512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155566.512827:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.512835:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5eb781 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e35 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.512849:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155566.512855:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5eb781 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e35 expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.512863:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5eb781 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e35 expref: 23 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155566.512873:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc9c00, rc 0) 00000100:00100000:2.0:1746155566.512907:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123744512:12345-192.168.202.51@tcp:101:cat.0 Request processed in 91us (430us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155566.512915:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12028 00010000:00010000:0.0:1746155566.513082:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155566.513084:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155566.513091:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155566.513099:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.513255:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155566.513266:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124575488:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155566.514159:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.514826:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.515311:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123744640 00000100:00100000:0.0:1746155566.515317:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123744640 00000100:00100000:0.0:1746155566.515732:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12029 00000100:00100000:0.0:1746155566.515739:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123744640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155566.515752:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155566.515765:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eb788 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e3c expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155566.515803:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124575616:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155566.516180:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.517452:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.517490:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124575488:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155566.517554:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124575616:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155566.517576:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eb788 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e3c expref: 23 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.517598:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eb788 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e3c expref: 23 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.517623:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f62400, rc 0) 00000100:00100000:1.0:1746155566.517652:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123744640:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1914us (2828us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155566.517660:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12029 00010000:00010000:2.0:1746155566.517725:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155566.517743:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123744384:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5117us (5777us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.517750:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6050 00000100:00100000:3.0:1746155566.517833:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123744896 00000100:00100000:3.0:1746155566.517839:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123744896 00002000:00100000:3.0:1746155566.517868:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d6:0x0] (487424->491519) req@ffff8800944aea00 x1830976123744896/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.517876:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944aea00 with x1830976123744896 ext(487424->491519) 00002000:00010000:3.0:1746155566.517879:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944aea00 00000100:00100000:3.0:1746155566.517895:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4611 00000100:00100000:3.0:1746155566.517901:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123744896:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155566.518400:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123744896:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 494us (945us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155566.518407:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4611 00002000:00100000:3.0:1746155566.518412:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d6:0x0] (487424->491519) req@ffff8800944aea00 x1830976123744896/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.518419:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944aea00 with x1830976123744896 ext(487424->491519) 00002000:00010000:3.0:1746155566.518421:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944aea00 00000100:00100000:2.0:1746155566.521374:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.521420:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123745152 00000100:00100000:3.0:1746155566.521427:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123745152 00000100:00100000:3.0:1746155566.521470:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4030 00000100:00100000:3.0:1746155566.521477:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+313:29128:x1830976123745152:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155566.521669:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+314:29128:x1830976123745152:12345-192.168.202.51@tcp:35:cat.0 Request processed in 192us (300us total) trans 8589943938 rc 0/0 00000100:00100000:3.0:1746155566.521675:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4030 00000100:00100000:0.0:1746155566.523252:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.523343:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123745280 00000100:00100000:1.0:1746155566.523348:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123745280 00000100:00100000:1.0:1746155566.523379:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12030 00000100:00100000:1.0:1746155566.523384:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29131:x1830976123745280:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155566.523396:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.523408:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e43 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.523431:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.523438:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155566.523439:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155566.523442:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->1265663] (req 1048576->1265663) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 16 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.523466:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.523476:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 23 pid: 9235 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155566.523491:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124575744:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155566.524423:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.527065:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124575744:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.527090:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->1265663] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 16 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.527105:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913f0200, rc 0) 00000100:00100000:1.0:1746155566.527149:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29131:x1830976123745280:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3764us (3900us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.527156:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12030 00000100:00100000:3.0:1746155566.528961:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.529015:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123745408 00000100:00100000:0.0:1746155566.529021:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123745408 00002000:00100000:0.0:1746155566.529054:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1249279) req@ffff88009fac6680 x1830976123745408/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155566.529310:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6680 with x1830976123745408 ext(1048576->1249279) 00010000:00010000:0.0:1746155566.529319:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 24 pid: 9235 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746155566.529332:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 24 pid: 9235 timeout: 795 lvb_type: 0 00002000:00010000:0.0:1746155566.529338:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac6680 00000100:00100000:0.0:1746155566.529368:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 718 00000100:00100000:0.0:1746155566.529375:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123745408:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155566.543634:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123745408:12345-192.168.202.51@tcp:4:cat.0 Request processed in 14250us (14667us total) trans 17179873181 rc 0/0 00000100:00100000:3.0:1746155566.543646:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 718 00002000:00100000:3.0:1746155566.543658:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1249279) req@ffff88009fac6680 x1830976123745408/t17179873181(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/448 e 0 to 0 dl 1746155577 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.543666:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6680 with x1830976123745408 ext(1048576->1249279) 00010000:00010000:3.0:1746155566.543675:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 26 pid: 9235 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.543690:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 26 pid: 9235 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746155566.543701:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac6680 00000100:00100000:0.0:1746155566.546622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.546704:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123745536 00000100:00100000:2.0:1746155566.546712:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123745536 00010000:00010000:2.0:1746155566.546746:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 26 pid: 9235 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746155566.546853:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6051 00000100:00100000:2.0:1746155566.546860:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123745536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155566.546973:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155566.546990:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 26 pid: 9235 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.547001:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 26 pid: 9235 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.547023:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093eca800/0x844e5faceb5eb726 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10def expref: 26 pid: 9235 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.547293:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155566.547294:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155566.547299:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.547306:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.547332:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155566.547342:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124575872:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155566.548494:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfde40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.551367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.551467:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124575872:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155566.551486:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155566.551701:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123745792 00000100:00100000:3.0:1746155566.551707:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123745792 00002000:00100000:3.0:1746155566.551737:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1261568->1265663) req@ffff8800944aca80 x1830976123745792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.551746:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944aca80 with x1830976123745792 ext(1261568->1265663) 00002000:00010000:3.0:1746155566.551749:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944aca80 00000100:00100000:2.0:1746155566.551940:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123745536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5080us (5323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.551947:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6051 00000100:00100000:3.0:1746155566.553877:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4612 00000100:00100000:3.0:1746155566.553893:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123745792:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155566.554049:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123745792:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 164us (2688us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155566.554055:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4612 00002000:00100000:3.0:1746155566.554060:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1261568->1265663) req@ffff8800944aca80 x1830976123745792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.554068:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944aca80 with x1830976123745792 ext(1261568->1265663) 00002000:00010000:3.0:1746155566.554072:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944aca80 00000100:00100000:0.0:1746155566.556622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.558211:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123746048 00000100:00100000:2.0:1746155566.558221:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123746048 00000100:00100000:2.0:1746155566.558271:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4031 00000100:00100000:2.0:1746155566.558279:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29131:x1830976123746048:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155566.558526:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:29131:x1830976123746048:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 247us (1909us total) trans 8589943939 rc 0/0 00000100:00100000:2.0:1746155566.558532:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4031 00000100:00100000:0.0:1746155566.694177:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.694354:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123746304 00000100:00100000:2.0:1746155566.694362:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123746304 00000100:00100000:2.0:1746155566.694463:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9999 00000100:00100000:2.0:1746155566.694470:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+314:29138:x1830976123746304:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155566.694489:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.694539:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090012400/0x844e5faceb5eb796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e4a expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.694654:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb79d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.694665:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb79d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.694811:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb79d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.694826:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090012c00/0x844e5faceb5eb7a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.694832:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090012c00/0x844e5faceb5eb7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.694838:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090012c00/0x844e5faceb5eb7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.694996:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5eb7ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695008:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5eb7ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695013:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5eb7ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155566.695020:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155566.695084:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb79d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695090:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb79d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695095:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb79d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695100:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090013000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155566.695103:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb79d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695108:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb79d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695117:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155566.695120:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155566.695123:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb79d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695127:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb79d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695713:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090012c00/0x844e5faceb5eb7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695722:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090012c00/0x844e5faceb5eb7a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695726:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090012c00/0x844e5faceb5eb7a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695730:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090012c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155566.695733:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090012c00/0x844e5faceb5eb7a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695737:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090012c00/0x844e5faceb5eb7a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695744:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9900) 00010000:00010000:2.0:1746155566.695747:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155566.695749:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090012c00/0x844e5faceb5eb7a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.695753:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090012c00/0x844e5faceb5eb7a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.697295:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090012400/0x844e5faceb5eb796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e4a expref: 317 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.697309:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5eb7ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e4a expref: 316 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.697316:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155566.697318:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155566.697320:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090013200, rc 0) 00000100:00100000:2.0:1746155566.698367:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+316:29138:x1830976123746304:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3892us (4191us total) trans 8589943940 rc 0/0 00000100:00100000:2.0:1746155566.698377:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9999 00000100:00100000:0.0:1746155566.722114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.724813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.726580:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123746560 00000100:00100000:0.0:1746155566.726599:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123746560 00002000:00100000:0.0:1746155566.726637:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (0->487423) req@ffff880136630000 x1830976123746560/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155566.726647:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136630000 with x1830976123746560 ext(0->487423) 00002000:00010000:0.0:1746155566.726652:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136630000 00000100:00100000:0.0:1746155566.726681:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123746816 00000100:00100000:0.0:1746155566.726683:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123746816 00002000:00100000:0.0:1746155566.726694:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1265664->2097151) req@ffff88008ff1a680 x1830976123746816/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155566.726701:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1a680 with x1830976123746816 ext(1265664->2097151) 00002000:00010000:0.0:1746155566.726704:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ff1a680 00000100:00100000:0.0:1746155566.726722:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4613 00000100:00100000:0.0:1746155566.726729:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976123746560:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155566.727238:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4614 00000100:00100000:3.0:1746155566.727253:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123746816:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155566.744979:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123746816:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17725us (20161us total) trans 0 rc 831488/831488 00000100:00100000:3.0:1746155566.744989:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4614 00002000:00100000:3.0:1746155566.745000:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1265664->2097151) req@ffff88008ff1a680 x1830976123746816/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 831488/831488 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.745011:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1a680 with x1830976123746816 ext(1265664->2097151) 00002000:00010000:3.0:1746155566.745016:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ff1a680 00000100:00100000:0.0:1746155566.746102:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976123746560:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19371us (23992us total) trans 0 rc 487424/487424 00000100:00100000:0.0:1746155566.746108:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4613 00002000:00100000:0.0:1746155566.746114:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (0->487423) req@ffff880136630000 x1830976123746560/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 487424/487424 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155566.746121:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136630000 with x1830976123746560 ext(0->487423) 00002000:00010000:0.0:1746155566.746124:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136630000 00000100:00100000:0.0:1746155566.763883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.763984:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123747072 00000100:00100000:2.0:1746155566.763993:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123747072 00000100:00100000:2.0:1746155566.764042:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10000 00000100:00100000:2.0:1746155566.764050:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+316:29144:x1830976123747072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155566.764071:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.764086:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82cc00/0x844e5faceb5eb7b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e51 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.764160:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82dc00/0x844e5faceb5eb7c0 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.764172:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82dc00/0x844e5faceb5eb7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155566.764182:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82dc00/0x844e5faceb5eb7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155566.764190:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155566.764281:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82cc00/0x844e5faceb5eb7b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e51 expref: 319 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.764472:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82dc00/0x844e5faceb5eb7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e51 expref: 318 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.764480:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155566.764483:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746155566.764486:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e82dc00, rc 0) 00000100:00100000:2.0:1746155566.764548:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+318:29144:x1830976123747072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 498us (672us total) trans 8589943941 rc 0/0 00000100:00100000:2.0:1746155566.764554:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10000 00000100:00100000:0.0:1746155566.771889:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3296:1830976124576000:0@lo:400:kworker.0 00000100:00100000:0.0:1746155566.771945:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155566.772007:0:14230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124576000 00000100:00100000:0.0:1746155566.772013:0:14230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124576000 00000100:00100000:1.0:1746155566.772440:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124576384:0@lo:400:kworker.0 00000100:00100000:1.0:1746155566.772471:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155566.772571:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124576384 00000100:00100000:1.0:1746155566.772574:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124576384 00000100:00100000:1.0:1746155566.772607:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1746155566.772614:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3295:x1830976124576384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155566.772658:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3295:x1830976124576384:12345-0@lo:400:kworker.0 Request processed in 46us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.772667:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1746155566.772700:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124576384:0@lo:400:kworker.0 00000100:00100000:3.0:1746155566.772813:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1830976124576128:0@lo:400:kworker.0 00000100:00100000:3.0:1746155566.772843:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155566.772858:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1830976124576256:0@lo:400:kworker.0 00000100:00100000:1.0:1746155566.772905:0:14231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1746155566.772914:0:14231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3296:x1830976124576000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155566.772943:0:14231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3296:x1830976124576000:12345-0@lo:400:kworker.0 Request processed in 30us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.772948:0:14231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1746155566.772973:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746155566.772978:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124576512:0@lo:400:kworker.0 00000100:00100000:1.0:1746155566.772995:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155566.773012:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124576512 00000100:00100000:1.0:1746155566.773015:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124576512 00000100:00100000:0.0:1746155566.773140:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124576128 00000100:00100000:0.0:1746155566.773146:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124576128 00000100:00100000:1.0:1746155566.773227:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1746155566.773232:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1830976124576512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746155566.773273:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1746155566.773278:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830976124576128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746155566.773392:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3296:1830976124576000:0@lo:400:kworker.0 00000100:00100000:0.0:1746155566.773444:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830976124576128:12345-0@lo:400:kworker.0 Request processed in 165us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155566.773449:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1746155566.773465:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155566.773883:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124576512:0@lo:400:kworker.0 00000100:00100000:0.0:1746155566.773933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.773949:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123747200 00000100:00100000:0.0:1746155566.773951:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123747200 00000100:00100000:0.0:1746155566.773972:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12031 00000100:00100000:0.0:1746155566.773977:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976123747200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155566.773989:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155566.774005:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b44ec00/0x844e5faceb5eb7ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e58 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155566.774046:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124576768:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155566.774093:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.774181:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.774239:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123747328 00000100:00100000:0.0:1746155566.774242:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123747328 00000100:00100000:0.0:1746155566.774261:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12032 00000100:00100000:0.0:1746155566.774265:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123747328:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155566.774275:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155566.774285:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f62400/0x844e5faceb5eb7d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e5f expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155566.774439:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155566.774481:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124576256 00000100:00100000:2.0:1746155566.774483:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124576256 00000100:00100000:2.0:1746155566.774529:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1746155566.774534:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830976124576256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155566.774635:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1830976124576128:0@lo:400:kworker.0 00000100:00100000:3.0:1746155566.774642:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830976124576640:0@lo:400:kworker.0 00000100:00100000:3.0:1746155566.774662:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155566.774686:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124576640 00000100:00100000:3.0:1746155566.774689:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124576640 00000100:00100000:1.0:1746155566.774721:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1830976124576512:12345-0@lo:400:kworker.0 Request processed in 463us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.774726:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1746155566.775325:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1746155566.775331:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830976124576640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155566.775358:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830976124576640:12345-0@lo:400:kworker.0 Request processed in 27us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.775362:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1746155566.775385:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830976124576640:0@lo:400:kworker.0 00000100:00080000:1.0:1746155566.775459:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155566.776827:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124576896:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155566.776881:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850300 going to sleep for 11 seconds 00000100:00100000:2.0:1746155566.777744:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830976124576256:12345-0@lo:400:kworker.0 Request processed in 3206us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.777753:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1746155566.777824:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1830976124576256:0@lo:400:kworker.0 00000100:00100000:0.0:1746155566.780297:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.780719:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123747584 00000100:00100000:2.0:1746155566.780726:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123747584 00002000:00100000:2.0:1746155566.780758:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880136632680 x1830976123747584/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.780767:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632680 with x1830976123747584 ext(2097152->3145727) 00002000:00010000:2.0:1746155566.780772:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136632680 00000100:00100000:2.0:1746155566.780908:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4615 00000100:00100000:2.0:1746155566.780915:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123747584:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155566.781373:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.781410:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123747840 00000100:00100000:3.0:1746155566.781413:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123747840 00002000:00100000:3.0:1746155566.781430:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880136632d80 x1830976123747840/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.781437:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632d80 with x1830976123747840 ext(3145728->4194303) 00002000:00010000:3.0:1746155566.781439:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136632d80 00000100:00100000:3.0:1746155566.781458:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4616 00000100:00100000:3.0:1746155566.781464:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123747840:12345-192.168.202.51@tcp:3:cat.0 00002000:00010000:0.0:1746155566.781533:0:9235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155566 -> 1746155567 00002000:00010000:0.0:1746155566.781536:0:9235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155566 -> 1746155567 00002000:00010000:0.0:1746155566.781538:0:9235:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155566 -> 1746155567 00000100:00100000:0.0:1746155566.781550:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124576896:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155566.781576:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f62400/0x844e5faceb5eb7d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e5f expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155566.781598:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f62400/0x844e5faceb5eb7d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e5f expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155566.781616:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f62400, rc 0) 00002000:00010000:1.0:1746155566.781685:0:1625:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime: 1746155566 -> 1746155567 00002000:00010000:1.0:1746155566.781687:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime: 1746155566 -> 1746155567 00002000:00010000:1.0:1746155566.781689:0:1625:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime: 1746155566 -> 1746155567 00000100:00100000:1.0:1746155566.781699:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136633480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124576768:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155566.781714:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b44ec00/0x844e5faceb5eb7ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e58 expref: 22 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.781722:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b44ec00/0x844e5faceb5eb7ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e58 expref: 22 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.781742:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b44ec00, rc 0) 00000100:00100000:0.0:1746155566.782373:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123747328:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8105us (8190us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155566.782380:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12032 00000100:00100000:1.0:1746155566.782468:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976123747200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8489us (8535us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155566.782473:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12031 00000100:00100000:0.0:1746155566.792690:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.793007:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123748096 00000100:00100000:2.0:1746155566.793015:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123748096 00000100:00100000:2.0:1746155566.793061:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10001 00000100:00100000:2.0:1746155566.793068:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:29146:x1830976123748096:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155566.793090:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.793104:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c400/0x844e5faceb5eb7dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e66 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.793178:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155566.793190:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5eb7ab lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e4a expref: 317 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.793195:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155566.793220:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5eb7ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e4a expref: 317 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.793230:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5eb7ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e4a expref: 317 pid: 15474 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746155566.793246:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124577024:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155566.793340:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.794671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.795131:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123748224 00000100:00100000:1.0:1746155566.795138:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123748224 00000100:00100000:1.0:1746155566.795166:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12033 00000100:00100000:1.0:1746155566.795171:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29144:x1830976123748224:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155566.795183:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.795195:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e6d expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.795216:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.795223:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155566.795224:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155566.795227:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e6d expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.795245:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.795253:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 13 pid: 8436 timeout: 795 lvb_type: 0 00000100:00100000:1.0:1746155566.795267:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124577152:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155566.796157:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850300 going to sleep for 11 seconds 00000100:00100000:2.0:1746155566.797558:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123747584:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16580us (17204us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155566.797570:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4615 00002000:00100000:2.0:1746155566.797592:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880136632680 x1830976123747584/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.797602:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632680 with x1830976123747584 ext(2097152->3145727) 00002000:00010000:2.0:1746155566.797609:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136632680 00000100:00100000:2.0:1746155566.800497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.800535:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123748352 00000100:00100000:2.0:1746155566.800543:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123748352 00010000:00010000:2.0:1746155566.800570:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5eb7ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e4a expref: 318 pid: 15474 timeout: 795 lvb_type: 0 00000100:00100000:0.0:1746155566.800814:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124577024:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155566.800832:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155566.801139:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6052 00000100:00100000:2.0:1746155566.801146:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+318:1962:x1830976123748352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155566.801215:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155566.801223:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5eb7ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e4a expref: 318 pid: 15474 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.801233:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5eb7ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e4a expref: 318 pid: 15474 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.801253:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5eb7ab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e4a expref: 318 pid: 15474 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.801268:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155566.801272:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155566.801280:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155566.801285:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155566.801562:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123747840:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20096us (20187us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155566.801570:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4616 00002000:00100000:3.0:1746155566.801577:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880136632d80 x1830976123747840/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.801595:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136632d80 with x1830976123747840 ext(3145728->4194303) 00002000:00010000:3.0:1746155566.801599:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136632d80 00010000:00010000:2.0:1746155566.801739:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155566.801755:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+317:1962:x1830976123748352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 609us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.801760:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6052 00010000:00010000:1.0:1746155566.801826:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155566.801832:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155566.801848:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155566.801963:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c400/0x844e5faceb5eb7dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e66 expref: 28 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.801978:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e66 expref: 27 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.801985:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155566.801987:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155566.801989:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374cc00, rc 0) 00000100:00100000:1.0:1746155566.802011:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:29146:x1830976123748096:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8944us (9331us total) trans 8589943942 rc 0/0 00000100:00100000:1.0:1746155566.802020:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10001 00000100:00100000:3.0:1746155566.804408:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124577152:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155566.804435:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e6d expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.804450:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090013600, rc 0) 00000100:00100000:3.0:1746155566.804484:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29144:x1830976123748224:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9312us (9817us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.804492:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12033 00000100:00100000:1.0:1746155566.805293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.805528:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123748480 00000100:00100000:3.0:1746155566.805535:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123748480 00002000:00100000:3.0:1746155566.805568:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d6:0x0] (487424->1048575) req@ffff88008ff1b480 x1830976123748480/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.805577:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1b480 with x1830976123748480 ext(487424->1048575) 00010000:00010000:3.0:1746155566.805592:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 14 pid: 8436 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.805602:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 14 pid: 8436 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746155566.805608:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ff1b480 00000100:00100000:3.0:1746155566.805631:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 719 00000100:00100000:3.0:1746155566.805639:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123748480:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155566.819012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.820426:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123748480:12345-192.168.202.51@tcp:4:cat.0 Request processed in 14784us (15134us total) trans 21474840563 rc 0/0 00000100:00100000:3.0:1746155566.820436:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 719 00002000:00100000:3.0:1746155566.820445:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d6:0x0] (487424->1048575) req@ffff88008ff1b480 x1830976123748480/t21474840563(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/448 e 0 to 0 dl 1746155577 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.820454:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff1b480 with x1830976123748480 ext(487424->1048575) 00010000:00010000:3.0:1746155566.820462:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 16 pid: 8436 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.820474:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 16 pid: 8436 timeout: 795 lvb_type: 0 00002000:00010000:3.0:1746155566.820481:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ff1b480 00000100:00100000:3.0:1746155566.826260:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123748608 00000100:00100000:3.0:1746155566.826271:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123748608 00000100:00100000:3.0:1746155566.826333:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12034 00000100:00100000:3.0:1746155566.826341:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123748608:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155566.826358:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155566.826371:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6041400/0x844e5faceb5eb7f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e74 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155566.826422:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124577280:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155566.826538:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155566.830437:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124577280:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155566.830463:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6041400/0x844e5faceb5eb7f8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e74 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.830474:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041400/0x844e5faceb5eb7f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e74 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.830487:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6041400, rc 0) 00000100:00100000:3.0:1746155566.830558:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123748608:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4216us (11552us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155566.830565:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12034 00000100:00100000:0.0:1746155566.840573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.840706:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123748736 00000100:00100000:3.0:1746155566.840713:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123748736 00000100:00100000:3.0:1746155566.840751:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12035 00000100:00100000:3.0:1746155566.840758:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123748736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155566.840774:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155566.840786:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5eb7ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e7b expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155566.840828:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124577408:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155566.842400:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.842819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.843027:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123748864 00000100:00100000:2.0:1746155566.843033:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123748864 00010000:00010000:2.0:1746155566.843055:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 18 pid: 8436 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746155566.843081:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6053 00000100:00100000:2.0:1746155566.843086:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123748864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155566.843096:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155566.843112:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 18 pid: 8436 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.843121:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 18 pid: 8436 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746155566.843138:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155566.843139:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155566.843145:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e6d expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.843151:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e6d expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155566.843171:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e6d expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155566.843179:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124577536:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155566.844387:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4300 going to sleep for 11 seconds 00010000:00010000:3.0:1746155566.847350:0:1625:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.51@tcp) returned -22 from glimpse AST (req@ffff88009fac5500 x1830976124577408) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 18 pid: 8436 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746155566.847380:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8800/0x844e5faceb5eb773 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e27 expref: 18 pid: 8436 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746155566.847401:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124577408:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155566.847426:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5eb7ff lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e7b expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.847437:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5eb7ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e7b expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.847442:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6041e00, rc 0) 00000100:00100000:3.0:1746155566.848660:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123748736:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7899us (8090us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155566.848667:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12035 00000100:00100000:0.0:1746155566.863203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.863247:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.863279:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123749248 00000100:00100000:0.0:1746155566.863286:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123749248 00000100:00100000:0.0:1746155566.863333:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12036 00000100:00100000:0.0:1746155566.863341:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123749248:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155566.863359:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155566.863373:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f63000/0x844e5faceb5eb806 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e82 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155566.863394:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155566.863396:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155566.863403:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f63000/0x844e5faceb5eb806 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e82 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155566.863417:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f63000/0x844e5faceb5eb806 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e82 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155566.863426:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f63000, rc 0) 00000100:00100000:0.0:1746155566.863462:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123749248:12345-192.168.202.51@tcp:101:cat.0 Request processed in 121us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155566.863468:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12036 00000100:00100000:2.0:1746155566.863726:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124577536:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155566.863741:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155566.863762:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123748864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 20676us (20946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.863768:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6053 00000100:00100000:3.0:1746155566.863864:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123749120 00000100:00100000:3.0:1746155566.863867:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123749120 00002000:00100000:3.0:1746155566.863890:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800a6061880 x1830976123749120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.863898:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6061880 with x1830976123749120 ext(0->1048575) 00002000:00010000:3.0:1746155566.863902:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6061880 00000100:00100000:3.0:1746155566.863913:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4617 00000100:00100000:3.0:1746155566.863918:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123749120:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155566.875996:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123749120:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12068us (12791us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155566.876008:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4617 00002000:00100000:3.0:1746155566.876017:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800a6061880 x1830976123749120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.876026:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6061880 with x1830976123749120 ext(0->1048575) 00002000:00010000:3.0:1746155566.876030:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6061880 00000100:00100000:0.0:1746155566.894035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.894156:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123749376 00000100:00100000:1.0:1746155566.894165:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123749376 00000100:00100000:1.0:1746155566.894212:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12037 00000100:00100000:1.0:1746155566.894221:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:29144:x1830976123749376:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155566.894244:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.894260:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e89 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.894287:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.894295:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155566.894296:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155566.894300:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 26 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.894332:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.894345:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 15 pid: 9235 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155566.894356:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124577664:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155566.894474:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.896105:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124577664:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.896124:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 26 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.896136:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090012c00, rc 0) 00000100:00100000:1.0:1746155566.896161:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:29144:x1830976123749376:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1942us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.896169:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12037 00000100:00100000:0.0:1746155566.904693:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.904988:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123749504 00000100:00100000:3.0:1746155566.904998:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123749504 00002000:00100000:3.0:1746155566.905041:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1265663) req@ffff8800a6060380 x1830976123749504/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155566.905050:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060380 with x1830976123749504 ext(1048576->1265663) 00010000:00010000:3.0:1746155566.905059:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 16 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155566.905072:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 16 pid: 9235 timeout: 796 lvb_type: 0 00002000:00010000:3.0:1746155566.905079:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a6060380 00000100:00100000:2.0:1746155566.906433:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 720 00000100:00100000:2.0:1746155566.906445:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123749504:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155566.912141:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123749504:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5689us (7448us total) trans 17179873182 rc 0/0 00000100:00100000:2.0:1746155566.912152:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 720 00002000:00100000:2.0:1746155566.912163:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1265663) req@ffff8800a6060380 x1830976123749504/t17179873182(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/448 e 0 to 0 dl 1746155577 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.912172:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060380 with x1830976123749504 ext(1048576->1265663) 00010000:00010000:2.0:1746155566.912182:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 18 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155566.912196:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 18 pid: 9235 timeout: 796 lvb_type: 0 00002000:00010000:2.0:1746155566.912203:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a6060380 00000100:00100000:2.0:1746155566.915489:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.915790:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123749632 00000100:00100000:3.0:1746155566.915799:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123749632 00010000:00010000:3.0:1746155566.915831:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 18 pid: 9235 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746155566.915998:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6054 00000100:00100000:3.0:1746155566.916007:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123749632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155566.916020:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155566.916339:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 18 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155566.916350:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 18 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155566.916371:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0200/0x844e5faceb5eb78f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e43 expref: 18 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155566.916401:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.916403:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.916410:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.916417:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.916448:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155566.916459:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124577792:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155566.917280:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155566.922237:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124577792:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155566.922256:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155566.922722:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123749632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6715us (7239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.922731:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6054 00000100:00100000:0.0:1746155566.924154:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.924647:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123749888 00000100:00100000:2.0:1746155566.924654:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123749888 00002000:00100000:2.0:1746155566.924687:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800a6063800 x1830976123749888/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.924702:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6063800 with x1830976123749888 ext(1048576->2097151) 00002000:00010000:2.0:1746155566.924706:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6063800 00000100:00100000:0.0:1746155566.924935:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.925268:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4618 00000100:00100000:2.0:1746155566.925274:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123749888:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155566.925593:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123750016 00000100:00100000:1.0:1746155566.925597:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123750016 00000100:00100000:1.0:1746155566.925616:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12038 00000100:00100000:1.0:1746155566.925621:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29138:x1830976123750016:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155566.925628:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.925641:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e90 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.925659:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d16 expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.925665:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ecb800/0x844e5faceb5eb70a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dd3 expref: 5 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.925671:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5eb646 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d5c expref: 16 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.925676:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.925677:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.925680:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1757184->2097151] (req 1757184->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 28 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.925700:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5eb646 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d5c expref: 16 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.925709:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5eb646 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d5c expref: 16 pid: 19959 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155566.925718:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124577920:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.925773:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ecb800/0x844e5faceb5eb70a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dd3 expref: 5 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.925780:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ecb800/0x844e5faceb5eb70a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dd3 expref: 5 pid: 9235 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155566.925787:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124578048:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.925805:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d16 expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.925812:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d16 expref: 28 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155566.925818:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124578176:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155566.925831:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.929669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.929701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.929719:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123750272 00000100:00100000:0.0:1746155566.929725:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123750272 00010000:00010000:0.0:1746155566.929752:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d16 expref: 30 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746155566.929779:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123750144 00000100:00100000:0.0:1746155566.929781:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123750144 00010000:00010000:0.0:1746155566.929791:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ecb800/0x844e5faceb5eb70a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dd3 expref: 6 pid: 9235 timeout: 796 lvb_type: 1 00000100:00100000:0.0:1746155566.929805:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6055 00000100:00100000:0.0:1746155566.929812:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123750272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155566.929823:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155566.929898:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d16 expref: 30 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155566.929910:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d16 expref: 30 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155566.929931:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155566.929964:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123750272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 152us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155566.929969:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6055 00000100:00100000:0.0:1746155566.929982:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6056 00000100:00100000:0.0:1746155566.929986:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976123750144:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155566.929993:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155566.930000:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ecb800/0x844e5faceb5eb70a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dd3 expref: 6 pid: 9235 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746155566.930011:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ecb800/0x844e5faceb5eb70a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dd3 expref: 6 pid: 9235 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746155566.930018:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155566.930028:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976123750144:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 42us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155566.930032:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6056 00000100:00100000:0.0:1746155566.930060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.930074:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123750400 00000100:00100000:0.0:1746155566.930077:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123750400 00000100:00100000:0.0:1746155566.930093:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12039 00000100:00100000:0.0:1746155566.930097:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29146:x1830976123750400:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155566.930109:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155566.930119:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e97 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155566.930145:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 29 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155566.930151:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155566.930153:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155566.930155:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1167360->1847295] (req 1167360->1847295) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155566.930177:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 29 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155566.930189:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 29 pid: 9235 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746155566.930199:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124578304:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155566.930246:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.931340:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124577920:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.931352:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ecb800/0x844e5faceb5eb70a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dd3 expref: 5 pid: 9235 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155566.931366:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124578048:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.931376:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a065ac00/0x844e5faceb5eb600 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d16 expref: 29 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155566.931388:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124578176:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.931409:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1757184->2097151] (req 1757184->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 28 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.931417:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090012400, rc 0) 00000100:00100000:1.0:1746155566.931442:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:29138:x1830976123750016:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5820us (6506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.931447:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12038 00000100:00100000:0.0:1746155566.933097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.934188:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123750528 00000100:00100000:3.0:1746155566.934194:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123750528 00000100:00100000:2.0:1746155566.934195:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123749888:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8920us (10044us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155566.934204:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4618 00002000:00100000:2.0:1746155566.934212:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800a6063800 x1830976123749888/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746155566.934219:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5eb646 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d5c expref: 19 pid: 19959 timeout: 796 lvb_type: 1 00002000:00100000:2.0:1746155566.934220:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6063800 with x1830976123749888 ext(1048576->2097151) 00010000:00010000:2.0:1746155566.934226:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 26 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155566.934233:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 26 pid: 9235 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746155566.934238:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6057 00002000:00010000:2.0:1746155566.934239:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a6063800 00000100:00100000:3.0:1746155566.934243:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976123750528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155566.934252:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155566.934267:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5eb646 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d5c expref: 19 pid: 19959 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746155566.934276:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5eb646 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d5c expref: 19 pid: 19959 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746155566.934294:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5eb646 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d5c expref: 19 pid: 19959 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746155566.934314:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.934316:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.934322:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.934330:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.934355:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155566.934368:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124578432:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155566.934452:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.934544:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124578304:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.934560:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1167360->1847295] (req 1167360->1847295) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.934569:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374de00, rc 0) 00000100:00100000:1.0:1746155566.934595:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29146:x1830976123750400:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4498us (4535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.934601:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12039 00000100:00100000:3.0:1746155566.940882:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124578432:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155566.940902:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155566.941181:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123750528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6936us (8085us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.941190:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6057 00000100:00100000:0.0:1746155566.941496:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.941824:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.942012:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123750912 00000100:00100000:3.0:1746155566.942017:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123750912 00010000:00010000:3.0:1746155566.942039:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 26 pid: 9235 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155566.942110:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123750784 00000100:00100000:1.0:1746155566.942114:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123750784 00002000:00100000:1.0:1746155566.942137:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1757184->1761279) req@ffff8800a6060a80 x1830976123750784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.942146:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060a80 with x1830976123750784 ext(1757184->1761279) 00002000:00010000:1.0:1746155566.942149:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6060a80 00000100:00100000:1.0:1746155566.942159:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4619 00000100:00100000:1.0:1746155566.942165:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123750784:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155566.942285:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123750784:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 118us (789us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155566.942290:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4619 00002000:00100000:1.0:1746155566.942295:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1757184->1761279) req@ffff8800a6060a80 x1830976123750784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.942301:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060a80 with x1830976123750784 ext(1757184->1761279) 00002000:00010000:1.0:1746155566.942304:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6060a80 00000100:00100000:3.0:1746155566.944007:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6058 00000100:00100000:3.0:1746155566.944016:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123750912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155566.944028:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155566.944045:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 26 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155566.944057:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 26 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155566.944075:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090012c00/0x844e5faceb5eb80d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e89 expref: 26 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155566.944091:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.944093:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155566.944099:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.944106:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155566.944130:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155566.944140:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124578560:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155566.945824:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155566.945845:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.946359:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123751168 00000100:00100000:1.0:1746155566.946365:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123751168 00002000:00100000:1.0:1746155566.946395:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009c28d500 x1830976123751168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 504/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.946403:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28d500 with x1830976123751168 ext(1048576->2097151) 00002000:00010000:1.0:1746155566.946406:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28d500 00000100:00100000:1.0:1746155566.946433:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4620 00000100:00100000:1.0:1746155566.946439:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123751168:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155566.950605:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124578560:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155566.950620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155566.950626:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155566.950662:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123750912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6647us (8838us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.950671:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6058 00000100:00100000:2.0:1746155566.950987:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123751424 00000100:00100000:2.0:1746155566.950993:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123751424 00002000:00100000:2.0:1746155566.951023:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1167360->1171455) req@ffff8800a6061f80 x1830976123751424/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.951032:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6061f80 with x1830976123751424 ext(1167360->1171455) 00002000:00010000:2.0:1746155566.951036:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6061f80 00000100:00100000:2.0:1746155566.951056:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4621 00000100:00100000:2.0:1746155566.951062:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123751424:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155566.951186:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123751424:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 123us (566us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155566.951191:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4621 00002000:00100000:2.0:1746155566.951195:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1167360->1171455) req@ffff8800a6061f80 x1830976123751424/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155566.951201:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6061f80 with x1830976123751424 ext(1167360->1171455) 00002000:00010000:2.0:1746155566.951203:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6061f80 00000100:00100000:1.0:1746155566.956972:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123751168:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10525us (11122us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746155566.956982:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4620 00002000:00100000:1.0:1746155566.956991:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009c28d500 x1830976123751168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 504/440 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.957000:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28d500 with x1830976123751168 ext(1048576->2097151) 00002000:00010000:1.0:1746155566.957005:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28d500 00000100:00100000:0.0:1746155566.959143:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.959488:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123751680 00000100:00100000:1.0:1746155566.959496:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123751680 00002000:00100000:1.0:1746155566.959645:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1843200->1847295) req@ffff8800a6060000 x1830976123751680/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.959654:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060000 with x1830976123751680 ext(1843200->1847295) 00002000:00010000:1.0:1746155566.959659:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6060000 00000100:00100000:1.0:1746155566.959685:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4622 00000100:00100000:1.0:1746155566.959692:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123751680:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155566.960404:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123751680:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 710us (1265us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155566.960410:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4622 00002000:00100000:1.0:1746155566.960416:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1843200->1847295) req@ffff8800a6060000 x1830976123751680/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.960423:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060000 with x1830976123751680 ext(1843200->1847295) 00002000:00010000:1.0:1746155566.960425:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6060000 00000100:00100000:0.0:1746155566.967603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155566.967729:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123751808 00000100:00100000:1.0:1746155566.967737:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123751808 00000100:00100000:1.0:1746155566.967865:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12040 00000100:00100000:1.0:1746155566.967873:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29138:x1830976123751808:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155566.967889:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155566.967903:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10e9e expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.967930:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d71 expref: 15 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.967938:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ecb400/0x844e5faceb5eb711 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dda expref: 7 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.967944:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eb6a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d86 expref: 23 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.967950:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.967952:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155566.967955:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->1654783] (req 1048576->1654783) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.967983:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eb6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d86 expref: 23 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.967994:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eb6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d86 expref: 23 pid: 20796 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155566.968004:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124578688:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.968088:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ecb400/0x844e5faceb5eb711 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dda expref: 7 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155566.968095:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ecb400/0x844e5faceb5eb711 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dda expref: 7 pid: 8438 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155566.968102:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124578816:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.968125:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d71 expref: 15 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.968131:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d71 expref: 15 pid: 4461 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155566.968137:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124578944:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155566.968151:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155566.980446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155566.980474:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.980489:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123751936 00000100:00100000:2.0:1746155566.980494:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.980497:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123751936 00000100:00100000:2.0:1746155566.980526:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123752064 00000100:00100000:2.0:1746155566.980529:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123752064 00010000:00010000:2.0:1746155566.980548:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ecb400/0x844e5faceb5eb711 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dda expref: 8 pid: 8438 timeout: 796 lvb_type: 1 00000100:00100000:3.0:1746155566.980551:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12041 00000100:00100000:3.0:1746155566.980558:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123751936:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155566.980566:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123752192 00000100:00100000:2.0:1746155566.980568:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123752192 00010000:00010000:3.0:1746155566.980570:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155566.980575:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d71 expref: 16 pid: 4461 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155566.980592:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6041400/0x844e5faceb5eb829 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ea5 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155566.980597:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6059 00000100:00100000:2.0:1746155566.980602:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123752064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155566.980612:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155566.980628:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ecb400/0x844e5faceb5eb711 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dda expref: 8 pid: 8438 timeout: 796 lvb_type: 1 00000100:00100000:3.0:1746155566.980635:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124579072:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155566.980637:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ecb400/0x844e5faceb5eb711 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dda expref: 8 pid: 8438 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746155566.980652:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155566.980690:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155566.980705:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6060 00000100:00100000:3.0:1746155566.980710:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123752192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155566.980714:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124578688:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155566.980716:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155566.980723:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d71 expref: 16 pid: 4461 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746155566.980723:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ecb400/0x844e5faceb5eb711 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10dda expref: 8 pid: 8438 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746155566.980730:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d71 expref: 16 pid: 4461 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155566.980736:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124578816:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155566.980740:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155566.980743:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5eb670 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d71 expref: 16 pid: 4461 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155566.980750:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124578944:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155566.980775:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->1654783] (req 1048576->1654783) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155566.980783:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0dec00, rc 0) 00000100:00100000:2.0:1746155566.981057:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976123752064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 453us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.981063:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6059 00000100:00100000:3.0:1746155566.981471:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123752192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 759us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155566.981477:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6060 00000100:00100000:1.0:1746155566.981603:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29138:x1830976123751808:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 13731us (14008us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155566.981609:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12040 00000100:00100000:3.0:1746155566.982228:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.982543:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123752320 00000100:00100000:0.0:1746155566.982549:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123752320 00010000:00010000:0.0:1746155566.982566:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eb6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d86 expref: 23 pid: 20796 timeout: 796 lvb_type: 1 00000100:00100000:0.0:1746155566.982601:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6061 00000100:00100000:0.0:1746155566.982607:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123752320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155566.982614:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155566.982624:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eb6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d86 expref: 23 pid: 20796 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746155566.982633:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eb6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d86 expref: 23 pid: 20796 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746155566.982645:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eb6a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d86 expref: 23 pid: 20796 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746155566.982666:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155566.982668:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155566.982673:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155566.982679:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155566.983238:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155566.983248:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124579200:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155566.983422:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155566.984250:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124579072:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155566.984275:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6041400/0x844e5faceb5eb829 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ea5 expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.984286:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6041400/0x844e5faceb5eb829 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ea5 expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.984308:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6041400, rc 0) 00000100:00100000:3.0:1746155566.984344:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123751936:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3786us (3906us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155566.984350:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12041 00000100:00100000:2.0:1746155566.987760:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124579200:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155566.987782:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155566.987837:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123752320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5228us (5608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155566.987846:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6061 00000100:00100000:0.0:1746155566.989854:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.989981:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123752448 00000100:00100000:3.0:1746155566.989988:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123752448 00000100:00100000:3.0:1746155566.990034:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12042 00000100:00100000:3.0:1746155566.990163:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123752448:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155566.990177:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155566.990191:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6040c00/0x844e5faceb5eb830 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10eac expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155566.990234:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124579328:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155566.990294:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155566.992996:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.994067:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124579328:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155566.994094:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6040c00/0x844e5faceb5eb830 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eac expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.994107:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6040c00/0x844e5faceb5eb830 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eac expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155566.994120:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6040c00, rc 0) 00000100:00100000:3.0:1746155566.994154:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123752448:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4113us (4305us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155566.994161:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12042 00000100:00100000:1.0:1746155566.994529:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123752704 00000100:00100000:1.0:1746155566.994535:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123752704 00002000:00100000:1.0:1746155566.994563:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1650688->1654783) req@ffff8800a3fc5500 x1830976123752704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/0 e 0 to 0 dl 1746155577 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.994572:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5500 with x1830976123752704 ext(1650688->1654783) 00002000:00010000:1.0:1746155566.994576:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc5500 00000100:00100000:1.0:1746155566.994634:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4623 00000100:00100000:1.0:1746155566.994642:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123752704:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155566.994766:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123752704:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 124us (1775us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155566.994771:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4623 00002000:00100000:1.0:1746155566.994776:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1650688->1654783) req@ffff8800a3fc5500 x1830976123752704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:637/0 lens 488/4536 e 0 to 0 dl 1746155577 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155566.994784:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5500 with x1830976123752704 ext(1650688->1654783) 00002000:00010000:1.0:1746155566.994787:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc5500 00000100:00100000:0.0:1746155566.996654:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155566.996745:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155566.997311:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123752832 00000100:00100000:3.0:1746155566.997317:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123752832 00000100:00100000:2.0:1746155566.997956:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123753088 00000100:00100000:2.0:1746155566.997960:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123753088 00000100:00100000:2.0:1746155566.997985:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4032 00000100:00100000:2.0:1746155566.997990:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea55850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+317:29138:x1830976123753088:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155566.998140:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea55850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+318:29138:x1830976123753088:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 149us (1394us total) trans 8589943943 rc 0/0 00000100:00100000:2.0:1746155566.998145:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4032 00000100:00100000:3.0:1746155566.998533:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12043 00000100:00100000:3.0:1746155566.998540:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123752832:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155566.998550:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155566.998564:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6041a00/0x844e5faceb5eb837 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10eb3 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155566.998608:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124579456:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155566.998650:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155567.002569:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124579456:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155567.002608:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6041a00/0x844e5faceb5eb837 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eb3 expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.002622:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6041a00/0x844e5faceb5eb837 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eb3 expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.002635:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6041a00, rc 0) 00000100:00100000:3.0:1746155567.002673:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123752832:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4133us (6021us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155567.002680:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12043 00000100:00100000:0.0:1746155567.014888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.015148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.016553:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123753216 00000100:00100000:3.0:1746155567.016561:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123753216 00000100:00100000:3.0:1746155567.016608:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123753344 00000100:00100000:3.0:1746155567.016611:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123753344 00000100:00080000:0.0:1746155567.017716:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746155567.017721:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746155567.017788:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12044 00000100:00100000:1.0:1746155567.017799:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123753216:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155567.017815:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155567.017829:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0de800/0x844e5faceb5eb83e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10eba expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155567.017876:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124579584:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155567.017935:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155567.018074:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12045 00000100:00100000:1.0:1746155567.018518:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123753344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155567.018528:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155567.018536:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5eb845 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ec1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155567.018560:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124579712:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155567.019045:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850300 going to sleep for 11 seconds 00002000:00010000:1.0:1746155567.021655:0:1625:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime: 1746155566 -> 1746155567 00002000:00010000:1.0:1746155567.021661:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime: 1746155566 -> 1746155567 00002000:00010000:1.0:1746155567.021662:0:1625:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime: 1746155566 -> 1746155567 00000100:00100000:1.0:1746155567.021683:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124579584:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155567.021708:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0de800/0x844e5faceb5eb83e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eba expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155567.021719:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0de800/0x844e5faceb5eb83e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eba expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155567.021739:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0de800, rc 0) 00000100:00100000:1.0:1746155567.021774:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123753216:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3977us (6892us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155567.021781:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12044 00002000:00010000:2.0:1746155567.022690:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155566 -> 1746155567 00002000:00010000:2.0:1746155567.022698:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155566 -> 1746155567 00002000:00010000:2.0:1746155567.022699:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155566 -> 1746155567 00000100:00100000:2.0:1746155567.022712:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124579712:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155567.022733:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5eb845 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec1 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.022742:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5eb845 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec1 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.022757:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0dfa00, rc 0) 00000100:00100000:2.0:1746155567.022790:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123753344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4710us (7642us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155567.022796:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12045 00000100:00100000:0.0:1746155567.032805:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.032849:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.032922:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123753856 00000100:00100000:2.0:1746155567.032930:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123753856 00002000:00100000:2.0:1746155567.032967:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800a3fc4e00 x1830976123753856/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 504/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155567.032976:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4e00 with x1830976123753856 ext(1048576->2097151) 00002000:00010000:2.0:1746155567.032981:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc4e00 00000100:00100000:2.0:1746155567.033082:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123753728 00000100:00100000:2.0:1746155567.033085:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123753728 00002000:00100000:2.0:1746155567.033098:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800a3fc7100 x1830976123753728/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155567.033104:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc7100 with x1830976123753728 ext(0->1048575) 00002000:00010000:2.0:1746155567.033107:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc7100 00000100:00100000:1.0:1746155567.033154:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4624 00000100:00100000:1.0:1746155567.033162:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123753856:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155567.034489:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4625 00000100:00100000:2.0:1746155567.034499:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123753728:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155567.041267:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123753856:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8097us (8462us total) trans 0 rc 368640/368640 00000100:00100000:1.0:1746155567.041279:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4624 00002000:00100000:1.0:1746155567.041289:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800a3fc4e00 x1830976123753856/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 504/440 e 0 to 0 dl 1746155578 ref 1 fl Complete:/200/0 rc 368640/368640 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155567.041298:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4e00 with x1830976123753856 ext(1048576->2097151) 00002000:00010000:1.0:1746155567.041303:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc4e00 00000100:00100000:2.0:1746155567.056282:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123753728:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21777us (23424us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155567.056293:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4625 00002000:00100000:2.0:1746155567.056303:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800a3fc7100 x1830976123753728/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/440 e 0 to 0 dl 1746155578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155567.056311:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc7100 with x1830976123753728 ext(0->1048575) 00002000:00010000:2.0:1746155567.056315:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc7100 00000100:00100000:0.0:1746155567.078489:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.080635:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123753984 00000100:00100000:2.0:1746155567.080646:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123753984 00000100:00100000:2.0:1746155567.080701:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12046 00000100:00100000:2.0:1746155567.080709:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29153:x1830976123753984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155567.080726:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.080742:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ec8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.080766:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 24 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.080773:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155567.080774:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155567.080777:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.080803:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 24 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.080814:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 24 pid: 9235 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.080824:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124579840:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.080909:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155567.087030:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.087632:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124579840:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155567.087654:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.087669:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f088c00, rc 0) 00000100:00100000:3.0:1746155567.088063:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123754112 00000100:00100000:3.0:1746155567.088069:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123754112 00002000:00100000:3.0:1746155567.088102:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1757184->2097151) req@ffff8800a3fc5180 x1830976123754112/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155567.088114:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5180 with x1830976123754112 ext(1757184->2097151) 00000100:00100000:2.0:1746155567.088370:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29153:x1830976123753984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7661us (9888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.088378:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12046 00010000:00010000:3.0:1746155567.088421:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 25 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.088433:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 25 pid: 9235 timeout: 796 lvb_type: 0 00002000:00010000:3.0:1746155567.088439:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a3fc5180 00000100:00100000:3.0:1746155567.088726:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 721 00000100:00100000:3.0:1746155567.088735:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123754112:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155567.104913:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123754112:12345-192.168.202.51@tcp:4:cat.0 Request processed in 16171us (17882us total) trans 17179873183 rc 0/0 00000100:00100000:3.0:1746155567.104925:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 721 00002000:00100000:3.0:1746155567.104936:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1757184->2097151) req@ffff8800a3fc5180 x1830976123754112/t17179873183(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/448 e 0 to 0 dl 1746155578 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155567.104944:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5180 with x1830976123754112 ext(1757184->2097151) 00010000:00010000:3.0:1746155567.104953:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 27 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.104968:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 27 pid: 9235 timeout: 796 lvb_type: 0 00002000:00010000:3.0:1746155567.104974:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a3fc5180 00000100:00100000:0.0:1746155567.107747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.107841:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123754240 00000100:00100000:2.0:1746155567.107849:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123754240 00010000:00010000:2.0:1746155567.107878:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 27 pid: 9235 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.107911:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6062 00000100:00100000:2.0:1746155567.107918:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123754240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155567.107931:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155567.107949:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 27 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.107959:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 27 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.107977:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090012400/0x844e5faceb5eb814 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e90 expref: 27 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.108548:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.108550:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.108557:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.108564:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.108600:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155567.108611:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124579968:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155567.108902:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746155567.110151:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155567.172203:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.173174:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155567.173478:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123754368 00000100:00100000:1.0:1746155567.173486:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123754368 00000100:00100000:1.0:1746155567.173551:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123754496 00000100:00100000:1.0:1746155567.173554:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123754496 00000100:00100000:1.0:1746155567.173568:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12047 00000100:00100000:1.0:1746155567.173574:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29155:x1830976123754368:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:3.0:1746155567.173593:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12048 00010000:00010000:1.0:1746155567.173596:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155567.173603:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123754496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155567.173610:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155567.173610:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ecf expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.173618:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6041400/0x844e5faceb5eb85a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ed6 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.173631:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.173637:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155567.173639:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155567.173642:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1171456->1896447] (req 1171456->1896447) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155567.173653:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124580096:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155567.173657:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.173666:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 19 pid: 8436 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.173678:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124580224:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155567.173735:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155567.173858:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155567.173898:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.173944:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123754624 00000100:00100000:2.0:1746155567.173947:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123754624 00000100:00100000:2.0:1746155567.173965:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12049 00000100:00100000:2.0:1746155567.173969:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123754624:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155567.173974:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.173983:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f089c00/0x844e5faceb5eb861 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10edd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.173991:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.173997:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f089c00/0x844e5faceb5eb861 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10edd expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.174004:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f089c00/0x844e5faceb5eb861 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10edd expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.174014:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f089c00, rc 0) 00000100:00100000:2.0:1746155567.174032:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123754624:12345-192.168.202.51@tcp:101:cat.0 Request processed in 62us (133us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155567.174037:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12049 00000100:00100000:3.0:1746155567.175642:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124580096:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155567.175664:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6041400/0x844e5faceb5eb85a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ed6 expref: 28 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.175673:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6041400/0x844e5faceb5eb85a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ed6 expref: 28 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.175694:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6041400, rc 0) 00000100:00100000:3.0:1746155567.175718:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123754496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2118us (2546us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155567.175723:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12048 00000100:00100000:2.0:1746155567.175978:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124579968:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155567.175988:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155567.176006:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123754240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 68089us (68267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.176013:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6062 00000100:00100000:0.0:1746155567.177685:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155567.178975:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124580224:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155567.178998:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1171456->1896447] (req 1171456->1896447) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.179013:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0dfc00, rc 0) 00000100:00100000:3.0:1746155567.180124:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123754880 00000100:00100000:3.0:1746155567.180132:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123754880 00002000:00100000:3.0:1746155567.180172:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88012fe8e300 x1830976123754880/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155567.180181:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8e300 with x1830976123754880 ext(1048576->2097151) 00010000:00010000:3.0:1746155567.180187:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 20 pid: 8436 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.180203:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 20 pid: 8436 timeout: 796 lvb_type: 0 00002000:00010000:3.0:1746155567.180209:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fe8e300 00000100:00100000:3.0:1746155567.180232:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 722 00000100:00100000:3.0:1746155567.180239:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123754880:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155567.180787:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29155:x1830976123754368:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7211us (8589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155567.180794:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12047 00000100:00100000:2.0:1746155567.180956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.180970:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123755008 00000100:00100000:0.0:1746155567.180974:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123755008 00000100:00100000:0.0:1746155567.180996:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12050 00000100:00100000:0.0:1746155567.181001:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:29159:x1830976123755008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155567.181010:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155567.181021:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ee4 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.181403:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.181412:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155567.181413:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155567.181417:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ee4 expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.181443:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.181453:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 20 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746155567.181469:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124580352:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155567.181567:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155567.185736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.185805:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123755136 00000100:00100000:2.0:1746155567.185812:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123755136 00002000:00100000:2.0:1746155567.185849:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1167360->1847295) req@ffff88009c28e680 x1830976123755136/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155567.185858:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28e680 with x1830976123755136 ext(1167360->1847295) 00010000:00010000:2.0:1746155567.185865:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.185874:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00002000:00010000:2.0:1746155567.185881:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28e680 00000100:00100000:0.0:1746155567.186940:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124580352:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155567.186961:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ee4 expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.186974:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374dc00, rc 0) 00000100:00100000:0.0:1746155567.187014:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29159:x1830976123755008:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6012us (6058us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.187020:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12050 00000100:00100000:2.0:1746155567.187244:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 723 00000100:00100000:2.0:1746155567.187251:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123755136:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155567.192802:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123754880:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12555us (15112us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155567.192811:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 722 00002000:00100000:3.0:1746155567.192820:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88012fe8e300 x1830976123754880/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/440 e 0 to 0 dl 1746155578 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155567.192828:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8e300 with x1830976123754880 ext(1048576->2097151) 00010000:00010000:3.0:1746155567.192836:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 21 pid: 8436 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.192846:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 21 pid: 8436 timeout: 796 lvb_type: 0 00002000:00010000:3.0:1746155567.192853:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fe8e300 00000100:00100000:2.0:1746155567.199479:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123755136:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 12220us (13743us total) trans 17179873184 rc 0/0 00000100:00100000:2.0:1746155567.199490:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 723 00002000:00100000:2.0:1746155567.199500:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1167360->1847295) req@ffff88009c28e680 x1830976123755136/t17179873184(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/448 e 0 to 0 dl 1746155578 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155567.199524:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28e680 with x1830976123755136 ext(1167360->1847295) 00010000:00010000:2.0:1746155567.199532:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.199542:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00002000:00010000:2.0:1746155567.199548:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28e680 00000100:00100000:0.0:1746155567.200694:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.201149:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123755264 00000100:00100000:2.0:1746155567.201156:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123755264 00000100:00100000:2.0:1746155567.204153:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12051 00000100:00100000:2.0:1746155567.204168:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29153:x1830976123755264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155567.204184:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.204200:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10eeb expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.204224:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.204232:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155567.204234:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155567.204237:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eeb expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155567.206968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155567.206989:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.207002:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.207014:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124580480:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.207069:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155567.207287:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123755392 00000100:00100000:3.0:1746155567.207294:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123755392 00010000:00010000:3.0:1746155567.207319:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 21 pid: 8436 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746155567.207342:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6063 00000100:00100000:3.0:1746155567.207348:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123755392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155567.207357:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155567.207373:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 21 pid: 8436 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.207382:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 21 pid: 8436 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.207399:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f088c00/0x844e5faceb5eb84c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ec8 expref: 21 pid: 8436 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.207414:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.207416:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.207421:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.207427:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.207447:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155567.207454:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124580608:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155567.207476:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece600 going to sleep for 11 seconds 00000100:00100000:2.0:1746155567.207880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.209366:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123755520 00000100:00100000:3.0:1746155567.209374:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123755520 00010000:00010000:3.0:1746155567.209398:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746155567.209430:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6064 00000100:00100000:3.0:1746155567.209436:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d759850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123755520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155567.209446:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155567.209462:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.209471:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.209487:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5eb81b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1167360->1847295) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e97 expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.209497:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.209498:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.209533:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ee4 expref: 26 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.209540:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ee4 expref: 26 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.209566:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ee4 expref: 26 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155567.209588:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124580736:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155567.210688:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155567.212722:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124580480:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.212723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155567.212750:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eeb expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155567.212756:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155567.212766:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a231800, rc 0) 00000100:00100000:2.0:1746155567.212777:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123755648 00000100:00100000:2.0:1746155567.212783:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123755648 00002000:00100000:2.0:1746155567.212814:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1654783) req@ffff88009286ed80 x1830976123755648/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155567.212823:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286ed80 with x1830976123755648 ext(1048576->1654783) 00000100:00100000:0.0:1746155567.212991:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29153:x1830976123755264:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8826us (12298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.212999:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12051 00000100:00100000:3.0:1746155567.213026:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124580608:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155567.213038:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155567.213056:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123755392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5708us (6094us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.213063:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6063 00000100:00100000:3.0:1746155567.213086:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123755904 00000100:00100000:3.0:1746155567.213089:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123755904 00002000:00100000:3.0:1746155567.213103:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1171456->1175551) req@ffff88009286df80 x1830976123755904/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155567.213110:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286df80 with x1830976123755904 ext(1171456->1175551) 00010000:00010000:2.0:1746155567.213262:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 22 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.213273:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 22 pid: 1625 timeout: 796 lvb_type: 0 00002000:00010000:2.0:1746155567.213279:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009286ed80 00000100:00100000:2.0:1746155567.213306:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 724 00000100:00100000:2.0:1746155567.213313:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123755648:12345-192.168.202.51@tcp:4:cat.0 00002000:00010000:3.0:1746155567.213817:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286df80 00000100:00100000:3.0:1746155567.213830:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4626 00000100:00100000:3.0:1746155567.213836:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123755904:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155567.213931:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123755904:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 96us (1174us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155567.213937:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4626 00002000:00100000:3.0:1746155567.213941:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1171456->1175551) req@ffff88009286df80 x1830976123755904/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746155578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155567.213947:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286df80 with x1830976123755904 ext(1171456->1175551) 00002000:00010000:3.0:1746155567.213950:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009286df80 00000100:00100000:1.0:1746155567.219420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.219732:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123756160 00000100:00100000:0.0:1746155567.219739:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123756160 00002000:00100000:0.0:1746155567.219774:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88008ff19500 x1830976123756160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155567.219788:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff19500 with x1830976123756160 ext(1048576->2097151) 00002000:00010000:0.0:1746155567.219793:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ff19500 00000100:00100000:0.0:1746155567.219870:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4627 00000100:00100000:0.0:1746155567.219878:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123756160:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155567.219909:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124580736:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155567.219925:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155567.219958:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d759850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123755520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10522us (12079us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.219965:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6064 00000100:00100000:1.0:1746155567.231490:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123756160:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11606us (12070us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155567.231500:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4627 00002000:00100000:1.0:1746155567.231523:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88008ff19500 x1830976123756160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/440 e 0 to 0 dl 1746155578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155567.231532:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff19500 with x1830976123756160 ext(1048576->2097151) 00002000:00010000:1.0:1746155567.231536:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ff19500 00000100:00100000:0.0:1746155567.231810:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.231988:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123755648:12345-192.168.202.51@tcp:4:cat.0 Request processed in 18674us (19266us total) trans 21474840564 rc 0/0 00000100:00100000:2.0:1746155567.231995:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 724 00002000:00100000:2.0:1746155567.232000:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1654783) req@ffff88009286ed80 x1830976123755648/t21474840564(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/448 e 0 to 0 dl 1746155578 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155567.232007:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009286ed80 with x1830976123755648 ext(1048576->1654783) 00000100:00100000:1.0:1746155567.232018:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123756416 00000100:00100000:1.0:1746155567.232024:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123756416 00002000:00100000:1.0:1746155567.232049:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3db:0x0] (1892352->1896447) req@ffff88012fe8df80 x1830976123756416/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155567.232061:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8df80 with x1830976123756416 ext(1892352->1896447) 00002000:00010000:1.0:1746155567.232064:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fe8df80 00000100:00100000:1.0:1746155567.232356:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4628 00000100:00100000:1.0:1746155567.232363:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123756416:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155567.232477:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123756416:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 114us (667us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155567.232482:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4628 00002000:00100000:1.0:1746155567.232487:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3db:0x0] (1892352->1896447) req@ffff88012fe8df80 x1830976123756416/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746155578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155567.232493:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8df80 with x1830976123756416 ext(1892352->1896447) 00002000:00010000:1.0:1746155567.232496:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fe8df80 00010000:00010000:2.0:1746155567.232575:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 24 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.232597:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 24 pid: 1625 timeout: 796 lvb_type: 0 00002000:00010000:2.0:1746155567.232604:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009286ed80 00000100:00100000:0.0:1746155567.235025:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.235485:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123756544 00000100:00100000:3.0:1746155567.235493:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123756544 00010000:00010000:3.0:1746155567.235545:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 24 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746155567.235570:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6065 00000100:00100000:3.0:1746155567.235576:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123756544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155567.235594:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155567.235609:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 24 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.235619:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 24 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.235635:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0dec00/0x844e5faceb5eb822 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1654783) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e9e expref: 24 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.235822:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.235824:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.235830:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eeb expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.235841:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eeb expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.235865:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eeb expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155567.235874:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124580864:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155567.236398:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ecea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155567.238949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.239054:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123756672 00000100:00100000:2.0:1746155567.239060:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123756672 00000100:00100000:2.0:1746155567.239091:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12052 00000100:00100000:2.0:1746155567.239097:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29159:x1830976123756672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155567.239110:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.239123:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ef2 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.239148:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.239159:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155567.239160:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155567.239163:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef2 expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.239183:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.239191:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 18 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.239201:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124580992:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.239271:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155567.241882:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124580864:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155567.241906:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155567.241939:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123756544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6362us (6918us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.241948:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6065 00000100:00100000:0.0:1746155567.247394:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.247426:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.247448:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155567.247637:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123757056 00000100:00100000:1.0:1746155567.247644:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123757056 00000100:00100000:1.0:1746155567.247680:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10002 00000100:00100000:1.0:1746155567.247687:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+318:29161:x1830976123757056:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155567.247705:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155567.247719:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090013c00/0x844e5faceb5eb87d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ef9 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.247796:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb884 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155567.247809:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb884 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155567.247818:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb884 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155567.247827:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155567.247913:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090013c00/0x844e5faceb5eb87d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef9 expref: 321 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.247932:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb884 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef9 expref: 320 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.247939:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155567.247941:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155567.247943:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090013000, rc 0) 00000100:00100000:1.0:1746155567.247979:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+320:29161:x1830976123757056:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 292us (594us total) trans 8589943944 rc 0/0 00000100:00100000:1.0:1746155567.247984:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10002 00000100:00100000:1.0:1746155567.248084:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123756800 00000100:00100000:1.0:1746155567.248087:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123756800 00000100:00100000:2.0:1746155567.248106:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123757312 00002000:00100000:1.0:1746155567.248108:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1171456->1896447) req@ffff88012fe8d880 x1830976123756800/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746155567.248110:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123757312 00002000:00100000:1.0:1746155567.248117:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8d880 with x1830976123756800 ext(1171456->1896447) 00010000:00010000:1.0:1746155567.248123:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 19 pid: 1625 timeout: 796 lvb_type: 0 00002000:00100000:2.0:1746155567.248129:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012fe8fb80 x1830976123757312/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746155567.248134:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 19 pid: 1625 timeout: 796 lvb_type: 0 00002000:00100000:2.0:1746155567.248136:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8fb80 with x1830976123757312 ext(1048576->2097151) 00002000:00010000:2.0:1746155567.248140:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fe8fb80 00002000:00010000:1.0:1746155567.248140:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fe8d880 00000100:00100000:2.0:1746155567.248160:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 725 00000100:00100000:2.0:1746155567.248166:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123756800:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155567.248205:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124580992:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155567.248222:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef2 expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.248232:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcbc600, rc 0) 00000100:00100000:3.0:1746155567.248252:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:29159:x1830976123756672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9156us (9309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.248258:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12052 00000100:00100000:1.0:1746155567.249164:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4629 00000100:00100000:1.0:1746155567.249171:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123757312:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155567.257796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155567.257838:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123757440 00000100:00100000:1.0:1746155567.257844:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123757440 00000100:00100000:1.0:1746155567.257879:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12053 00000100:00100000:1.0:1746155567.257886:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29161:x1830976123757440:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155567.257901:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155567.257915:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f00 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.257937:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e6d expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.257945:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f63000/0x844e5faceb5eb806 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e82 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155567.257951:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155567.257953:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155567.257956:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [425984->610303] (req 425984->610303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.257979:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f63000/0x844e5faceb5eb806 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e82 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155567.257988:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f63000/0x844e5faceb5eb806 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e82 expref: 17 pid: 1625 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155567.258003:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124581120:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155567.258051:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e6d expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.258058:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e6d expref: 24 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.258066:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124581248:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155567.258081:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155567.269637:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123757312:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 20458us (22179us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155567.269647:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4629 00002000:00100000:1.0:1746155567.269657:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012fe8fb80 x1830976123757312/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/440 e 0 to 0 dl 1746155578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155567.269665:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8fb80 with x1830976123757312 ext(1048576->2097151) 00002000:00010000:1.0:1746155567.269670:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fe8fb80 00000100:00100000:1.0:1746155567.269707:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124581120:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155567.269714:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124581248:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155567.269736:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [425984->610303] (req 425984->610303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.269750:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090012400, rc 0) 00000100:00100000:1.0:1746155567.269770:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:29161:x1830976123757440:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 11885us (11981us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155567.269776:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12053 00000100:00100000:0.0:1746155567.270979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.271215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155567.271616:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123757696 00000100:00100000:1.0:1746155567.271622:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123757696 00010000:00010000:1.0:1746155567.271645:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e6d expref: 24 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.271698:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123757568 00000100:00100000:1.0:1746155567.271701:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123757568 00000100:00100000:2.0:1746155567.271704:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6066 00010000:00010000:1.0:1746155567.271709:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f63000/0x844e5faceb5eb806 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e82 expref: 16 pid: 1625 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746155567.271711:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976123757696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155567.271722:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155567.271722:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6067 00000100:00100000:1.0:1746155567.271726:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123757568:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155567.271730:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155567.271737:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e6d expref: 24 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746155567.271737:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f63000/0x844e5faceb5eb806 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e82 expref: 16 pid: 1625 timeout: 796 lvb_type: 1 00010000:00010000:1.0:1746155567.271745:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f63000/0x844e5faceb5eb806 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e82 expref: 16 pid: 1625 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746155567.271786:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e6d expref: 24 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746155567.271803:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f63000/0x844e5faceb5eb806 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e82 expref: 16 pid: 1625 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746155567.271889:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090013600/0x844e5faceb5eb7ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e6d expref: 24 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746155567.271889:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155567.271891:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155567.271897:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.271994:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.272005:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155567.272020:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155567.272030:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976123757696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 319us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155567.272030:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124581376:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155567.272035:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6066 00000100:00100000:1.0:1746155567.272062:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155567.272591:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123756800:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 24415us (25154us total) trans 17179873185 rc 0/0 00000100:00100000:3.0:1746155567.272602:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 725 00002000:00100000:3.0:1746155567.272609:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1171456->1896447) req@ffff88012fe8d880 x1830976123756800/t17179873185(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:638/0 lens 488/448 e 0 to 0 dl 1746155578 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155567.272616:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8d880 with x1830976123756800 ext(1171456->1896447) 00010000:00010000:3.0:1746155567.272623:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.272634:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00002000:00010000:3.0:1746155567.272639:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fe8d880 00000100:00100000:1.0:1746155567.274954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.275016:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123757952 00000100:00100000:3.0:1746155567.275022:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123757952 00000100:00100000:2.0:1746155567.275040:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124581376:192.168.202.51@tcp:105: 00002000:00100000:3.0:1746155567.275056:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (425984->430079) req@ffff88008ff18700 x1830976123757952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746155567.275056:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746155567.275063:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff18700 with x1830976123757952 ext(425984->430079) 00002000:00010000:3.0:1746155567.275066:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ff18700 00000100:00100000:3.0:1746155567.275082:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4630 00000100:00100000:3.0:1746155567.275088:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123757952:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155567.275120:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123757568:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3392us (3904us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.275126:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6067 00000100:00100000:3.0:1746155567.275207:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123757952:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 118us (258us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155567.275213:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4630 00002000:00100000:3.0:1746155567.275218:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (425984->430079) req@ffff88008ff18700 x1830976123757952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746155578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155567.275230:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff18700 with x1830976123757952 ext(425984->430079) 00002000:00010000:3.0:1746155567.275232:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ff18700 00000100:00100000:0.0:1746155567.275545:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.275559:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123758080 00000100:00100000:2.0:1746155567.275562:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123758080 00010000:00010000:2.0:1746155567.275587:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.275611:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6068 00000100:00100000:2.0:1746155567.275616:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123758080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155567.275624:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155567.275637:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.275648:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.275665:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0dfc00/0x844e5faceb5eb853 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1896447) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ecf expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.275676:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.275677:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.275682:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef2 expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.275689:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef2 expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.275713:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef2 expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155567.275722:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124581504:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155567.275780:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155567.279139:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.279341:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124581504:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155567.279359:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155567.279397:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123758080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3779us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.279406:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6068 00000100:00100000:3.0:1746155567.279768:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.279791:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123758208 00000100:00100000:3.0:1746155567.279796:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123758208 00000100:00100000:0.0:1746155567.279814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.279904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.279921:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123758336 00000100:00100000:2.0:1746155567.279924:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123758336 00000100:00100000:2.0:1746155567.279936:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123758464 00000100:00100000:2.0:1746155567.279938:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123758464 00000100:00100000:2.0:1746155567.279947:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12054 00000100:00100000:2.0:1746155567.279952:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976123758208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155567.279965:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.279977:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb899 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f07 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155567.280266:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124581632:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155567.280304:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155567.280315:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12055 00000100:00100000:2.0:1746155567.280320:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123758336:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155567.280326:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.280334:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5eb8a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f0e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.280344:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.280346:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.280351:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5eb8a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f0e expref: 22 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.280363:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5eb8a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f0e expref: 22 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.280371:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0000, rc 0) 00000100:00100000:2.0:1746155567.280383:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123758336:12345-192.168.202.51@tcp:101:cat.0 Request processed in 64us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.280388:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12055 00000100:00100000:2.0:1746155567.280396:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12056 00000100:00100000:2.0:1746155567.280400:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123758464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155567.280404:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.280408:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb8a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f15 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.280414:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.280416:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.280419:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb8a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f15 expref: 22 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.280425:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb8a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f15 expref: 22 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.280430:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1000, rc 0) 00000100:00100000:2.0:1746155567.280438:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123758464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 38us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.280442:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12056 00000100:00100000:1.0:1746155567.280578:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123758720 00000100:00100000:1.0:1746155567.280592:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123758720 00000100:00100000:0.0:1746155567.280598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.280612:0:14230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123758848 00002000:00100000:1.0:1746155567.280614:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88012fe8d500 x1830976123758720/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746155567.280614:0:14230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123758848 00002000:00100000:1.0:1746155567.280622:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8d500 with x1830976123758720 ext(1048576->2097151) 00002000:00010000:1.0:1746155567.280626:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fe8d500 00000100:00100000:0.0:1746155567.280637:0:14230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 167 00000100:00100000:0.0:1746155567.280642:0:14230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06793f43-a06c-4add-b66d-476e36bacde6+15:1962:x1830976123758848:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:1.0:1746155567.280657:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4631 00000100:00100000:0.0:1746155567.280660:0:14230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06793f43-a06c-4add-b66d-476e36bacde6+15:1962:x1830976123758848:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 19us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155567.280662:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123758720:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155567.280665:0:14230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 167 00000100:00100000:0.0:1746155567.280692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.280703:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123758976 00000100:00100000:0.0:1746155567.280706:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123758976 00000100:00100000:0.0:1746155567.280730:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 145 00000100:00100000:0.0:1746155567.280735:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1962:x1830976123758976:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:0.0:1746155567.280759:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1962:x1830976123758976:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 24us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.280764:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 145 00000100:00080000:0.0:1746155567.280775:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155567.280795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.281039:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123759232 00000100:00100000:2.0:1746155567.281043:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123759232 00002000:00100000:2.0:1746155567.281057:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (606208->610303) req@ffff88012fe8dc00 x1830976123759232/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155567.281064:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8dc00 with x1830976123759232 ext(606208->610303) 00002000:00010000:2.0:1746155567.281067:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fe8dc00 00000100:00100000:2.0:1746155567.281087:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4632 00000100:00100000:2.0:1746155567.281092:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123759232:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155567.281239:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123759232:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 147us (443us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155567.281245:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4632 00002000:00100000:2.0:1746155567.281249:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (606208->610303) req@ffff88012fe8dc00 x1830976123759232/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/4536 e 0 to 0 dl 1746155578 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155567.281256:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8dc00 with x1830976123759232 ext(606208->610303) 00002000:00010000:2.0:1746155567.281259:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fe8dc00 00000100:00100000:2.0:1746155567.287051:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124581632:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155567.287079:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb899 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f07 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.287092:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913d8e00/0x844e5faceb5eb899 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f07 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.287109:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913d8e00, rc 0) 00000100:00100000:2.0:1746155567.287159:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976123758208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7205us (8025us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155567.287166:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12054 00000100:00100000:1.0:1746155567.288498:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123758720:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7832us (8589us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155567.288521:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4631 00002000:00100000:1.0:1746155567.288529:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88012fe8d500 x1830976123758720/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/440 e 0 to 0 dl 1746155578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155567.288538:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8d500 with x1830976123758720 ext(1048576->2097151) 00002000:00010000:1.0:1746155567.288542:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fe8d500 00000100:00100000:0.0:1746155567.293097:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.293480:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123759360 00000100:00100000:2.0:1746155567.293488:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123759360 00000100:00100000:2.0:1746155567.293567:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12057 00000100:00100000:2.0:1746155567.293574:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123759360:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155567.293598:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.293613:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f1c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155567.293655:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124581760:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155567.293731:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155567.296137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.296390:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123759488 00000100:00100000:3.0:1746155567.296397:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123759488 00000100:00100000:3.0:1746155567.296427:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12058 00000100:00100000:3.0:1746155567.296434:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29159:x1830976123759488:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155567.296447:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155567.296460:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c9f200/0x844e5faceb5eb8b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f23 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.296477:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.296479:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.296485:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9f200/0x844e5faceb5eb8b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f23 expref: 24 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.296497:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c9f200/0x844e5faceb5eb8b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f23 expref: 24 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.296530:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c9f200, rc 0) 00000100:00100000:2.0:1746155567.297429:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124581760:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155567.297451:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8ae lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f1c expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.297460:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f1c expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.297477:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913d9a00, rc 0) 00000100:00100000:3.0:1746155567.297521:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:29159:x1830976123759488:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1087us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.297526:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12058 00000100:00100000:2.0:1746155567.297885:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123759360:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4311us (4794us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155567.297891:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12057 00000100:00100000:0.0:1746155567.307111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.307161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.307176:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123759744 00000100:00100000:2.0:1746155567.307184:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123759744 00000100:00100000:1.0:1746155567.307789:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123759872 00000100:00100000:1.0:1746155567.307794:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123759872 00002000:00100000:1.0:1746155567.307821:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880136633b80 x1830976123759872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155567.307829:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136633b80 with x1830976123759872 ext(1048576->2097151) 00002000:00010000:1.0:1746155567.307833:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136633b80 00000100:00100000:1.0:1746155567.307850:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4633 00000100:00100000:1.0:1746155567.307855:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123759872:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155567.308872:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12059 00000100:00100000:2.0:1746155567.308879:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123759744:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155567.308889:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.308901:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f2a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155567.308941:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124581888:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155567.308999:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155567.310563:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124581888:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155567.310590:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8bc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f2a expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.310600:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f2a expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.310620:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913d9200, rc 0) 00000100:00100000:2.0:1746155567.310645:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123759744:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1766us (3541us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155567.310651:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12059 00000100:00100000:1.0:1746155567.319730:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123759872:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11865us (12560us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155567.319741:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4633 00002000:00100000:1.0:1746155567.319751:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880136633b80 x1830976123759872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/440 e 0 to 0 dl 1746155578 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155567.319760:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136633b80 with x1830976123759872 ext(1048576->2097151) 00002000:00010000:1.0:1746155567.319765:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136633b80 00000100:00100000:0.0:1746155567.351691:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.351787:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123760000 00000100:00100000:2.0:1746155567.351794:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123760000 00000100:00100000:2.0:1746155567.351846:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10003 00000100:00100000:2.0:1746155567.351854:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:29166:x1830976123760000:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155567.351870:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.351885:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9800/0x844e5faceb5eb8c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f31 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.351933:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.351944:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.351954:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.351964:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.351970:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.351974:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.352058:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.352068:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e66 expref: 26 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.352074:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb884 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef9 expref: 319 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.352079:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.352103:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb884 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef9 expref: 319 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.352112:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb884 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef9 expref: 319 pid: 20364 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.352122:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124582016:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155567.352198:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e66 expref: 26 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.352206:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e66 expref: 26 pid: 20364 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.352217:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124582144:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.352687:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155567.355928:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124582016:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.355939:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124582144:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155567.355958:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155567.356181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.356865:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.357200:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123760256 00000100:00100000:3.0:1746155567.357206:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123760256 00000100:00100000:3.0:1746155567.357246:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123760512 00000100:00100000:3.0:1746155567.357248:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123760512 00000100:00100000:3.0:1746155567.357269:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4033 00000100:00100000:3.0:1746155567.357275:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+320:7661:x1830976123760256:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155567.357438:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+321:7661:x1830976123760256:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 162us (1261us total) trans 8589943945 rc 0/0 00000100:00100000:3.0:1746155567.357444:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4033 00000100:00100000:3.0:1746155567.357458:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4034 00000100:00100000:3.0:1746155567.357463:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+27:13789:x1830976123760512:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155567.357539:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:13789:x1830976123760512:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 76us (675us total) trans 8589943946 rc 0/0 00000100:00100000:3.0:1746155567.357545:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4034 00000100:00080000:0.0:1746155567.358055:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155567.360051:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.360459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.361182:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123760640 00000100:00100000:2.0:1746155567.361189:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123760640 00010000:00010000:2.0:1746155567.361217:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb884 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef9 expref: 321 pid: 20364 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.361244:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123760768 00000100:00100000:2.0:1746155567.361245:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123760768 00010000:00010000:2.0:1746155567.361254:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e66 expref: 28 pid: 20364 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.361268:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6069 00000100:00100000:2.0:1746155567.361274:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+321:1960:x1830976123760640:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155567.361284:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155567.361288:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb884 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef9 expref: 321 pid: 20364 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.361296:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb884 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef9 expref: 321 pid: 20364 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.361316:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090013000/0x844e5faceb5eb884 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef9 expref: 321 pid: 20364 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.361330:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155567.361333:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.361340:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.361344:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.361348:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155567.361378:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+320:1960:x1830976123760640:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 105us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.361383:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6069 00000100:00100000:2.0:1746155567.361395:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6070 00000100:00100000:2.0:1746155567.361399:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123760768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155567.361847:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155567.361853:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e66 expref: 28 pid: 20364 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.361861:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e66 expref: 28 pid: 20364 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.361872:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5eb7e3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e66 expref: 28 pid: 20364 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.361884:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155567.361887:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.361893:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.361899:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.361925:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155567.361988:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.361994:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155567.362027:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:0.0:1746155567.362031:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155567.362043:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362051:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362060:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362065:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362071:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362075:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913d9200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155567.362079:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362084:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362092:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155567.362094:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155567.362097:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362101:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9200/0x844e5faceb5eb8ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362112:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362117:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362121:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362125:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913d9a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155567.362128:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362132:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362138:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9c00) 00010000:00010000:0.0:1746155567.362139:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155567.362141:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362146:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9a00/0x844e5faceb5eb8d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.362170:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913d9800/0x844e5faceb5eb8c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f31 expref: 19 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.362179:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f31 expref: 18 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.362185:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155567.362187:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155567.362189:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3ac00, rc 0) 00000100:00100000:2.0:1746155567.362642:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123760768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1240us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.362648:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6070 00000100:00100000:0.0:1746155567.363254:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:29166:x1830976123760000:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 11400us (11570us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.363259:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10003 00000100:00100000:0.0:1746155567.365797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.365822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.365849:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.365861:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.366018:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123761024 00000100:00100000:2.0:1746155567.366025:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123761024 00000100:00100000:0.0:1746155567.366035:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.366062:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123761280 00000100:00100000:2.0:1746155567.366065:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123761280 00000100:00100000:0.0:1746155567.366069:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123760896 00000100:00100000:0.0:1746155567.366072:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123760896 00000100:00100000:2.0:1746155567.366142:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123761152 00000100:00100000:2.0:1746155567.366145:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123761152 00000100:00100000:3.0:1746155567.366157:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123761408 00000100:00100000:3.0:1746155567.366160:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123761408 00000100:00100000:3.0:1746155567.366181:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12060 00000100:00100000:3.0:1746155567.366187:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123761024:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155567.366202:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155567.366216:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c9fa00/0x844e5faceb5eb8df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f3f expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.366234:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.366236:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.366243:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c9fa00/0x844e5faceb5eb8df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f3f expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.366259:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c9fa00/0x844e5faceb5eb8df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f3f expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.366268:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c9fa00, rc 0) 00000100:00100000:3.0:1746155567.366298:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123761024:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 112us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.366303:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12060 00000100:00100000:3.0:1746155567.366315:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12061 00000100:00100000:3.0:1746155567.366320:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123761280:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155567.366326:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155567.366333:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c9f400/0x844e5faceb5eb8e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f4d expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.366342:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.366343:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.366347:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9f400/0x844e5faceb5eb8e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f4d expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.366356:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c9f400/0x844e5faceb5eb8e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f4d expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.366362:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c9f400, rc 0) 00000100:00100000:3.0:1746155567.366375:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123761280:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 56us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.366379:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12061 00000100:00100000:3.0:1746155567.366389:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12062 00000100:00100000:3.0:1746155567.366393:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123760896:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155567.366398:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155567.366404:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5eb8ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f38 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155567.366434:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124582272:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155567.366471:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:3.0:1746155567.366487:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12063 00000100:00100000:3.0:1746155567.366492:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123761152:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155567.366497:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155567.366519:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d1db400/0x844e5faceb5eb8f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f46 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.366527:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.366529:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.366533:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1db400/0x844e5faceb5eb8f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f46 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.366541:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d1db400/0x844e5faceb5eb8f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f46 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.366547:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d1db400, rc 0) 00000100:00100000:3.0:1746155567.366561:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123761152:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 69us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.366566:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12063 00000100:00100000:3.0:1746155567.366576:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12064 00000100:00100000:3.0:1746155567.366591:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123761408:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155567.366597:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155567.366602:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d1db000/0x844e5faceb5eb8fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f54 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.366610:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.366611:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.366615:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1db000/0x844e5faceb5eb8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f54 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.366623:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d1db000/0x844e5faceb5eb8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f54 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.366629:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d1db000, rc 0) 00000100:00100000:3.0:1746155567.366642:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123761408:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 51us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.366646:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12064 00000100:00100000:3.0:1746155567.369351:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124582272:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155567.369377:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5eb8ed lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f38 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.369388:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5eb8ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f38 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.369401:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c9f800, rc 0) 00000100:00100000:3.0:1746155567.369438:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123760896:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 3043us (3587us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155567.369444:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12062 00000100:00100000:0.0:1746155567.371448:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.371617:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123761664 00000100:00100000:2.0:1746155567.371624:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123761664 00000100:00100000:2.0:1746155567.371667:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10004 00000100:00100000:2.0:1746155567.371674:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:29166:x1830976123761664:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155567.371689:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.371702:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3aa00/0x844e5faceb5eb902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f5b expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.371773:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb909 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.371785:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f31 expref: 19 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.371791:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb909 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.371814:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f31 expref: 19 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.371823:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f31 expref: 19 pid: 15474 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.371832:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124582400:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.371898:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155567.376159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.376207:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123761792 00000100:00100000:3.0:1746155567.376214:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123761792 00010000:00010000:3.0:1746155567.376242:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f31 expref: 20 pid: 15474 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.376242:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124582400:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155567.376259:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb909 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155567.376281:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6071 00000100:00100000:3.0:1746155567.376288:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d75a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:1961:x1830976123761792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155567.376297:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155567.376302:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f31 expref: 20 pid: 15474 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.376311:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f31 expref: 20 pid: 15474 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.376329:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5eb8d8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f31 expref: 20 pid: 15474 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.376613:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155567.376618:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb909 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155567.376626:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb909 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155567.376631:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb909 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155567.376655:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155567.376672:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb909 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155567.376677:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb909 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155567.376692:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155567.376797:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3aa00/0x844e5faceb5eb902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f5b expref: 21 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.376824:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb909 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f5b expref: 20 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.376829:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155567.376833:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155567.376835:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3ba00, rc 0) 00000100:00100000:0.0:1746155567.376866:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:29166:x1830976123761664:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 5193us (5424us total) trans 8589943947 rc 0/0 00000100:00100000:0.0:1746155567.376872:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10004 00000100:00100000:3.0:1746155567.376963:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d75a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+19:1961:x1830976123761792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 674us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.376969:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6071 00000100:00100000:0.0:1746155567.378929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.378983:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123762048 00000100:00100000:2.0:1746155567.378988:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123762048 00000100:00100000:2.0:1746155567.379033:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10005 00000100:00100000:2.0:1746155567.379040:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+19:29166:x1830976123762048:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155567.379057:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.379060:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746155567.379076:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb909 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f5b expref: 19 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.379107:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155567.379110:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155567.379120:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b400/0x844e5faceb5eb917 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f62 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.379564:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5eb91e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.379574:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5eb91e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.379594:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5eb91e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155567.379603:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155567.379682:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b400/0x844e5faceb5eb917 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f62 expref: 21 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.379693:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5eb91e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f62 expref: 20 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.379698:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155567.379701:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155567.379702:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3a400, rc 0) 00000100:00100000:2.0:1746155567.379734:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:29166:x1830976123762048:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 696us (811us total) trans 8589943948 rc 0/0 00000100:00100000:2.0:1746155567.379740:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10005 00000100:00100000:0.0:1746155567.383812:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.383840:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.383860:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.383881:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.383892:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.383915:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.384020:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123762304 00000100:00100000:2.0:1746155567.384029:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123762304 00000100:00100000:0.0:1746155567.384053:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123762560 00000100:00100000:0.0:1746155567.384057:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123762560 00000100:00100000:2.0:1746155567.384061:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123762816 00000100:00100000:2.0:1746155567.384063:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123762816 00000100:00100000:1.0:1746155567.384087:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123762432 00000100:00100000:1.0:1746155567.384090:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123762432 00000100:00100000:2.0:1746155567.384157:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123762688 00000100:00100000:2.0:1746155567.384160:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123762688 00000100:00100000:1.0:1746155567.384166:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12065 00000100:00100000:1.0:1746155567.384173:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123762304:12345-192.168.202.51@tcp:1:mirror_io.0 00000100:00100000:2.0:1746155567.384176:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12066 00000100:00100000:2.0:1746155567.384182:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123762560:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:2.0:1746155567.384206:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.384206:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.384220:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eeb expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.384220:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ee4 expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.384227:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c9f400/0x844e5faceb5eb8e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f4d expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155567.384230:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c9fa00/0x844e5faceb5eb8df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f3f expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.384234:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c9f200/0x844e5faceb5eb8b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f23 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.384237:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5eb8a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f0e expref: 21 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.384240:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.384241:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155567.384241:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.384243:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.384243:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155567.384244:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.384266:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c9f200/0x844e5faceb5eb8b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f23 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.384266:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5eb8a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f0e expref: 21 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.384275:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c9f200/0x844e5faceb5eb8b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f23 expref: 23 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746155567.384276:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5eb8a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f0e expref: 21 pid: 8438 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155567.384286:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124582656:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.384289:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124582528:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155567.384335:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12067 00010000:00010000:2.0:1746155567.384343:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c9f400/0x844e5faceb5eb8e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f4d expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155567.384345:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123762816:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:2.0:1746155567.384350:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c9f400/0x844e5faceb5eb8e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f4d expref: 9 pid: 20796 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746155567.384357:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124582784:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155567.384360:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.384368:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db7 expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155567.384385:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123762176 00000100:00100000:0.0:1746155567.384388:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123762176 00000100:00100000:0.0:1746155567.384405:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12068 00000100:00100000:0.0:1746155567.384409:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123762432:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155567.384421:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.384429:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef2 expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.384435:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d1db400/0x844e5faceb5eb8f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f46 expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155567.384441:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb8a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f15 expref: 21 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155567.384446:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155567.384447:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155567.384449:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.384461:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb8a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f15 expref: 21 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155567.384468:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb8a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f15 expref: 21 pid: 8438 timeout: 796 lvb_type: 1 00000100:00100000:0.0:1746155567.384481:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124582912:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155567.384525:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d1db000/0x844e5faceb5eb8fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f54 expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.384532:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0600/0x844e5faceb5eb750 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e0b expref: 21 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.384537:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.384538:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.384540:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.384554:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913f0600/0x844e5faceb5eb750 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e0b expref: 21 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.384561:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913f0600/0x844e5faceb5eb750 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e0b expref: 21 pid: 9235 timeout: 796 lvb_type: 1 00000100:00100000:3.0:1746155567.384574:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124583040:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155567.385418:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c9fa00/0x844e5faceb5eb8df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f3f expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155567.385427:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c9fa00/0x844e5faceb5eb8df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f3f expref: 10 pid: 20796 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155567.385434:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124583168:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155567.385458:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ee4 expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385465:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ee4 expref: 27 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.385472:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124583296:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155567.385486:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155567.385517:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12069 00000100:00100000:1.0:1746155567.385524:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123762688:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:1.0:1746155567.385541:0:10591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385550:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d9b expref: 14 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385556:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093eca600/0x844e5faceb5eb718 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10de1 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155567.385561:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a539c200/0x844e5faceb5eb6c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da2 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385567:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c29ac00/0x844e5faceb5eb60e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d24 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385571:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155567.385573:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155567.385575:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 7/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385599:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c29ac00/0x844e5faceb5eb60e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d24 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385606:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c29ac00/0x844e5faceb5eb60e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d24 expref: 23 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.385613:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124583424:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155567.385635:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a539c200/0x844e5faceb5eb6c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da2 expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385641:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a539c200/0x844e5faceb5eb6c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da2 expref: 23 pid: 4461 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.385647:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124583552:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155567.385664:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093eca600/0x844e5faceb5eb718 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10de1 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155567.385671:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093eca600/0x844e5faceb5eb718 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10de1 expref: 10 pid: 8438 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155567.385677:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124583680:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155567.385697:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d9b expref: 14 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385704:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d9b expref: 14 pid: 20796 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.385710:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124583808:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155567.385722:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155567.385745:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12070 00000100:00100000:1.0:1746155567.385750:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123762176:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:1.0:1746155567.385764:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385772:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385777:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155567.385779:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155567.385781:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385793:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.385800:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 23 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.385807:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124583936:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155567.385820:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5010c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746155567.385908:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eeb expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.385918:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eeb expref: 14 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.385926:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124584064:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.385943:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00010000:00010000:0.0:1746155567.386152:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d1db400/0x844e5faceb5eb8f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f46 expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155567.386163:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d1db400/0x844e5faceb5eb8f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f46 expref: 10 pid: 9235 timeout: 796 lvb_type: 1 00000100:00100000:0.0:1746155567.386171:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124584192:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155567.386208:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d1db000/0x844e5faceb5eb8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f54 expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.386216:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d1db000/0x844e5faceb5eb8fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f54 expref: 10 pid: 9235 timeout: 796 lvb_type: 1 00000100:00100000:3.0:1746155567.386222:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124584320:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155567.386253:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db7 expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.386260:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db7 expref: 27 pid: 20796 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746155567.386268:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124584448:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155567.386282:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ecea80 going to sleep for 11 seconds 00010000:00010000:0.0:1746155567.386615:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef2 expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.386622:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef2 expref: 27 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746155567.386629:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124584576:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155567.386650:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155567.392927:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124582528:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.396133:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124583424:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.396143:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124583552:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155567.396336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.396399:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123762944 00000100:00100000:3.0:1746155567.396406:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123762944 00010000:00010000:3.0:1746155567.396434:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5eb8a0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f0e expref: 22 pid: 8438 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155567.396450:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124582656:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155567.396470:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6072 00000100:00100000:3.0:1746155567.396477:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123762944:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155567.396490:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155567.396523:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5eb8a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f0e expref: 22 pid: 8438 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746155567.396532:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5eb8a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f0e expref: 22 pid: 8438 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746155567.396550:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5eb8a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f0e expref: 22 pid: 8438 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155567.396562:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124583168:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155567.396573:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155567.396573:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124583296:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155567.396602:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155567.396616:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123762944:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 140us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.396622:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6072 00000100:00100000:0.0:1746155567.400009:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.400043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.400067:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.400092:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.400110:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123763200 00000100:00100000:0.0:1746155567.400117:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123763200 00010000:00010000:0.0:1746155567.400141:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c29ac00/0x844e5faceb5eb60e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d24 expref: 24 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746155567.400161:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123763456 00000100:00100000:0.0:1746155567.400163:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123763456 00010000:00010000:0.0:1746155567.400174:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c9fa00/0x844e5faceb5eb8df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f3f expref: 11 pid: 20796 timeout: 796 lvb_type: 1 00000100:00100000:0.0:1746155567.400184:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123763072 00000100:00100000:0.0:1746155567.400185:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123763072 00010000:00010000:0.0:1746155567.400192:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9f200/0x844e5faceb5eb8b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f23 expref: 25 pid: 9235 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746155567.400199:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123763328 00000100:00100000:0.0:1746155567.400201:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123763328 00010000:00010000:0.0:1746155567.400207:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ee4 expref: 28 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746155567.400217:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6073 00000100:00100000:0.0:1746155567.400223:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123763200:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155567.400233:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155567.400249:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c29ac00/0x844e5faceb5eb60e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d24 expref: 25 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.400258:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c29ac00/0x844e5faceb5eb60e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d24 expref: 25 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.400275:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c29ac00/0x844e5faceb5eb60e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d24 expref: 25 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.400301:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155567.400330:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123763200:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 107us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.400335:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6073 00000100:00100000:0.0:1746155567.400348:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6074 00000100:00100000:0.0:1746155567.400352:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123763456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155567.400358:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155567.400369:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c9fa00/0x844e5faceb5eb8df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f3f expref: 11 pid: 20796 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746155567.400376:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c9fa00/0x844e5faceb5eb8df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f3f expref: 11 pid: 20796 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746155567.400386:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c9fa00/0x844e5faceb5eb8df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f3f expref: 11 pid: 20796 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746155567.400394:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155567.400404:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123763456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 52us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.400409:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6074 00000100:00100000:0.0:1746155567.400416:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6075 00000100:00100000:0.0:1746155567.400420:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123763072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155567.400424:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155567.400431:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c9f200/0x844e5faceb5eb8b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f23 expref: 23 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.400438:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c9f200/0x844e5faceb5eb8b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f23 expref: 23 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.400446:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c9f200/0x844e5faceb5eb8b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f23 expref: 23 pid: 9235 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.400452:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155567.400462:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123763072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 42us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.400466:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6075 00000100:00100000:0.0:1746155567.400472:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6076 00000100:00100000:0.0:1746155567.400476:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123763328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155567.400481:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155567.400486:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ee4 expref: 28 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.400493:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ee4 expref: 28 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.400500:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eb868 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ee4 expref: 28 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.400528:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155567.400529:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155567.400533:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.400540:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.400556:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155567.400568:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123763328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 91us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.400572:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6076 00010000:00010000:3.0:1746155567.400624:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.400632:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.400648:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.400654:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.400660:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.400666:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090013000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155567.400669:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.400675:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.400684:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.400690:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5eb92c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155567.400705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.400721:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.400731:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123763584 00000100:00100000:0.0:1746155567.400734:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123763584 00000100:00100000:3.0:1746155567.400737:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123762304:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 16564us (16929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.400743:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12065 00010000:00010000:0.0:1746155567.400744:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093eca600/0x844e5faceb5eb718 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10de1 expref: 11 pid: 8438 timeout: 796 lvb_type: 1 00000100:00100000:0.0:1746155567.400754:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123763840 00000100:00100000:0.0:1746155567.400756:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123763840 00010000:00010000:0.0:1746155567.400761:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9f400/0x844e5faceb5eb8e6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f4d expref: 12 pid: 20796 timeout: 796 lvb_type: 1 00000100:00100000:3.0:1746155567.400763:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6077 00000100:00100000:3.0:1746155567.400769:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123763584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155567.400772:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6078 00010000:00010000:3.0:1746155567.400775:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155567.400776:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d759450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976123763840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155567.400781:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155567.400784:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093eca600/0x844e5faceb5eb718 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10de1 expref: 12 pid: 8438 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746155567.400788:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c9f400/0x844e5faceb5eb8e6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f4d expref: 12 pid: 20796 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746155567.400791:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093eca600/0x844e5faceb5eb718 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10de1 expref: 12 pid: 8438 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746155567.400795:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c9f400/0x844e5faceb5eb8e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f4d expref: 12 pid: 20796 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746155567.400805:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155567.400807:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093eca600/0x844e5faceb5eb718 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10de1 expref: 12 pid: 8438 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746155567.400807:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124583680:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155567.400814:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155567.400816:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124583808:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155567.400818:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d759450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123763840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 41us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.400823:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6078 00000100:00100000:3.0:1746155567.400830:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123763584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 62us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.400835:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6077 00010000:00010000:2.0:1746155567.400841:0:10591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.400864:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c9f400/0x844e5faceb5eb8e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f4d expref: 9 pid: 20796 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746155567.400876:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124582784:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155567.400877:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124582912:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.400883:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124584064:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155567.400896:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155567.400909:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124583936:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155567.400920:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155567.401899:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.401937:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.401954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.401966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.401981:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124583040:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155567.401990:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124584320:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155567.401993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.402005:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123764352 00000100:00100000:2.0:1746155567.402005:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123764224 00000100:00100000:0.0:1746155567.402007:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123764096 00000100:00100000:3.0:1746155567.402009:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123764352 00000100:00100000:2.0:1746155567.402009:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123764224 00000100:00100000:0.0:1746155567.402010:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123764096 00010000:00010000:0.0:1746155567.402023:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d9b expref: 16 pid: 20796 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.402024:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eeb expref: 16 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.402025:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a539c200/0x844e5faceb5eb6c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da2 expref: 22 pid: 4461 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746155567.402047:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123763968 00000100:00100000:3.0:1746155567.402049:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123763968 00010000:00010000:3.0:1746155567.402060:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb8a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f15 expref: 21 pid: 8438 timeout: 796 lvb_type: 1 00000100:00100000:2.0:1746155567.402144:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6079 00000100:00100000:2.0:1746155567.402151:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123764352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155567.402160:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155567.402171:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eeb expref: 16 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.402179:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eeb expref: 16 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.402192:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a231800/0x844e5faceb5eb86f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10eeb expref: 16 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.402202:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.402203:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155567.402204:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6080 00010000:00010000:2.0:1746155567.402206:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402212:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155567.402213:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123764224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155567.402227:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155567.402249:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123764352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 99us (294us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155567.402253:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155567.402262:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a539c200/0x844e5faceb5eb6c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da2 expref: 22 pid: 4461 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.402270:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a539c200/0x844e5faceb5eb6c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da2 expref: 22 pid: 4461 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746155567.402279:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6081 00010000:00010000:0.0:1746155567.402280:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a539c200/0x844e5faceb5eb6c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10da2 expref: 22 pid: 4461 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746155567.402287:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1962:x1830976123764096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155567.402294:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155567.402294:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155567.402302:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d9b expref: 15 pid: 20796 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746155567.402308:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123764224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (411us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155567.402310:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d9b expref: 15 pid: 20796 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746155567.402314:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6080 00010000:00010000:3.0:1746155567.402320:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5eb6bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10d9b expref: 15 pid: 20796 timeout: 796 lvb_type: 0 00000100:00100000:0.0:1746155567.402324:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6082 00010000:00010000:3.0:1746155567.402327:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.402328:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155567.402329:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123763968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155567.402330:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.402335:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155567.402336:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.402343:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb8a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f15 expref: 21 pid: 8438 timeout: 796 lvb_type: 1 00010000:00010000:3.0:1746155567.402349:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155567.402351:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb8a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f15 expref: 21 pid: 8438 timeout: 796 lvb_type: 1 00010000:00010000:0.0:1746155567.402360:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb8a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f15 expref: 21 pid: 8438 timeout: 796 lvb_type: 1 00000100:00100000:3.0:1746155567.402364:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123764096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.402368:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6081 00010000:00010000:0.0:1746155567.402368:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155567.402379:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123763968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.402384:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6082 00000100:00100000:0.0:1746155567.402407:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123763712 00000100:00100000:0.0:1746155567.402409:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123763712 00000100:00100000:3.0:1746155567.402428:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:0.0:1746155567.402429:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d6:0x0] (425984->610303) req@ffff88012fe8ed80 x1830976123763712/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/0 e 0 to 0 dl 1746155578 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155567.402439:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8ed80 with x1830976123763712 ext(425984->610303) 00010000:00010000:0.0:1746155567.402446:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.402454:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 21 pid: 1625 timeout: 796 lvb_type: 0 00002000:00010000:0.0:1746155567.402460:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fe8ed80 00000100:00100000:0.0:1746155567.402471:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123764480 00000100:00100000:0.0:1746155567.402473:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123764480 00010000:00010000:0.0:1746155567.402481:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1db000/0x844e5faceb5eb8fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f54 expref: 9 pid: 9235 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155567.402496:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6083 00000100:00100000:2.0:1746155567.402523:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6079 00000100:00100000:1.0:1746155567.402525:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123764480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155567.402532:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155567.402540:0:10591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.402541:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d1db000/0x844e5faceb5eb8fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f54 expref: 9 pid: 9235 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746155567.402546:0:10591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.402549:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d1db000/0x844e5faceb5eb8fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f54 expref: 9 pid: 9235 timeout: 796 lvb_type: 1 00010000:00010000:1.0:1746155567.402559:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d1db000/0x844e5faceb5eb8fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f54 expref: 9 pid: 9235 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746155567.402560:0:10591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402567:0:10591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.402570:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155567.402573:0:10591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402596:0:10591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130cb4400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155567.402599:0:10591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155567.402599:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123764480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 76us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155567.402605:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6083 00010000:00010000:2.0:1746155567.402606:0:10591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402615:0:10591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402620:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130cb4400/0x844e5faceb5eb948 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155567.402630:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 726 00000100:00100000:1.0:1746155567.402636:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123763712:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155567.402654:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123762688:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 17130us (18737us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.402660:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12069 00010000:00010000:2.0:1746155567.402675:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402681:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402691:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402696:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402701:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402706:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6020a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155567.402708:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402715:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402722:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.402728:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6020a00/0x844e5faceb5eb933 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155567.402752:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123762560:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 18570us (18910us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.402756:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12066 00000100:00100000:0.0:1746155567.403937:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124584448:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155567.403960:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155567.404298:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124584192:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.404305:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124584576:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155567.404321:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155567.405178:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.405239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.405278:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123764608 00000100:00100000:2.0:1746155567.405285:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123764608 00000100:00100000:1.0:1746155567.405285:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123764736 00000100:00100000:1.0:1746155567.405288:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123764736 00010000:00010000:2.0:1746155567.405307:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913f0600/0x844e5faceb5eb750 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e0b expref: 20 pid: 9235 timeout: 796 lvb_type: 1 00010000:00010000:1.0:1746155567.405307:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1db400/0x844e5faceb5eb8f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f46 expref: 8 pid: 9235 timeout: 796 lvb_type: 1 00000100:00100000:1.0:1746155567.405438:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6084 00000100:00100000:1.0:1746155567.405445:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d75a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123764736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155567.405456:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155567.405464:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6085 00000100:00100000:2.0:1746155567.405471:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123764608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155567.405473:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d1db400/0x844e5faceb5eb8f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f46 expref: 8 pid: 9235 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746155567.405479:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155567.405481:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d1db400/0x844e5faceb5eb8f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f46 expref: 8 pid: 9235 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746155567.405489:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913f0600/0x844e5faceb5eb750 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e0b expref: 20 pid: 9235 timeout: 796 lvb_type: 1 00010000:00010000:1.0:1746155567.405496:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d1db400/0x844e5faceb5eb8f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f46 expref: 8 pid: 9235 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746155567.405499:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913f0600/0x844e5faceb5eb750 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e0b expref: 20 pid: 9235 timeout: 796 lvb_type: 1 00010000:00010000:1.0:1746155567.405525:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155567.405531:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0600/0x844e5faceb5eb750 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e0b expref: 20 pid: 9235 timeout: 796 lvb_type: 1 00010000:00010000:2.0:1746155567.405540:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155567.405898:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d75a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123764736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 453us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.405900:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123764608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 428us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155567.405904:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6084 00000100:00100000:2.0:1746155567.405993:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6085 00000100:00100000:0.0:1746155567.410052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.410677:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123764992 00000100:00100000:0.0:1746155567.410685:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123764992 00010000:00010000:0.0:1746155567.410713:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef2 expref: 27 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.410730:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123763712:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8092us (8796us total) trans 21474840565 rc 0/0 00000100:00100000:1.0:1746155567.410738:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 726 00000100:00100000:0.0:1746155567.410744:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6086 00002000:00100000:1.0:1746155567.410745:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (425984->610303) req@ffff88012fe8ed80 x1830976123763712/t21474840565(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:638/0 lens 488/448 e 0 to 0 dl 1746155578 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155567.410750:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123764992:12345-192.168.202.51@tcp:103:ldlm_bl.0 00002000:00100000:1.0:1746155567.410757:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8ed80 with x1830976123763712 ext(425984->610303) 00010000:00010000:0.0:1746155567.410760:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155567.410763:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 23 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.410776:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef2 expref: 27 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746155567.410777:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 23 pid: 1625 timeout: 796 lvb_type: 0 00002000:00010000:1.0:1746155567.410783:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fe8ed80 00010000:00010000:0.0:1746155567.410784:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef2 expref: 27 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.410801:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc600/0x844e5faceb5eb876 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ef2 expref: 27 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:0.0:1746155567.410811:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155567.410813:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155567.410816:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.410822:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.410837:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155567.410849:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155567.410850:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123764992:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 101us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.410854:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6086 00010000:00010000:2.0:1746155567.410858:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.410873:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.410880:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.410886:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.410892:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009374c000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155567.410895:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.410900:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155567.410904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155567.410910:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.410915:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009374c000/0x844e5faceb5eb941 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155567.410956:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1960:x1830976123762432:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 26545us (27061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.410963:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12068 00000100:00100000:1.0:1746155567.411018:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123764864 00000100:00100000:1.0:1746155567.411021:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123764864 00010000:00010000:1.0:1746155567.411032:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db7 expref: 26 pid: 20796 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.411044:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6087 00000100:00100000:1.0:1746155567.411049:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123764864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155567.411055:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155567.411064:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db7 expref: 26 pid: 20796 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746155567.411071:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db7 expref: 26 pid: 20796 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746155567.411082:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5daee00/0x844e5faceb5eb6ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10db7 expref: 26 pid: 20796 timeout: 796 lvb_type: 0 00010000:00010000:1.0:1746155567.411090:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155567.411092:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155567.411094:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.411100:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.411112:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155567.411128:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123764864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155567.411134:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6087 00010000:00010000:0.0:1746155567.412456:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.412465:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.412484:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.412491:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.412496:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.412537:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d1db200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155567.412540:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.412546:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.412556:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.412561:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d1db200/0x844e5faceb5eb93a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155567.412634:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1960:x1830976123762816:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 28291us (28771us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155567.412641:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12067 00000100:00100000:0.0:1746155567.413846:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.413903:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123765120 00000100:00100000:2.0:1746155567.413908:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123765120 00010000:00010000:2.0:1746155567.413927:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 23 pid: 1625 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.413958:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6088 00000100:00100000:2.0:1746155567.413962:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123765120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155567.413971:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155567.413982:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 23 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.413991:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 23 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.414004:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090012400/0x844e5faceb5eb892 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 425984->610303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f00 expref: 23 pid: 1625 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.414013:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.414014:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.414017:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.414023:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.414047:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155567.414068:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123765120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 105us (224us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155567.414071:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155567.414073:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6088 00010000:00010000:3.0:1746155567.414078:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.414092:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.414097:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.414102:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.414107:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a065be00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155567.414109:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.414115:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.414123:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155567.414129:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a065be00/0x844e5faceb5eb94f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155567.414204:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1960:x1830976123762176:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 28453us (30320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.414211:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12070 00000100:00100000:0.0:1746155567.415903:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155567.415959:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123765376 00000100:00100000:1.0:1746155567.415965:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123765376 00000100:00100000:1.0:1746155567.416020:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10006 00000100:00100000:1.0:1746155567.416027:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:29166:x1830976123765376:12345-192.168.202.51@tcp:36:mirror_io.0 00010000:00010000:1.0:1746155567.416113:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155567.416154:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ecae00/0x844e5faceb5eb049 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109a4 expref: 20 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.416167:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155567.416170:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155567.416192:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155567.416202:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1099d expref: 26 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.416213:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.416218:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539cc00/0x844e5faceb5eb2cd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b10 expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.416224:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82dc00/0x844e5faceb5eb7c0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e51 expref: 319 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.416230:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5a00/0x844e5faceb5eb129 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a0d expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.416236:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb15a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a29 expref: 319 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.416243:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155567.416266:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb15a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a29 expref: 319 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.416275:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb15a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a29 expref: 319 pid: 19870 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.416286:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124584704:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155567.417419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155567.417524:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5a00/0x844e5faceb5eb129 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a0d expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.417537:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5a00/0x844e5faceb5eb129 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a0d expref: 26 pid: 15474 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.417545:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124584832:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155567.417874:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123765504 00000100:00100000:2.0:1746155567.417879:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123765504 00010000:00010000:2.0:1746155567.417897:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb15a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a29 expref: 320 pid: 19870 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.417917:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6089 00000100:00100000:2.0:1746155567.417922:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+320:1961:x1830976123765504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155567.417930:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155567.417934:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb15a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a29 expref: 320 pid: 19870 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.417942:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb15a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a29 expref: 320 pid: 19870 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.417956:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155567.417960:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155567.417966:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155567.417987:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+320:1961:x1830976123765504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 65us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.417992:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6089 00010000:00010000:1.0:1746155567.418164:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82dc00/0x844e5faceb5eb7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e51 expref: 319 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.418172:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82dc00/0x844e5faceb5eb7c0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e51 expref: 319 pid: 15474 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.418180:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124584960:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155567.418209:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539cc00/0x844e5faceb5eb2cd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b10 expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.418215:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539cc00/0x844e5faceb5eb2cd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b10 expref: 26 pid: 15474 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.418221:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124585088:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155567.418239:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.418245:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 26 pid: 27374 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.418250:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124585216:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155567.418270:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1099d expref: 26 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155567.418276:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1099d expref: 26 pid: 19870 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.418282:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124585344:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155567.418295:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5010c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746155567.418313:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb15a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a29 expref: 319 pid: 19870 timeout: 796 lvb_type: 0 00000100:00100000:1.0:1746155567.418325:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124584704:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155567.419356:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124584832:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155567.419536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155567.423097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155567.423120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155567.423135:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123765888 00000100:00100000:1.0:1746155567.423140:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123765888 00000100:00100000:1.0:1746155567.423165:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123766144 00000100:00100000:1.0:1746155567.423166:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123766144 00000100:00100000:1.0:1746155567.423178:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4035 00000100:00100000:1.0:1746155567.423184:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+319:27128:x1830976123765888:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746155567.423347:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+320:27128:x1830976123765888:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 162us (254us total) trans 8589943949 rc 0/0 00000100:00100000:1.0:1746155567.423354:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4035 00000100:00100000:1.0:1746155567.423367:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4036 00000100:00100000:1.0:1746155567.423372:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+27:27129:x1830976123766144:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746155567.423430:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+28:27129:x1830976123766144:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 57us (308us total) trans 8589943950 rc 0/0 00000100:00100000:1.0:1746155567.423435:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4036 00000100:00100000:1.0:1746155567.423460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.423601:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124584960:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155567.423611:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124585088:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155567.423618:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124585216:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155567.423784:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155567.423912:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123765632 00000100:00100000:2.0:1746155567.423916:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123765632 00010000:00010000:2.0:1746155567.423936:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5a00/0x844e5faceb5eb129 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a0d expref: 28 pid: 15474 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.423954:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123766272 00000100:00100000:2.0:1746155567.423956:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123766272 00010000:00010000:2.0:1746155567.423965:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 29 pid: 27374 timeout: 796 lvb_type: 0 00000100:00100000:2.0:1746155567.423983:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6090 00000100:00100000:2.0:1746155567.423988:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123765632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155567.423997:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155567.424001:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5a00/0x844e5faceb5eb129 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a0d expref: 29 pid: 15474 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.424011:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5a00/0x844e5faceb5eb129 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a0d expref: 29 pid: 15474 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.424027:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130cb5a00/0x844e5faceb5eb129 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10a0d expref: 29 pid: 15474 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.424038:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155567.424042:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155567.424049:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155567.424076:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123765632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 88us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.424082:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6090 00000100:00100000:2.0:1746155567.424092:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6091 00000100:00100000:2.0:1746155567.424102:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123766272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155567.424108:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155567.424112:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 27 pid: 27374 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.424124:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 27 pid: 27374 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.424139:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5eb050 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f109ab expref: 27 pid: 27374 timeout: 796 lvb_type: 0 00010000:00010000:2.0:1746155567.424146:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155567.424149:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155567.424154:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155567.424168:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123766272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 70us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.424172:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6091 00000100:00100000:0.0:1746155567.424236:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124585344:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155567.424263:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155567.424311:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123766400 00000100:00100000:3.0:1746155567.424315:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123766400 00010000:00010000:3.0:1746155567.424330:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1099d expref: 26 pid: 19870 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746155567.424352:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6092 00000100:00100000:3.0:1746155567.424357:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d758450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1961:x1830976123766400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155567.424363:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155567.424367:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1099d expref: 26 pid: 19870 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.424374:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1099d expref: 26 pid: 19870 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.424384:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5eb042 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1099d expref: 26 pid: 19870 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.424392:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155567.424395:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155567.424400:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155567.424753:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d758450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123766400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 394us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.424763:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6092 00000100:00100000:0.0:1746155567.427967:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.428004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155567.428069:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123766656 00000100:00100000:3.0:1746155567.428076:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123766656 00010000:00010000:3.0:1746155567.428101:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82dc00/0x844e5faceb5eb7c0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e51 expref: 320 pid: 15474 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746155567.428118:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123766528 00000100:00100000:3.0:1746155567.428120:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123766528 00010000:00010000:3.0:1746155567.428127:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539cc00/0x844e5faceb5eb2cd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b10 expref: 25 pid: 15474 timeout: 796 lvb_type: 0 00000100:00100000:3.0:1746155567.428138:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6093 00000100:00100000:3.0:1746155567.428143:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+320:1960:x1830976123766656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155567.428152:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155567.428156:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82dc00/0x844e5faceb5eb7c0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e51 expref: 320 pid: 15474 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.428165:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82dc00/0x844e5faceb5eb7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e51 expref: 320 pid: 15474 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.428180:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82dc00/0x844e5faceb5eb7c0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10e51 expref: 320 pid: 15474 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.428193:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155567.428196:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155567.428202:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155567.428248:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+319:1960:x1830976123766656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 104us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.428254:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6093 00000100:00100000:3.0:1746155567.428266:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6094 00000100:00100000:3.0:1746155567.428271:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123766528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155567.428276:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155567.428279:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539cc00/0x844e5faceb5eb2cd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b10 expref: 25 pid: 15474 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.428286:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539cc00/0x844e5faceb5eb2cd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b10 expref: 25 pid: 15474 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.428295:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a539cc00/0x844e5faceb5eb2cd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10b10 expref: 25 pid: 15474 timeout: 796 lvb_type: 0 00010000:00010000:3.0:1746155567.428303:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155567.428306:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155567.428311:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155567.428317:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155567.428333:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155567.428347:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123766528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 76us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155567.428351:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6094 00010000:00010000:0.0:1746155567.428522:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155567.428529:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000040:00080000:0.0:1746155567.429017:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2881, 88 off240912 00000004:00080000:0.0:1746155567.429022:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696578519022ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155567.429175:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2825, 88 off235712 00000004:00080000:0.0:1746155567.429179:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696578675876ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155567.429371:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2826, 88 off235800 00000004:00080000:0.0:1746155567.429375:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696578872454ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155567.429383:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2882, 88 off241000 00000004:00080000:0.0:1746155567.429385:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696578882032ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155567.429548:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2883, 88 off241088 00000004:00080000:0.0:1746155567.429552:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696579048949ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155567.429559:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2827, 88 off235888 00000004:00080000:0.0:1746155567.429561:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696579057696ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155567.429567:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2828, 88 off235976 00000004:00080000:0.0:1746155567.429569:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696579066295ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155567.429574:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2829, 88 off236064 00000004:00080000:0.0:1746155567.429576:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696579073525ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155567.429592:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2884, 88 off241176 00000004:00080000:0.0:1746155567.429594:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696579091206ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155567.429599:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2830, 88 off236152 00000004:00080000:0.0:1746155567.429601:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696579098379ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155567.429606:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2885, 88 off241264 00000004:00080000:0.0:1746155567.429608:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696579105520ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155567.429613:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2831, 88 off236240 00000004:00080000:0.0:1746155567.429615:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696579112394ns, next at 645866785986ns, rc = 0 00000040:00080000:0.0:1746155567.429620:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2886, 88 off241352 00000004:00080000:0.0:1746155567.429622:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696579118950ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155567.429627:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2887, 88 off241440 00000004:00080000:0.0:1746155567.429629:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696579125994ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155567.429634:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2888, 88 off241528 00000004:00080000:0.0:1746155567.429636:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696579132766ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155567.429640:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2889, 88 off241616 00000004:00080000:0.0:1746155567.429642:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 696579139294ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155567.429647:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2832, 88 off236328 00000004:00080000:0.0:1746155567.429649:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 696579146089ns, next at 645866785986ns, rc = 0 00000001:00080000:0.0:1746155567.449659:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943951 is committed 00000004:00080000:0.0:1746155567.449666:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2025 committed 00000004:00080000:0.0:1746155567.449673:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2088 committed 00000100:00100000:3.0:1746155567.449860:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124585856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155567.449909:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155567.449936:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124586368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155567.449950:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155567.449996:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124585472:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155567.450019:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124585728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155567.450642:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2087 committed 00000004:00080000:0.0:1746155567.450645:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2086 committed 00000004:00080000:0.0:1746155567.450647:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2085 committed 00000004:00080000:0.0:1746155567.450648:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2024 committed 00000004:00080000:0.0:1746155567.450649:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2084 committed 00000004:00080000:0.0:1746155567.450650:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2023 committed 00000004:00080000:0.0:1746155567.450652:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2083 committed 00000004:00080000:0.0:1746155567.450654:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2022 committed 00000004:00080000:0.0:1746155567.450655:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2021 committed 00000004:00080000:0.0:1746155567.450656:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2020 committed 00000004:00080000:0.0:1746155567.450657:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2082 committed 00000004:00080000:0.0:1746155567.450659:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2081 committed 00000004:00080000:0.0:1746155567.450661:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2019 committed 00000004:00080000:0.0:1746155567.450662:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2018 committed 00000004:00080000:0.0:1746155567.450675:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2080 committed 00000001:00080000:0.0:1746155567.450686:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943933 is committed 00000001:00080000:0.0:1746155567.450699:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943950 is committed 00000001:00080000:0.0:1746155567.450704:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943949 is committed 00000100:00100000:0.0:1746155567.450812:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124585600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155567.451243:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155567.451258:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124585856 00000100:00100000:0.0:1746155567.451264:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124585856 00000100:00100000:0.0:1746155567.451303:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124586368 00000100:00100000:0.0:1746155567.451305:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124586368 00000100:00100000:0.0:1746155567.451319:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12071 00000100:00100000:0.0:1746155567.451324:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3297:x1830976124585856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155567.451535:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3297:x1830976124585856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (1624us total) trans 17179873186 rc 0/0 00000100:00100000:0.0:1746155567.451541:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12071 00000100:00100000:0.0:1746155567.451555:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12072 00000100:00100000:0.0:1746155567.451560:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3297:x1830976124586368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155567.451654:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3297:x1830976124586368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (1702us total) trans 17179873187 rc 0/0 00000100:00100000:0.0:1746155567.451659:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12072 00000100:00080000:0.0:1746155567.451674:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00010000:1.0:1746155567.451762:0:20364:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012fef2a00 reply state ffff88012ef78c00 transno 8589943951 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155567.451771:0:20364:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746155567.451828:0:20364:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746155567.451839:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29166:x1830976123765376:12345-192.168.202.51@tcp:36:mirror_io.0 Request processed in 35811us (35938us total) trans 8589943951 rc 0/0 00000100:00100000:1.0:1746155567.451846:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10006 00010000:00010000:1.0:1746155567.451868:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155567.451875:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155567.451880:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155567.451886:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a065b400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155567.451889:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155567.451895:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155567.451908:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155567.451910:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155567.451914:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155567.451918:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a065b400/0x844e5faceb5eb956 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155567.452949:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124586240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155567.452975:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155567.452991:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124586752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155567.453004:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155567.453013:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124587264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155567.453022:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155567.453030:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746155567.453033:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124586624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155567.453043:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155567.453051:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124587136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155567.453060:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155567.453151:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155567.453178:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124586112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155567.453194:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155567.453307:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124585728 00000100:00100000:1.0:1746155567.453312:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124585728 00000100:00100000:1.0:1746155567.453336:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124586240 00000100:00100000:1.0:1746155567.453338:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124586240 00000100:00100000:1.0:1746155567.453346:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124586752 00000100:00100000:1.0:1746155567.453348:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124586752 00000100:00100000:1.0:1746155567.453363:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124587264 00000100:00100000:1.0:1746155567.453365:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124587264 00000100:00100000:1.0:1746155567.453373:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124586624 00000100:00100000:1.0:1746155567.453375:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124586624 00000100:00100000:1.0:1746155567.453380:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124587136 00000100:00100000:1.0:1746155567.453381:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124587136 00000100:00100000:1.0:1746155567.453387:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124585600 00000100:00100000:1.0:1746155567.453389:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124585600 00000100:00100000:1.0:1746155567.453394:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124586112 00000100:00100000:1.0:1746155567.453396:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124586112 00000100:00100000:1.0:1746155567.453403:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12073 00000100:00100000:1.0:1746155567.453408:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3296:x1830976124585728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155567.453553:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976124585728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (2310us total) trans 17179873188 rc 0/0 00000100:00100000:1.0:1746155567.453559:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12073 00000100:00100000:1.0:1746155567.453570:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12074 00000100:00100000:1.0:1746155567.453575:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3296:x1830976124586240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155567.453667:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976124586240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (691us total) trans 17179873189 rc 0/0 00000100:00100000:1.0:1746155567.453675:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12074 00000100:00100000:1.0:1746155567.453684:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12075 00000100:00100000:1.0:1746155567.453689:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3296:x1830976124586752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155567.453783:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3296:x1830976124586752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (778us total) trans 21474840566 rc 0/0 00000100:00100000:1.0:1746155567.453788:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12075 00000100:00100000:1.0:1746155567.453797:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12076 00000100:00100000:1.0:1746155567.453801:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3296:x1830976124587264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155567.453907:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3296:x1830976124587264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (883us total) trans 21474840567 rc 0/0 00000100:00100000:1.0:1746155567.453912:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12076 00000100:00100000:1.0:1746155567.453921:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12077 00000100:00100000:1.0:1746155567.453925:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3296:x1830976124586624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155567.453998:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3296:x1830976124586624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (953us total) trans 21474840568 rc 0/0 00000100:00100000:1.0:1746155567.454003:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12077 00000100:00100000:1.0:1746155567.454012:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12078 00000100:00100000:1.0:1746155567.454016:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3296:x1830976124587136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155567.454087:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3296:x1830976124587136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1025us total) trans 21474840569 rc 0/0 00000100:00100000:1.0:1746155567.454092:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12078 00000100:00100000:1.0:1746155567.454101:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12079 00000100:00100000:1.0:1746155567.454104:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3295:x1830976124585600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155567.454183:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3295:x1830976124585600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (1031us total) trans 17179873190 rc 0/0 00000100:00100000:1.0:1746155567.454188:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12079 00000100:00100000:1.0:1746155567.454197:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12080 00000100:00100000:1.0:1746155567.454201:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3295:x1830976124586112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155567.454274:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3295:x1830976124586112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (1078us total) trans 17179873191 rc 0/0 00000100:00100000:1.0:1746155567.454279:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12080 00000100:00100000:3.0:1746155567.454552:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155567.454602:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124585984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155567.454621:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155567.454637:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124586496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155567.454650:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155567.454659:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124587008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155567.454670:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155567.454680:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746155567.454685:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124586880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155567.454697:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155567.454705:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124587392:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155567.454716:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155567.454731:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124585472 00000100:00100000:3.0:1746155567.454735:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124585472 00000100:00100000:3.0:1746155567.454750:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124585984 00000100:00100000:3.0:1746155567.454752:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124585984 00000100:00100000:3.0:1746155567.454759:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124586496 00000100:00100000:3.0:1746155567.454760:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124586496 00000100:00100000:3.0:1746155567.454766:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124587008 00000100:00100000:3.0:1746155567.454768:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124587008 00000100:00100000:3.0:1746155567.454773:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124586880 00000100:00100000:3.0:1746155567.454774:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124586880 00000100:00100000:3.0:1746155567.454780:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124587392 00000100:00100000:3.0:1746155567.454781:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124587392 00000100:00100000:3.0:1746155567.454788:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12081 00000100:00100000:3.0:1746155567.454792:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976124585472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155567.454883:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124585472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (330us total) trans 17179873192 rc 0/0 00000100:00100000:3.0:1746155567.454888:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12081 00000100:00100000:3.0:1746155567.454900:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12082 00000100:00100000:3.0:1746155567.454904:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976124585984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155567.454994:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124585984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (372us total) trans 17179873193 rc 0/0 00000100:00100000:3.0:1746155567.454999:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12082 00000100:00100000:3.0:1746155567.455008:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12083 00000100:00100000:3.0:1746155567.455011:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976124586496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155567.455085:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124586496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (434us total) trans 21474840570 rc 0/0 00000100:00100000:3.0:1746155567.455092:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12083 00000100:00100000:3.0:1746155567.455100:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12084 00000100:00100000:3.0:1746155567.455104:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976124587008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155567.455172:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124587008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (500us total) trans 21474840571 rc 0/0 00000100:00100000:3.0:1746155567.455177:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12084 00000100:00100000:3.0:1746155567.455185:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12085 00000100:00100000:3.0:1746155567.455189:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976124586880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155567.455281:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:3.0:1746155567.455284:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155567.455286:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746155567.455288:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155567.455290:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:3.0:1746155567.455307:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124586880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (609us total) trans 21474840572 rc 0/0 00000100:00100000:3.0:1746155567.455312:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12085 00000100:00100000:3.0:1746155567.455320:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12086 00000100:00100000:3.0:1746155567.455324:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976124587392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155567.455391:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124587392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (673us total) trans 21474840573 rc 0/0 00000100:00100000:3.0:1746155567.455396:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12086 00000004:00080000:3.0:1746155567.455421:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ff19180/2, rc 0, transno 21474840572 00000100:00100000:3.0:1746155567.455428:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124586880:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155567.455435:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c32a00/2, rc 0, transno 21474840573 00000100:00100000:3.0:1746155567.455438:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124587392:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155567.455444:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fe8d180/2, rc 0, transno 21474840570 00000100:00100000:3.0:1746155567.455446:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124586496:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155567.455451:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ff19f80/2, rc 0, transno 21474840571 00000100:00100000:3.0:1746155567.455454:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124587008:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155567.455461:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6062680/2, rc 0, transno 17179873192 00000100:00100000:3.0:1746155567.455464:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124585472:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155567.455470:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800944ac000/2, rc 0, transno 17179873193 00000100:00100000:3.0:1746155567.455473:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124585984:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155567.455489:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800944af800/2, rc 0, transno 17179873187 00000100:00100000:3.0:1746155567.455491:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124586368:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155567.455517:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800944ac700/2, rc 0, transno 17179873186 00000100:00100000:3.0:1746155567.455520:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124585856:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155567.455534:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fe8f480/2, rc 0, transno 21474840568 00000100:00100000:3.0:1746155567.455536:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124586624:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155567.455543:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c30e00/2, rc 0, transno 21474840569 00000100:00100000:3.0:1746155567.455545:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124587136:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155567.455550:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fe8c000/2, rc 0, transno 21474840566 00000100:00100000:3.0:1746155567.455552:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124586752:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155567.455556:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c31c00/2, rc 0, transno 21474840567 00000100:00100000:3.0:1746155567.455558:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124587264:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155567.455564:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c28d180/2, rc 0, transno 17179873188 00000100:00100000:3.0:1746155567.455566:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124585728:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155567.455571:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800944ae300/2, rc 0, transno 17179873189 00000100:00100000:3.0:1746155567.455573:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124586240:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746155567.456059:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746155567.456080:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6061180/2, rc 0, transno 17179873190 00000100:00100000:0.0:1746155567.456084:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124585600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155567.456090:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800944ac380/2, rc 0, transno 17179873191 00000100:00100000:0.0:1746155567.456093:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124586112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155567.456208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.456373:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123766784 00000100:00100000:0.0:1746155567.456377:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123766784 00000100:00100000:0.0:1746155567.456410:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10007 00000100:00100000:0.0:1746155567.456415:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29166:x1830976123766784:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155567.456428:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155567.456441:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb95d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f69 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.456481:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb95d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f69 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.456492:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb95d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f69 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155567.456529:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155567.456532:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155567.456534:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3ba00, rc 0) 00000100:00100000:0.0:1746155567.456562:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29166:x1830976123766784:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 147us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.456570:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10007 00000100:00100000:3.0:1746155567.458178:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124587520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155567.458216:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155567.458392:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124587520 00000100:00100000:1.0:1746155567.458396:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124587520 00000100:00100000:1.0:1746155567.458416:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12087 00000100:00100000:1.0:1746155567.458421:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124587520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155567.458605:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3298:x1830976124587520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (388us total) trans 21474840574 rc 0/0 00000100:00100000:1.0:1746155567.458611:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12087 00000100:00100000:0.0:1746155567.458948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000004:00080000:3.0:1746155567.459229:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c32d80/2, rc 0, transno 21474840574 00000100:00100000:3.0:1746155567.459235:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124587520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155567.459748:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123766912 00000100:00100000:2.0:1746155567.459752:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123766912 00000100:00100000:2.0:1746155567.459782:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10008 00000100:00100000:2.0:1746155567.459787:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29166:x1830976123766912:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155567.459797:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155567.459810:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb964 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f70 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.459860:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb96b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.459871:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb96b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.459879:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb96b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155567.459898:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155567.459901:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155567.459913:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb96b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155567.459929:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb964 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f70 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.459953:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb96b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f70 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.459960:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155567.459962:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155567.459964:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0000, rc 0) 00000100:00100000:2.0:1746155567.459991:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29166:x1830976123766912:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 204us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.459996:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10008 00000100:00100000:0.0:1746155567.472741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.472771:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.472782:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.472791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.472802:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.472858:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155567.472876:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123767040 00000100:00100000:0.0:1746155567.472886:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123767040 00000100:00100000:0.0:1746155567.472912:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123767296 00000100:00100000:0.0:1746155567.472913:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123767296 00000100:00100000:0.0:1746155567.472922:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123767552 00000100:00100000:0.0:1746155567.472924:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123767552 00000100:00100000:0.0:1746155567.472931:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123767168 00000100:00100000:0.0:1746155567.472932:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123767168 00000100:00100000:0.0:1746155567.472939:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123767424 00000100:00100000:0.0:1746155567.472940:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123767424 00000100:00100000:2.0:1746155567.472944:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123767680 00000100:00100000:2.0:1746155567.472949:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123767680 00000100:00100000:0.0:1746155567.472954:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12088 00000100:00100000:0.0:1746155567.472959:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123767040:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:2.0:1746155567.472968:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12089 00010000:00010000:0.0:1746155567.472972:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155567.472973:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123767296:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155567.472981:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155567.472987:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5eb972 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f77 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155567.472991:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb979 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f85 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155567.473005:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x6814382f, atime: 0x6814382f, ctime: 0x6814382f, blocks: 0x765 00002000:00010000:2.0:1746155567.473006:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3db:0x0] initial LVB size: 2097152, mtime: 0x6814382f, atime: 0x6814382f, ctime: 0x6814382f, blocks: 0x821 00010000:00010000:2.0:1746155567.473017:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155567.473017:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.473019:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155567.473019:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155567.473026:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb979 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f85 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155567.473026:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5eb972 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f77 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.473037:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb979 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f85 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155567.473037:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5eb972 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f77 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155567.473045:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1000, rc 0) 00010000:00010000:0.0:1746155567.473045:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801353a2000, rc 0) 00000100:00100000:0.0:1746155567.473086:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123767040:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 126us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.473090:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12088 00000100:00100000:0.0:1746155567.473104:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12090 00000100:00100000:0.0:1746155567.473108:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123767552:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155567.473113:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155567.473121:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801353a2a00/0x844e5faceb5eb980 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f93 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155567.473131:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d9:0x0] initial LVB size: 4954272, mtime: 0x6814382e, atime: 0x6814382e, ctime: 0x6814382d, blocks: 0x1613 00010000:00010000:0.0:1746155567.473138:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155567.473139:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155567.473143:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801353a2a00/0x844e5faceb5eb980 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f93 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155567.473151:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801353a2a00/0x844e5faceb5eb980 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f93 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155567.473157:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801353a2a00, rc 0) 00000100:00100000:3.0:1746155567.473316:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12091 00000100:00100000:3.0:1746155567.473323:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123767168:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155567.473329:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155567.473336:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5eb987 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f7e expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155567.473347:0:4461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3da:0x0] initial LVB size: 2097152, mtime: 0x6814382f, atime: 0x6814382f, ctime: 0x6814382f, blocks: 0x821 00010000:00010000:3.0:1746155567.473359:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.473360:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155567.473364:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5eb987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f7e expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.473372:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5eb987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f7e expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155567.473377:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374c400, rc 0) 00000100:00100000:1.0:1746155567.473414:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12092 00000100:00100000:1.0:1746155567.473420:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123767424:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155567.473426:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155567.473433:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090013200/0x844e5faceb5eb98e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f8c expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155567.473443:0:29728:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x6814382f, atime: 0x6814382e, ctime: 0x6814382f, blocks: 0x821 00010000:00010000:1.0:1746155567.473450:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155567.473451:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155567.473455:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090013200/0x844e5faceb5eb98e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f8c expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155567.473473:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090013200/0x844e5faceb5eb98e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f8c expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155567.473483:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090013200, rc 0) 00000100:00100000:2.0:1746155567.473589:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123767296:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 613us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155567.473595:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12089 00000100:00100000:0.0:1746155567.473609:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123767552:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 499us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.473621:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12090 00000100:00100000:0.0:1746155567.473633:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12093 00000100:00100000:0.0:1746155567.473638:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123767680:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:3.0:1746155567.473640:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123767168:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 319us (847us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155567.473643:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155567.473647:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12091 00010000:00010000:0.0:1746155567.473650:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb995 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10f9a expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155567.473659:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3dc:0x0] initial LVB size: 4194304, mtime: 0x6814382e, atime: 0x6814382e, ctime: 0x6814382e, blocks: 0x1029 00010000:00010000:0.0:1746155567.473666:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155567.473667:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155567.473670:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb995 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f9a expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155567.473679:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb995 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f9a expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155567.473685:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130cb4400, rc 0) 00000100:00100000:0.0:1746155567.473699:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123767680:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 61us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155567.473703:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12093 00000100:00100000:1.0:1746155567.473824:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123767424:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 403us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155567.473829:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12092 00010000:00010000:2.0:1746155568.110709:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155568.495137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155568.496820:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123767936 00000100:00100000:1.0:1746155568.496831:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123767936 00000100:00100000:1.0:1746155568.496910:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4634 00000100:00100000:1.0:1746155568.496918:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123767936:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:1.0:1746155568.496949:0:25391:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb99c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.496961:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155568.496963:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155568.496968:0:25391:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb99c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.496980:0:25391:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb99c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746155568.499269:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155568.500398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.500640:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123768448 00000100:00100000:0.0:1746155568.500648:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123768448 00000100:00100000:2.0:1746155568.500794:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.502099:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123768704 00000100:00100000:0.0:1746155568.502105:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123768704 00000100:00100000:2.0:1746155568.502353:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4635 00000100:00100000:2.0:1746155568.502361:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123768448:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:2.0:1746155568.502393:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb9a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.502406:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155568.502407:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155568.502411:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb9a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.502426:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb9a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155568.503223:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4636 00000100:00100000:0.0:1746155568.503231:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123768704:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:0.0:1746155568.503247:0:2798:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094fa5e00/0x844e5faceb5eb9aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.503255:0:2798:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155568.503256:0:2798:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155568.503260:0:2798:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fa5e00/0x844e5faceb5eb9aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.503268:0:2798:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fa5e00/0x844e5faceb5eb9aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155568.507800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.510024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.510054:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123768192 00000100:00100000:2.0:1746155568.510061:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123768192 00000100:00100000:2.0:1746155568.510128:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123768832 00000100:00100000:2.0:1746155568.510131:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123768832 00000100:00100000:2.0:1746155568.510152:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4637 00000100:00100000:2.0:1746155568.510160:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123768192:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:2.0:1746155568.510190:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc800/0x844e5faceb5eb9b1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.510203:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155568.510204:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155568.510209:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc800/0x844e5faceb5eb9b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.510221:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc800/0x844e5faceb5eb9b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155568.510500:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4638 00000100:00100000:1.0:1746155568.510521:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123768832:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:1.0:1746155568.510538:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800acd44e00/0x844e5faceb5eb9b8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.510545:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155568.510547:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155568.510549:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd44e00/0x844e5faceb5eb9b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.510557:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd44e00/0x844e5faceb5eb9b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746155568.511656:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155568.511826:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.511840:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.511856:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.511882:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123769216 00000100:00100000:0.0:1746155568.511886:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123769216 00000100:00100000:0.0:1746155568.511909:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123769472 00000100:00100000:0.0:1746155568.511911:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123769472 00000100:00100000:0.0:1746155568.511928:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123769728 00000100:00100000:0.0:1746155568.511930:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123769728 00000100:00100000:0.0:1746155568.511942:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4639 00000100:00100000:0.0:1746155568.511948:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1962:x1830976123769216:12345-192.168.202.51@tcp:3:mirror_io.0 00000100:00100000:1.0:1746155568.511963:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4640 00010000:00010000:0.0:1746155568.511963:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094fa4e00/0x844e5faceb5eb9bf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155568.511971:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1962:x1830976123769472:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:0.0:1746155568.511971:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155568.511973:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155568.511976:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fa4e00/0x844e5faceb5eb9bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.511985:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fa4e00/0x844e5faceb5eb9bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.511988:0:31253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eb9c6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.512000:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155568.512002:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155568.512005:0:31253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eb9c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.512013:0:31253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eb9c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155568.512345:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4641 00000100:00100000:0.0:1746155568.512350:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1963:x1830976123769728:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:0.0:1746155568.512361:0:10888:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095144400/0x844e5faceb5eb9cd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.512367:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155568.512368:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155568.512371:0:10888:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095144400/0x844e5faceb5eb9cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.512377:0:10888:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095144400/0x844e5faceb5eb9cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.541445:0:25391:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb99c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.541460:0:25391:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb99c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.541468:0:25391:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb99c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.541475:0:25391:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800909e7c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155568.541479:0:25391:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb99c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.541486:0:25391:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb99c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.541519:0:25391:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb99c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.541525:0:25391:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909e7c00/0x844e5faceb5eb99c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155568.541615:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1962:x1830976123767936:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 44694us (46481us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.541625:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4634 00010000:00010000:1.0:1746155568.550918:0:2798:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094fa5e00/0x844e5faceb5eb9aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.550933:0:2798:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094fa5e00/0x844e5faceb5eb9aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.550941:0:2798:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094fa5e00/0x844e5faceb5eb9aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.550946:0:2798:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fa5e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155568.550949:0:2798:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094fa5e00/0x844e5faceb5eb9aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.550957:0:2798:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094fa5e00/0x844e5faceb5eb9aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.550971:0:2798:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094fa5e00/0x844e5faceb5eb9aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.550977:0:2798:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fa5e00/0x844e5faceb5eb9aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155568.551050:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1963:x1830976123768704:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 47816us (50252us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.551059:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4636 00010000:00010000:0.0:1746155568.553315:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb9a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.553328:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb9a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.553334:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb9a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.553344:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb1e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155568.553347:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb9a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.553353:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb9a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.553365:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb9a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.553370:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5eb9a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155568.553441:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123768448:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 51078us (53045us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155568.553449:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4635 00010000:00010000:3.0:1746155568.560485:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc800/0x844e5faceb5eb9b1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.560500:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc800/0x844e5faceb5eb9b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.560531:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc800/0x844e5faceb5eb9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.560537:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcbc800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155568.560540:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc800/0x844e5faceb5eb9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.560546:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc800/0x844e5faceb5eb9b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.560560:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc800/0x844e5faceb5eb9b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.560566:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcbc800/0x844e5faceb5eb9b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155568.560649:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1962:x1830976123768192:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 50485us (52853us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155568.560658:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4637 00010000:00010000:1.0:1746155568.569795:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800acd44e00/0x844e5faceb5eb9b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.569809:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd44e00/0x844e5faceb5eb9b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.569817:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800acd44e00/0x844e5faceb5eb9b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.569823:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acd44e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155568.569827:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800acd44e00/0x844e5faceb5eb9b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.569833:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800acd44e00/0x844e5faceb5eb9b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.569849:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800acd44e00/0x844e5faceb5eb9b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.569855:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd44e00/0x844e5faceb5eb9b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155568.569939:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976123768832:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 59416us (59917us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.569949:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4638 00010000:00010000:2.0:1746155568.574729:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eb9c6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.574744:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eb9c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.574757:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eb9c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.574762:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3a800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155568.574765:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eb9c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.574771:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eb9c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.574786:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eb9c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.574791:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5eb9c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155568.574883:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123769472:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 62909us (63037us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155568.574892:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4640 00010000:00010000:2.0:1746155568.580129:0:10888:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095144400/0x844e5faceb5eb9cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.580143:0:10888:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095144400/0x844e5faceb5eb9cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.580149:0:10888:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095144400/0x844e5faceb5eb9cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.580156:0:10888:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095144400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155568.580160:0:10888:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095144400/0x844e5faceb5eb9cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.580166:0:10888:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095144400/0x844e5faceb5eb9cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.580181:0:10888:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095144400/0x844e5faceb5eb9cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.580187:0:10888:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095144400/0x844e5faceb5eb9cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155568.580265:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123769728:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 67910us (68403us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155568.580273:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4641 00010000:00010000:1.0:1746155568.580643:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094fa4e00/0x844e5faceb5eb9bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.580651:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094fa4e00/0x844e5faceb5eb9bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.580656:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094fa4e00/0x844e5faceb5eb9bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.580660:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fa4e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155568.580663:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094fa4e00/0x844e5faceb5eb9bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.580668:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094fa4e00/0x844e5faceb5eb9bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.580677:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094fa4e00/0x844e5faceb5eb9bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.580686:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fa4e00/0x844e5faceb5eb9bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155568.580726:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123769216:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 68778us (68902us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.580733:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4639 00000100:00100000:2.0:1746155568.598037:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.598565:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123769856 00000100:00100000:0.0:1746155568.598581:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123769856 00000100:00100000:0.0:1746155568.598630:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 586 00000100:00100000:0.0:1746155568.598637:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29166:x1830976123769856:12345-192.168.202.51@tcp:103:mirror_io.0 00010000:00010000:0.0:1746155568.598650:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155568.598670:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5eb91e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f62 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.598697:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155568.598701:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155568.598741:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29166:x1830976123769856:12345-192.168.202.51@tcp:103:mirror_io.0 Request processed in 104us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155568.598747:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 586 00000100:00100000:0.0:1746155568.599922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155568.599998:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123770112 00000100:00100000:3.0:1746155568.600002:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123770112 00000100:00100000:3.0:1746155568.600599:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4037 00000100:00100000:3.0:1746155568.600607:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29166:x1830976123770112:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:3.0:1746155568.600811:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29166:x1830976123770112:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 206us (891us total) trans 8589943952 rc 0/0 00000100:00100000:3.0:1746155568.600817:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4037 00000100:00100000:0.0:1746155568.603246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155568.603316:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123770368 00000100:00100000:3.0:1746155568.603322:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123770368 00000100:00100000:3.0:1746155568.603349:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4038 00000100:00100000:3.0:1746155568.603354:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29166:x1830976123770368:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:3.0:1746155568.603535:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29166:x1830976123770368:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 179us (293us total) trans 8589943953 rc 0/0 00000100:00100000:3.0:1746155568.603542:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4038 00000100:00100000:0.0:1746155568.626228:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.626389:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123770624 00000100:00100000:2.0:1746155568.626398:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123770624 00000100:00100000:2.0:1746155568.626467:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10009 00000100:00100000:2.0:1746155568.626475:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+285:29177:x1830976123770624:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155568.626495:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155568.626536:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44ec00/0x844e5faceb5eb9d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10fa1 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746155568.626620:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746155568.626633:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44fa00/0x844e5faceb5eb9db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626652:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44fa00/0x844e5faceb5eb9db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626662:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44fa00/0x844e5faceb5eb9db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626674:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eb9e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626679:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eb9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626683:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eb9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626773:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f63000/0x844e5faceb5eb9e9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626781:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f63000/0x844e5faceb5eb9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626786:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f63000/0x844e5faceb5eb9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155568.626793:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155568.626858:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44fa00/0x844e5faceb5eb9db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626864:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44fa00/0x844e5faceb5eb9db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626869:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44fa00/0x844e5faceb5eb9db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626877:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b44fa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155568.626880:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44fa00/0x844e5faceb5eb9db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626885:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44fa00/0x844e5faceb5eb9db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626893:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155568.626896:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155568.626899:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44fa00/0x844e5faceb5eb9db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626904:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44fa00/0x844e5faceb5eb9db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626928:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eb9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626932:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eb9e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626936:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eb9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626940:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b44f000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155568.626942:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eb9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626946:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eb9e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626951:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9a00) 00010000:00010000:2.0:1746155568.626953:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155568.626955:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eb9e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626959:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eb9e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155568.626989:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44ec00/0x844e5faceb5eb9d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa1 expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.626999:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f63000/0x844e5faceb5eb9e9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa1 expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.627004:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155568.627006:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155568.627008:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f63000, rc 0) 00000100:00100000:2.0:1746155568.629667:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29177:x1830976123770624:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3183us (3438us total) trans 8589943954 rc 0/0 00000100:00100000:2.0:1746155568.629677:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10009 00000100:00100000:0.0:1746155568.641008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.641059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155568.641113:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123770880 00000100:00100000:3.0:1746155568.641120:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123770880 00000100:00100000:2.0:1746155568.641132:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123771136 00000100:00100000:2.0:1746155568.641136:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123771136 00000100:00100000:3.0:1746155568.641155:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10010 00000100:00100000:2.0:1746155568.641160:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10011 00000100:00100000:3.0:1746155568.641161:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+6:29181:x1830976123770880:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155568.641166:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29180:x1830976123771136:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155568.641180:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155568.641180:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155568.641193:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fab600/0x844e5faceb5eb9f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10fa8 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.641193:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62400/0x844e5faceb5eb9fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10faf expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.641261:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62200/0x844e5faceb5eba05 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155568.641268:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374dc00/0x844e5faceb5eba0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155568.641271:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62200/0x844e5faceb5eba05 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155568.641274:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009374dc00/0x844e5faceb5eba0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.641280:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009374dc00/0x844e5faceb5eba0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155568.641280:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62200/0x844e5faceb5eba05 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155568.641288:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155568.641290:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5eba13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.641295:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5eba13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.641299:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5eba13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.641359:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eba21 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.641364:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eba21 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.641369:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eba21 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155568.641374:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155568.641377:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62400/0x844e5faceb5eb9fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10faf expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.641396:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62200/0x844e5faceb5eba05 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10faf expref: 289 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.641402:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155568.641405:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746155568.641407:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f62200, rc 0) 00000100:00100000:2.0:1746155568.641457:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29180:x1830976123771136:12345-192.168.202.51@tcp:101:cat.0 Request processed in 291us (397us total) trans 8589943955 rc 0/0 00000100:00100000:2.0:1746155568.641463:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10011 00010000:00010000:3.0:1746155568.642604:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374dc00/0x844e5faceb5eba0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.642612:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009374dc00/0x844e5faceb5eba0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.642617:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009374dc00/0x844e5faceb5eba0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.642622:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009374dc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155568.642624:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009374dc00/0x844e5faceb5eba0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.642629:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009374dc00/0x844e5faceb5eba0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.642638:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155568.642640:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155568.642643:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009374dc00/0x844e5faceb5eba0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.642647:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374dc00/0x844e5faceb5eba0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.643792:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5eba13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.643800:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5eba13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.643805:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5eba13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.643810:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0db3000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155568.643812:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5eba13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.643817:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5eba13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.643825:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009c823800) 00010000:00010000:3.0:1746155568.643827:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155568.643830:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5eba13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.643834:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5eba13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155568.643878:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fab600/0x844e5faceb5eb9f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa8 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.643890:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eba21 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa8 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.643896:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155568.643898:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155568.643900:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd5000, rc 0) 00000100:00100000:3.0:1746155568.645122:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29181:x1830976123770880:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3954us (4113us total) trans 8589943956 rc 0/0 00000100:00100000:3.0:1746155568.645130:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10010 00000100:00100000:1.0:1746155568.645164:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155568.645196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155568.645211:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123771264 00000100:00100000:1.0:1746155568.645217:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123771264 00000100:00100000:1.0:1746155568.645246:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123771392 00000100:00100000:1.0:1746155568.645248:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123771392 00000100:00100000:1.0:1746155568.645261:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12094 00000100:00100000:0.0:1746155568.645263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155568.645266:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123771264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155568.645279:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155568.645291:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc3ee00/0x844e5faceb5eba2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10fb6 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.645308:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155568.645310:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155568.645315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155568.645316:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc3ee00/0x844e5faceb5eba2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fb6 expref: 23 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.645328:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc3ee00/0x844e5faceb5eba2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fb6 expref: 23 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.645336:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc3ee00, rc 0) 00000100:00100000:0.0:1746155568.645341:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155568.645359:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123771264:12345-192.168.202.51@tcp:101:cat.0 Request processed in 92us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.645363:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12094 00000100:00100000:1.0:1746155568.645373:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123771520 00000100:00100000:1.0:1746155568.645375:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123771520 00000100:00100000:1.0:1746155568.645385:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123771648 00000100:00100000:1.0:1746155568.645386:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123771648 00000100:00100000:1.0:1746155568.645393:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123771776 00000100:00100000:1.0:1746155568.645395:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123771776 00000100:00100000:1.0:1746155568.645405:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12095 00000100:00100000:1.0:1746155568.645410:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123771392:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155568.645416:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155568.645425:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fa4800/0x844e5faceb5eba36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10fbd expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.645434:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155568.645435:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155568.645439:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fa4800/0x844e5faceb5eba36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fbd expref: 27 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.645448:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fa4800/0x844e5faceb5eba36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fbd expref: 27 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.645455:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fa4800, rc 0) 00000100:00100000:3.0:1746155568.645480:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12096 00000100:00100000:3.0:1746155568.645485:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123771520:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155568.645486:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12097 00010000:00010000:3.0:1746155568.645491:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155568.645494:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976123771648:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155568.645496:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5c00/0x844e5faceb5eba3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10fc4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.645513:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155568.645518:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.645519:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155568.645521:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eba44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10fcb expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.645523:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5c00/0x844e5faceb5eba3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fc4 expref: 28 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.645531:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5c00/0x844e5faceb5eba3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fc4 expref: 28 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155568.645534:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.645536:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd5c00, rc 0) 00010000:00010000:2.0:1746155568.645536:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155568.645541:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eba44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fcb expref: 25 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155568.645550:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eba44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fcb expref: 25 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155568.645558:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f62800, rc 0) 00000100:00100000:3.0:1746155568.646249:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123771520:12345-192.168.202.51@tcp:101:cat.0 Request processed in 762us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155568.646257:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12096 00000100:00100000:3.0:1746155568.646268:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12098 00000100:00100000:3.0:1746155568.646272:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123771776:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155568.646278:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155568.646284:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eba4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10fd2 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.646293:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155568.646293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155568.646294:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.646297:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eba4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd2 expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.646305:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eba4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd2 expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.646311:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4400, rc 0) 00000100:00100000:3.0:1746155568.646324:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123771776:12345-192.168.202.51@tcp:101:cat.0 Request processed in 52us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155568.646328:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12098 00000100:00100000:3.0:1746155568.646335:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123771904 00000100:00100000:3.0:1746155568.646338:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123771904 00000100:00100000:3.0:1746155568.646351:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12099 00000100:00100000:3.0:1746155568.646355:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123771904:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155568.646363:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155568.646368:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5eba52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10fd9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.646380:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00080000:0.0:1746155568.646380:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746155568.646381:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.646385:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5eba52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd9 expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00000100:00080000:0.0:1746155568.646385:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746155568.646393:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5eba52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd9 expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.646398:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4a00, rc 0) 00000100:00100000:3.0:1746155568.646413:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123771904:12345-192.168.202.51@tcp:101:cat.0 Request processed in 58us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155568.646417:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12099 00000100:00100000:1.0:1746155568.646498:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123771392:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1085us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.646516:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12095 00000100:00100000:2.0:1746155568.646587:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123771648:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1093us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155568.646592:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12097 00000100:00100000:0.0:1746155568.652732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.652769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.653063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.653306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.653416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.653442:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123772032 00000100:00100000:2.0:1746155568.653450:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123772032 00000100:00100000:1.0:1746155568.653580:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123772160 00000100:00100000:1.0:1746155568.653584:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123772160 00000100:00100000:2.0:1746155568.653628:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123772288 00000100:00100000:2.0:1746155568.653631:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123772288 00000100:00100000:0.0:1746155568.653828:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155568.653844:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123772416 00000100:00100000:3.0:1746155568.653847:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123772416 00000100:00100000:3.0:1746155568.653864:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123772544 00000100:00100000:3.0:1746155568.653866:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123772544 00000100:00100000:3.0:1746155568.653884:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12100 00000100:00100000:3.0:1746155568.653891:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123772032:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155568.653907:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155568.653921:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5a00/0x844e5faceb5eba59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10fe0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.653940:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.653942:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.653949:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5a00/0x844e5faceb5eba59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe0 expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.653965:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5a00/0x844e5faceb5eba59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe0 expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.653974:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd5a00, rc 0) 00000100:00100000:3.0:1746155568.654012:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123772032:12345-192.168.202.51@tcp:101:cat.0 Request processed in 121us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155568.654017:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12100 00000100:00100000:3.0:1746155568.654034:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12101 00000100:00100000:3.0:1746155568.654038:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123772160:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155568.654045:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155568.654054:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5eba60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10fe7 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.654063:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.654065:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.654069:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5eba60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe7 expref: 21 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.654078:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5eba60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe7 expref: 21 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.654084:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd5800, rc 0) 00000100:00100000:3.0:1746155568.654098:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123772160:12345-192.168.202.51@tcp:101:cat.0 Request processed in 60us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155568.654102:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12101 00000100:00100000:3.0:1746155568.654114:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12102 00000100:00100000:3.0:1746155568.654119:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123772288:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155568.654124:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155568.654130:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5600/0x844e5faceb5eba67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10fee expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.654138:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.654140:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.654143:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5600/0x844e5faceb5eba67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fee expref: 21 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.654152:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5600/0x844e5faceb5eba67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fee expref: 21 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.654158:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd5600, rc 0) 00000100:00100000:3.0:1746155568.654171:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123772288:12345-192.168.202.51@tcp:101:cat.0 Request processed in 52us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155568.654176:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12102 00000100:00100000:3.0:1746155568.654186:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12103 00000100:00100000:3.0:1746155568.654189:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123772416:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155568.654195:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155568.654201:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eba6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ff5 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.654209:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.654210:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.654214:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eba6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ff5 expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.654221:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eba6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ff5 expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.654227:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f62400, rc 0) 00000100:00100000:3.0:1746155568.654239:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123772416:12345-192.168.202.51@tcp:101:cat.0 Request processed in 49us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155568.654243:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12103 00000100:00100000:3.0:1746155568.654253:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12104 00000100:00100000:3.0:1746155568.654258:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123772544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155568.654263:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155568.654268:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5eba75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f10ffc expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155568.654276:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.654277:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155568.654280:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5eba75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ffc expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.654288:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5eba75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ffc expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.654293:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4c00, rc 0) 00000100:00100000:3.0:1746155568.654305:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123772544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 47us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155568.654310:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12104 00000100:00100000:0.0:1746155568.654805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.654891:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123772672 00000100:00100000:2.0:1746155568.654895:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123772672 00000100:00100000:2.0:1746155568.654924:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12105 00000100:00100000:2.0:1746155568.654930:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123772672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155568.654937:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155568.654944:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eba7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11003 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.654954:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155568.654955:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155568.654959:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eba7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11003 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155568.654967:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eba7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11003 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155568.654973:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374dc00, rc 0) 00000100:00100000:2.0:1746155568.654998:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123772672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 68us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155568.655003:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12105 00000100:00100000:2.0:1746155568.655024:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123772928 00000100:00100000:2.0:1746155568.655026:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123772928 00000100:00100000:2.0:1746155568.655043:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10012 00000100:00100000:2.0:1746155568.655048:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29179:x1830976123772928:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155568.655060:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155568.655070:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44ec00/0x844e5faceb5eba83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1100a expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.655144:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155568.655154:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb96b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f70 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.655447:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f63000/0x844e5faceb5eb9e9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa1 expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.655454:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eba21 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa8 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.655460:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155568.655483:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eba21 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa8 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.655493:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eba21 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa8 expref: 9 pid: 15474 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746155568.655525:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124587648:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155568.655718:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f63000/0x844e5faceb5eb9e9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa1 expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.655727:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f63000/0x844e5faceb5eb9e9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa1 expref: 288 pid: 20364 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746155568.655739:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124587776:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155568.655764:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb96b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f70 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.655771:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb96b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f70 expref: 9 pid: 15474 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746155568.655777:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124587904:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155568.655791:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155568.659940:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124587648:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155568.660790:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124587776:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155568.664196:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124587904:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155568.664227:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155568.667012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.667044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.667069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.667093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.667106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.667117:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.667135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.667165:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123773568 00000100:00100000:0.0:1746155568.667172:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123773568 00002000:00100000:0.0:1746155568.667207:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009fac5500 x1830976123773568/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.667216:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac5500 with x1830976123773568 ext(0->1048575) 00002000:00010000:0.0:1746155568.667221:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac5500 00000100:00100000:0.0:1746155568.667235:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123773824 00000100:00100000:0.0:1746155568.667237:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123773824 00002000:00100000:0.0:1746155568.667253:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880137121500 x1830976123773824/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.667260:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121500 with x1830976123773824 ext(1048576->2097151) 00002000:00010000:0.0:1746155568.667262:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137121500 00000100:00100000:0.0:1746155568.667271:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123774080 00000100:00100000:0.0:1746155568.667273:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123774080 00002000:00100000:0.0:1746155568.667282:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880137123800 x1830976123774080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.667288:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123800 with x1830976123774080 ext(1048576->2097151) 00002000:00010000:0.0:1746155568.667290:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137123800 00000100:00100000:0.0:1746155568.667298:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123774336 00000100:00100000:0.0:1746155568.667300:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123774336 00002000:00100000:0.0:1746155568.667308:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880137123b80 x1830976123774336/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.667313:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123b80 with x1830976123774336 ext(1048576->2097151) 00002000:00010000:0.0:1746155568.667316:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137123b80 00000100:00100000:0.0:1746155568.667327:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4642 00000100:00100000:0.0:1746155568.667333:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123773568:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155568.667808:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123773184 00000100:00100000:1.0:1746155568.667813:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123773184 00010000:00010000:1.0:1746155568.667832:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f63000/0x844e5faceb5eb9e9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa1 expref: 289 pid: 20364 timeout: 797 lvb_type: 0 00000100:00100000:1.0:1746155568.667848:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123773056 00000100:00100000:1.0:1746155568.667850:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123773056 00010000:00010000:1.0:1746155568.667857:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eba21 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa8 expref: 10 pid: 15474 timeout: 797 lvb_type: 0 00000100:00100000:1.0:1746155568.667866:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123773312 00000100:00100000:1.0:1746155568.667868:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123773312 00010000:00010000:1.0:1746155568.667875:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb96b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f70 expref: 10 pid: 15474 timeout: 797 lvb_type: 0 00000100:00100000:1.0:1746155568.667886:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6095 00000100:00100000:1.0:1746155568.667890:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1960:x1830976123773184:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155568.667899:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155568.667903:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f63000/0x844e5faceb5eb9e9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa1 expref: 289 pid: 20364 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746155568.667911:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f63000/0x844e5faceb5eb9e9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa1 expref: 289 pid: 20364 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746155568.667927:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f63000/0x844e5faceb5eb9e9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa1 expref: 289 pid: 20364 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746155568.667945:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155568.667948:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155568.667956:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155568.667960:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155568.667992:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1960:x1830976123773184:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 101us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.667998:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6095 00000100:00100000:1.0:1746155568.668010:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6096 00000100:00100000:1.0:1746155568.668015:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123773056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155568.668021:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155568.668024:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eba21 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa8 expref: 10 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746155568.668031:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eba21 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa8 expref: 10 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746155568.668040:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5000/0x844e5faceb5eba21 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fa8 expref: 10 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746155568.668047:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155568.668050:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155568.668055:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155568.668060:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155568.668071:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976123773056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 56us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.668076:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6096 00000100:00100000:1.0:1746155568.668083:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6097 00000100:00100000:1.0:1746155568.668087:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123773312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155568.668092:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155568.668096:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb96b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f70 expref: 10 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746155568.668103:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb96b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f70 expref: 10 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746155568.668112:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5eb96b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f70 expref: 10 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:1.0:1746155568.668118:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155568.668120:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155568.668126:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155568.668137:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155568.668152:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155568.668166:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123773312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 77us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.668170:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6097 00000100:00100000:1.0:1746155568.668186:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4643 00000100:00100000:1.0:1746155568.668192:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123773824:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155568.668395:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4644 00000100:00100000:2.0:1746155568.668401:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123774080:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155568.669489:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4645 00000100:00100000:3.0:1746155568.669498:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123774336:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:1.0:1746155568.670695:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155568.670705:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155568.670719:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155568.670816:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44ec00/0x844e5faceb5eba83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1100a expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.670829:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1100a expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.670836:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155568.670839:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155568.670841:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b44f000, rc 0) 00000100:00100000:1.0:1746155568.670864:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29179:x1830976123772928:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 15815us (16059us total) trans 8589943957 rc 0/0 00000100:00100000:1.0:1746155568.670870:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10012 00000100:00100000:0.0:1746155568.677885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.678623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.679188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.680689:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123774592 00000100:00100000:2.0:1746155568.680698:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123774592 00002000:00100000:2.0:1746155568.680732:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880137123100 x1830976123774592/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.680740:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123100 with x1830976123774592 ext(0->1048575) 00002000:00010000:2.0:1746155568.680744:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137123100 00000100:00100000:2.0:1746155568.680775:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123774848 00000100:00100000:2.0:1746155568.680777:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123774848 00002000:00100000:2.0:1746155568.680788:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880137122680 x1830976123774848/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.680794:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137122680 with x1830976123774848 ext(1048576->2097151) 00002000:00010000:2.0:1746155568.680797:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137122680 00000100:00100000:2.0:1746155568.680805:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123775104 00000100:00100000:2.0:1746155568.680807:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123775104 00002000:00100000:2.0:1746155568.680816:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880137120700 x1830976123775104/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.680821:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120700 with x1830976123775104 ext(1048576->2097151) 00002000:00010000:2.0:1746155568.680823:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137120700 00000100:00100000:2.0:1746155568.680833:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4646 00000100:00100000:2.0:1746155568.680839:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123774592:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155568.681864:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4647 00000100:00100000:2.0:1746155568.681871:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123774848:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155568.682896:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4648 00000100:00100000:2.0:1746155568.682905:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123775104:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155568.688417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155568.689737:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123773824:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21541us (22625us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.689750:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4643 00002000:00100000:1.0:1746155568.689761:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880137121500 x1830976123773824/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.689768:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121500 with x1830976123773824 ext(1048576->2097151) 00002000:00010000:1.0:1746155568.689773:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137121500 00000100:00100000:1.0:1746155568.689792:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123775360 00000100:00100000:1.0:1746155568.689798:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123775360 00002000:00100000:1.0:1746155568.689821:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880137122a00 x1830976123775360/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.689827:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137122a00 with x1830976123775360 ext(1048576->2097151) 00002000:00010000:1.0:1746155568.689830:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137122a00 00000100:00100000:1.0:1746155568.689843:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4649 00000100:00100000:1.0:1746155568.689849:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123775360:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155568.694215:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123774336:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24711us (27070us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155568.694224:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4645 00002000:00100000:3.0:1746155568.694233:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880137123b80 x1830976123774336/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155568.694241:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123b80 with x1830976123774336 ext(1048576->2097151) 00002000:00010000:3.0:1746155568.694246:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137123b80 00000100:00100000:1.0:1746155568.704140:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123773568:12345-192.168.202.51@tcp:3:cat.0 Request processed in 36798us (37037us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.704150:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4642 00002000:00100000:1.0:1746155568.704160:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009fac5500 x1830976123773568/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.704168:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac5500 with x1830976123773568 ext(0->1048575) 00002000:00010000:1.0:1746155568.704174:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac5500 00000100:00100000:2.0:1746155568.713136:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123774080:12345-192.168.202.51@tcp:3:cat.0 Request processed in 44728us (46010us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155568.713146:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4644 00002000:00100000:2.0:1746155568.713155:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880137123800 x1830976123774080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.713162:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123800 with x1830976123774080 ext(1048576->2097151) 00002000:00010000:2.0:1746155568.713167:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137123800 00000100:00100000:2.0:1746155568.730053:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123774592:12345-192.168.202.51@tcp:3:cat.0 Request processed in 49205us (52167us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155568.730064:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4646 00002000:00100000:2.0:1746155568.730074:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880137123100 x1830976123774592/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.730083:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123100 with x1830976123774592 ext(0->1048575) 00002000:00010000:2.0:1746155568.730088:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137123100 00000100:00100000:3.0:1746155568.739354:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123775104:12345-192.168.202.51@tcp:3:cat.0 Request processed in 56443us (60157us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155568.739364:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4648 00002000:00100000:3.0:1746155568.739372:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880137120700 x1830976123775104/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155568.739381:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120700 with x1830976123775104 ext(1048576->2097151) 00002000:00010000:3.0:1746155568.739386:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137120700 00000100:00100000:2.0:1746155568.739975:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123774848:12345-192.168.202.51@tcp:3:cat.0 Request processed in 58103us (61352us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155568.739982:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4647 00002000:00100000:2.0:1746155568.739987:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880137122680 x1830976123774848/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.739995:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137122680 with x1830976123774848 ext(1048576->2097151) 00002000:00010000:2.0:1746155568.739998:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137122680 00000100:00100000:1.0:1746155568.749704:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123775360:12345-192.168.202.51@tcp:3:cat.0 Request processed in 59848us (61288us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.749714:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4649 00002000:00100000:1.0:1746155568.749723:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880137122a00 x1830976123775360/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.749732:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137122a00 with x1830976123775360 ext(1048576->2097151) 00002000:00010000:1.0:1746155568.749737:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137122a00 00000100:00100000:0.0:1746155568.772241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155568.773910:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123775488 00000100:00100000:1.0:1746155568.773926:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123775488 00000100:00100000:1.0:1746155568.773975:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10013 00000100:00100000:1.0:1746155568.773983:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29181:x1830976123775488:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155568.774110:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155568.774126:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040c00/0x844e5faceb5eba98 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11011 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.774177:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040c00/0x844e5faceb5eba98 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11011 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.774189:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040c00/0x844e5faceb5eba98 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11011 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.774203:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155568.774206:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155568.774209:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6040c00, rc 0) 00000100:00100000:1.0:1746155568.774265:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29181:x1830976123775488:12345-192.168.202.51@tcp:101:cat.0 Request processed in 282us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.774270:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10013 00000100:00100000:0.0:1746155568.785044:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.785074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.785107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.787062:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.787099:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123776384 00000100:00100000:0.0:1746155568.787107:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123776384 00000100:00100000:0.0:1746155568.787143:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10014 00000100:00100000:0.0:1746155568.787150:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29183:x1830976123776384:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155568.787175:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155568.787190:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4e00/0x844e5faceb5eba9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11018 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.787241:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5a00/0x844e5faceb5ebaa6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.787252:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5a00/0x844e5faceb5ebaa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.787260:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5a00/0x844e5faceb5ebaa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.787270:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5e00/0x844e5faceb5ebaad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.787279:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5e00/0x844e5faceb5ebaad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.787283:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5e00/0x844e5faceb5ebaad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.787372:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.787381:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1100a expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.787387:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.787415:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1100a expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.787424:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1100a expref: 9 pid: 15474 timeout: 797 lvb_type: 0 00000100:00100000:0.0:1746155568.787434:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137121880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124588032:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155568.787491:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155568.788526:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123775744 00000100:00100000:1.0:1746155568.788532:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123775744 00002000:00100000:1.0:1746155568.788559:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880137122d80 x1830976123775744/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.788578:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137122d80 with x1830976123775744 ext(2097152->3145727) 00002000:00010000:1.0:1746155568.788582:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137122d80 00000100:00100000:1.0:1746155568.788599:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123776000 00000100:00100000:1.0:1746155568.788602:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123776000 00002000:00100000:1.0:1746155568.788614:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880137120000 x1830976123776000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.788625:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120000 with x1830976123776000 ext(3145728->4194303) 00002000:00010000:1.0:1746155568.788628:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120000 00000100:00100000:1.0:1746155568.788637:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123776256 00000100:00100000:1.0:1746155568.788639:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123776256 00002000:00100000:1.0:1746155568.788650:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880137121f80 x1830976123776256/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.788656:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121f80 with x1830976123776256 ext(2097152->3145727) 00002000:00010000:1.0:1746155568.788659:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137121f80 00000100:00100000:1.0:1746155568.788668:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4650 00000100:00100000:1.0:1746155568.788673:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123775744:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155568.789814:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4651 00000100:00100000:1.0:1746155568.789823:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123776000:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155568.790863:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4652 00000100:00100000:1.0:1746155568.790870:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123776256:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155568.795628:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.795667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.795723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.795764:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137121880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124588032:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155568.795782:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155568.795818:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123776640 00000100:00100000:0.0:1746155568.795823:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123776640 00002000:00100000:0.0:1746155568.795854:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880137120380 x1830976123776640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.795862:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120380 with x1830976123776640 ext(3145728->4194303) 00002000:00010000:0.0:1746155568.795866:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137120380 00000100:00100000:0.0:1746155568.795882:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4653 00000100:00100000:0.0:1746155568.795888:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123776640:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155568.797009:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123777024 00000100:00100000:0.0:1746155568.797013:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123777024 00000100:00100000:0.0:1746155568.797043:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10015 00000100:00100000:0.0:1746155568.797048:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29179:x1830976123777024:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155568.797059:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155568.797062:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746155568.797079:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040c00/0x844e5faceb5eba98 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11011 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.797095:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155568.797099:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.797105:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.797109:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.797116:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155568.797125:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de000/0x844e5faceb5ebabb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1101f expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.797157:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155568.797165:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb95d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f69 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.797171:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62200/0x844e5faceb5eba05 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10faf expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.797177:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.797181:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155568.797193:0:27374:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.797209:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62200/0x844e5faceb5eba05 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10faf expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.797217:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62200/0x844e5faceb5eba05 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10faf expref: 287 pid: 20364 timeout: 797 lvb_type: 0 00000100:00100000:0.0:1746155568.797226:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137121880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124588160:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155568.797268:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb95d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f69 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.797275:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb95d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f69 expref: 10 pid: 20364 timeout: 797 lvb_type: 0 00000100:00100000:0.0:1746155568.797280:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124588288:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155568.797292:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155568.797883:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123776768 00000100:00100000:0.0:1746155568.797886:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123776768 00010000:00010000:0.0:1746155568.797902:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1100a expref: 11 pid: 15474 timeout: 797 lvb_type: 0 00000100:00100000:0.0:1746155568.797917:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6098 00000100:00100000:0.0:1746155568.797922:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123776768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155568.797929:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155568.797932:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1100a expref: 11 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746155568.797940:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1100a expref: 11 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746155568.797950:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5eba8a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1100a expref: 11 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746155568.797958:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155568.797962:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.797968:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.797974:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.797979:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155568.797984:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155568.797995:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155568.798014:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123776768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 91us (2345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155568.798020:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6098 00010000:00010000:0.0:1746155568.798062:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798068:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155568.798095:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:0.0:1746155568.798099:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155568.798111:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798119:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798126:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5a00/0x844e5faceb5ebaa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798131:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5a00/0x844e5faceb5ebaa6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798139:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5a00/0x844e5faceb5ebaa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798143:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fa5a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155568.798146:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5a00/0x844e5faceb5ebaa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798152:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5a00/0x844e5faceb5ebaa6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798158:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155568.798161:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155568.798163:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5a00/0x844e5faceb5ebaa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798166:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5a00/0x844e5faceb5ebaa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798175:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5e00/0x844e5faceb5ebaad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798179:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5e00/0x844e5faceb5ebaad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798184:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5e00/0x844e5faceb5ebaad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798187:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fa5e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155568.798189:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5e00/0x844e5faceb5ebaad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798193:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5e00/0x844e5faceb5ebaad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798201:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fca6b00) 00010000:00010000:0.0:1746155568.798202:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155568.798204:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5e00/0x844e5faceb5ebaad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798208:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa5e00/0x844e5faceb5ebaad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155568.798232:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4e00/0x844e5faceb5eba9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11018 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.798243:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11018 expref: 10 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746155568.798250:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11018 expref: 10 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746155568.798255:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fa4400, rc 0) 00000100:00100000:0.0:1746155568.798275:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29183:x1830976123776384:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 11126us (11219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155568.798281:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10014 00000100:00100000:0.0:1746155568.806634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.806669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.806688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.806719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.806752:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123777280 00000100:00100000:0.0:1746155568.806759:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123777280 00002000:00100000:0.0:1746155568.806790:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880137120a80 x1830976123777280/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.806799:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120a80 with x1830976123777280 ext(2097152->3145727) 00002000:00010000:0.0:1746155568.806804:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120a80 00000100:00100000:0.0:1746155568.806817:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123777536 00000100:00100000:0.0:1746155568.806819:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123777536 00002000:00100000:0.0:1746155568.806829:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012fef0000 x1830976123777536/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.806835:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0000 with x1830976123777536 ext(3145728->4194303) 00002000:00010000:0.0:1746155568.806837:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef0000 00000100:00100000:0.0:1746155568.806844:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123777792 00000100:00100000:0.0:1746155568.806846:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123777792 00002000:00100000:0.0:1746155568.806856:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012fef1500 x1830976123777792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.806862:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef1500 with x1830976123777792 ext(2097152->3145727) 00002000:00010000:0.0:1746155568.806864:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef1500 00000100:00100000:0.0:1746155568.806871:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123778048 00000100:00100000:0.0:1746155568.806872:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123778048 00002000:00100000:0.0:1746155568.806880:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009fac4700 x1830976123778048/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.806886:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4700 with x1830976123778048 ext(3145728->4194303) 00002000:00010000:0.0:1746155568.806888:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac4700 00000100:00100000:0.0:1746155568.806897:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4654 00000100:00100000:0.0:1746155568.806903:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123777280:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155568.807032:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4655 00000100:00100000:1.0:1746155568.807039:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123777536:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155568.807970:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4656 00000100:00100000:0.0:1746155568.807976:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123777792:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155568.808004:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4657 00000100:00100000:1.0:1746155568.808009:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123778048:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155568.815885:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123775744:12345-192.168.202.51@tcp:3:cat.0 Request processed in 27199us (30836us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.815895:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4650 00002000:00100000:1.0:1746155568.815905:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880137122d80 x1830976123775744/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.815912:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137122d80 with x1830976123775744 ext(2097152->3145727) 00002000:00010000:1.0:1746155568.815917:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137122d80 00000100:00100000:3.0:1746155568.818780:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123776000:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28952us (33697us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155568.818789:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4651 00002000:00100000:3.0:1746155568.818798:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880137120000 x1830976123776000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155568.818798:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137121880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124588160:192.168.202.51@tcp:104: 00002000:00100000:3.0:1746155568.818806:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120000 with x1830976123776000 ext(3145728->4194303) 00000100:00100000:1.0:1746155568.818807:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124588288:192.168.202.51@tcp:104: 00002000:00010000:3.0:1746155568.818810:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120000 00010000:00010000:1.0:1746155568.818824:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155568.821726:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.821842:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.821969:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123778176 00000100:00100000:2.0:1746155568.821977:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123778176 00010000:00010000:2.0:1746155568.822005:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62200/0x844e5faceb5eba05 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10faf expref: 288 pid: 20364 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746155568.822028:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123778304 00000100:00100000:2.0:1746155568.822029:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123778304 00010000:00010000:2.0:1746155568.822037:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb95d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f69 expref: 10 pid: 20364 timeout: 797 lvb_type: 0 00000100:00100000:2.0:1746155568.822062:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6099 00000100:00100000:2.0:1746155568.822069:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1961:x1830976123778176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155568.822079:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155568.822084:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62200/0x844e5faceb5eba05 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10faf expref: 288 pid: 20364 timeout: 797 lvb_type: 0 00000100:00100000:3.0:1746155568.822090:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6100 00010000:00010000:2.0:1746155568.822093:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62200/0x844e5faceb5eba05 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10faf expref: 288 pid: 20364 timeout: 797 lvb_type: 0 00000100:00100000:3.0:1746155568.822097:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123778304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155568.822102:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155568.822105:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb95d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f69 expref: 10 pid: 20364 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746155568.822112:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f62200/0x844e5faceb5eba05 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10faf expref: 288 pid: 20364 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746155568.822113:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb95d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f69 expref: 10 pid: 20364 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746155568.822123:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5eb95d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f69 expref: 10 pid: 20364 timeout: 797 lvb_type: 0 00010000:00010000:2.0:1746155568.822130:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155568.822134:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.822395:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.822401:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155568.822472:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155568.822476:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155568.822481:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155568.822484:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155568.822646:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123778304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 548us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155568.822646:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1961:x1830976123778176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 577us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155568.822652:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6100 00000100:00100000:2.0:1746155568.822654:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6099 00000100:00100000:0.0:1746155568.822900:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123776256:12345-192.168.202.51@tcp:3:cat.0 Request processed in 32030us (37791us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155568.822907:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4652 00002000:00100000:0.0:1746155568.822914:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880137121f80 x1830976123776256/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.822921:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121f80 with x1830976123776256 ext(2097152->3145727) 00002000:00010000:0.0:1746155568.822924:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137121f80 00000100:00100000:0.0:1746155568.824731:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.824751:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123778432 00000100:00100000:0.0:1746155568.824758:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123778432 00000100:00100000:0.0:1746155568.824786:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10016 00000100:00100000:0.0:1746155568.824793:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29183:x1830976123778432:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155568.824809:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155568.824823:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081000/0x844e5faceb5ebac9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11026 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.824872:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155568.824881:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155568.824886:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155568.824899:0:19870:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155568.824908:0:19870:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000100:00100000:2.0:1746155568.825816:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123776640:12345-192.168.202.51@tcp:3:cat.0 Request processed in 29926us (30193us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155568.825826:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4653 00002000:00100000:2.0:1746155568.825833:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880137120380 x1830976123776640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.825841:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120380 with x1830976123776640 ext(3145728->4194303) 00002000:00010000:2.0:1746155568.825845:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137120380 00000100:00100000:0.0:1746155568.834060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155568.834407:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123778560 00000100:00100000:3.0:1746155568.834414:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123778560 00010000:00010000:3.0:1746155568.834440:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11018 expref: 11 pid: 15474 timeout: 797 lvb_type: 0 00000100:00100000:3.0:1746155568.834474:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6101 00000100:00100000:3.0:1746155568.834481:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123778560:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155568.834493:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155568.834498:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11018 expref: 11 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746155568.834528:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11018 expref: 11 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746155568.834544:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fa4400/0x844e5faceb5ebab4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11018 expref: 11 pid: 15474 timeout: 797 lvb_type: 0 00010000:00010000:3.0:1746155568.834560:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155568.834563:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155568.834578:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155568.834583:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155568.834588:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155568.834593:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155568.834598:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155568.834618:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155568.834655:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123778560:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 174us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155568.834662:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6101 00010000:00010000:3.0:1746155568.834694:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155568.834699:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00000040:00080000:3.0:1746155568.835258:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2890, 88 off241704 00000004:00080000:3.0:1746155568.835264:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697984761070ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155568.835297:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2833, 88 off236416 00000004:00080000:3.0:1746155568.835301:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697984797775ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155568.835310:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2834, 88 off236504 00000004:00080000:3.0:1746155568.835313:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697984810120ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155568.835319:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2891, 88 off241792 00000004:00080000:3.0:1746155568.835322:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697984819119ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155568.835329:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2892, 88 off241880 00000004:00080000:3.0:1746155568.835331:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697984828050ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155568.835336:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2835, 88 off236592 00000004:00080000:3.0:1746155568.835338:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697984835229ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155568.835343:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2836, 88 off236680 00000004:00080000:3.0:1746155568.835345:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697984842427ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155568.835351:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2837, 88 off236768 00000004:00080000:3.0:1746155568.835353:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697984850318ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155568.835359:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2893, 88 off241968 00000004:00080000:3.0:1746155568.835361:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697984858372ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155568.835367:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2838, 88 off236856 00000004:00080000:3.0:1746155568.835369:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697984866079ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155568.835375:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2894, 88 off242056 00000004:00080000:3.0:1746155568.835378:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697984874759ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155568.835383:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2839, 88 off236944 00000004:00080000:3.0:1746155568.835385:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697984882082ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155568.835391:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2895, 88 off242144 00000004:00080000:3.0:1746155568.835393:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697984890350ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155568.835399:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2896, 88 off242232 00000004:00080000:3.0:1746155568.835401:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697984898269ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155568.835407:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2897, 88 off242320 00000004:00080000:3.0:1746155568.835409:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697984906024ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155568.835414:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2898, 88 off242408 00000004:00080000:3.0:1746155568.835416:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697984912744ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155568.835421:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2840, 88 off237032 00000004:00080000:3.0:1746155568.835423:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 697984919860ns, next at 645866785986ns, rc = 0 00000100:00100000:1.0:1746155568.835610:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123777280:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 28704us (28982us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.835618:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4654 00002000:00100000:1.0:1746155568.835625:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880137120a80 x1830976123777280/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.835633:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120a80 with x1830976123777280 ext(2097152->3145727) 00002000:00010000:1.0:1746155568.835637:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120a80 00000100:00100000:1.0:1746155568.840697:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155568.841555:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123778688 00000100:00100000:1.0:1746155568.841563:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123778688 00000100:00100000:0.0:1746155568.841635:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10017 00000100:00100000:0.0:1746155568.841644:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29180:x1830976123778688:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155568.841662:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155568.841677:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1102d expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.841734:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.841745:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.841756:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155568.841759:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155568.841761:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.841767:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1e00, rc 0) 00000100:00100000:1.0:1746155568.848282:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29180:x1830976123778688:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6632us (7590us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.848292:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10017 00000100:00100000:1.0:1746155568.848640:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123777536:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 41602us (41971us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.848647:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4655 00002000:00100000:1.0:1746155568.848655:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012fef0000 x1830976123777536/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.848664:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0000 with x1830976123777536 ext(3145728->4194303) 00002000:00010000:1.0:1746155568.848669:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef0000 00000100:00100000:1.0:1746155568.849291:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123778048:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 41280us (42570us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.849297:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4657 00002000:00100000:1.0:1746155568.849302:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009fac4700 x1830976123778048/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.849308:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4700 with x1830976123778048 ext(3145728->4194303) 00002000:00010000:1.0:1746155568.849311:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac4700 00000100:00100000:1.0:1746155568.849644:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123777792:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 41667us (42953us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.849650:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4656 00002000:00100000:1.0:1746155568.849655:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012fef1500 x1830976123777792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.849661:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef1500 with x1830976123777792 ext(2097152->3145727) 00002000:00010000:1.0:1746155568.849664:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef1500 00000100:00100000:0.0:1746155568.850598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155568.850650:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123778816 00000100:00100000:1.0:1746155568.850655:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123778816 00000100:00100000:1.0:1746155568.850679:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10018 00000100:00100000:1.0:1746155568.850685:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29181:x1830976123778816:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155568.850698:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155568.850712:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11034 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.850753:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.850762:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.850771:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155568.850773:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155568.850776:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 287 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.850781:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e82c000, rc 0) 00000100:00100000:1.0:1746155568.850925:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29181:x1830976123778816:12345-192.168.202.51@tcp:101:cat.0 Request processed in 239us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.850930:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10018 00000001:00080000:1.0:1746155568.877293:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943957 is committed 00010000:00010000:2.0:1746155568.877298:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1101f expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746155568.877303:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943955 is committed 00010000:00010000:2.0:1746155568.877308:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00000001:00080000:1.0:1746155568.877310:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943958 is committed 00010000:00010000:2.0:1746155568.877311:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:1.0:1746155568.877313:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2033 committed 00010000:00010000:2.0:1746155568.877314:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x40 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00080000:1.0:1746155568.877319:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2097 committed 00010000:00010000:2.0:1746155568.877321:0:27374:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19870 initiator: MDT0 00000004:00080000:1.0:1746155568.877323:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2096 committed 00000004:00080000:1.0:1746155568.877325:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2095 committed 00010000:00010000:2.0:1746155568.877326:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19870 initiator: MDT0 00000004:00080000:1.0:1746155568.877326:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2094 committed 00000004:00080000:1.0:1746155568.877328:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2032 committed 00000004:00080000:1.0:1746155568.877329:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2093 committed 00000004:00080000:1.0:1746155568.877331:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2031 committed 00010000:00010000:2.0:1746155568.877332:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 285 pid: 15474 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746155568.877332:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2092 committed 00000004:00080000:1.0:1746155568.877334:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2030 committed 00000004:00080000:1.0:1746155568.877335:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2029 committed 00000004:00080000:1.0:1746155568.877337:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2028 committed 00000004:00080000:1.0:1746155568.877338:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2091 committed 00010000:00010000:2.0:1746155568.877339:0:27374:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 285 pid: 15474 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746155568.877340:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2090 committed 00000004:00080000:1.0:1746155568.877342:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2027 committed 00000004:00080000:1.0:1746155568.877343:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2026 committed 00000004:00080000:1.0:1746155568.877345:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2089 committed 00010000:00010000:2.0:1746155568.877348:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 285 pid: 15474 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746155568.877350:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943953 is committed 00010000:00010000:2.0:1746155568.877354:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.877359:0:27374:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.877363:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.877382:0:27374:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155568.877392:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124588544:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155568.877431:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124588416:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746155568.877460:0:27374:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 285 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155568.877460:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155568.877466:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124589568:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155568.877478:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124589056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155568.877483:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155568.877490:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155568.877520:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746155568.877524:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124588672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155568.877539:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155568.877548:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124589184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155568.877558:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746155568.877599:0:19870:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155568.877606:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:2.0:1746155568.877635:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155568.877640:0:19870:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155568.877652:0:19870:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155568.877660:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155568.877681:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081000/0x844e5faceb5ebac9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11026 expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.877693:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11026 expref: 7 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.877698:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155568.877701:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746155568.877703:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f081a00, rc 0) 00000100:00100000:2.0:1746155568.877725:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29183:x1830976123778432:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 52933us (52999us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155568.877732:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10016 00000100:00100000:3.0:1746155568.877741:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124589824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155568.877756:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124588416 00000100:00100000:3.0:1746155568.877759:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155568.877762:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124588416 00000100:00100000:3.0:1746155568.877770:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124590336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155568.877781:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155568.877782:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124589056 00000100:00100000:2.0:1746155568.877784:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124589056 00000100:00100000:3.0:1746155568.877791:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746155568.877792:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124588672 00000100:00100000:2.0:1746155568.877793:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124588672 00000100:00100000:3.0:1746155568.877794:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124589696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155568.877802:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124589184 00000100:00100000:2.0:1746155568.877804:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124589184 00000100:00100000:3.0:1746155568.877805:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155568.877813:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124589824 00000100:00100000:3.0:1746155568.877814:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124590208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155568.877814:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124589824 00000100:00100000:3.0:1746155568.877823:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155568.877824:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124590336 00000100:00100000:2.0:1746155568.877825:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124590336 00000100:00100000:2.0:1746155568.877831:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124589696 00000100:00100000:2.0:1746155568.877833:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124589696 00000100:00100000:3.0:1746155568.877834:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124588800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155568.877839:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124590208 00000100:00100000:2.0:1746155568.877840:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124590208 00000100:00100000:3.0:1746155568.877845:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155568.877848:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12106 00000100:00100000:3.0:1746155568.877851:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124589312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155568.877853:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976124588416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155568.877861:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155568.877866:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124589952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155568.877875:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155568.877881:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124590464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155568.877889:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155568.877895:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746155568.877897:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124590080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155568.877908:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155568.877913:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124590592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155568.877923:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155568.877936:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124588800 00000100:00100000:3.0:1746155568.877938:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124588800 00000100:00100000:3.0:1746155568.877947:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124589312 00000100:00100000:3.0:1746155568.877948:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124589312 00000100:00100000:3.0:1746155568.877953:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124589952 00000100:00100000:3.0:1746155568.877955:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124589952 00000100:00100000:3.0:1746155568.877960:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124590464 00000100:00100000:3.0:1746155568.877962:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124590464 00000100:00100000:3.0:1746155568.877966:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124590080 00000100:00100000:3.0:1746155568.877968:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124590080 00000100:00100000:3.0:1746155568.877972:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124590592 00000100:00100000:3.0:1746155568.877973:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124590592 00000100:00100000:3.0:1746155568.877980:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12107 00000100:00100000:3.0:1746155568.877984:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976124589056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155568.877986:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155568.877989:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155567 -> 1746155567 00002000:00010000:2.0:1746155568.877990:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155567 -> 1746155567 00002000:00010000:2.0:1746155568.877992:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155567 -> 1746155567 00002000:00010000:2.0:1746155568.877994:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1893 -> 1893 00000100:00100000:2.0:1746155568.878012:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976124588416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (551us total) trans 21474840575 rc 0/0 00000100:00100000:2.0:1746155568.878017:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12106 00000100:00100000:2.0:1746155568.878026:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12108 00000100:00100000:2.0:1746155568.878030:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976124588672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155568.878063:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976124589056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (571us total) trans 21474840576 rc 0/0 00000100:00100000:2.0:1746155568.878083:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12109 00000100:00100000:2.0:1746155568.878088:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976124589184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155568.878163:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124589184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (603us total) trans 21474840577 rc 0/0 00000100:00100000:2.0:1746155568.878168:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12109 00000100:00100000:2.0:1746155568.878177:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12110 00000100:00100000:2.0:1746155568.878181:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976124589824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155568.878206:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12111 00000100:00100000:2.0:1746155568.878210:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976124590336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155568.878388:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124588928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155568.878407:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155568.878415:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124589440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155568.878427:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155568.878442:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124588928 00000100:00100000:1.0:1746155568.878445:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124588928 00000100:00100000:1.0:1746155568.878454:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124589440 00000100:00100000:1.0:1746155568.878456:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124589440 00000100:00100000:1.0:1746155568.878462:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12112 00000100:00100000:1.0:1746155568.878466:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976124589696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155568.878554:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12113 00000100:00100000:0.0:1746155568.878560:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976124590208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155568.878662:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976124590208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (837us total) trans 17179873194 rc 0/0 00000100:00100000:0.0:1746155568.878667:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12113 00000100:00100000:0.0:1746155568.878686:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12114 00000100:00100000:0.0:1746155568.878690:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976124588800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155568.878756:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:0.0:1746155568.878758:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155566 -> 1746155566 00002000:00010000:0.0:1746155568.878760:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155566 -> 1746155566 00002000:00010000:0.0:1746155568.878762:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155565 -> 1746155565 00002000:00010000:0.0:1746155568.878763:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:2.0:1746155568.878779:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12115 00000100:00100000:0.0:1746155568.878782:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3297:x1830976124588800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (936us total) trans 21474840578 rc 0/0 00000100:00100000:2.0:1746155568.878784:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3297:x1830976124589312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155568.878786:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12114 00000100:00100000:0.0:1746155568.878796:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12116 00000100:00100000:0.0:1746155568.878799:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976124589952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155568.878851:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155568.878854:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155566 -> 1746155566 00002000:00010000:0.0:1746155568.878855:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155566 -> 1746155566 00002000:00010000:0.0:1746155568.878857:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155566 -> 1746155566 00002000:00010000:0.0:1746155568.878858:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746155568.878864:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3297:x1830976124589312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (1001us total) trans 21474840579 rc 0/0 00000100:00100000:2.0:1746155568.878869:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12115 00000100:00100000:0.0:1746155568.878870:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124589952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (994us total) trans 17179873195 rc 0/0 00000100:00100000:0.0:1746155568.878875:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12116 00000100:00100000:2.0:1746155568.878879:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12117 00000100:00100000:2.0:1746155568.878883:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976124590464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155568.878883:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12118 00000100:00100000:0.0:1746155568.878886:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976124590080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155568.878913:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12119 00000100:00100000:2.0:1746155568.878917:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976124590592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155568.878939:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12107 00000004:00080000:0.0:1746155568.878979:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9f480/2, rc 0, transno 17179873194 00000100:00100000:0.0:1746155568.878984:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124590208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155568.879232:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12120 00000100:00100000:3.0:1746155568.879237:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976124588928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155568.879298:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:3.0:1746155568.879300:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155568.879302:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746155568.879303:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155568.879305:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:3.0:1746155568.879323:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976124588928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (916us total) trans 21474840580 rc 0/0 00000004:00080000:0.0:1746155568.879357:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c31180/2, rc 0, transno 21474840580 00000100:00100000:0.0:1746155568.879364:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124588928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155568.879389:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12121 00000100:00100000:1.0:1746155568.879395:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976124589440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155568.879470:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3298:x1830976124589440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (1040us total) trans 21474840581 rc 0/0 00000100:00100000:1.0:1746155568.879475:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12121 00000100:00100000:1.0:1746155568.879523:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746155568.879529:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124590720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155568.879547:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746155568.879558:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155568.879560:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155567 -> 1746155567 00000100:00100000:1.0:1746155568.879561:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124590720 00002000:00010000:2.0:1746155568.879562:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155566 -> 1746155566 00002000:00010000:2.0:1746155568.879563:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155567 -> 1746155567 00000100:00100000:1.0:1746155568.879574:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124590720 00002000:00010000:2.0:1746155568.879575:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155568.879586:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12122 00000100:00100000:1.0:1746155568.879590:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3296:x1830976124590720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155568.879593:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3295:x1830976124588672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1563us (2054us total) trans 21474840582 rc 0/0 00000100:00100000:2.0:1746155568.879598:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12108 00000100:00100000:1.0:1746155568.879654:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3296:x1830976124590720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (106us total) trans 21474840583 rc 0/0 00000100:00100000:1.0:1746155568.879659:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12122 00000100:00100000:3.0:1746155568.879754:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12120 00000004:00080000:3.0:1746155568.879783:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c33b80/2, rc 0, transno 21474840578 00000100:00100000:3.0:1746155568.879786:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124588800:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155568.879792:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c31f80/2, rc 0, transno 21474840579 00000100:00100000:3.0:1746155568.879795:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124589312:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155568.879801:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9c380/2, rc 0, transno 17179873195 00000100:00100000:3.0:1746155568.879803:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124589952:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155568.879815:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c30380/2, rc 0, transno 21474840582 00000100:00100000:3.0:1746155568.879817:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124588672:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155568.879822:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c33800/2, rc 0, transno 21474840577 00000100:00100000:3.0:1746155568.879824:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124589184:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155568.879829:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c30a80/2, rc 0, transno 21474840575 00000100:00100000:3.0:1746155568.879831:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124588416:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155568.879836:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c31880/2, rc 0, transno 21474840576 00000100:00100000:3.0:1746155568.879838:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124589056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155568.880235:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c32300/2, rc 0, transno 21474840581 00000100:00100000:0.0:1746155568.880239:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124589440:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155568.880243:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155568.880246:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155567 -> 1746155567 00002000:00010000:2.0:1746155568.880247:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155567 -> 1746155567 00002000:00010000:2.0:1746155568.880249:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155567 -> 1746155567 00002000:00010000:2.0:1746155568.880251:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155568.880269:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3296:x1830976124589696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1803us (2463us total) trans 17179873196 rc 0/0 00000100:00100000:2.0:1746155568.880274:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12112 00000100:00100000:3.0:1746155568.880514:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3296:x1830976124590336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2292us (2720us total) trans 17179873197 rc 0/0 00000100:00100000:3.0:1746155568.880519:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12111 00002000:00010000:2.0:1746155568.880577:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155568.880580:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155567 -> 1746155567 00002000:00010000:2.0:1746155568.880582:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155567 -> 1746155567 00002000:00010000:2.0:1746155568.880583:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155567 -> 1746155567 00002000:00010000:2.0:1746155568.880585:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2081 -> 2081 00000004:00080000:1.0:1746155568.880586:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131497100/2, rc 0, transno 21474840583 00000100:00100000:1.0:1746155568.880589:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124590720:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155568.880596:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9df80/2, rc 0, transno 17179873196 00000100:00100000:1.0:1746155568.880599:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124589696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155568.880602:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3296:x1830976124589824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2421us (2843us total) trans 17179873198 rc 0/0 00000004:00080000:1.0:1746155568.880604:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9ce00/2, rc 0, transno 17179873198 00000100:00100000:1.0:1746155568.880606:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124589824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155568.880607:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12110 00000004:00080000:1.0:1746155568.880611:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9d500/2, rc 0, transno 17179873197 00000100:00100000:1.0:1746155568.880613:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124590336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155568.881235:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3297:x1830976124590464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2351us (3343us total) trans 17179873199 rc 0/0 00000100:00100000:3.0:1746155568.881244:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12117 00000004:00080000:0.0:1746155568.881296:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9f800/2, rc 0, transno 17179873199 00000100:00100000:0.0:1746155568.881299:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124590464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155568.881310:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976124590592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2392us (3385us total) trans 17179873200 rc 0/0 00000004:00080000:0.0:1746155568.881310:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9e680/2, rc 0, transno 17179873200 00000100:00100000:0.0:1746155568.881312:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124590592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155568.881315:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12119 00000100:00100000:1.0:1746155568.881374:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124590080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2487us (3465us total) trans 17179873201 rc 0/0 00000100:00100000:1.0:1746155568.881380:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12118 00000004:00080000:0.0:1746155568.881384:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9c000/2, rc 0, transno 17179873201 00000100:00100000:0.0:1746155568.881387:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124590080:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155568.883839:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124588544:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155568.883853:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124589568:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155568.883885:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de000/0x844e5faceb5ebabb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1101f expref: 9 pid: 27374 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746155568.883902:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1101f expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.883930:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0df600, rc 0) 00000100:00100000:2.0:1746155568.883979:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29179:x1830976123777024:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 86929us (88255us total) trans 8589943958 rc 0/0 00000100:00100000:2.0:1746155568.883986:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10015 00000100:00100000:2.0:1746155568.885292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.885323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.885347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.885377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.885397:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123779200 00000100:00100000:2.0:1746155568.885403:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123779200 00000100:00100000:2.0:1746155568.885443:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123779328 00000100:00100000:2.0:1746155568.885445:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123779328 00000100:00100000:2.0:1746155568.885460:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10019 00000100:00100000:2.0:1746155568.885467:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29177:x1830976123779200:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155568.885482:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155568.885495:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ef200/0x844e5faceb5ebae5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1103b expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155568.885525:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10020 00000100:00100000:1.0:1746155568.885531:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29183:x1830976123779328:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155568.885537:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155568.885543:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df400/0x844e5faceb5ebaec lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11042 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.885550:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ef200/0x844e5faceb5ebae5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1103b expref: 287 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.885561:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df400/0x844e5faceb5ebaec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11042 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155568.885600:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123779072 00000100:00100000:0.0:1746155568.885608:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123779072 00000100:00100000:0.0:1746155568.885628:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123778944 00000100:00100000:0.0:1746155568.885630:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123778944 00000100:00100000:0.0:1746155568.885642:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4039 00000100:00100000:0.0:1746155568.885647:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29181:x1830976123779072:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:0.0:1746155568.885704:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29181:x1830976123779072:12345-192.168.202.51@tcp:49:cat.0 Request processed in 56us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155568.885709:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4039 00000100:00100000:0.0:1746155568.885720:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4040 00000100:00100000:0.0:1746155568.885724:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009286ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29180:x1830976123778944:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:0.0:1746155568.885753:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29180:x1830976123778944:12345-192.168.202.51@tcp:49:cat.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155568.885761:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4040 00010000:00010000:2.0:1746155568.886204:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ef200/0x844e5faceb5ebae5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1103b expref: 287 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.886204:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df400/0x844e5faceb5ebaec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11042 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.886220:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155568.886223:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155568.886225:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01ef200, rc 0) 00010000:00010000:1.0:1746155568.886225:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155568.886226:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155568.886228:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0df400, rc 0) 00000100:00100000:2.0:1746155568.886253:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29177:x1830976123779200:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 786us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.886253:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009286d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29183:x1830976123779328:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 722us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155568.886258:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10019 00000100:00100000:1.0:1746155568.886260:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10020 00000100:00100000:0.0:1746155568.889004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155568.889058:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123779456 00000100:00100000:1.0:1746155568.889065:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123779456 00000100:00100000:1.0:1746155568.889105:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4041 00000100:00100000:1.0:1746155568.889112:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29179:x1830976123779456:12345-192.168.202.51@tcp:49:multiop.0 00000100:00100000:1.0:1746155568.889235:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29179:x1830976123779456:12345-192.168.202.51@tcp:49:multiop.0 Request processed in 123us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.889242:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4041 00000100:00100000:3.0:1746155568.890444:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.890528:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123779584 00000100:00100000:0.0:1746155568.890532:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123779584 00000100:00100000:0.0:1746155568.892198:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 587 00000100:00100000:0.0:1746155568.892209:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1963:x1830976123779584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155568.892223:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155568.892245:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ef200/0x844e5faceb5ebae5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1103b expref: 287 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.892276:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155568.892280:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155568.892325:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:1963:x1830976123779584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 120us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155568.892331:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 587 00000100:00100000:0.0:1746155568.894324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.894368:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123779840 00000100:00100000:2.0:1746155568.894375:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123779840 00000100:00100000:2.0:1746155568.894418:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10021 00000100:00100000:2.0:1746155568.894425:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29183:x1830976123779840:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155568.894441:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155568.894454:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ebaf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11049 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.894576:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee000/0x844e5faceb5ebafa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.894586:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee000/0x844e5faceb5ebafa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.894594:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee000/0x844e5faceb5ebafa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.894604:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.894608:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.894613:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.894699:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5ebb08 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.894705:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5ebb08 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.894710:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5ebb08 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155568.894717:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155568.895573:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee000/0x844e5faceb5ebafa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895580:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee000/0x844e5faceb5ebafa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895588:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee000/0x844e5faceb5ebafa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895593:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01ee000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155568.895596:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee000/0x844e5faceb5ebafa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895601:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee000/0x844e5faceb5ebafa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895609:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155568.895611:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155568.895614:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee000/0x844e5faceb5ebafa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895618:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee000/0x844e5faceb5ebafa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895625:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895630:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895633:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895637:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01ee200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155568.895639:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895642:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895650:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9f00) 00010000:00010000:2.0:1746155568.895651:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155568.895653:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895657:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.895687:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ebaf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11049 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.895696:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5ebb08 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11049 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.895701:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155568.895703:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155568.895705:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01ee600, rc 0) 00000100:00100000:2.0:1746155568.895741:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29183:x1830976123779840:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 1317us (1422us total) trans 8589943959 rc 0/0 00000100:00100000:2.0:1746155568.895748:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10021 00000100:00100000:0.0:1746155568.903241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.908407:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.908588:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123780096 00000100:00100000:2.0:1746155568.908596:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123780096 00000100:00100000:2.0:1746155568.908635:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10022 00000100:00100000:2.0:1746155568.908642:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29183:x1830976123780096:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155568.908669:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155568.908686:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ef200/0x844e5faceb5ebb16 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11050 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155568.908719:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123780224 00000100:00100000:1.0:1746155568.908723:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123780224 00000100:00100000:1.0:1746155568.908756:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12123 00000100:00100000:1.0:1746155568.908761:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:29177:x1830976123780224:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155568.908765:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01efa00/0x844e5faceb5ebb1d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155568.908768:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155568.908775:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01efa00/0x844e5faceb5ebb1d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155568.908776:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11057 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.908784:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01efa00/0x844e5faceb5ebb1d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155568.908792:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801353a2a00/0x844e5faceb5eb980 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f93 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155568.908793:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01efa00/0x844e5faceb5ebb1d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.908798:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01efa00/0x844e5faceb5ebb1d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155568.908799:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5eba75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ffc expref: 15 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155568.908804:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01efa00/0x844e5faceb5ebb1d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155568.908805:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eba4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd2 expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155568.908809:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01efa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155568.908810:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155568.908811:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155568.908812:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01efa00/0x844e5faceb5ebb1d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155568.908814:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3272704->4087807] (req 3272704->4087807) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.908817:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01efa00/0x844e5faceb5ebb1d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.908823:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155568.908826:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155568.908828:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01efa00/0x844e5faceb5ebb1d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155568.908832:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01efa00/0x844e5faceb5ebb1d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155568.908835:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eba4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd2 expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.908844:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eba4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd2 expref: 26 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155568.908855:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ef200/0x844e5faceb5ebb16 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11050 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155568.908858:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124590848:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155568.908861:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ef200/0x844e5faceb5ebb16 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11050 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.908866:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01ef200, rc 0) 00010000:00010000:1.0:1746155568.908923:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5eba75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ffc expref: 15 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.908930:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5eba75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ffc expref: 15 pid: 4461 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746155568.908938:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131496d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124590976:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155568.908942:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29183:x1830976123780096:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 301us (5709us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155568.908947:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10022 00010000:00010000:1.0:1746155568.908956:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801353a2a00/0x844e5faceb5eb980 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f93 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.908964:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801353a2a00/0x844e5faceb5eb980 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f93 expref: 8 pid: 20796 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746155568.908971:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124591104:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155568.908986:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825240 going to sleep for 11 seconds 00000100:00100000:1.0:1746155568.912683:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124590848:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155568.912693:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131496d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124590976:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155568.912700:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124591104:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155568.912723:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3272704->4087807] (req 3272704->4087807) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.912742:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0de800, rc 0) 00000100:00100000:1.0:1746155568.912772:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:29177:x1830976123780224:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4010us (4372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.912779:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12123 00000100:00100000:0.0:1746155568.913221:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.913306:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.913342:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.913399:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123780480 00000100:00100000:2.0:1746155568.913405:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123780480 00010000:00010000:2.0:1746155568.913427:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5eba75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ffc expref: 16 pid: 4461 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746155568.913444:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123780352 00000100:00100000:2.0:1746155568.913447:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123780352 00010000:00010000:2.0:1746155568.913454:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eba4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd2 expref: 26 pid: 8436 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746155568.913467:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123780608 00000100:00100000:2.0:1746155568.913468:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123780608 00010000:00010000:2.0:1746155568.913475:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801353a2a00/0x844e5faceb5eb980 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f93 expref: 9 pid: 20796 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746155568.913488:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6102 00000100:00100000:2.0:1746155568.913494:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123780480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155568.913528:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155568.913547:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5eba75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ffc expref: 16 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155568.913555:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5eba75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ffc expref: 16 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155568.913586:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5eba75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ffc expref: 16 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155568.913599:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155568.913618:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1962:x1830976123780480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 124us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155568.913623:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6102 00000100:00100000:2.0:1746155568.913634:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6103 00000100:00100000:2.0:1746155568.913638:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123780352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155568.913645:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155568.913652:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eba4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd2 expref: 26 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155568.913660:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eba4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd2 expref: 26 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155568.913669:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4400/0x844e5faceb5eba4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd2 expref: 26 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155568.913681:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155568.913694:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123780352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 55us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155568.913699:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6103 00000100:00100000:2.0:1746155568.913708:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6104 00000100:00100000:2.0:1746155568.913713:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d759050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123780608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155568.913718:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155568.913724:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801353a2a00/0x844e5faceb5eb980 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f93 expref: 9 pid: 20796 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155568.913732:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801353a2a00/0x844e5faceb5eb980 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f93 expref: 9 pid: 20796 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155568.913742:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801353a2a00/0x844e5faceb5eb980 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f93 expref: 9 pid: 20796 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155568.913749:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155568.913751:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155568.913756:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.913763:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.913790:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155568.913800:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124591232:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155568.913843:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155568.920667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.920707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.920743:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155568.920811:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123781120 00000100:00100000:3.0:1746155568.920819:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123781120 00000100:00100000:1.0:1746155568.921402:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123780864 00000100:00100000:1.0:1746155568.921406:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123780864 00002000:00100000:1.0:1746155568.921434:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880094869880 x1830976123780864/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.921443:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094869880 with x1830976123780864 ext(2097152->3145727) 00002000:00010000:1.0:1746155568.921449:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094869880 00000100:00100000:1.0:1746155568.921464:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4658 00000100:00100000:1.0:1746155568.921471:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123780864:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155568.922486:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123781248 00000100:00100000:1.0:1746155568.922491:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123781248 00000100:00100000:1.0:1746155568.922532:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12124 00000100:00100000:1.0:1746155568.922537:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29179:x1830976123781248:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155568.922547:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155568.922561:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1105e expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.922592:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090013200/0x844e5faceb5eb98e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f8c expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.922600:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eba6e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ff5 expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.922608:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eba44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fcb expref: 24 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.922614:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155568.922616:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155568.922619:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1789952->2097151] (req 1789952->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.922643:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eba44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fcb expref: 24 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.922654:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eba44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fcb expref: 24 pid: 9235 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746155568.922664:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124591360:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155568.922714:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eba6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ff5 expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.922722:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eba6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ff5 expref: 16 pid: 4461 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746155568.922729:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131496d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124591488:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155568.922750:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090013200/0x844e5faceb5eb98e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f8c expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155568.922763:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090013200/0x844e5faceb5eb98e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f8c expref: 8 pid: 29728 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746155568.922770:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124591616:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155568.922785:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155568.924402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.924449:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123781504 00000100:00100000:0.0:1746155568.924454:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123781504 00002000:00100000:0.0:1746155568.924474:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3272704->3276799) req@ffff880094868380 x1830976123781504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.924483:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094868380 with x1830976123781504 ext(3272704->3276799) 00002000:00010000:0.0:1746155568.924487:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094868380 00000100:00100000:0.0:1746155568.924520:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4659 00000100:00100000:0.0:1746155568.924527:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123781504:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155568.924641:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123781504:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 114us (243us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155568.924647:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4659 00002000:00100000:0.0:1746155568.924652:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3272704->3276799) req@ffff880094868380 x1830976123781504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.924658:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094868380 with x1830976123781504 ext(3272704->3276799) 00002000:00010000:0.0:1746155568.924661:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094868380 00000100:00100000:2.0:1746155568.926457:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4042 00000100:00100000:2.0:1746155568.926470:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29183:x1830976123781120:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:2.0:1746155568.926637:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29183:x1830976123781120:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 172us (5928us total) trans 8589943960 rc 0/0 00000100:00100000:2.0:1746155568.926642:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4042 00000100:00100000:2.0:1746155568.926682:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124591232:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155568.926694:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155568.926707:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d759050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123780608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 12994us (13364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155568.926712:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6104 00000100:00100000:0.0:1746155568.929008:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155568.929153:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123781760 00000100:00100000:1.0:1746155568.929161:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123781760 00002000:00100000:1.0:1746155568.929199:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009486ad80 x1830976123781760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.929208:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486ad80 with x1830976123781760 ext(2097152->3145727) 00002000:00010000:1.0:1746155568.929213:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486ad80 00000100:00100000:1.0:1746155568.929324:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4660 00000100:00100000:1.0:1746155568.929333:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123781760:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155568.934971:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123780864:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13492us (14304us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155568.935004:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4658 00002000:00100000:2.0:1746155568.935015:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880094869880 x1830976123780864/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746155568.935120:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155568.935135:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155568.935163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155568.935181:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123782144 00000100:00100000:3.0:1746155568.935187:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123782144 00010000:00010000:3.0:1746155568.935214:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090013200/0x844e5faceb5eb98e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f8c expref: 8 pid: 29728 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746155568.935234:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123781888 00000100:00100000:3.0:1746155568.935236:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123781888 00010000:00010000:3.0:1746155568.935244:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eba44 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fcb expref: 25 pid: 9235 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746155568.935262:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123782016 00000100:00100000:3.0:1746155568.935264:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123782016 00010000:00010000:3.0:1746155568.935274:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eba6e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ff5 expref: 17 pid: 4461 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746155568.935285:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6105 00000100:00100000:0.0:1746155568.935293:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123782144:12345-192.168.202.51@tcp:103:ldlm_bl.0 00002000:00100000:2.0:1746155568.935302:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094869880 with x1830976123780864 ext(2097152->3145727) 00010000:00010000:0.0:1746155568.935303:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746155568.935307:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094869880 00010000:00010000:0.0:1746155568.935322:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090013200/0x844e5faceb5eb98e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f8c expref: 8 pid: 29728 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746155568.935331:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090013200/0x844e5faceb5eb98e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f8c expref: 8 pid: 29728 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746155568.935439:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6106 00000100:00100000:3.0:1746155568.935444:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123781888:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155568.935454:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155568.935513:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6107 00000100:00100000:2.0:1746155568.935518:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123782016:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155568.935526:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155568.935656:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124591360:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155568.935666:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131496d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124591488:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155568.935674:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124591616:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155568.935977:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eba44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fcb expref: 25 pid: 9235 timeout: 798 lvb_type: 1 00010000:00010000:3.0:1746155568.935986:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eba44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fcb expref: 25 pid: 9235 timeout: 798 lvb_type: 1 00010000:00010000:3.0:1746155568.936002:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5eba44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fcb expref: 25 pid: 9235 timeout: 798 lvb_type: 1 00010000:00010000:3.0:1746155568.936019:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155568.936043:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123781888:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 599us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155568.936048:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6106 00010000:00010000:2.0:1746155568.936121:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eba6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ff5 expref: 17 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746155568.936129:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [1789952->2097151] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.936130:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eba6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ff5 expref: 17 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155568.936140:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f62400/0x844e5faceb5eba6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10ff5 expref: 17 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155568.936151:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155568.936166:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123782016:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 649us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155568.936171:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6107 00010000:00010000:0.0:1746155568.936267:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090013200/0x844e5faceb5eb98e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f8c expref: 8 pid: 29728 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746155568.936282:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155568.936284:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155568.936289:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 15 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.936295:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 15 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.936317:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 15 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155568.936326:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009486aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124591744:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155568.936359:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00010000:00010000:1.0:1746155568.936395:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6041e00, rc 0) 00000100:00100000:1.0:1746155568.936412:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29179:x1830976123781248:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 13875us (15668us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.936421:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12124 00000100:00100000:3.0:1746155568.943488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.943556:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123782400 00000100:00100000:2.0:1746155568.943572:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123782400 00002000:00100000:2.0:1746155568.943604:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3272703) req@ffff880094f08380 x1830976123782400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.943611:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08380 with x1830976123782400 ext(3145728->3272703) 00002000:00010000:2.0:1746155568.943615:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f08380 00000100:00100000:2.0:1746155568.943631:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4661 00000100:00100000:2.0:1746155568.943637:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123782400:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155568.944226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.944275:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123782656 00000100:00100000:0.0:1746155568.944279:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123782656 00002000:00100000:0.0:1746155568.944296:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1789952->1794047) req@ffff880094f08000 x1830976123782656/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.944304:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08000 with x1830976123782656 ext(1789952->1794047) 00002000:00010000:0.0:1746155568.944307:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f08000 00000100:00100000:0.0:1746155568.944682:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4662 00000100:00100000:0.0:1746155568.944688:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123782656:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155568.944776:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123782656:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 86us (549us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155568.944782:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4662 00002000:00100000:0.0:1746155568.944788:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1789952->1794047) req@ffff880094f08000 x1830976123782656/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/4536 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155568.944795:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08000 with x1830976123782656 ext(1789952->1794047) 00002000:00010000:0.0:1746155568.944798:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f08000 00000100:00100000:0.0:1746155568.944832:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009486aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124591744:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155568.944845:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155568.944932:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123782144:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9640us (9812us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155568.944938:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6105 00000100:00100000:1.0:1746155568.945448:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123781760:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 16115us (16445us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155568.945454:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4660 00002000:00100000:1.0:1746155568.945459:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009486ad80 x1830976123781760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155568.945467:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486ad80 with x1830976123781760 ext(2097152->3145727) 00002000:00010000:1.0:1746155568.945470:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486ad80 00000100:00100000:0.0:1746155568.947380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.948013:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123782400:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 4373us (4530us total) trans 0 rc 126976/126976 00000100:00100000:2.0:1746155568.948022:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4661 00002000:00100000:2.0:1746155568.948031:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3272703) req@ffff880094f08380 x1830976123782400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 126976/126976 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.948039:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08380 with x1830976123782400 ext(3145728->3272703) 00002000:00010000:2.0:1746155568.948044:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f08380 00000100:00100000:2.0:1746155568.948060:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123782912 00000100:00100000:2.0:1746155568.948066:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123782912 00002000:00100000:2.0:1746155568.948087:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3588096->4194303) req@ffff88009486aa00 x1830976123782912/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.948093:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486aa00 with x1830976123782912 ext(3588096->4194303) 00002000:00010000:2.0:1746155568.948095:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486aa00 00000100:00100000:2.0:1746155568.948124:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4663 00000100:00100000:2.0:1746155568.948130:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123782912:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155568.949371:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.954436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155568.954529:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123783296 00000100:00100000:1.0:1746155568.954537:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123783296 00000100:00100000:1.0:1746155568.954580:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12125 00000100:00100000:1.0:1746155568.954587:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29181:x1830976123783296:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155568.954601:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155568.954616:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11065 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.954638:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 25 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.954644:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155568.954646:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155568.954649:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11065 expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.954672:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 25 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.954685:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 25 pid: 29728 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746155568.954696:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124591872:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155568.954765:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155568.954882:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123783168 00000100:00100000:2.0:1746155568.954886:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123783168 00002000:00100000:2.0:1746155568.954909:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009486a680 x1830976123783168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.954919:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486a680 with x1830976123783168 ext(3145728->4194303) 00002000:00010000:2.0:1746155568.954923:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486a680 00000100:00100000:2.0:1746155568.954934:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4664 00000100:00100000:2.0:1746155568.954939:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123783168:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155568.955008:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155568.955022:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123783424 00000100:00100000:0.0:1746155568.955025:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123783424 00000100:00100000:0.0:1746155568.955039:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12126 00000100:00100000:0.0:1746155568.955044:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29179:x1830976123783424:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155568.955050:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155568.955056:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1106c expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.955066:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155568.955067:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155568.955070:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->2461695] (req 2097152->2461695) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 18 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.955078:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->2461695] (req 2097152->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 18 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155568.955086:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e7ac00, rc 0) 00000100:00100000:0.0:1746155568.955106:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29179:x1830976123783424:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 62us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155568.955111:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12126 00000100:00100000:1.0:1746155568.963690:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124591872:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155568.963717:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11065 expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155568.964013:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0de600, rc 0) 00000100:00100000:1.0:1746155568.964055:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29181:x1830976123783296:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9467us (9625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155568.964062:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12125 00000100:00100000:3.0:1746155568.965624:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123783168:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10681us (16252us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155568.965632:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4664 00002000:00100000:3.0:1746155568.965639:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009486a680 x1830976123783168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155568.965647:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486a680 with x1830976123783168 ext(3145728->4194303) 00002000:00010000:3.0:1746155568.965652:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486a680 00000100:00100000:2.0:1746155568.968585:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123782912:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 20448us (21201us total) trans 0 rc 606208/606208 00000100:00100000:2.0:1746155568.968595:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4663 00002000:00100000:2.0:1746155568.968604:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3588096->4194303) req@ffff88009486aa00 x1830976123782912/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/440 e 0 to 0 dl 1746155579 ref 1 fl Complete:/200/0 rc 606208/606208 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.968613:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486aa00 with x1830976123782912 ext(3588096->4194303) 00010000:00010000:2.0:1746155568.968621:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 24 pid: 29728 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155568.968634:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 24 pid: 29728 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746155568.968640:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009486aa00 00000100:00100000:0.0:1746155568.977403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155568.977536:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123783808 00000100:00100000:3.0:1746155568.977544:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123783808 00000100:00100000:3.0:1746155568.977604:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4043 00000100:00100000:3.0:1746155568.977613:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29177:x1830976123783808:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155568.977857:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29177:x1830976123783808:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 244us (461us total) trans 8589943961 rc 0/0 00000100:00100000:3.0:1746155568.977863:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4043 00000100:00100000:1.0:1746155568.978284:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.978327:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123783936 00000100:00100000:2.0:1746155568.978331:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123783936 00002000:00100000:2.0:1746155568.978360:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3272704->4087807) req@ffff880131495c00 x1830976123783936/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/0 e 0 to 0 dl 1746155579 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155568.978367:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495c00 with x1830976123783936 ext(3272704->4087807) 00010000:00010000:2.0:1746155568.978374:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 24 pid: 29728 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155568.978385:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 24 pid: 29728 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746155568.978391:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131495c00 00000100:00100000:2.0:1746155568.978415:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 727 00000100:00100000:2.0:1746155568.978420:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123783936:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155568.981444:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.981582:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123784064 00000100:00100000:2.0:1746155568.981589:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123784064 00000100:00100000:2.0:1746155568.981806:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12127 00000100:00100000:2.0:1746155568.981814:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123784064:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155568.982069:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155568.982088:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11073 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155568.982129:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124592000:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155568.982196:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155568.984652:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.985013:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123784192 00000100:00100000:2.0:1746155568.985020:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123784192 00000100:00100000:2.0:1746155568.985062:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12128 00000100:00100000:2.0:1746155568.985069:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123784192:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155568.985082:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155568.985096:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1107a expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155568.985137:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124592128:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155568.985200:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29b40 going to sleep for 11 seconds 00002000:00010000:2.0:1746155568.986356:0:29728:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155567 -> 1746155569 00002000:00010000:2.0:1746155568.986360:0:29728:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155566 -> 1746155569 00002000:00010000:2.0:1746155568.986362:0:29728:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155567 -> 1746155569 00000100:00100000:2.0:1746155568.986584:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124592000:192.168.202.51@tcp:106: 00002000:00010000:3.0:1746155568.986600:0:10591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime: 1746155566 -> 1746155569 00002000:00010000:3.0:1746155568.986603:0:10591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155566 -> 1746155569 00002000:00010000:3.0:1746155568.986604:0:10591:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime: 1746155565 -> 1746155569 00000100:00100000:3.0:1746155568.986612:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124592128:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155568.986626:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb47 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1107a expref: 29 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.986636:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1107a expref: 29 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155568.986648:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6040400, rc 0) 00010000:00010000:2.0:1746155568.986727:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb40 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11073 expref: 29 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155568.986740:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01ee200/0x844e5faceb5ebb40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11073 expref: 28 pid: 29728 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155568.986805:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123784192:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1735us (2157us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155568.986812:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12128 00010000:00010000:2.0:1746155568.986953:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01ee200, rc 0) 00000100:00100000:2.0:1746155568.986977:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123784064:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5164us (5540us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155568.986982:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12127 00000100:00100000:1.0:1746155568.998957:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155568.999060:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123784320 00000100:00100000:2.0:1746155568.999067:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123784320 00000100:00100000:2.0:1746155568.999114:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12129 00000100:00100000:2.0:1746155568.999121:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:29180:x1830976123784320:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155568.999137:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155568.999151:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11081 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.999174:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155568.999176:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155568.999180:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->4956159] (req 4194304->4956159) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11081 expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.999191:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->4956159] (req 4194304->4956159) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11081 expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155568.999200:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6040400, rc 0) 00000100:00100000:2.0:1746155568.999248:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29180:x1830976123784320:12345-192.168.202.51@tcp:101:cat.0 Request processed in 127us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155568.999253:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12129 00000100:00100000:2.0:1746155569.004678:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123783936:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 26248us (26384us total) trans 21474840584 rc 0/0 00000100:00100000:2.0:1746155569.004689:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 727 00002000:00100000:2.0:1746155569.004699:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3272704->4087807) req@ffff880131495c00 x1830976123783936/t21474840584(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:639/0 lens 488/448 e 0 to 0 dl 1746155579 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.004708:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495c00 with x1830976123783936 ext(3272704->4087807) 00010000:00010000:2.0:1746155569.004717:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 27 pid: 29728 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155569.004732:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 27 pid: 29728 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746155569.004737:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131495c00 00000100:00100000:0.0:1746155569.008334:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.008443:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123784448 00000100:00100000:2.0:1746155569.008451:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123784448 00010000:00010000:2.0:1746155569.008483:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 27 pid: 29728 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746155569.008907:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6108 00000100:00100000:2.0:1746155569.008915:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123784448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155569.008927:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155569.008947:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 27 pid: 29728 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155569.008958:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 27 pid: 29728 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155569.008983:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0de800/0x844e5faceb5ebb24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3272704->4087807) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11057 expref: 27 pid: 29728 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155569.009811:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.009813:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.009822:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11065 expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.009903:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11065 expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.009912:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.009913:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.009917:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.009923:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.009927:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.009928:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.009931:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11081 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.009937:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11081 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.009968:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11081 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155569.009979:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124592256:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155569.010054:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155569.010062:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124592384:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155569.010084:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11065 expref: 16 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155569.010090:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124592512:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155569.010104:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca296c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155569.011750:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124592256:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155569.011758:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124592384:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155569.011763:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff18000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124592512:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155569.011779:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155569.011813:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123784448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2898us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155569.011822:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6108 00000100:00100000:0.0:1746155569.015882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.016120:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123784832 00000100:00100000:3.0:1746155569.016218:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123784832 00002000:00100000:3.0:1746155569.016254:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009486b480 x1830976123784832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.016264:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b480 with x1830976123784832 ext(4194304->4956159) 00002000:00010000:3.0:1746155569.016268:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486b480 00000100:00100000:0.0:1746155569.016493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.017313:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123785088 00000100:00100000:3.0:1746155569.017318:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123785088 00002000:00100000:3.0:1746155569.017340:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (2457600->2461695) req@ffff880094868a80 x1830976123785088/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.017348:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094868a80 with x1830976123785088 ext(2457600->2461695) 00002000:00010000:3.0:1746155569.017351:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094868a80 00000100:00100000:3.0:1746155569.017362:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4665 00000100:00100000:3.0:1746155569.017368:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123784832:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155569.019209:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4666 00000100:00100000:1.0:1746155569.019218:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123785088:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155569.019318:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123785088:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 102us (2825us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155569.019323:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4666 00002000:00100000:1.0:1746155569.019329:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2457600->2461695) req@ffff880094868a80 x1830976123785088/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155569.019342:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094868a80 with x1830976123785088 ext(2457600->2461695) 00002000:00010000:1.0:1746155569.019346:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094868a80 00000100:00080000:0.0:1746155569.019905:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155569.020662:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.020991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.021657:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123785344 00000100:00100000:2.0:1746155569.021665:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123785344 00002000:00100000:2.0:1746155569.021697:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800910db800 x1830976123785344/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.021705:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910db800 with x1830976123785344 ext(3145728->4194303) 00002000:00010000:2.0:1746155569.021709:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910db800 00000100:00100000:2.0:1746155569.021724:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123785600 00000100:00100000:2.0:1746155569.021726:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123785600 00002000:00100000:2.0:1746155569.021742:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800910db100 x1830976123785600/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.021748:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910db100 with x1830976123785600 ext(3145728->4194303) 00002000:00010000:2.0:1746155569.021751:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910db100 00000100:00100000:2.0:1746155569.021771:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4667 00000100:00100000:2.0:1746155569.021776:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123785344:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155569.023092:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4668 00000100:00100000:1.0:1746155569.023101:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123785600:12345-192.168.202.51@tcp:3:multiop.0 00000100:00080000:2.0:1746155569.023368:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746155569.024907:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123784832:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7533us (9031us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155569.024916:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4665 00002000:00100000:3.0:1746155569.024923:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009486b480 x1830976123784832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.024932:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b480 with x1830976123784832 ext(4194304->4956159) 00002000:00010000:3.0:1746155569.024937:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486b480 00000100:00100000:0.0:1746155569.033185:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.033684:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123785344:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11905us (13022us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155569.033695:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4667 00002000:00100000:2.0:1746155569.033705:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800910db800 x1830976123785344/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.033713:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910db800 with x1830976123785344 ext(3145728->4194303) 00002000:00010000:2.0:1746155569.033718:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910db800 00000100:00100000:3.0:1746155569.033963:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123785856 00000100:00100000:3.0:1746155569.033973:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123785856 00000100:00100000:3.0:1746155569.034027:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4044 00000100:00100000:3.0:1746155569.034035:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29179:x1830976123785856:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155569.034889:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29179:x1830976123785856:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 853us (1711us total) trans 8589943962 rc 0/0 00000100:00100000:3.0:1746155569.034894:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4044 00000100:00080000:2.0:1746155569.035213:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155569.035919:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.036190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.036359:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123785984 00000100:00100000:3.0:1746155569.036365:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123785984 00000100:00100000:3.0:1746155569.036396:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123786112 00000100:00100000:3.0:1746155569.036398:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123786112 00000100:00100000:3.0:1746155569.036418:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12130 00000100:00100000:3.0:1746155569.036423:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123785984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155569.036435:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155569.036769:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12131 00000100:00100000:0.0:1746155569.036774:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123786112:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155569.036781:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155569.036787:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e7a000/0x844e5faceb5ebb5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1108f expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.036809:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e7a000/0x844e5faceb5ebb5c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1108f expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155569.036817:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e7a000/0x844e5faceb5ebb5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1108f expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155569.036830:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e7a000, rc 0) 00010000:00010000:3.0:1746155569.037209:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c70800/0x844e5faceb5ebb55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11088 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155569.037243:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124592640:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155569.037823:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123786112:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1047us (1631us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155569.037829:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12131 00000100:00100000:3.0:1746155569.037995:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da480 going to sleep for 11 seconds 00000100:00100000:3.0:1746155569.041969:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124592640:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155569.041998:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c70800/0x844e5faceb5ebb55 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11088 expref: 27 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.042009:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c70800/0x844e5faceb5ebb55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11088 expref: 27 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.042022:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c70800, rc 0) 00000100:00100000:3.0:1746155569.042065:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123785984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5641us (6146us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155569.042072:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12130 00000100:00100000:2.0:1746155569.042408:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123785600:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 19307us (21415us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155569.042416:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4668 00002000:00100000:2.0:1746155569.042423:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800910db100 x1830976123785600/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.042432:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910db100 with x1830976123785600 ext(3145728->4194303) 00002000:00010000:2.0:1746155569.042436:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910db100 00000100:00100000:0.0:1746155569.048202:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.048246:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.048352:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123786368 00000100:00100000:3.0:1746155569.048361:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123786368 00000100:00100000:3.0:1746155569.048405:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123786240 00000100:00100000:3.0:1746155569.048408:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123786240 00000100:00100000:3.0:1746155569.048422:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12132 00000100:00100000:3.0:1746155569.048429:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123786368:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155569.048442:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12133 00010000:00010000:3.0:1746155569.048444:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155569.048450:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123786240:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155569.048457:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c71600/0x844e5faceb5ebb63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1109d expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.048457:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.048467:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb6a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11096 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.048481:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c71600/0x844e5faceb5ebb63 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1109d expref: 29 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.048489:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c71600/0x844e5faceb5ebb63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1109d expref: 29 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.048522:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c71600, rc 0) 00000100:00100000:2.0:1746155569.048523:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124592768:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155569.048559:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123786368:12345-192.168.202.51@tcp:101:cat.0 Request processed in 130us (363us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155569.048577:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12132 00000100:00100000:2.0:1746155569.048582:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155569.050675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.050878:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123786496 00000100:00100000:1.0:1746155569.050885:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123786496 00000100:00100000:1.0:1746155569.050923:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12134 00000100:00100000:1.0:1746155569.050929:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123786496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155569.050940:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155569.050951:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebb71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110a4 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.050970:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebb71 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110a4 expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155569.050977:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebb71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110a4 expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155569.050988:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3d14c00, rc 0) 00000100:00100000:1.0:1746155569.051016:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123786496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 88us (347us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155569.051021:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12134 00000100:00100000:2.0:1746155569.051444:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124592768:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155569.051463:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb6a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11096 expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.051471:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11096 expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.051712:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013121f400, rc 0) 00000100:00100000:2.0:1746155569.051826:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123786240:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3376us (3578us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155569.051831:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12133 00000100:00100000:0.0:1746155569.055020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.055417:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123786752 00000100:00100000:2.0:1746155569.055424:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123786752 00002000:00100000:2.0:1746155569.055461:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800910db480 x1830976123786752/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.055469:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910db480 with x1830976123786752 ext(4194304->4956159) 00002000:00010000:2.0:1746155569.055474:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910db480 00000100:00100000:2.0:1746155569.055520:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4669 00000100:00100000:2.0:1746155569.055528:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123786752:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155569.055732:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.056261:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123787008 00000100:00100000:3.0:1746155569.056265:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123787008 00000100:00100000:3.0:1746155569.056299:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4045 00000100:00100000:3.0:1746155569.056305:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29180:x1830976123787008:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155569.056448:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29180:x1830976123787008:12345-192.168.202.51@tcp:35:cat.0 Request processed in 141us (715us total) trans 8589943963 rc 0/0 00000100:00100000:3.0:1746155569.056454:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4045 00000100:00100000:2.0:1746155569.064152:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123786752:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8617us (9131us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155569.064163:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4669 00002000:00100000:2.0:1746155569.064172:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800910db480 x1830976123786752/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.064181:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910db480 with x1830976123786752 ext(4194304->4956159) 00002000:00010000:2.0:1746155569.064185:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910db480 00000100:00100000:0.0:1746155569.067946:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.068040:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123787136 00000100:00100000:2.0:1746155569.068047:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123787136 00000100:00100000:2.0:1746155569.068088:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12135 00000100:00100000:2.0:1746155569.068094:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123787136:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155569.068109:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.068121:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013121f800/0x844e5faceb5ebb78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110ab expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.068144:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013121f800/0x844e5faceb5ebb78 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ab expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.068153:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013121f800/0x844e5faceb5ebb78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ab expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.068178:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013121f800, rc 0) 00000100:00100000:2.0:1746155569.068210:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123787136:12345-192.168.202.51@tcp:101:cat.0 Request processed in 116us (270us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155569.068215:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12135 00000100:00100000:0.0:1746155569.071188:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.071280:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123787264 00000100:00100000:3.0:1746155569.071288:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123787264 00000100:00100000:3.0:1746155569.071381:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12136 00000100:00100000:3.0:1746155569.071388:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123787264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155569.071401:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.071415:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5ebb7f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110b2 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.071445:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5ebb7f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110b2 expref: 18 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.071454:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5ebb7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110b2 expref: 18 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.071673:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4c00, rc 0) 00000100:00100000:3.0:1746155569.071717:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123787264:12345-192.168.202.51@tcp:101:cat.0 Request processed in 329us (535us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155569.071722:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12136 00000100:00100000:0.0:1746155569.074949:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.075025:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123787520 00000100:00100000:2.0:1746155569.075032:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123787520 00000100:00100000:2.0:1746155569.075076:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4046 00000100:00100000:2.0:1746155569.075083:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29181:x1830976123787520:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155569.075255:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29181:x1830976123787520:12345-192.168.202.51@tcp:35:cat.0 Request processed in 172us (312us total) trans 8589943964 rc 0/0 00000100:00100000:2.0:1746155569.075261:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4046 00010000:00010000:3.0:1746155569.113939:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155569.211378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.211600:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123787776 00000100:00100000:2.0:1746155569.211609:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123787776 00000100:00100000:2.0:1746155569.211648:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10023 00000100:00100000:2.0:1746155569.211656:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29194:x1830976123787776:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155569.211677:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.211692:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f800/0x844e5faceb5ebb86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110b9 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.211773:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.211783:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.211792:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.211804:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ebb94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.211808:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ebb94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.211813:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ebb94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.211897:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebb9b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.211904:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebb9b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.211909:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebb9b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155569.211916:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155569.211982:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.211987:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.211992:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.211997:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013121f400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155569.212000:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.212006:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.212014:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155569.212017:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155569.212020:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.212024:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5ebb8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.213817:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ebb94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.213827:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ebb94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.213833:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ebb94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.213838:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01eec00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155569.213841:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ebb94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.213846:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ebb94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.213854:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9a00) 00010000:00010000:2.0:1746155569.213857:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155569.213859:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ebb94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.213863:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eec00/0x844e5faceb5ebb94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.213916:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f800/0x844e5faceb5ebb86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110b9 expref: 13 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.213930:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebb9b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110b9 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.213935:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155569.213937:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155569.213940:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd0f200, rc 0) 00000100:00100000:2.0:1746155569.213993:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29194:x1830976123787776:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2337us (2622us total) trans 8589943965 rc 0/0 00000100:00100000:2.0:1746155569.213999:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10023 00000100:00100000:0.0:1746155569.217334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.217543:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123788032 00000100:00100000:2.0:1746155569.217551:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123788032 00000100:00100000:2.0:1746155569.217609:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10024 00000100:00100000:2.0:1746155569.217616:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29193:x1830976123788032:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155569.217635:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.217650:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28600/0x844e5faceb5ebba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110c0 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.217735:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ebbb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217745:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ebbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217754:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ebbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217765:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5ebbb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217774:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5ebbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217778:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5ebbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217857:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbbe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217865:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbbe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217871:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbbe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155569.217877:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155569.217942:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ebbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217948:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ebbb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217952:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ebbb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217956:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e28a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155569.217960:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ebbb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217965:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ebbb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217973:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155569.217975:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155569.217978:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ebbb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217982:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ebbb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217992:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5ebbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217996:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5ebbb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.217999:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5ebbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.218003:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801369b9c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155569.218005:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5ebbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.218009:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5ebbb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.218014:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9300) 00010000:00010000:2.0:1746155569.218015:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155569.218017:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5ebbb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.218022:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9c00/0x844e5faceb5ebbb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.218051:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28600/0x844e5faceb5ebba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110c0 expref: 291 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.218064:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbbe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110c0 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.218069:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155569.218071:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155569.218073:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369b9400, rc 0) 00000100:00100000:2.0:1746155569.224018:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29193:x1830976123788032:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6393us (6681us total) trans 8589943966 rc 0/0 00000100:00100000:2.0:1746155569.224029:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10024 00000100:00100000:0.0:1746155569.225036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.225133:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123788160 00000100:00100000:3.0:1746155569.225140:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123788160 00000100:00100000:3.0:1746155569.225180:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12137 00000100:00100000:3.0:1746155569.225187:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123788160:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155569.225202:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.225216:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5ebbcc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110c7 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.225241:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5ebbcc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110c7 expref: 18 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.225251:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4c00/0x844e5faceb5ebbcc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110c7 expref: 18 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.225266:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4c00, rc 0) 00000100:00100000:3.0:1746155569.225312:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123788160:12345-192.168.202.51@tcp:101:cat.0 Request processed in 125us (278us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155569.225317:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12137 00000100:00100000:0.0:1746155569.232184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.232235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.232314:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123788416 00000100:00100000:2.0:1746155569.232322:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123788416 00002000:00100000:2.0:1746155569.232358:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800910daa00 x1830976123788416/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.232367:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910daa00 with x1830976123788416 ext(0->1048575) 00002000:00010000:2.0:1746155569.232371:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910daa00 00000100:00100000:2.0:1746155569.232397:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123788672 00000100:00100000:2.0:1746155569.232400:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123788672 00002000:00100000:2.0:1746155569.232412:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800910dad80 x1830976123788672/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.232419:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910dad80 with x1830976123788672 ext(1048576->2097151) 00002000:00010000:2.0:1746155569.232421:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910dad80 00000100:00100000:2.0:1746155569.232433:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4670 00000100:00100000:2.0:1746155569.232439:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123788416:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155569.233642:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4671 00000100:00100000:2.0:1746155569.233650:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123788672:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155569.242185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.242237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.242318:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123788928 00000100:00100000:3.0:1746155569.242326:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123788928 00002000:00100000:3.0:1746155569.242360:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff8800910da300 x1830976123788928/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.242368:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910da300 with x1830976123788928 ext(1048576->2097151) 00002000:00010000:3.0:1746155569.242373:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910da300 00000100:00100000:3.0:1746155569.242399:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123789184 00000100:00100000:3.0:1746155569.242401:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123789184 00002000:00100000:3.0:1746155569.242413:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1789951) req@ffff8800910d9500 x1830976123789184/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.242420:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9500 with x1830976123789184 ext(1048576->1789951) 00002000:00010000:3.0:1746155569.242422:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d9500 00000100:00100000:3.0:1746155569.242434:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4672 00000100:00100000:3.0:1746155569.242439:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123788928:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155569.243124:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4673 00000100:00100000:1.0:1746155569.243131:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123789184:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155569.254288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.256603:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123789312 00000100:00100000:3.0:1746155569.256615:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123789312 00000100:00100000:3.0:1746155569.256681:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12138 00000100:00100000:3.0:1746155569.256689:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:29193:x1830976123789312:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155569.256706:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.256723:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110ce expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.256747:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5eb987 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f7e expref: 7 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.256755:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5eba60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe7 expref: 25 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.256761:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094fa4800/0x844e5faceb5eba36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fbd expref: 29 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.256768:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155569.256769:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155569.256772:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1662976->1982463] (req 1662976->1982463) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.256797:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094fa4800/0x844e5faceb5eba36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fbd expref: 29 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.256808:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094fa4800/0x844e5faceb5eba36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fbd expref: 29 pid: 29728 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746155569.256818:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124592896:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155569.257080:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5eba60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe7 expref: 25 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.257088:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5eba60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe7 expref: 25 pid: 4461 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746155569.257096:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124593024:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155569.257121:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5eb987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f7e expref: 7 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.257128:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5eb987 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f7e expref: 7 pid: 4461 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746155569.257135:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124593152:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155569.257148:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da480 going to sleep for 11 seconds 00000100:00100000:3.0:1746155569.265642:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123788672:12345-192.168.202.51@tcp:3:cat.0 Request processed in 31983us (33396us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155569.265655:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4671 00002000:00100000:3.0:1746155569.265666:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800910dad80 x1830976123788672/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.265675:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910dad80 with x1830976123788672 ext(1048576->2097151) 00000100:00100000:2.0:1746155569.265684:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123788416:12345-192.168.202.51@tcp:3:cat.0 Request processed in 33244us (33506us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746155569.265686:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5eba60 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe7 expref: 24 pid: 4461 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746155569.265691:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4670 00002000:00100000:2.0:1746155569.265696:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800910daa00 x1830976123788416/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746155569.265698:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5eba60 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe7 expref: 24 pid: 4461 timeout: 798 lvb_type: 1 00002000:00100000:2.0:1746155569.265702:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910daa00 with x1830976123788416 ext(0->1048575) 00002000:00010000:3.0:1746155569.265705:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910dad80 00002000:00010000:2.0:1746155569.265705:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910daa00 00000100:00100000:1.0:1746155569.268957:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.268973:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.269182:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123789184:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26050us (26943us total) trans 0 rc 741376/741376 00000100:00100000:1.0:1746155569.269192:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4673 00002000:00100000:1.0:1746155569.269200:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1789951) req@ffff8800910d9500 x1830976123789184/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155569.269208:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9500 with x1830976123789184 ext(1048576->1789951) 00002000:00010000:1.0:1746155569.269213:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d9500 00000100:00100000:1.0:1746155569.269251:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123789568 00000100:00100000:1.0:1746155569.269256:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123789568 00010000:00010000:1.0:1746155569.269278:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5eb987 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f7e expref: 8 pid: 4461 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746155569.269295:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123789440 00000100:00100000:1.0:1746155569.269297:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123789440 00010000:00010000:1.0:1746155569.269304:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094fa4800/0x844e5faceb5eba36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fbd expref: 30 pid: 29728 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746155569.269317:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6109 00000100:00100000:1.0:1746155569.269323:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123789568:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.269333:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155569.269347:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5eb987 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f7e expref: 8 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746155569.269356:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5eb987 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f7e expref: 8 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746155569.269377:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.269392:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123789568:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 69us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.269397:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6109 00000100:00100000:1.0:1746155569.269407:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6110 00000100:00100000:1.0:1746155569.269411:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123789440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.269416:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155569.269423:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094fa4800/0x844e5faceb5eba36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fbd expref: 30 pid: 29728 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746155569.269430:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094fa4800/0x844e5faceb5eba36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fbd expref: 30 pid: 29728 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746155569.269439:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.269451:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123789440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 40us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.269456:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6110 00010000:00010000:3.0:1746155569.269543:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fa4800/0x844e5faceb5eba36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fbd expref: 29 pid: 29728 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746155569.269558:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124592896:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155569.269578:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009286ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124593024:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155569.269586:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5eb987 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f7e expref: 7 pid: 4461 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746155569.269593:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124593152:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155569.269614:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1662976->1982463] (req 1662976->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.269623:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c29ac00, rc 0) 00000100:00100000:3.0:1746155569.269640:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:29193:x1830976123789312:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 12952us (15359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155569.269646:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12138 00000100:00100000:3.0:1746155569.272885:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123788928:12345-192.168.202.51@tcp:3:cat.0 Request processed in 30436us (30700us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155569.272896:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4672 00002000:00100000:3.0:1746155569.272907:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff8800910da300 x1830976123788928/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.272915:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910da300 with x1830976123788928 ext(1048576->2097151) 00002000:00010000:3.0:1746155569.272920:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910da300 00000100:00100000:0.0:1746155569.284326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.284348:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123789696 00000100:00100000:0.0:1746155569.284355:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123789696 00010000:00010000:0.0:1746155569.284383:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5eba60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe7 expref: 22 pid: 4461 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746155569.284405:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6111 00000100:00100000:0.0:1746155569.284411:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123789696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155569.284421:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155569.284438:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5eba60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe7 expref: 22 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746155569.284449:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5eba60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe7 expref: 22 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746155569.284465:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5eba60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe7 expref: 22 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746155569.284487:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155569.284489:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155569.284495:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.284519:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.284545:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155569.284554:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124593280:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155569.284625:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155569.284661:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.284727:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.284756:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123790080 00000100:00100000:0.0:1746155569.284759:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123790080 00000100:00100000:0.0:1746155569.284777:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10025 00000100:00100000:0.0:1746155569.284782:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29196:x1830976123790080:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155569.284796:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155569.284806:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebbda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110dc expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.284866:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.284876:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11026 expref: 10 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.284882:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5ebb08 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11049 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.284887:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebb9b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110b9 expref: 13 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.284892:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbbe lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110c0 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.284896:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 7/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.284909:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbbe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110c0 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.284916:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbbe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110c0 expref: 289 pid: 27374 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746155569.284927:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca97100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124593408:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155569.284952:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebb9b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110b9 expref: 13 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.284958:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebb9b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110b9 expref: 13 pid: 15474 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746155569.284964:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca96300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124593536:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155569.284978:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5ebb08 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11049 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.284983:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5ebb08 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11049 expref: 10 pid: 27374 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746155569.284989:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124593664:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155569.285002:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11026 expref: 10 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.285007:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11026 expref: 10 pid: 19870 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746155569.285013:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124593792:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155569.285021:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155569.285078:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123789824 00000100:00100000:0.0:1746155569.285080:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123789824 00000100:00100000:0.0:1746155569.285095:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12139 00000100:00100000:0.0:1746155569.285099:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29194:x1830976123789824:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155569.285105:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155569.285112:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110d5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.285123:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.285127:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155569.285129:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155569.285131:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110d5 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.285142:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.285149:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 27 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746155569.285157:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124593920:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155569.285177:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337480 going to sleep for 11 seconds 00000100:00100000:1.0:1746155569.287744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.287758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.287784:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123790464 00000100:00100000:1.0:1746155569.287789:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123790464 00010000:00010000:1.0:1746155569.287812:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbbe lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110c0 expref: 290 pid: 27374 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746155569.287832:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123790336 00000100:00100000:1.0:1746155569.287834:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123790336 00010000:00010000:1.0:1746155569.287843:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebb9b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110b9 expref: 14 pid: 15474 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746155569.287854:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124593280:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155569.287866:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6112 00010000:00010000:0.0:1746155569.287871:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.287872:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1962:x1830976123790464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.287881:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155569.287886:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbbe lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110c0 expref: 290 pid: 27374 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.287894:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbbe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110c0 expref: 290 pid: 27374 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746155569.287904:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976123789696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3491us (3584us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155569.287911:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6111 00010000:00010000:1.0:1746155569.287912:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155569.287917:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155569.287924:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155569.287929:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.287945:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1962:x1830976123790464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.287950:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6112 00000100:00100000:0.0:1746155569.287954:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6113 00000100:00100000:0.0:1746155569.287960:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123790336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155569.287966:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155569.287971:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebb9b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110b9 expref: 14 pid: 15474 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746155569.287975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155569.287979:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebb9b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110b9 expref: 14 pid: 15474 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746155569.287986:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123790720 00000100:00100000:1.0:1746155569.287988:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123790720 00010000:00010000:0.0:1746155569.287990:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155569.287993:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.287998:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.288002:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155569.288003:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5ebb08 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11049 expref: 11 pid: 27374 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746155569.288013:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6114 00000100:00100000:0.0:1746155569.288017:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123790336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.288018:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123790720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.288022:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155569.288022:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6113 00010000:00010000:1.0:1746155569.288025:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5ebb08 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11049 expref: 11 pid: 27374 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.288032:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5ebb08 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11049 expref: 11 pid: 27374 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.288040:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155569.288043:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155569.288047:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155569.288051:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155569.288052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.288062:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123790720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 44us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155569.288063:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123790592 00000100:00100000:1.0:1746155569.288066:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6114 00000100:00100000:0.0:1746155569.288066:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123790592 00010000:00010000:0.0:1746155569.288076:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11026 expref: 11 pid: 19870 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746155569.288096:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6115 00000100:00100000:1.0:1746155569.288100:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123790592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.288111:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155569.288115:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11026 expref: 11 pid: 19870 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.288121:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11026 expref: 11 pid: 19870 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.288132:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155569.288134:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155569.288140:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155569.288144:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155569.288154:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.288164:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123790592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 63us (112us total) trans 0 rc 0/0 00000100:00080000:2.0:1746155569.288195:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746155569.288213:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbbe lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110c0 expref: 289 pid: 27374 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746155569.288226:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca97100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124593408:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155569.288233:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebb9b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110b9 expref: 13 pid: 15474 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746155569.288239:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca96300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124593536:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155569.288245:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01ee600/0x844e5faceb5ebb08 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11049 expref: 11 pid: 27374 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746155569.288250:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124593664:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155569.288255:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081a00/0x844e5faceb5ebad0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11026 expref: 10 pid: 19870 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746155569.288261:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124593792:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155569.288278:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.288285:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.288289:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155569.288301:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155569.288400:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebbda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110dc expref: 14 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.288410:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110dc expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.288416:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155569.288418:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155569.288420:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b3c00, rc 0) 00000100:00100000:2.0:1746155569.288439:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29196:x1830976123790080:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3656us (3778us total) trans 8589943967 rc 0/0 00000100:00100000:2.0:1746155569.288444:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10025 00000100:00100000:2.0:1746155569.288498:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.288614:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123790848 00000100:00100000:2.0:1746155569.288617:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123790848 00002000:00100000:2.0:1746155569.288638:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1662976->1667071) req@ffff88008ff18000 x1830976123790848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.288647:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff18000 with x1830976123790848 ext(1662976->1667071) 00010000:00010000:2.0:1746155569.288653:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 28 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155569.288663:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 28 pid: 8436 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746155569.288668:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ff18000 00000100:00100000:2.0:1746155569.288685:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 728 00000100:00100000:2.0:1746155569.288691:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123790848:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155569.288788:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123790848:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 97us (289us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155569.288793:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 728 00002000:00100000:2.0:1746155569.288798:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1662976->1667071) req@ffff88008ff18000 x1830976123790848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746155580 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.288805:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff18000 with x1830976123790848 ext(1662976->1667071) 00010000:00010000:2.0:1746155569.288809:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 28 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155569.288817:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 28 pid: 8436 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746155569.288823:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ff18000 00000100:00100000:1.0:1746155569.290958:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6115 00000100:00100000:2.0:1746155569.291695:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124593920:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155569.291722:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110d5 expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.291741:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b18d400, rc 0) 00000100:00100000:2.0:1746155569.291788:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29194:x1830976123789824:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6686us (7059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155569.291793:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12139 00000100:00100000:0.0:1746155569.298373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.298472:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123791104 00000100:00100000:2.0:1746155569.298480:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123791104 00002000:00100000:2.0:1746155569.298542:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1978368->1982463) req@ffff88009ca95f80 x1830976123791104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.298550:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95f80 with x1830976123791104 ext(1978368->1982463) 00010000:00010000:2.0:1746155569.298557:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 28 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155569.298577:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 28 pid: 8436 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746155569.298584:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca95f80 00000100:00100000:2.0:1746155569.298602:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 729 00000100:00100000:2.0:1746155569.298609:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123791104:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155569.298764:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123791104:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 154us (398us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155569.298770:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 729 00002000:00100000:2.0:1746155569.298776:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1978368->1982463) req@ffff88009ca95f80 x1830976123791104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746155580 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.298787:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95f80 with x1830976123791104 ext(1978368->1982463) 00010000:00010000:2.0:1746155569.298791:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 28 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155569.298800:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 28 pid: 8436 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746155569.298805:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca95f80 00000100:00100000:0.0:1746155569.300748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.302203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.303415:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123791744 00000100:00100000:3.0:1746155569.303424:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123791744 00000100:00100000:3.0:1746155569.303465:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4047 00000100:00100000:3.0:1746155569.303472:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29193:x1830976123791744:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155569.303775:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123791360 00000100:00100000:2.0:1746155569.303780:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123791360 00000100:00100000:2.0:1746155569.303805:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10026 00000100:00100000:2.0:1746155569.303811:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29199:x1830976123791360:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155569.303820:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.303835:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5ebbf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110e3 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.303914:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.303926:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.303935:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.303946:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.303951:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304125:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304203:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18dc00/0x844e5faceb5ebc0b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304210:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18dc00/0x844e5faceb5ebc0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304215:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18dc00/0x844e5faceb5ebc0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155569.304222:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155569.304572:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304578:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304583:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304587:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801369b9400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155569.304590:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304595:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304605:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155569.304607:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155569.304610:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304618:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ebbfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304630:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304634:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304639:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304643:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801369b8a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155569.304645:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304649:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155569.304651:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:29193:x1830976123791744:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 1177us (2449us total) trans 8589943968 rc 0/0 00010000:00010000:2.0:1746155569.304655:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9c00) 00010000:00010000:2.0:1746155569.304657:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746155569.304659:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4047 00010000:00010000:2.0:1746155569.304659:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304663:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155569.304692:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5ebbf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110e3 expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.304703:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18dc00/0x844e5faceb5ebc0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110e3 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.304713:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155569.304714:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155569.304716:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b18dc00, rc 0) 00000100:00100000:2.0:1746155569.304741:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:29199:x1830976123791360:12345-192.168.202.51@tcp:101:cat.0 Request processed in 931us (3998us total) trans 8589943969 rc 0/0 00000100:00100000:2.0:1746155569.304746:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10026 00000100:00100000:0.0:1746155569.305019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.305042:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123791872 00000100:00100000:0.0:1746155569.305046:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123791872 00002000:00100000:0.0:1746155569.305070:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1662976->1982463) req@ffff88009ca96d80 x1830976123791872/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155569.305079:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96d80 with x1830976123791872 ext(1662976->1982463) 00010000:00010000:0.0:1746155569.305085:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 28 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746155569.305095:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 28 pid: 8436 timeout: 798 lvb_type: 0 00002000:00010000:0.0:1746155569.305101:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca96d80 00000100:00100000:1.0:1746155569.306526:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 730 00000100:00100000:1.0:1746155569.306536:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123791872:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155569.308569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.308624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.308674:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.308691:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123792000 00000100:00100000:1.0:1746155569.308697:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123792000 00000100:00100000:1.0:1746155569.308725:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123792128 00000100:00100000:1.0:1746155569.308727:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123792128 00000100:00100000:1.0:1746155569.308737:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123792256 00000100:00100000:1.0:1746155569.308738:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123792256 00000100:00100000:1.0:1746155569.308749:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12140 00000100:00100000:1.0:1746155569.308754:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123792000:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155569.308772:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155569.308786:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c71c00/0x844e5faceb5ebc19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110ea expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155569.308922:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12141 00000100:00100000:2.0:1746155569.308929:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123792128:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155569.308936:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.308943:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110f1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155569.308975:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124594048:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155569.309011:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12142 00000100:00100000:0.0:1746155569.309018:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123792256:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155569.309024:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155569.309031:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5ebc27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110f8 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.309046:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5ebc27 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110f8 expref: 29 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155569.309053:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5ebc27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110f8 expref: 29 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155569.309067:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f62800, rc 0) 00000100:00100000:0.0:1746155569.309104:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123792256:12345-192.168.202.51@tcp:101:cat.0 Request processed in 87us (430us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155569.309110:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12142 00000100:00100000:2.0:1746155569.309226:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155569.309612:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124594176:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155569.311034:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155569.312787:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124594048:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155569.312815:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc20 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110f1 expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.312827:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ebc20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110f1 expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.312836:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369b8a00, rc 0) 00000100:00100000:2.0:1746155569.312871:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123792128:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3941us (4246us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155569.312881:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12141 00000100:00100000:1.0:1746155569.313427:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123791872:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 6891us (8407us total) trans 17179873202 rc 0/0 00000100:00100000:1.0:1746155569.313435:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 730 00002000:00100000:1.0:1746155569.313443:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1662976->1982463) req@ffff88009ca96d80 x1830976123791872/t17179873202(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/448 e 0 to 0 dl 1746155580 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155569.313450:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96d80 with x1830976123791872 ext(1662976->1982463) 00010000:00010000:1.0:1746155569.313457:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 32 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.313468:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 32 pid: 8436 timeout: 798 lvb_type: 0 00002000:00010000:1.0:1746155569.313474:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca96d80 00002000:00010000:1.0:1746155569.315330:0:1625:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155567 -> 1746155569 00002000:00010000:1.0:1746155569.315335:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155567 -> 1746155569 00002000:00010000:1.0:1746155569.315337:0:1625:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155567 -> 1746155569 00000100:00100000:1.0:1746155569.315350:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124594176:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155569.315371:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c71c00/0x844e5faceb5ebc19 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ea expref: 31 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155569.315382:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c71c00/0x844e5faceb5ebc19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ea expref: 31 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155569.315718:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c71c00, rc 0) 00000100:00100000:1.0:1746155569.315749:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123792000:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6994us (7194us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155569.315755:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12140 00000100:00100000:0.0:1746155569.322482:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.323378:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123792384 00000100:00100000:1.0:1746155569.323387:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123792384 00010000:00010000:1.0:1746155569.323419:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 30 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746155569.323456:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6116 00000100:00100000:1.0:1746155569.323463:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123792384:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.323477:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155569.323495:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 30 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.323530:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 30 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.323548:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebbd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1982463) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ce expref: 30 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746155569.324202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155569.324680:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.324683:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.324690:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110d5 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.324703:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110d5 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.324730:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110d5 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155569.324740:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124594304:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155569.325453:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123792768 00000100:00100000:3.0:1746155569.325459:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123792768 00002000:00100000:3.0:1746155569.325486:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009ca95880 x1830976123792768/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.325494:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95880 with x1830976123792768 ext(0->1048575) 00002000:00010000:3.0:1746155569.325498:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca95880 00000100:00100000:3.0:1746155569.326008:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4674 00000100:00100000:3.0:1746155569.326015:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123792768:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155569.327286:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825240 going to sleep for 11 seconds 00000100:00100000:1.0:1746155569.343838:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124594304:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155569.343857:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.343967:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123792384:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 20502us (21491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.343977:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6116 00000100:00100000:0.0:1746155569.345863:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.345994:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123793024 00000100:00100000:3.0:1746155569.346001:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123793024 00002000:00100000:3.0:1746155569.346035:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009ca96a00 x1830976123793024/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.346043:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96a00 with x1830976123793024 ext(1048576->2097151) 00002000:00010000:3.0:1746155569.346047:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca96a00 00000100:00100000:3.0:1746155569.346711:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4675 00000100:00100000:3.0:1746155569.346720:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123793024:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155569.347449:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123792768:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21432us (23248us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155569.347457:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4674 00002000:00100000:0.0:1746155569.347464:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009ca95880 x1830976123792768/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155569.347472:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95880 with x1830976123792768 ext(0->1048575) 00002000:00010000:0.0:1746155569.347475:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca95880 00000100:00100000:0.0:1746155569.363745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.363902:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123793152 00000100:00100000:1.0:1746155569.363911:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123793152 00000100:00100000:1.0:1746155569.363961:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12143 00000100:00100000:1.0:1746155569.363969:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:29199:x1830976123793152:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155569.363984:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155569.364001:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01ee600/0x844e5faceb5ebc2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f110ff expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.364023:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.364025:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.364032:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01ee600/0x844e5faceb5ebc2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ff expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.364052:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01ee600/0x844e5faceb5ebc2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ff expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.364061:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01ee600, rc 0) 00000100:00100000:1.0:1746155569.364099:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29199:x1830976123793152:12345-192.168.202.51@tcp:101:cat.0 Request processed in 131us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.364105:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12143 00000100:00100000:3.0:1746155569.364754:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123793024:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18033us (18894us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155569.364762:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4675 00002000:00100000:3.0:1746155569.364769:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009ca96a00 x1830976123793024/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.364778:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96a00 with x1830976123793024 ext(1048576->2097151) 00002000:00010000:3.0:1746155569.364782:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca96a00 00000100:00100000:0.0:1746155569.378659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.378715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.379579:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123793408 00000100:00100000:3.0:1746155569.379590:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123793408 00000100:00100000:2.0:1746155569.379622:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123793664 00000100:00100000:2.0:1746155569.379625:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123793664 00002000:00100000:3.0:1746155569.379628:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009ca96300 x1830976123793408/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.379637:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96300 with x1830976123793408 ext(1048576->2097151) 00002000:00100000:2.0:1746155569.379639:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2461696->3145727) req@ffff88009ca97100 x1830976123793664/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746155569.379642:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca96300 00002000:00100000:2.0:1746155569.379645:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97100 with x1830976123793664 ext(2461696->3145727) 00002000:00010000:2.0:1746155569.379648:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca97100 00000100:00100000:3.0:1746155569.379659:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4676 00000100:00100000:3.0:1746155569.379665:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123793408:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155569.379666:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4677 00000100:00100000:2.0:1746155569.379670:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123793664:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155569.385600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.388918:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123793920 00000100:00100000:0.0:1746155569.388931:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123793920 00002000:00100000:1.0:1746155569.389001:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009fac7b80 x1830976123793920/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155569.389012:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7b80 with x1830976123793920 ext(1048576->2097151) 00002000:00010000:1.0:1746155569.389017:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac7b80 00000100:00100000:1.0:1746155569.389049:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4678 00000100:00100000:1.0:1746155569.389055:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123793920:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155569.411378:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123793664:12345-192.168.202.51@tcp:3:cat.0 Request processed in 31699us (32655us total) trans 0 rc 684032/684032 00000100:00100000:2.0:1746155569.411388:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4677 00002000:00100000:2.0:1746155569.411398:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2461696->3145727) req@ffff88009ca97100 x1830976123793664/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 684032/684032 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.411406:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97100 with x1830976123793664 ext(2461696->3145727) 00002000:00010000:2.0:1746155569.411411:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca97100 00000100:00100000:0.0:1746155569.466697:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.466991:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123793408:12345-192.168.202.51@tcp:3:cat.0 Request processed in 87324us (88337us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155569.467001:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4676 00002000:00100000:0.0:1746155569.467011:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009ca96300 x1830976123793408/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155569.467020:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96300 with x1830976123793408 ext(1048576->2097151) 00002000:00010000:0.0:1746155569.467025:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca96300 00000100:00100000:3.0:1746155569.467225:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123794176 00000100:00100000:3.0:1746155569.467231:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123794176 00000100:00100000:3.0:1746155569.467258:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10027 00000100:00100000:3.0:1746155569.467265:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:29202:x1830976123794176:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155569.467282:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.467297:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11106 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.467380:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b400/0x844e5faceb5ebc3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467391:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b400/0x844e5faceb5ebc3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467400:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b400/0x844e5faceb5ebc3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467410:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebc43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467415:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebc43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467419:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebc43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467527:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebc4a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467535:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebc4a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467541:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebc4a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155569.467549:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155569.467625:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b400/0x844e5faceb5ebc3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467631:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b400/0x844e5faceb5ebc3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467636:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b400/0x844e5faceb5ebc3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467641:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3b400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155569.467644:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b400/0x844e5faceb5ebc3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467650:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b400/0x844e5faceb5ebc3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467661:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155569.467663:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155569.467666:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b400/0x844e5faceb5ebc3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467670:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b400/0x844e5faceb5ebc3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467683:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebc43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467687:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebc43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467691:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebc43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467695:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3a800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155569.467697:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebc43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467701:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebc43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467706:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009c823b00) 00010000:00010000:3.0:1746155569.467708:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155569.467710:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebc43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467714:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebc43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155569.467743:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11106 expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.467753:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebc4a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11106 expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.467758:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155569.467759:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155569.467761:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3ac00, rc 0) 00000100:00100000:3.0:1746155569.467797:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29202:x1830976123794176:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 532us (1108us total) trans 8589943970 rc 0/0 00000100:00100000:3.0:1746155569.467802:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10027 00000100:00100000:0.0:1746155569.471733:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.471819:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123794304 00000100:00100000:2.0:1746155569.471826:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123794304 00000100:00100000:2.0:1746155569.471908:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12144 00000100:00100000:2.0:1746155569.471915:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123794304:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155569.471935:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.471950:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a539cc00/0x844e5faceb5ebc58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1110d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.471980:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a539cc00/0x844e5faceb5ebc58 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1110d expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.471989:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a539cc00/0x844e5faceb5ebc58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1110d expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.472008:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a539cc00, rc 0) 00000100:00100000:2.0:1746155569.473098:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123794304:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1181us (1368us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155569.473104:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12144 00000100:00100000:1.0:1746155569.500295:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123793920:12345-192.168.202.51@tcp:3:cat.0 Request processed in 111232us (114695us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155569.500304:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4678 00002000:00100000:1.0:1746155569.500313:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009fac7b80 x1830976123793920/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155569.500320:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7b80 with x1830976123793920 ext(1048576->2097151) 00002000:00010000:1.0:1746155569.500325:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac7b80 00000100:00100000:0.0:1746155569.514657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.514750:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123794432 00000100:00100000:2.0:1746155569.514757:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123794432 00000100:00100000:2.0:1746155569.514807:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12145 00000100:00100000:2.0:1746155569.514815:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123794432:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155569.514833:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.514848:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a539cc00/0x844e5faceb5ebc5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11114 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.514878:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a539cc00/0x844e5faceb5ebc5f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11114 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.514886:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a539cc00/0x844e5faceb5ebc5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11114 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.514907:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a539cc00, rc 0) 00000100:00100000:2.0:1746155569.514953:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123794432:12345-192.168.202.51@tcp:101:cat.0 Request processed in 140us (303us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155569.514959:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12145 00000100:00100000:0.0:1746155569.516436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.516534:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123794560 00000100:00100000:1.0:1746155569.516540:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123794560 00000100:00100000:1.0:1746155569.516577:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12146 00000100:00100000:1.0:1746155569.516584:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123794560:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155569.516595:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155569.516605:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e7a800/0x844e5faceb5ebc66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1111b expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.516622:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e7a800/0x844e5faceb5ebc66 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1111b expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155569.516630:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e7a800/0x844e5faceb5ebc66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1111b expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155569.517132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.517158:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123794688 00000100:00100000:0.0:1746155569.517161:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123794688 00000100:00100000:0.0:1746155569.517186:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 588 00000100:00100000:0.0:1746155569.517192:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1961:x1830976123794688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155569.517201:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155569.517217:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebc4a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11106 expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.517230:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155569.517234:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155569.517263:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1961:x1830976123794688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 71us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155569.517269:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 588 00000100:00100000:0.0:1746155569.520557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.520602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.520657:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123794816 00000100:00100000:3.0:1746155569.520663:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123794816 00000100:00100000:3.0:1746155569.520690:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123794944 00000100:00100000:3.0:1746155569.520692:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123794944 00000100:00100000:3.0:1746155569.520704:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12147 00000100:00100000:3.0:1746155569.520710:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:29199:x1830976123794816:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155569.520723:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.520738:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11122 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.520761:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.520768:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155569.520770:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155569.520773:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11122 expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.520799:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 17 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.520809:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 17 pid: 29728 timeout: 798 lvb_type: 0 00000100:00100000:3.0:1746155569.520819:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124594432:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155569.520877:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da480 going to sleep for 11 seconds 00000100:00100000:3.0:1746155569.520891:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12148 00000100:00100000:3.0:1746155569.520895:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29202:x1830976123794944:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155569.520901:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.520910:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11129 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.520922:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb979 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f85 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.520929:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5600/0x844e5faceb5eba67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fee expref: 21 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.520935:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5c00/0x844e5faceb5eba3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fc4 expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.520939:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155569.520941:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155569.520944:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1654784->1888255] (req 1654784->1888255) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 31 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.520956:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5c00/0x844e5faceb5eba3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fc4 expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.520963:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5c00/0x844e5faceb5eba3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fc4 expref: 31 pid: 8436 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746155569.520970:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124594560:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155569.520990:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5600/0x844e5faceb5eba67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fee expref: 21 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.520997:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5600/0x844e5faceb5eba67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fee expref: 21 pid: 4461 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746155569.521005:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124594688:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155569.521021:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb979 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f85 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.521028:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb979 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f85 expref: 6 pid: 8436 timeout: 798 lvb_type: 1 00000100:00100000:3.0:1746155569.521034:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124594816:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155569.521044:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746155569.522115:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e7a800, rc 0) 00000100:00100000:1.0:1746155569.526138:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123794560:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9545us (9694us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155569.526148:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12146 00000100:00100000:0.0:1746155569.529245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.532115:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123795072 00000100:00100000:2.0:1746155569.532127:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123795072 00000100:00100000:2.0:1746155569.532177:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12149 00000100:00100000:2.0:1746155569.532184:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29196:x1830976123795072:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155569.532200:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.532216:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11130 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.532239:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110d5 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.532247:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a01ee600/0x844e5faceb5ebc2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ff expref: 31 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.532253:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.532255:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.532258:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1589248->2097151] (req 1589248->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.532284:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a01ee600/0x844e5faceb5ebc2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ff expref: 31 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.532294:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a01ee600/0x844e5faceb5ebc2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ff expref: 31 pid: 1625 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746155569.532310:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124594944:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155569.532400:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110d5 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.532408:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110d5 expref: 23 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746155569.532417:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124595072:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155569.532434:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155569.532527:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124594432:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155569.532546:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11122 expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155569.532556:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155569.532557:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3ba00, rc 0) 00000100:00100000:1.0:1746155569.532586:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123795456 00000100:00100000:1.0:1746155569.532589:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123795456 00000100:00100000:3.0:1746155569.532595:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29199:x1830976123794816:12345-192.168.202.51@tcp:101:cat.0 Request processed in 11884us (12043us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155569.532601:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12147 00010000:00010000:1.0:1746155569.532605:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb979 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f85 expref: 7 pid: 8436 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746155569.532621:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6117 00000100:00100000:1.0:1746155569.532626:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123795456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.532633:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155569.532649:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb979 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f85 expref: 7 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746155569.532662:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb979 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f85 expref: 7 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746155569.532676:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.532692:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123795456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 65us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.532697:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6117 00000100:00100000:2.0:1746155569.532710:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124594560:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155569.532717:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124594688:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155569.532726:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5eb979 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f85 expref: 6 pid: 8436 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746155569.532749:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124594816:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155569.532774:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1654784->1888255] (req 1654784->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 31 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.532782:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c29ac00, rc 0) 00000100:00100000:2.0:1746155569.532801:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29202:x1830976123794944:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 11905us (12199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155569.532807:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12148 00000100:00100000:0.0:1746155569.535631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.535669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.535861:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123795328 00000100:00100000:1.0:1746155569.535868:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123795328 00010000:00010000:1.0:1746155569.535897:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5c00/0x844e5faceb5eba3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fc4 expref: 31 pid: 8436 timeout: 798 lvb_type: 1 00000100:00100000:1.0:1746155569.535936:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6118 00000100:00100000:1.0:1746155569.535943:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123795328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.535955:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155569.535973:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5c00/0x844e5faceb5eba3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fc4 expref: 31 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746155569.535984:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5c00/0x844e5faceb5eba3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fc4 expref: 31 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746155569.536003:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5c00/0x844e5faceb5eba3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fc4 expref: 31 pid: 8436 timeout: 798 lvb_type: 1 00010000:00010000:1.0:1746155569.536019:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.536052:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123795328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 110us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.536058:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6118 00000100:00100000:2.0:1746155569.536165:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123795200 00000100:00100000:2.0:1746155569.536389:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123795200 00002000:00100000:2.0:1746155569.536416:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1789952->2097151) req@ffff88008e26e680 x1830976123795200/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.536424:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26e680 with x1830976123795200 ext(1789952->2097151) 00010000:00010000:2.0:1746155569.536431:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 17 pid: 29728 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155569.536442:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 17 pid: 29728 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746155569.536447:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e26e680 00000100:00100000:2.0:1746155569.536460:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 731 00000100:00100000:2.0:1746155569.536465:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123795200:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155569.537889:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124594944:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155569.537899:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124595072:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155569.537944:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1589248->2097151] (req 1589248->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.537960:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a539c200, rc 0) 00000100:00100000:0.0:1746155569.537996:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29196:x1830976123795072:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5812us (8756us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155569.538002:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12149 00000100:00100000:0.0:1746155569.539239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.539297:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123795840 00000100:00100000:3.0:1746155569.539302:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123795840 00000100:00100000:3.0:1746155569.539331:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4048 00000100:00100000:3.0:1746155569.539336:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29194:x1830976123795840:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155569.539747:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.539772:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123795584 00000100:00100000:2.0:1746155569.539775:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123795584 00010000:00010000:2.0:1746155569.539791:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5600/0x844e5faceb5eba67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fee expref: 23 pid: 4461 timeout: 798 lvb_type: 1 00000100:00100000:2.0:1746155569.539808:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6119 00000100:00100000:2.0:1746155569.539813:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123795584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155569.539821:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155569.539837:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5600/0x844e5faceb5eba67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fee expref: 23 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155569.539853:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5600/0x844e5faceb5eba67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fee expref: 23 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155569.539870:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5600/0x844e5faceb5eba67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fee expref: 23 pid: 4461 timeout: 798 lvb_type: 1 00010000:00010000:2.0:1746155569.539882:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.539884:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.539889:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 29 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.539896:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 29 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.539918:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 29 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155569.539928:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124595200:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155569.539982:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155569.540758:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29194:x1830976123795840:12345-192.168.202.51@tcp:35:cat.0 Request processed in 1419us (1519us total) trans 8589943971 rc 0/0 00000100:00100000:3.0:1746155569.540764:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4048 00000100:00100000:2.0:1746155569.545532:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.545842:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.545864:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123795968 00000100:00100000:3.0:1746155569.545871:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123795968 00010000:00010000:3.0:1746155569.545900:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01ee600/0x844e5faceb5ebc2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ff expref: 30 pid: 1625 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746155569.545942:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124595200:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155569.545957:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155569.545988:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123795584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6174us (6241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155569.545994:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6119 00000100:00100000:2.0:1746155569.546010:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123796096 00000100:00100000:2.0:1746155569.546012:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123796096 00010000:00010000:2.0:1746155569.546021:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110d5 expref: 22 pid: 8436 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746155569.547077:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6120 00000100:00100000:2.0:1746155569.547086:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123795968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155569.547098:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155569.547280:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a01ee600/0x844e5faceb5ebc2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ff expref: 30 pid: 1625 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155569.547290:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a01ee600/0x844e5faceb5ebc2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ff expref: 30 pid: 1625 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746155569.547330:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6121 00000100:00100000:1.0:1746155569.547343:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123796096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.547353:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155569.547363:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110d5 expref: 22 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.547371:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110d5 expref: 22 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.547380:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5ebbe8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110d5 expref: 22 pid: 8436 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.547390:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.547392:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.547397:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01ee600/0x844e5faceb5ebc2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110ff expref: 30 pid: 1625 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.547398:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.547405:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.547645:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155569.547669:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123795968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 585us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155569.547674:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6120 00010000:00010000:1.0:1746155569.548099:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155569.548111:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131496300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124595328:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155569.548169:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155569.549162:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976123795200:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 12694us (13489us total) trans 21474840585 rc 0/0 00000100:00100000:2.0:1746155569.549170:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 731 00002000:00100000:2.0:1746155569.549176:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1789952->2097151) req@ffff88008e26e680 x1830976123795200/t21474840585(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/448 e 0 to 0 dl 1746155580 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.549190:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26e680 with x1830976123795200 ext(1789952->2097151) 00010000:00010000:2.0:1746155569.549197:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 19 pid: 29728 timeout: 798 lvb_type: 0 00010000:00010000:2.0:1746155569.549208:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 19 pid: 29728 timeout: 798 lvb_type: 0 00002000:00010000:2.0:1746155569.549213:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e26e680 00000100:00100000:0.0:1746155569.549958:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.550114:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123796352 00000100:00100000:2.0:1746155569.550121:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123796352 00002000:00100000:2.0:1746155569.550146:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1654784->1658879) req@ffff88008e26d180 x1830976123796352/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.550153:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26d180 with x1830976123796352 ext(1654784->1658879) 00002000:00010000:2.0:1746155569.550156:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26d180 00000100:00100000:2.0:1746155569.550168:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4679 00000100:00100000:2.0:1746155569.550174:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123796352:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155569.550291:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123796352:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 116us (332us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155569.550297:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4679 00002000:00100000:2.0:1746155569.550301:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1654784->1658879) req@ffff88008e26d180 x1830976123796352/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.550308:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26d180 with x1830976123796352 ext(1654784->1658879) 00002000:00010000:2.0:1746155569.550311:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26d180 00000100:00100000:1.0:1746155569.551634:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131496300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124595328:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155569.551656:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.551725:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123796096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4382us (5882us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.551733:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6121 00000100:00100000:0.0:1746155569.554159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.554615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.555055:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123796608 00000100:00100000:2.0:1746155569.555063:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123796608 00002000:00100000:2.0:1746155569.555099:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1589248->1593343) req@ffff88008e26f100 x1830976123796608/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.555108:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26f100 with x1830976123796608 ext(1589248->1593343) 00002000:00010000:2.0:1746155569.555112:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26f100 00000100:00100000:2.0:1746155569.555140:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4680 00000100:00100000:2.0:1746155569.555147:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123796608:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155569.555419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.555477:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123796992 00000100:00100000:3.0:1746155569.555481:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123796992 00002000:00100000:3.0:1746155569.555498:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1884160->1888255) req@ffff88008e26dc00 x1830976123796992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.555520:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26dc00 with x1830976123796992 ext(1884160->1888255) 00002000:00010000:3.0:1746155569.555524:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26dc00 00000100:00100000:3.0:1746155569.555540:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4681 00000100:00100000:3.0:1746155569.555546:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123796992:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155569.555632:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123796992:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 85us (212us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155569.555638:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4681 00002000:00100000:3.0:1746155569.555643:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3db:0x0] (1884160->1888255) req@ffff88008e26dc00 x1830976123796992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.555649:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26dc00 with x1830976123796992 ext(1884160->1888255) 00002000:00010000:3.0:1746155569.555652:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26dc00 00000100:00100000:1.0:1746155569.555816:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123796736 00000100:00100000:1.0:1746155569.555820:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123796736 00010000:00010000:1.0:1746155569.555838:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 19 pid: 29728 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746155569.555857:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6122 00000100:00100000:1.0:1746155569.555861:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123796736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.555870:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155569.555890:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 19 pid: 29728 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.555899:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 19 pid: 29728 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.555915:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebb2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1105e expref: 19 pid: 29728 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.555925:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.555927:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.555933:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11122 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.555945:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11122 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.555970:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11122 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155569.555980:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131496300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124595456:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155569.556019:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155569.556219:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123796608:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1072us (2064us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155569.556224:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4680 00002000:00100000:2.0:1746155569.556230:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1589248->1593343) req@ffff88008e26f100 x1830976123796608/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.556237:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26f100 with x1830976123796608 ext(1589248->1593343) 00002000:00010000:2.0:1746155569.556239:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26f100 00000100:00100000:0.0:1746155569.557935:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.558487:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123797248 00000100:00100000:3.0:1746155569.558493:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123797248 00000100:00100000:3.0:1746155569.558538:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4049 00000100:00100000:3.0:1746155569.558543:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:29202:x1830976123797248:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155569.558748:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29202:x1830976123797248:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 204us (816us total) trans 8589943972 rc 0/0 00000100:00100000:3.0:1746155569.558755:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4049 00000100:00100000:1.0:1746155569.560342:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131496300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124595456:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155569.560364:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.560407:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123796736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4539us (5786us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.560415:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6122 00000100:00100000:0.0:1746155569.566856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.566960:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123797504 00000100:00100000:3.0:1746155569.566968:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123797504 00002000:00100000:3.0:1746155569.567005:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88008e26c700 x1830976123797504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.567014:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26c700 with x1830976123797504 ext(1048576->2097151) 00002000:00010000:3.0:1746155569.567018:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26c700 00000100:00100000:3.0:1746155569.567034:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4682 00000100:00100000:3.0:1746155569.567041:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123797504:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155569.578272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.580342:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123797632 00000100:00100000:2.0:1746155569.580352:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123797632 00000100:00100000:2.0:1746155569.580407:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12150 00000100:00100000:2.0:1746155569.580415:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29196:x1830976123797632:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155569.580431:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.580447:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11137 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.580469:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.580480:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155569.580481:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155569.580484:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->1482751] (req 1048576->1482751) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.580536:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.580546:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 28 pid: 10591 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746155569.580557:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124595584:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155569.580655:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155569.583599:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123797504:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 16550us (16743us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155569.583610:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4682 00002000:00100000:3.0:1746155569.583620:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88008e26c700 x1830976123797504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.583628:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26c700 with x1830976123797504 ext(1048576->2097151) 00002000:00010000:3.0:1746155569.583633:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26c700 00000100:00100000:2.0:1746155569.583956:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124595584:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155569.583979:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->1482751] (req 1048576->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.583993:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b2c00, rc 0) 00000100:00100000:2.0:1746155569.584010:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29196:x1830976123797632:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3597us (5745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155569.584016:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12150 00000100:00100000:0.0:1746155569.584292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.585380:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123797760 00000100:00100000:3.0:1746155569.585389:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123797760 00002000:00100000:3.0:1746155569.585420:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1654784->1888255) req@ffff88009fac4380 x1830976123797760/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.585427:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4380 with x1830976123797760 ext(1654784->1888255) 00010000:00010000:3.0:1746155569.585435:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 29 pid: 10591 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746155569.585446:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 29 pid: 10591 timeout: 798 lvb_type: 0 00002000:00010000:3.0:1746155569.585451:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac4380 00000100:00100000:3.0:1746155569.585481:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 732 00000100:00100000:3.0:1746155569.585487:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123797760:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155569.591871:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.592115:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123797888 00000100:00100000:2.0:1746155569.592122:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123797888 00000100:00100000:2.0:1746155569.592154:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12151 00000100:00100000:2.0:1746155569.592160:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29199:x1830976123797888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155569.592175:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.592189:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1113e expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.592213:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.592219:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155569.592220:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155569.592223:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1113e expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.592244:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.592252:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 17 pid: 10591 timeout: 798 lvb_type: 0 00000100:00100000:2.0:1746155569.592261:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124595712:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155569.592317:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155569.598885:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123797760:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 13388us (14584us total) trans 17179873203 rc 0/0 00000100:00100000:3.0:1746155569.598900:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 732 00002000:00100000:3.0:1746155569.598909:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1654784->1888255) req@ffff88009fac4380 x1830976123797760/t17179873203(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/448 e 0 to 0 dl 1746155580 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.598918:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4380 with x1830976123797760 ext(1654784->1888255) 00010000:00010000:3.0:1746155569.598926:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 31 pid: 10591 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746155569.598937:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 31 pid: 10591 timeout: 798 lvb_type: 0 00002000:00010000:3.0:1746155569.598943:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac4380 00000100:00100000:2.0:1746155569.601773:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124595712:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155569.601795:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1113e expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.601810:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b2200, rc 0) 00000100:00100000:2.0:1746155569.602178:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:29199:x1830976123797888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10016us (10313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155569.602188:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12151 00000100:00100000:0.0:1746155569.602674:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.602754:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123798016 00000100:00100000:3.0:1746155569.602760:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123798016 00002000:00100000:3.0:1746155569.602792:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2461695) req@ffff880094086d80 x1830976123798016/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.602801:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094086d80 with x1830976123798016 ext(2097152->2461695) 00010000:00010000:3.0:1746155569.602808:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 18 pid: 10591 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746155569.602818:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 18 pid: 10591 timeout: 798 lvb_type: 0 00002000:00010000:3.0:1746155569.602825:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094086d80 00000100:00100000:3.0:1746155569.603473:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 733 00000100:00100000:3.0:1746155569.603481:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123798016:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155569.606084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.610724:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123798144 00000100:00100000:1.0:1746155569.610734:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123798144 00010000:00010000:1.0:1746155569.610766:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 31 pid: 10591 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746155569.610792:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6123 00000100:00100000:1.0:1746155569.610798:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123798144:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.610807:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746155569.610820:0:7063:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155567 -> 1746155570 00002000:00010000:1.0:1746155569.610822:0:7063:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155567 -> 1746155570 00010000:00010000:1.0:1746155569.610828:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 31 pid: 10591 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.610845:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 31 pid: 10591 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.610867:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5ebc74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1888255) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11129 expref: 31 pid: 10591 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.610889:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.610891:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.610896:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.610903:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.610934:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155569.610948:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131496300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124595840:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155569.611018:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155569.613396:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123798016:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 9910us (10716us total) trans 21474840586 rc 0/0 00000100:00100000:3.0:1746155569.613406:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 733 00002000:00100000:3.0:1746155569.613414:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2461695) req@ffff880094086d80 x1830976123798016/t21474840586(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/448 e 0 to 0 dl 1746155580 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.613423:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094086d80 with x1830976123798016 ext(2097152->2461695) 00010000:00010000:3.0:1746155569.613431:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 20 pid: 10591 timeout: 798 lvb_type: 0 00010000:00010000:3.0:1746155569.613443:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 20 pid: 10591 timeout: 798 lvb_type: 0 00002000:00010000:3.0:1746155569.613449:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094086d80 00000100:00100000:1.0:1746155569.614733:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131496300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124595840:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155569.614752:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.614780:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123798144:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3981us (8700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.614786:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6123 00000100:00100000:0.0:1746155569.617050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.617125:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.617475:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123798272 00000100:00100000:1.0:1746155569.617481:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123798272 00010000:00010000:1.0:1746155569.617533:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 20 pid: 10591 timeout: 798 lvb_type: 0 00000100:00100000:1.0:1746155569.617554:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6124 00000100:00100000:1.0:1746155569.617569:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123798272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.617579:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746155569.617595:0:7063:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155569 -> 1746155570 00002000:00010000:1.0:1746155569.617598:0:7063:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155569 -> 1746155570 00010000:00010000:1.0:1746155569.617602:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 20 pid: 10591 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.617613:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 20 pid: 10591 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.617630:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebb39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2461695) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1106c expref: 20 pid: 10591 timeout: 798 lvb_type: 0 00010000:00010000:1.0:1746155569.617646:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.617648:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.617653:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1113e expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.617660:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1113e expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.618195:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1113e expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155569.618211:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131496300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124595968:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155569.619118:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123798528 00000100:00100000:3.0:1746155569.619123:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123798528 00002000:00100000:3.0:1746155569.619149:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1478656->1482751) req@ffff880094087100 x1830976123798528/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.619157:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087100 with x1830976123798528 ext(1478656->1482751) 00002000:00010000:3.0:1746155569.619161:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094087100 00000100:00100000:3.0:1746155569.619173:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4683 00000100:00100000:3.0:1746155569.619178:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123798528:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155569.619293:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123798528:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 114us (2167us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155569.619298:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4683 00002000:00100000:3.0:1746155569.619303:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1478656->1482751) req@ffff880094087100 x1830976123798528/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.619310:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087100 with x1830976123798528 ext(1478656->1482751) 00002000:00010000:3.0:1746155569.619312:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094087100 00000100:00100000:1.0:1746155569.619399:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155569.626723:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131496300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124595968:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155569.626741:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.626779:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976123798272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9219us (9733us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.626788:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6124 00000100:00100000:0.0:1746155569.632114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.632166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.632877:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123798784 00000100:00100000:1.0:1746155569.632886:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123798784 00002000:00100000:1.0:1746155569.632924:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880094086680 x1830976123798784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155569.632933:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094086680 with x1830976123798784 ext(2097152->3145727) 00002000:00010000:1.0:1746155569.632938:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094086680 00000100:00100000:1.0:1746155569.632957:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123799040 00000100:00100000:1.0:1746155569.632960:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123799040 00002000:00100000:1.0:1746155569.632970:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094085880 x1830976123799040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155569.632976:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085880 with x1830976123799040 ext(3145728->4194303) 00002000:00010000:1.0:1746155569.632978:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094085880 00000100:00100000:2.0:1746155569.632981:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4684 00000100:00100000:2.0:1746155569.632989:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123798784:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155569.632993:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4685 00000100:00100000:1.0:1746155569.632997:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123799040:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155569.647598:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123798784:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14601us (15484us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155569.647609:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4684 00002000:00100000:2.0:1746155569.647619:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880094086680 x1830976123798784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.647628:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094086680 with x1830976123798784 ext(2097152->3145727) 00002000:00010000:2.0:1746155569.647633:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094086680 00000100:00100000:1.0:1746155569.648939:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123799040:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15935us (16767us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155569.648951:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4685 00002000:00100000:1.0:1746155569.648958:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094085880 x1830976123799040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155569.648966:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085880 with x1830976123799040 ext(3145728->4194303) 00002000:00010000:1.0:1746155569.648970:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094085880 00000100:00100000:0.0:1746155569.655228:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.655261:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.655410:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123799168 00000100:00100000:1.0:1746155569.655418:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123799168 00000100:00100000:1.0:1746155569.655458:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123799296 00000100:00100000:1.0:1746155569.655460:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123799296 00000100:00100000:1.0:1746155569.655480:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12152 00000100:00100000:1.0:1746155569.655487:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123799168:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155569.655515:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155569.655530:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ebc90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11145 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155569.655583:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131496300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124596096:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155569.655640:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155569.655770:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12153 00000100:00100000:0.0:1746155569.655777:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123799296:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155569.655783:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155569.655790:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5ebc97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1114c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155569.655812:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094084e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124596224:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155569.655841:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00002000:00010000:2.0:1746155569.659743:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime: 1746155567 -> 1746155570 00002000:00010000:1.0:1746155569.659758:0:10591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155569 -> 1746155570 00002000:00010000:1.0:1746155569.659761:0:10591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155569 -> 1746155570 00002000:00010000:1.0:1746155569.659763:0:10591:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155569 -> 1746155570 00000100:00100000:2.0:1746155569.659767:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094084e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124596224:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155569.659769:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131496300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124596096:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155569.659792:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5ebc97 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1114c expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155569.659792:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ebc90 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11145 expref: 33 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.659803:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5ebc97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1114c expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155569.659803:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ebc90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11145 expref: 33 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155569.659821:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013121e400, rc 0) 00000100:00100000:1.0:1746155569.659867:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123799168:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4379us (4646us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155569.659875:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12152 00010000:00010000:2.0:1746155569.660618:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a231800, rc 0) 00000100:00100000:2.0:1746155569.660644:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123799296:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4868us (5381us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155569.660649:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12153 00000100:00100000:0.0:1746155569.669930:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.670006:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123799552 00000100:00100000:2.0:1746155569.670015:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123799552 00000100:00100000:0.0:1746155569.670273:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.670455:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123799424 00000100:00100000:2.0:1746155569.670459:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123799424 00000100:00100000:2.0:1746155569.670478:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12154 00000100:00100000:2.0:1746155569.670485:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123799552:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155569.670527:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.670543:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a231400/0x844e5faceb5ebc9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1115a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155569.670577:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12155 00000100:00100000:3.0:1746155569.670584:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123799424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155569.670590:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155569.670592:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124596352:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155569.670596:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8400/0x844e5faceb5ebca5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11153 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155569.670615:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124596480:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155569.671317:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fb540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155569.671363:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155569.672682:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124596352:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155569.672704:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a231400/0x844e5faceb5ebc9e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1115a expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.672714:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a231400/0x844e5faceb5ebc9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1115a expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155569.672789:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124596480:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155569.672805:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8400/0x844e5faceb5ebca5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11153 expref: 32 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.672812:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8400/0x844e5faceb5ebca5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11153 expref: 32 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.672830:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4c8400, rc 0) 00010000:00010000:2.0:1746155569.672877:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a231400, rc 0) 00000100:00100000:3.0:1746155569.672921:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123799424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2337us (2648us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155569.672929:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12155 00000100:00100000:2.0:1746155569.673008:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123799552:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2523us (3085us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155569.673013:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12154 00000100:00100000:0.0:1746155569.676761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.676909:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123799680 00000100:00100000:2.0:1746155569.676916:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123799680 00000100:00100000:2.0:1746155569.676959:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12156 00000100:00100000:2.0:1746155569.676967:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123799680:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155569.676986:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.677000:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2800/0x844e5faceb5ebcac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11161 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155569.677043:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124596608:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155569.677344:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155569.677427:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.677528:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123799808 00000100:00100000:3.0:1746155569.677535:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123799808 00000100:00100000:3.0:1746155569.677566:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12157 00000100:00100000:3.0:1746155569.677572:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123799808:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155569.677579:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.677586:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8a00/0x844e5faceb5ebcb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11168 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155569.677606:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124596736:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155569.677657:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fb540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155569.678642:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124596608:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155569.678661:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2800/0x844e5faceb5ebcac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11161 expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.678671:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2800/0x844e5faceb5ebcac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11161 expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.678682:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b2800, rc 0) 00000100:00100000:2.0:1746155569.678715:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123799680:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1749us (1962us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155569.678721:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12156 00000100:00100000:3.0:1746155569.679075:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124596736:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155569.679091:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8a00/0x844e5faceb5ebcb3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11168 expref: 31 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.679099:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8a00/0x844e5faceb5ebcb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11168 expref: 31 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.679116:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4c8a00, rc 0) 00000100:00100000:3.0:1746155569.679135:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123799808:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1563us (1708us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155569.679139:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12157 00000100:00100000:0.0:1746155569.682672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.684158:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123800064 00000100:00100000:2.0:1746155569.684168:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123800064 00000100:00100000:2.0:1746155569.684223:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4050 00000100:00100000:2.0:1746155569.684230:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29199:x1830976123800064:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155569.684434:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:29199:x1830976123800064:12345-192.168.202.51@tcp:35:cat.0 Request processed in 203us (1768us total) trans 8589943973 rc 0/0 00000100:00100000:2.0:1746155569.684441:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4050 00000100:00100000:0.0:1746155569.760213:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.761331:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123800320 00000100:00100000:2.0:1746155569.761340:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123800320 00000100:00100000:2.0:1746155569.761821:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10028 00000100:00100000:2.0:1746155569.761830:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29208:x1830976123800320:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155569.761849:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.761864:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2800/0x844e5faceb5ebcba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1116f expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.761948:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2400/0x844e5faceb5ebcc1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.761958:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2400/0x844e5faceb5ebcc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.761967:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2400/0x844e5faceb5ebcc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.761978:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5ebcc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.761983:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5ebcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.761988:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5ebcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762165:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c000/0x844e5faceb5ebccf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762172:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c000/0x844e5faceb5ebccf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762177:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c000/0x844e5faceb5ebccf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155569.762199:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155569.762625:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2400/0x844e5faceb5ebcc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762632:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2400/0x844e5faceb5ebcc1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762637:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2400/0x844e5faceb5ebcc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762655:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c7b2400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155569.762668:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2400/0x844e5faceb5ebcc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762689:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2400/0x844e5faceb5ebcc1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762699:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155569.762701:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155569.762704:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2400/0x844e5faceb5ebcc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762720:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2400/0x844e5faceb5ebcc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762743:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5ebcc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762748:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5ebcc8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762752:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5ebcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762759:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0db3000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155569.762761:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5ebcc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762765:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5ebcc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762771:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9a00) 00010000:00010000:2.0:1746155569.762773:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155569.762775:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5ebcc8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762778:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3000/0x844e5faceb5ebcc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.762812:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2800/0x844e5faceb5ebcba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1116f expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.762823:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c000/0x844e5faceb5ebccf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1116f expref: 16 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.762828:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155569.762830:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155569.762832:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94c000, rc 0) 00000100:00100000:2.0:1746155569.762889:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29208:x1830976123800320:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1059us (2682us total) trans 8589943974 rc 0/0 00000100:00100000:2.0:1746155569.762895:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10028 00000100:00100000:0.0:1746155569.771873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.772230:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123800576 00000100:00100000:2.0:1746155569.772239:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123800576 00000100:00100000:2.0:1746155569.772291:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4051 00000100:00100000:2.0:1746155569.772299:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29208:x1830976123800576:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155569.772491:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29208:x1830976123800576:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 193us (625us total) trans 8589943975 rc 0/0 00000100:00100000:2.0:1746155569.772497:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4051 00000100:00100000:0.0:1746155569.778612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.778762:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123800832 00000100:00100000:2.0:1746155569.778770:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123800832 00000100:00100000:2.0:1746155569.778909:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10029 00000100:00100000:2.0:1746155569.778917:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29212:x1830976123800832:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155569.778939:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.778955:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdc8a00/0x844e5faceb5ebcdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11176 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.779041:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdc8800/0x844e5faceb5ebce4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779051:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdc8800/0x844e5faceb5ebce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779060:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdc8800/0x844e5faceb5ebce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779071:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5ebceb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779076:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5ebceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779081:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5ebceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779168:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebcf2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779176:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779182:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebcf2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155569.779188:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155569.779259:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdc8800/0x844e5faceb5ebce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779265:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdc8800/0x844e5faceb5ebce4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779270:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdc8800/0x844e5faceb5ebce4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779274:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdc8800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155569.779277:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdc8800/0x844e5faceb5ebce4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779282:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdc8800/0x844e5faceb5ebce4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779291:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155569.779294:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155569.779297:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdc8800/0x844e5faceb5ebce4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779301:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdc8800/0x844e5faceb5ebce4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779317:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5ebceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779322:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5ebceb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779326:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5ebceb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779330:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090013200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155569.779332:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5ebceb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779337:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5ebceb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779343:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9c00) 00010000:00010000:2.0:1746155569.779345:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155569.779347:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5ebceb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779350:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090013200/0x844e5faceb5ebceb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155569.779382:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdc8a00/0x844e5faceb5ebcdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11176 expref: 20 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.779392:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebcf2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11176 expref: 19 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.779397:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155569.779399:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155569.779401:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6041e00, rc 0) 00000100:00100000:2.0:1746155569.780110:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29212:x1830976123800832:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1192us (1503us total) trans 8589943976 rc 0/0 00000100:00100000:2.0:1746155569.780116:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10029 00000100:00100000:0.0:1746155569.785496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.786042:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123800960 00000100:00100000:1.0:1746155569.786050:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123800960 00000100:00100000:1.0:1746155569.786102:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 589 00000100:00100000:1.0:1746155569.786110:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123800960:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.786123:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155569.786144:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6041e00/0x844e5faceb5ebcf2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11176 expref: 19 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.786172:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155569.786175:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.786211:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123800960:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 102us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.786217:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 589 00000100:00100000:0.0:1746155569.789076:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.789123:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.789237:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123801088 00000100:00100000:3.0:1746155569.789244:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123801088 00000100:00100000:3.0:1746155569.789312:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123801216 00000100:00100000:3.0:1746155569.789315:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123801216 00000100:00100000:3.0:1746155569.789544:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12158 00000100:00100000:3.0:1746155569.789552:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123801088:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155569.789578:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.789593:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4c8e00/0x844e5faceb5ebd00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1117d expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.789611:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155569.789614:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155569.789621:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4c8e00/0x844e5faceb5ebd00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1117d expref: 21 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.789634:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4c8e00/0x844e5faceb5ebd00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1117d expref: 21 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.789644:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4c8e00, rc 0) 00000100:00100000:2.0:1746155569.789769:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12159 00000100:00100000:2.0:1746155569.789778:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123801216:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155569.789786:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.789794:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebd07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11184 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.789804:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.789805:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.789815:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebd07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11184 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.789825:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebd07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11184 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.789832:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd0f200, rc 0) 00000100:00100000:3.0:1746155569.793006:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123801088:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3444us (3925us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155569.793017:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12158 00000100:00100000:2.0:1746155569.793268:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123801216:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3489us (4142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155569.793275:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12159 00000100:00100000:0.0:1746155569.812651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.812684:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.812723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.812800:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123801472 00000100:00100000:3.0:1746155569.812808:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123801472 00002000:00100000:3.0:1746155569.812847:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1589247) req@ffff88012bdf6d80 x1830976123801472/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.812857:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf6d80 with x1830976123801472 ext(1048576->1589247) 00002000:00010000:3.0:1746155569.812862:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf6d80 00000100:00100000:3.0:1746155569.812876:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123801728 00000100:00100000:3.0:1746155569.812879:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123801728 00002000:00100000:3.0:1746155569.812888:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1482752->2097151) req@ffff88012bdf5c00 x1830976123801728/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.812894:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5c00 with x1830976123801728 ext(1482752->2097151) 00002000:00010000:3.0:1746155569.812896:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf5c00 00000100:00100000:3.0:1746155569.812904:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123801984 00000100:00100000:3.0:1746155569.812907:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123801984 00002000:00100000:3.0:1746155569.812915:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012bdf5180 x1830976123801984/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.812921:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5180 with x1830976123801984 ext(1048576->2097151) 00002000:00010000:3.0:1746155569.812923:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5180 00000100:00100000:3.0:1746155569.812934:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4686 00000100:00100000:3.0:1746155569.812941:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976123801472:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155569.813859:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4687 00000100:00100000:3.0:1746155569.813866:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123801728:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155569.814540:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4688 00000100:00100000:3.0:1746155569.814548:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123801984:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155569.821046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.821094:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123802240 00000100:00100000:0.0:1746155569.821101:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123802240 00000100:00100000:0.0:1746155569.821131:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10030 00000100:00100000:0.0:1746155569.821138:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:29214:x1830976123802240:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155569.821159:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155569.821174:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d15e00/0x844e5faceb5ebd0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1118b expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.821259:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebd15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821270:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebd15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821279:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebd15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821289:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14200/0x844e5faceb5ebd1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821293:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14200/0x844e5faceb5ebd1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821298:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14200/0x844e5faceb5ebd1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821371:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ebd23 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821377:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ebd23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821381:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ebd23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155569.821387:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155569.821441:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebd15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821447:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebd15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821451:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebd15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821459:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3d14c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155569.821462:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebd15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821467:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebd15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821474:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155569.821476:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155569.821478:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebd15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821482:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5ebd15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821516:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14200/0x844e5faceb5ebd1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821520:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14200/0x844e5faceb5ebd1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821524:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14200/0x844e5faceb5ebd1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821528:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3d14200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155569.821529:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14200/0x844e5faceb5ebd1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821533:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14200/0x844e5faceb5ebd1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821537:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008e62d300) 00010000:00010000:0.0:1746155569.821539:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155569.821541:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14200/0x844e5faceb5ebd1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821545:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14200/0x844e5faceb5ebd1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155569.821580:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d15e00/0x844e5faceb5ebd0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1118b expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.821589:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ebd23 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1118b expref: 297 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.821594:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155569.821596:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155569.821597:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3d15c00, rc 0) 00000100:00100000:0.0:1746155569.821640:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29214:x1830976123802240:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 502us (601us total) trans 8589943977 rc 0/0 00000100:00100000:0.0:1746155569.821645:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10030 00000100:00100000:3.0:1746155569.826810:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123801472:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13859us (14156us total) trans 0 rc 540672/540672 00000100:00100000:3.0:1746155569.826824:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4686 00002000:00100000:3.0:1746155569.826835:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1589247) req@ffff88012bdf6d80 x1830976123801472/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 540672/540672 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.826844:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf6d80 with x1830976123801472 ext(1048576->1589247) 00002000:00010000:3.0:1746155569.826849:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf6d80 00000100:00100000:3.0:1746155569.832115:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123801728:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18241us (19420us total) trans 0 rc 614400/614400 00000100:00100000:3.0:1746155569.832124:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4687 00002000:00100000:3.0:1746155569.832133:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1482752->2097151) req@ffff88012bdf5c00 x1830976123801728/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.832142:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5c00 with x1830976123801728 ext(1482752->2097151) 00002000:00010000:3.0:1746155569.832147:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf5c00 00000100:00100000:0.0:1746155569.837754:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123801984:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23198us (25020us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155569.837765:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4688 00002000:00100000:0.0:1746155569.837774:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012bdf5180 x1830976123801984/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155569.837783:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5180 with x1830976123801984 ext(1048576->2097151) 00002000:00010000:0.0:1746155569.837788:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5180 00000100:00100000:0.0:1746155569.839677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.839701:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123802368 00000100:00100000:0.0:1746155569.839708:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123802368 00000100:00100000:0.0:1746155569.840546:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 590 00000100:00100000:0.0:1746155569.840555:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1962:x1830976123802368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155569.840577:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155569.840598:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ebd23 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1118b expref: 297 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.840612:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155569.840616:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155569.840950:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:1962:x1830976123802368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 395us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155569.840957:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 590 00000100:00100000:0.0:1746155569.851127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.851196:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123802624 00000100:00100000:2.0:1746155569.851205:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123802624 00002000:00100000:2.0:1746155569.851242:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012bdf7480 x1830976123802624/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.851257:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7480 with x1830976123802624 ext(2097152->3145727) 00002000:00010000:2.0:1746155569.851262:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf7480 00000100:00100000:2.0:1746155569.851290:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4689 00000100:00100000:2.0:1746155569.851297:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123802624:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155569.861607:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123802624:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10301us (10478us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155569.861617:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4689 00002000:00100000:2.0:1746155569.861628:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012bdf7480 x1830976123802624/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/440 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.861636:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7480 with x1830976123802624 ext(2097152->3145727) 00002000:00010000:2.0:1746155569.861641:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf7480 00000100:00100000:0.0:1746155569.865613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.865697:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123802752 00000100:00100000:2.0:1746155569.865704:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123802752 00000100:00100000:2.0:1746155569.865738:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12160 00000100:00100000:2.0:1746155569.865745:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29208:x1830976123802752:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155569.865760:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.865776:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11192 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.865798:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11122 expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.865806:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4c8e00/0x844e5faceb5ebd00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1117d expref: 22 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.865817:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.865819:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.865822:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [2023424->2097151] (req 2023424->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.865844:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4c8e00/0x844e5faceb5ebd00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1117d expref: 22 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155569.865855:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4c8e00/0x844e5faceb5ebd00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1117d expref: 22 pid: 20200 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746155569.865865:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124596864:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155569.866308:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11122 expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.866317:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11122 expref: 27 pid: 20200 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155569.866325:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124596992:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155569.866342:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155569.873627:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124596864:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155569.873704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.873724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.873812:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124596992:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155569.873815:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123803008 00000100:00100000:1.0:1746155569.873822:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123803008 00010000:00010000:3.0:1746155569.873840:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [2023424->2097151] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.873848:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4c8e00/0x844e5faceb5ebd00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1117d expref: 23 pid: 20200 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746155569.873854:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3ac00, rc 0) 00000100:00100000:1.0:1746155569.873870:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6125 00000100:00100000:1.0:1746155569.873876:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123803008:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.873887:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155569.873892:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29208:x1830976123802752:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8147us (8286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155569.873899:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12160 00010000:00010000:1.0:1746155569.873907:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4c8e00/0x844e5faceb5ebd00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1117d expref: 23 pid: 20200 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155569.873915:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123802880 00000100:00100000:3.0:1746155569.873917:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123802880 00010000:00010000:1.0:1746155569.873917:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4c8e00/0x844e5faceb5ebd00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1117d expref: 22 pid: 20200 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746155569.873935:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4c8e00/0x844e5faceb5ebd00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1117d expref: 23 pid: 20200 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155569.873937:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12161 00000100:00100000:3.0:1746155569.873941:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123802880:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155569.873950:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155569.873953:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.873961:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8a00/0x844e5faceb5ebd38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11199 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155569.873971:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123803008:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (245us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155569.873972:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746155569.873976:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6125 00010000:00010000:3.0:1746155569.873979:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8a00/0x844e5faceb5ebd38 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11199 expref: 23 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.873985:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8a00/0x844e5faceb5ebd38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11199 expref: 22 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.873999:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb8a00, rc 0) 00000100:00100000:3.0:1746155569.874014:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123802880:12345-192.168.202.51@tcp:101:cat.0 Request processed in 73us (312us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155569.874018:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12161 00000100:00100000:1.0:1746155569.874388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.874920:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123803136 00000100:00100000:0.0:1746155569.874925:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123803136 00010000:00010000:0.0:1746155569.874940:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11122 expref: 28 pid: 20200 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746155569.876031:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6126 00000100:00100000:0.0:1746155569.876040:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123803136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155569.876050:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155569.876066:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11122 expref: 28 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155569.876077:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11122 expref: 28 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155569.876093:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ba00/0x844e5faceb5ebc6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11122 expref: 28 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155569.876119:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155569.876121:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155569.876126:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.876133:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.876159:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155569.876169:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124597120:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155569.876322:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155569.877948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.878041:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124597120:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155569.878059:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155569.878098:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123803136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2060us (3709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155569.878107:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6126 00000100:00100000:3.0:1746155569.878393:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123803392 00000100:00100000:3.0:1746155569.878399:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123803392 00002000:00100000:3.0:1746155569.878429:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (2023424->2027519) req@ffff88012bdf4e00 x1830976123803392/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.878437:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4e00 with x1830976123803392 ext(2023424->2027519) 00002000:00010000:3.0:1746155569.878441:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf4e00 00000100:00100000:3.0:1746155569.878456:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4690 00000100:00100000:3.0:1746155569.878461:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123803392:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155569.878615:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123803392:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 153us (671us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155569.878621:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4690 00002000:00100000:3.0:1746155569.878626:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (2023424->2027519) req@ffff88012bdf4e00 x1830976123803392/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.878633:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4e00 with x1830976123803392 ext(2023424->2027519) 00002000:00010000:3.0:1746155569.878635:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf4e00 00000100:00100000:0.0:1746155569.881857:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.881970:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.882112:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123803776 00000100:00100000:2.0:1746155569.882120:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123803776 00000100:00100000:2.0:1746155569.882153:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4052 00000100:00100000:2.0:1746155569.882160:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29212:x1830976123803776:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155569.882362:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123803520 00000100:00100000:3.0:1746155569.882365:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123803520 00000100:00100000:3.0:1746155569.882394:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12162 00000100:00100000:3.0:1746155569.882399:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29208:x1830976123803520:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155569.882410:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.882425:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111a0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.882444:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1113e expref: 26 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.882451:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebd07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11184 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.882457:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155569.882459:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155569.882461:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->2748415] (req 2097152->2748415) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 22 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.882483:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebd07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11184 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.882494:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebd07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11184 expref: 22 pid: 8436 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155569.882532:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124597248:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155569.882603:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1113e expref: 26 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.882611:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1113e expref: 26 pid: 1625 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155569.882629:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124597376:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155569.882648:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155569.883172:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29212:x1830976123803776:12345-192.168.202.51@tcp:35:cat.0 Request processed in 1011us (1199us total) trans 8589943978 rc 0/0 00000100:00100000:2.0:1746155569.883179:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4052 00000100:00100000:3.0:1746155569.888569:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124597248:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155569.888583:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124597376:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155569.888616:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->2748415] (req 2097152->2748415) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 22 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.888632:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb9000, rc 0) 00000100:00100000:3.0:1746155569.888688:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29208:x1830976123803520:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6287us (6836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155569.888696:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12162 00000100:00100000:0.0:1746155569.893372:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.893443:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123803904 00000100:00100000:2.0:1746155569.893450:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123803904 00010000:00010000:2.0:1746155569.893481:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebd07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11184 expref: 22 pid: 8436 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746155569.893596:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6127 00000100:00100000:2.0:1746155569.893604:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123803904:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155569.893616:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155569.893638:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebd07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11184 expref: 22 pid: 8436 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155569.893649:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebd07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11184 expref: 22 pid: 8436 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155569.893667:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd0f200/0x844e5faceb5ebd07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11184 expref: 22 pid: 8436 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155569.893684:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155569.893787:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123803904:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 182us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155569.893792:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6127 00000100:00100000:0.0:1746155569.894781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.894839:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123804032 00000100:00100000:2.0:1746155569.894843:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123804032 00010000:00010000:2.0:1746155569.894858:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1113e expref: 27 pid: 1625 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155569.895165:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6128 00000100:00100000:2.0:1746155569.895172:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123804032:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155569.895182:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155569.895192:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1113e expref: 27 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155569.895202:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1113e expref: 27 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155569.895215:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5ebc89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1113e expref: 27 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155569.895225:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.895227:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155569.895232:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.895243:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.895268:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155569.895278:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124597504:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155569.901040:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155569.903161:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124597504:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155569.903179:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155569.903216:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123804032:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8044us (8435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155569.903226:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6128 00000100:00100000:0.0:1746155569.911091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.911531:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123804288 00000100:00100000:2.0:1746155569.911539:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123804288 00002000:00100000:2.0:1746155569.911587:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2744320->2748415) req@ffff880090189f80 x1830976123804288/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.911596:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189f80 with x1830976123804288 ext(2744320->2748415) 00002000:00010000:2.0:1746155569.911601:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090189f80 00000100:00100000:2.0:1746155569.911630:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4691 00000100:00100000:2.0:1746155569.911637:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123804288:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155569.911782:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123804288:12345-192.168.202.51@tcp:3:cat.0 Request processed in 144us (696us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155569.911790:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4691 00002000:00100000:2.0:1746155569.911796:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2744320->2748415) req@ffff880090189f80 x1830976123804288/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746155580 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.911801:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189f80 with x1830976123804288 ext(2744320->2748415) 00002000:00010000:2.0:1746155569.911804:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090189f80 00000100:00100000:0.0:1746155569.936448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.936484:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123804544 00000100:00100000:0.0:1746155569.936491:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123804544 00000100:00100000:0.0:1746155569.937387:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10031 00000100:00100000:0.0:1746155569.937396:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:29219:x1830976123804544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155569.937414:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155569.937430:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebd46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111a7 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.937542:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7aa00/0x844e5faceb5ebd4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937553:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7aa00/0x844e5faceb5ebd4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937572:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7aa00/0x844e5faceb5ebd4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937583:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b600/0x844e5faceb5ebd54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937588:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b600/0x844e5faceb5ebd54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937593:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b600/0x844e5faceb5ebd54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937678:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7a400/0x844e5faceb5ebd5b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937686:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7a400/0x844e5faceb5ebd5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937691:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7a400/0x844e5faceb5ebd5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155569.937698:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155569.937760:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7aa00/0x844e5faceb5ebd4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937766:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7aa00/0x844e5faceb5ebd4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937770:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7aa00/0x844e5faceb5ebd4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937774:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e7aa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155569.937777:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7aa00/0x844e5faceb5ebd4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937782:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7aa00/0x844e5faceb5ebd4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937790:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155569.937792:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155569.937795:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7aa00/0x844e5faceb5ebd4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937799:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7aa00/0x844e5faceb5ebd4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937817:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b600/0x844e5faceb5ebd54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937822:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b600/0x844e5faceb5ebd54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937825:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b600/0x844e5faceb5ebd54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937828:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e7b600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155569.937830:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b600/0x844e5faceb5ebd54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937837:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b600/0x844e5faceb5ebd54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937841:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008e62d100) 00010000:00010000:0.0:1746155569.937843:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155569.937845:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b600/0x844e5faceb5ebd54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937848:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7b600/0x844e5faceb5ebd54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155569.937874:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7ac00/0x844e5faceb5ebd46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a7 expref: 299 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.937883:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7a400/0x844e5faceb5ebd5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a7 expref: 298 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.937887:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155569.937889:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155569.937891:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e7a400, rc 0) 00000100:00100000:0.0:1746155569.937930:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:29219:x1830976123804544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 536us (1491us total) trans 8589943979 rc 0/0 00000100:00100000:0.0:1746155569.937936:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10031 00000100:00100000:0.0:1746155569.942606:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.942658:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123804672 00000100:00100000:3.0:1746155569.942666:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123804672 00000100:00100000:3.0:1746155569.942714:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12163 00000100:00100000:3.0:1746155569.942722:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29214:x1830976123804672:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155569.942738:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.942751:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111ae expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.942774:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.942781:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155569.942783:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155569.942786:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1245184->1941503] (req 1245184->1941503) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 31 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.942807:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.942817:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 21 pid: 1625 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155569.942826:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124597632:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155569.942910:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155569.944630:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.944848:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123804800 00000100:00100000:0.0:1746155569.944853:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123804800 00000100:00100000:0.0:1746155569.944890:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12164 00000100:00100000:0.0:1746155569.944896:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123804800:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155569.944909:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155569.944919:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e7be00/0x844e5faceb5ebd70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111b5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155569.944950:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124597760:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155569.945005:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155569.945104:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.945459:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123804928 00000100:00100000:2.0:1746155569.945464:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123804928 00000100:00100000:2.0:1746155569.945491:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12165 00000100:00100000:2.0:1746155569.945496:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123804928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155569.945527:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155569.945534:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01b3000/0x844e5faceb5ebd77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111bc expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155569.945565:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124597888:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155569.945606:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155569.946254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.946278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.946303:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.946319:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123805184 00000100:00100000:3.0:1746155569.946324:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123805184 00000100:00100000:3.0:1746155569.946344:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123805056 00000100:00100000:3.0:1746155569.946346:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123805056 00000100:00100000:0.0:1746155569.946355:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12166 00000100:00100000:3.0:1746155569.946361:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12167 00000100:00100000:0.0:1746155569.946362:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123805184:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155569.946367:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123805056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155569.946372:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.946375:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155569.946380:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e7b000/0x844e5faceb5ebd7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111ca expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.946384:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebd85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111c3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155569.946398:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e7b000/0x844e5faceb5ebd7e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ca expref: 29 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155569.946407:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e7b000/0x844e5faceb5ebd7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ca expref: 29 pid: 29728 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155569.946414:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124598016:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155569.946419:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e7b000, rc 0) 00000100:00100000:0.0:1746155569.946441:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123805184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 80us (188us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155569.946446:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12166 00000100:00100000:3.0:1746155569.946544:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fba80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155569.946581:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124597632:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155569.946603:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1245184->1941503] (req 1245184->1941503) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 35 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.946617:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb9600, rc 0) 00000100:00100000:3.0:1746155569.946636:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:29214:x1830976123804672:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3915us (4037us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155569.946641:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12163 00000100:00100000:2.0:1746155569.946868:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123805312 00000100:00100000:2.0:1746155569.946872:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123805312 00000100:00100000:2.0:1746155569.946905:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 591 00000100:00100000:2.0:1746155569.946910:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1961:x1830976123805312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155569.946918:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155569.946931:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e7a400/0x844e5faceb5ebd5b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a7 expref: 298 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155569.946944:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155569.946947:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155569.946962:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1961:x1830976123805312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 52us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155569.946967:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 591 00000100:00100000:0.0:1746155569.948668:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009018b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124597760:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155569.948689:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e7be00/0x844e5faceb5ebd70 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111b5 expref: 34 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155569.948699:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e7be00/0x844e5faceb5ebd70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111b5 expref: 34 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155569.948709:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e7be00, rc 0) 00000100:00100000:0.0:1746155569.948731:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123804800:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3835us (4104us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155569.948738:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12164 00000100:00100000:2.0:1746155569.949393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.949631:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124597888:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155569.949647:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01b3000/0x844e5faceb5ebd77 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111bc expref: 32 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.949655:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01b3000/0x844e5faceb5ebd77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111bc expref: 32 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.949676:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01b3000, rc 0) 00000100:00100000:3.0:1746155569.949697:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123804928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4200us (4592us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155569.949702:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12165 00000100:00100000:0.0:1746155569.950081:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123805440 00000100:00100000:0.0:1746155569.950086:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123805440 00002000:00100000:0.0:1746155569.950110:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1589248->2097151) req@ffff88012fe8e680 x1830976123805440/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155569.950118:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8e680 with x1830976123805440 ext(1589248->2097151) 00010000:00010000:0.0:1746155569.950124:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 22 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155569.951275:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 22 pid: 1625 timeout: 799 lvb_type: 0 00002000:00010000:0.0:1746155569.951283:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fe8e680 00000100:00100000:0.0:1746155569.951309:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 734 00000100:00100000:0.0:1746155569.951316:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123805440:12345-192.168.202.51@tcp:4:cat.0 00002000:00010000:3.0:1746155569.952107:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155569 -> 1746155570 00002000:00010000:3.0:1746155569.952111:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155569 -> 1746155570 00002000:00010000:3.0:1746155569.952113:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155569 -> 1746155570 00000100:00100000:3.0:1746155569.952126:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124598016:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155569.952148:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebd85 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111c3 expref: 27 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.952158:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebd85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111c3 expref: 27 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155569.952172:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb9c00, rc 0) 00000100:00100000:3.0:1746155569.952198:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123805056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5831us (5918us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155569.952203:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12167 00000100:00100000:0.0:1746155569.963878:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.964606:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123805568 00000100:00100000:3.0:1746155569.964613:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123805568 00000100:00100000:3.0:1746155569.964659:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12168 00000100:00100000:3.0:1746155569.964667:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29219:x1830976123805568:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155569.964680:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155569.964694:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111d1 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.964716:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155569.964721:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1245184->1941503] (req 1245184->1941503) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 32 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.964726:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746155569.964729:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d1 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.964761:0:8437:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1245184->1941503] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 32 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.964772:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d1 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155569.964785:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb9e00, rc 0) 00000100:00100000:3.0:1746155569.964833:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29219:x1830976123805568:12345-192.168.202.51@tcp:101:cat.0 Request processed in 167us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155569.964839:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12168 00000100:00100000:2.0:1746155569.966366:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123805440:12345-192.168.202.51@tcp:4:cat.0 Request processed in 15046us (16969us total) trans 17179873204 rc 0/0 00000100:00100000:2.0:1746155569.966376:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 734 00002000:00100000:2.0:1746155569.966384:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1589248->2097151) req@ffff88012fe8e680 x1830976123805440/t17179873204(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:640/0 lens 488/448 e 0 to 0 dl 1746155580 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.966392:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8e680 with x1830976123805440 ext(1589248->2097151) 00010000:00010000:2.0:1746155569.966399:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 24 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155569.966411:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 24 pid: 1625 timeout: 799 lvb_type: 0 00002000:00010000:2.0:1746155569.966417:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fe8e680 00000100:00100000:0.0:1746155569.971315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155569.971745:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123805696 00000100:00100000:1.0:1746155569.971752:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123805696 00010000:00010000:1.0:1746155569.971780:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 24 pid: 1625 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155569.971813:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6129 00000100:00100000:1.0:1746155569.971820:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123805696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155569.971831:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155569.971849:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 24 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155569.971864:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 24 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155569.971883:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a539c200/0x844e5faceb5ebc7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11130 expref: 24 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155569.973086:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.973089:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155569.973096:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 31 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.973103:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 31 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.973133:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 31 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155569.973143:0:7062:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 31 pid: 20200 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155569.973153:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124598272:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155569.973222:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155569.976909:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124598272:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155569.976929:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155569.976964:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123805696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5144us (5655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155569.976975:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6129 00000100:00100000:0.0:1746155569.977370:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.977687:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123805952 00000100:00100000:3.0:1746155569.977693:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123805952 00002000:00100000:3.0:1746155569.977723:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1245184->1249279) req@ffff88009fb69180 x1830976123805952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.977732:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69180 with x1830976123805952 ext(1245184->1249279) 00010000:00010000:3.0:1746155569.977738:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 32 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155569.977750:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 32 pid: 20200 timeout: 799 lvb_type: 0 00002000:00010000:3.0:1746155569.977756:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb69180 00000100:00100000:3.0:1746155569.977769:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 735 00000100:00100000:3.0:1746155569.977775:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123805952:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155569.977898:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123805952:12345-192.168.202.51@tcp:3:cat.0 Request processed in 122us (529us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155569.977904:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 735 00002000:00100000:3.0:1746155569.977909:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1245184->1249279) req@ffff88009fb69180 x1830976123805952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746155580 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.977921:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69180 with x1830976123805952 ext(1245184->1249279) 00010000:00010000:3.0:1746155569.977926:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 32 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155569.977934:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 32 pid: 20200 timeout: 799 lvb_type: 0 00002000:00010000:3.0:1746155569.977940:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb69180 00000100:00100000:0.0:1746155569.984158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155569.984349:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123806208 00000100:00100000:2.0:1746155569.984357:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123806208 00002000:00100000:2.0:1746155569.984392:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1937408->1941503) req@ffff88009fb69c00 x1830976123806208/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.984401:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69c00 with x1830976123806208 ext(1937408->1941503) 00010000:00010000:2.0:1746155569.984409:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 32 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155569.984421:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 32 pid: 20200 timeout: 799 lvb_type: 0 00002000:00010000:2.0:1746155569.984428:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb69c00 00000100:00100000:2.0:1746155569.984543:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 736 00000100:00100000:2.0:1746155569.984551:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123806208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155569.984702:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123806208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 151us (551us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155569.984708:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 736 00002000:00100000:2.0:1746155569.984713:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1937408->1941503) req@ffff88009fb69c00 x1830976123806208/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/4536 e 0 to 0 dl 1746155580 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155569.984719:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69c00 with x1830976123806208 ext(1937408->1941503) 00010000:00010000:2.0:1746155569.984724:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 32 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155569.984732:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 32 pid: 20200 timeout: 799 lvb_type: 0 00002000:00010000:2.0:1746155569.984738:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb69c00 00000100:00100000:0.0:1746155569.988966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155569.989842:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155569.989918:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123806464 00000100:00100000:3.0:1746155569.989927:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123806464 00002000:00100000:3.0:1746155569.989962:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1245184->1941503) req@ffff88009fb6a300 x1830976123806464/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/0 e 0 to 0 dl 1746155580 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155569.989970:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6a300 with x1830976123806464 ext(1245184->1941503) 00010000:00010000:3.0:1746155569.989977:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 32 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155569.989989:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 32 pid: 20200 timeout: 799 lvb_type: 0 00002000:00010000:3.0:1746155569.989995:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb6a300 00000100:00100000:2.0:1746155569.990328:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123806720 00000100:00100000:2.0:1746155569.990331:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123806720 00000100:00100000:2.0:1746155569.990354:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4053 00000100:00100000:2.0:1746155569.990360:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29214:x1830976123806720:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155569.990572:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:29214:x1830976123806720:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 210us (729us total) trans 8589943980 rc 0/0 00000100:00100000:2.0:1746155569.990578:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4053 00000100:00100000:3.0:1746155569.990722:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 737 00000100:00100000:3.0:1746155569.990733:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976123806464:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155570.003981:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976123806464:12345-192.168.202.51@tcp:4:cat.0 Request processed in 13239us (15013us total) trans 17179873205 rc 0/0 00000100:00100000:3.0:1746155570.003993:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 737 00002000:00100000:3.0:1746155570.004003:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1245184->1941503) req@ffff88009fb6a300 x1830976123806464/t17179873205(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:640/0 lens 488/448 e 0 to 0 dl 1746155580 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.004012:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6a300 with x1830976123806464 ext(1245184->1941503) 00010000:00010000:3.0:1746155570.004020:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 34 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.004032:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 34 pid: 20200 timeout: 799 lvb_type: 0 00002000:00010000:3.0:1746155570.004039:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb6a300 00000100:00100000:0.0:1746155570.007487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.009684:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123806848 00000100:00100000:1.0:1746155570.009694:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123806848 00010000:00010000:1.0:1746155570.009743:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 34 pid: 20200 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155570.009777:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6130 00000100:00100000:1.0:1746155570.009784:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123806848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.009796:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.009813:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 34 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.009823:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 34 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.009841:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9600/0x844e5faceb5ebd69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1941503) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ae expref: 34 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.009857:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.009859:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.009864:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d1 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.009871:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d1 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.009897:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d1 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155570.009907:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124598400:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155570.009977:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00080000:2.0:1746155570.010054:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746155570.012889:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124598400:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155570.012905:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.012948:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123806848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3163us (5465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.012956:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6130 00000100:00100000:0.0:1746155570.014097:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.014880:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123807104 00000100:00100000:3.0:1746155570.014887:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123807104 00002000:00100000:3.0:1746155570.014921:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009fb6b800 x1830976123807104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.014929:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b800 with x1830976123807104 ext(1048576->2097151) 00002000:00010000:3.0:1746155570.014933:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6b800 00000100:00100000:3.0:1746155570.015221:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4692 00000100:00100000:3.0:1746155570.015229:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123807104:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155570.027215:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123807104:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11978us (13111us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155570.027225:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4692 00002000:00100000:3.0:1746155570.027235:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009fb6b800 x1830976123807104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.027242:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b800 with x1830976123807104 ext(1048576->2097151) 00002000:00010000:3.0:1746155570.027247:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6b800 00000100:00100000:0.0:1746155570.035735:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.036034:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123807360 00000100:00100000:1.0:1746155570.036041:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123807360 00000100:00100000:1.0:1746155570.036087:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10032 00000100:00100000:1.0:1746155570.036094:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29223:x1830976123807360:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155570.036115:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155570.036131:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9a00/0x844e5faceb5ebd93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111d8 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.036216:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebd9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036227:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebd9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036236:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebd9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036247:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebda1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036252:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebda1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036259:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebda1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036350:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8a00/0x844e5faceb5ebda8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036358:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8a00/0x844e5faceb5ebda8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036364:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8a00/0x844e5faceb5ebda8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155570.036371:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155570.036442:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebd9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036448:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebd9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036454:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebd9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036459:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbb9400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155570.036462:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebd9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036468:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebd9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036476:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155570.036478:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155570.036481:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebd9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036489:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebd9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036536:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebda1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036541:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebda1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036545:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebda1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036549:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbb9c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155570.036552:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebda1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036564:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebda1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036570:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51400) 00010000:00010000:1.0:1746155570.036571:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155570.036573:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebda1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036576:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9c00/0x844e5faceb5ebda1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.036607:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9a00/0x844e5faceb5ebd93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d8 expref: 22 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.036617:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8a00/0x844e5faceb5ebda8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d8 expref: 21 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.036628:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155570.036630:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155570.036631:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb8a00, rc 0) 00000100:00100000:1.0:1746155570.036671:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29223:x1830976123807360:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 576us (943us total) trans 8589943981 rc 0/0 00000100:00100000:1.0:1746155570.036677:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10032 00000100:00100000:0.0:1746155570.038939:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.038970:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.038988:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123807744 00000100:00100000:0.0:1746155570.038993:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123807744 00000100:00100000:0.0:1746155570.039028:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4054 00000100:00100000:0.0:1746155570.039035:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29223:x1830976123807744:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155570.039186:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29223:x1830976123807744:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 150us (215us total) trans 8589943982 rc 0/0 00000100:00100000:0.0:1746155570.039192:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4054 00000100:00100000:0.0:1746155570.039267:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123807488 00000100:00100000:0.0:1746155570.039270:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123807488 00000100:00100000:0.0:1746155570.040470:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 592 00000100:00100000:0.0:1746155570.040477:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123807488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155570.040487:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155570.040523:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8a00/0x844e5faceb5ebda8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d8 expref: 22 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.040536:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155570.040539:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155570.040574:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123807488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 98us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.040579:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 592 00000100:00100000:0.0:1746155570.045606:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.045694:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123807872 00000100:00100000:0.0:1746155570.045700:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123807872 00000100:00100000:3.0:1746155570.045794:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12169 00000100:00100000:3.0:1746155570.045803:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:29219:x1830976123807872:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155570.045816:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.045830:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111df expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.045853:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.045860:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.045862:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.045864:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111df expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.045889:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.045898:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 22 pid: 1625 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.045908:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124598528:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.045962:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.048489:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124598528:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.048534:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111df expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.048546:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bc4a00, rc 0) 00000100:00100000:3.0:1746155570.048592:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:29219:x1830976123807872:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2790us (2992us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.048599:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12169 00000100:00100000:2.0:1746155570.048691:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.048747:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123808000 00000100:00100000:2.0:1746155570.048751:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123808000 00002000:00100000:2.0:1746155570.048777:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1482751) req@ffff88012fe8ea00 x1830976123808000/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.048785:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8ea00 with x1830976123808000 ext(1048576->1482751) 00010000:00010000:2.0:1746155570.048791:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 23 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.048801:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 23 pid: 1625 timeout: 799 lvb_type: 0 00002000:00010000:2.0:1746155570.048808:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fe8ea00 00000100:00100000:2.0:1746155570.048821:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 738 00000100:00100000:2.0:1746155570.048828:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123808000:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155570.055270:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123808000:12345-192.168.202.51@tcp:4:cat.0 Request processed in 6435us (6572us total) trans 17179873206 rc 0/0 00000100:00100000:0.0:1746155570.055281:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 738 00002000:00100000:0.0:1746155570.055290:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1482751) req@ffff88012fe8ea00 x1830976123808000/t17179873206(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/448 e 0 to 0 dl 1746155581 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155570.055298:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8ea00 with x1830976123808000 ext(1048576->1482751) 00010000:00010000:0.0:1746155570.055306:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 25 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.055319:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 25 pid: 1625 timeout: 799 lvb_type: 0 00002000:00010000:0.0:1746155570.055325:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fe8ea00 00000100:00100000:2.0:1746155570.064572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.064602:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123808128 00000100:00100000:2.0:1746155570.064608:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123808128 00010000:00010000:2.0:1746155570.064637:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 25 pid: 1625 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.064661:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6131 00000100:00100000:2.0:1746155570.064668:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123808128:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.064679:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.064695:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 25 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.064705:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 25 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.064724:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebc82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11137 expref: 25 pid: 1625 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.064735:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.064737:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.064743:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111df expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.064750:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111df expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.064776:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111df expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.064786:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124598656:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155570.064839:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.067876:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124598656:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155570.067894:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155570.067928:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123808128:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3259us (3360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.067937:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6131 00000100:00100000:0.0:1746155570.070354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.070806:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123808384 00000100:00100000:0.0:1746155570.070814:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123808384 00002000:00100000:2.0:1746155570.076100:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff8800a0a89180 x1830976123808384/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.076112:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a89180 with x1830976123808384 ext(1048576->2097151) 00002000:00010000:2.0:1746155570.076119:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a89180 00000100:00100000:2.0:1746155570.076149:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4693 00000100:00100000:2.0:1746155570.076160:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123808384:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155570.098426:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123808384:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22261us (28070us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155570.098436:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4693 00002000:00100000:0.0:1746155570.098445:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff8800a0a89180 x1830976123808384/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155570.098453:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a89180 with x1830976123808384 ext(1048576->2097151) 00002000:00010000:0.0:1746155570.098457:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a89180 00000100:00100000:0.0:1746155570.115179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.115243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.115265:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123808640 00000100:00100000:0.0:1746155570.115272:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123808640 00000100:00100000:0.0:1746155570.115304:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10033 00000100:00100000:0.0:1746155570.115310:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29226:x1830976123808640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155570.115329:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155570.115344:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18ca00/0x844e5faceb5ebdbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111e6 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.115434:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a5800/0x844e5faceb5ebdc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115448:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a5800/0x844e5faceb5ebdc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115459:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a5800/0x844e5faceb5ebdc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115472:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96c00/0x844e5faceb5ebdcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115478:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96c00/0x844e5faceb5ebdcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115485:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96c00/0x844e5faceb5ebdcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115639:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96200/0x844e5faceb5ebdd2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115649:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96200/0x844e5faceb5ebdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115656:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96200/0x844e5faceb5ebdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155570.115666:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155570.115757:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a5800/0x844e5faceb5ebdc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115764:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a5800/0x844e5faceb5ebdc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115769:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a5800/0x844e5faceb5ebdc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115774:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a62a5800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155570.115777:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a5800/0x844e5faceb5ebdc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115784:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a5800/0x844e5faceb5ebdc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115795:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155570.115798:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155570.115802:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a5800/0x844e5faceb5ebdc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115810:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a5800/0x844e5faceb5ebdc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115820:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96c00/0x844e5faceb5ebdcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115824:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96c00/0x844e5faceb5ebdcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115828:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96c00/0x844e5faceb5ebdcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115831:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea96c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155570.115833:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96c00/0x844e5faceb5ebdcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115838:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96c00/0x844e5faceb5ebdcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115844:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe31800) 00010000:00010000:0.0:1746155570.115846:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155570.115848:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96c00/0x844e5faceb5ebdcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115852:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96c00/0x844e5faceb5ebdcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.115889:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18ca00/0x844e5faceb5ebdbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111e6 expref: 24 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.115902:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96200/0x844e5faceb5ebdd2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111e6 expref: 23 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.115912:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155570.115914:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155570.115916:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea96200, rc 0) 00000100:00100000:0.0:1746155570.115967:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29226:x1830976123808640:12345-192.168.202.51@tcp:101:cat.0 Request processed in 654us (720us total) trans 8589943983 rc 0/0 00000100:00100000:0.0:1746155570.115974:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10033 00010000:00010000:0.0:1746155570.116032:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746155570.116421:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123808768 00000100:00100000:3.0:1746155570.116425:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123808768 00000100:00100000:3.0:1746155570.116451:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12170 00000100:00100000:3.0:1746155570.116457:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:29219:x1830976123808768:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155570.116464:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.116472:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111ed expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.116486:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.116493:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.116494:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.116497:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ed expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.116534:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.116543:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 20 pid: 8436 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.116552:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124598784:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.116607:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91000 going to sleep for 11 seconds 00000100:00080000:3.0:1746155570.116658:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155570.128566:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.128594:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.128614:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123808896 00000100:00100000:0.0:1746155570.128620:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123808896 00000100:00100000:0.0:1746155570.128648:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123809024 00000100:00100000:0.0:1746155570.128650:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123809024 00000100:00100000:0.0:1746155570.128661:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12171 00000100:00100000:0.0:1746155570.128668:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123808896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155570.128681:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155570.128693:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea97a00/0x844e5faceb5ebde7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111f4 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.128709:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.128711:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.128717:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea97a00/0x844e5faceb5ebde7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111f4 expref: 26 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155570.128728:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ea97a00/0x844e5faceb5ebde7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111f4 expref: 26 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155570.128741:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea97a00, rc 0) 00000100:00100000:0.0:1746155570.128771:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123808896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 105us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.128776:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12171 00000100:00100000:0.0:1746155570.128787:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12172 00000100:00100000:0.0:1746155570.128791:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123809024:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155570.128796:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155570.128800:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea96000/0x844e5faceb5ebdee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f111fb expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.128807:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.128808:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.128811:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea96000/0x844e5faceb5ebdee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111fb expref: 26 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155570.128818:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ea96000/0x844e5faceb5ebdee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111fb expref: 26 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155570.128823:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea96000, rc 0) 00000100:00100000:0.0:1746155570.128833:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123809024:12345-192.168.202.51@tcp:101:cat.0 Request processed in 41us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.128837:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12172 00000100:00100000:3.0:1746155570.129072:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124598784:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.129092:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ed expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.129101:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bc5600, rc 0) 00000100:00100000:3.0:1746155570.129121:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29219:x1830976123808768:12345-192.168.202.51@tcp:101:cat.0 Request processed in 12664us (13949us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.129126:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12170 00000100:00100000:1.0:1746155570.132822:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.132843:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.132861:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.133605:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123809280 00000100:00100000:0.0:1746155570.133615:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123809280 00002000:00100000:0.0:1746155570.133660:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (2023424->2097151) req@ffff880131496300 x1830976123809280/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155570.133670:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496300 with x1830976123809280 ext(2023424->2097151) 00010000:00010000:0.0:1746155570.133679:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 21 pid: 8436 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.133693:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 21 pid: 8436 timeout: 799 lvb_type: 0 00002000:00010000:0.0:1746155570.133700:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131496300 00000100:00100000:0.0:1746155570.133725:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 739 00000100:00100000:0.0:1746155570.133735:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123809280:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155570.133908:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123809408 00000100:00100000:0.0:1746155570.133914:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123809408 00000100:00100000:0.0:1746155570.133949:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 593 00000100:00100000:0.0:1746155570.133956:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123809408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155570.133967:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155570.133990:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea96200/0x844e5faceb5ebdd2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111e6 expref: 23 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.134005:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155570.134009:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155570.134037:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123809408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.134043:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 593 00000100:00100000:3.0:1746155570.134159:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123809152 00000100:00100000:3.0:1746155570.134164:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123809152 00000100:00100000:3.0:1746155570.134198:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12173 00000100:00100000:3.0:1746155570.134205:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976123809152:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155570.134216:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.134228:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bc5800/0x844e5faceb5ebdf5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11202 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.134252:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bc5800/0x844e5faceb5ebdf5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11202 expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.134262:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bc5800/0x844e5faceb5ebdf5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11202 expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.134270:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bc5800, rc 0) 00000100:00100000:3.0:1746155570.134296:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976123809152:12345-192.168.202.51@tcp:101:cat.0 Request processed in 91us (1477us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155570.134301:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12173 00000100:00100000:0.0:1746155570.144373:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123809280:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10634us (11523us total) trans 21474840587 rc 0/0 00000100:00100000:0.0:1746155570.144384:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 739 00002000:00100000:0.0:1746155570.144394:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (2023424->2097151) req@ffff880131496300 x1830976123809280/t21474840587(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/448 e 0 to 0 dl 1746155581 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155570.144402:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496300 with x1830976123809280 ext(2023424->2097151) 00010000:00010000:0.0:1746155570.144409:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 23 pid: 8436 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.144420:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 23 pid: 8436 timeout: 799 lvb_type: 0 00002000:00010000:0.0:1746155570.144426:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131496300 00000100:00100000:0.0:1746155570.148999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.149025:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123809536 00000100:00100000:0.0:1746155570.149031:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123809536 00010000:00010000:0.0:1746155570.149058:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 23 pid: 8436 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746155570.149080:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6132 00000100:00100000:0.0:1746155570.149087:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123809536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155570.149096:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155570.149112:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 23 pid: 8436 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.149122:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 23 pid: 8436 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.149143:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ebd31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11192 expref: 23 pid: 8436 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.149154:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.149155:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.149160:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ed expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.149167:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ed expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.149188:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ed expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155570.149197:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a88700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124598912:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155570.149259:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155570.158395:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.158414:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.158707:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123809920 00000100:00100000:3.0:1746155570.158715:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123809920 00002000:00100000:3.0:1746155570.158752:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880131494380 x1830976123809920/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.158761:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494380 with x1830976123809920 ext(1048576->2097151) 00002000:00010000:3.0:1746155570.158765:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494380 00000100:00100000:3.0:1746155570.158778:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123809792 00000100:00100000:3.0:1746155570.158780:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123809792 00002000:00100000:3.0:1746155570.158788:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880131494700 x1830976123809792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.158794:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494700 with x1830976123809792 ext(1048576->2097151) 00002000:00010000:3.0:1746155570.158796:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494700 00000100:00100000:3.0:1746155570.158807:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4694 00000100:00100000:3.0:1746155570.158814:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1963:x1830976123809920:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155570.158940:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4695 00000100:00100000:0.0:1746155570.158947:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1963:x1830976123809792:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155570.160329:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a88700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124598912:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155570.160344:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155570.160369:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976123809536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 11282us (11376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.160376:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6132 00000100:00100000:0.0:1746155570.160461:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.160790:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123810304 00000100:00100000:1.0:1746155570.160796:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123810304 00002000:00100000:1.0:1746155570.160821:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800a0a88700 x1830976123810304/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155570.160828:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a88700 with x1830976123810304 ext(1048576->2097151) 00002000:00010000:1.0:1746155570.160832:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a88700 00000100:00100000:1.0:1746155570.160850:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4696 00000100:00100000:1.0:1746155570.160858:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123810304:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155570.171974:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1963:x1830976123809792:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13021us (13552us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155570.171984:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4695 00002000:00100000:0.0:1746155570.171994:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880131494700 x1830976123809792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155570.172002:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494700 with x1830976123809792 ext(1048576->2097151) 00002000:00010000:0.0:1746155570.172007:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494700 00000100:00100000:3.0:1746155570.177213:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123809920:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18388us (18811us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155570.177224:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4694 00002000:00100000:3.0:1746155570.177233:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880131494380 x1830976123809920/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.177241:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494380 with x1830976123809920 ext(1048576->2097151) 00002000:00010000:3.0:1746155570.177246:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494380 00000100:00100000:2.0:1746155570.192779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.193210:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123810304:12345-192.168.202.51@tcp:3:cat.0 Request processed in 32349us (32744us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155570.193220:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4696 00002000:00100000:1.0:1746155570.193233:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800a0a88700 x1830976123810304/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155570.193248:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a88700 with x1830976123810304 ext(1048576->2097151) 00002000:00010000:1.0:1746155570.193254:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a88700 00000100:00100000:0.0:1746155570.193671:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123810432 00000100:00100000:0.0:1746155570.193680:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123810432 00000100:00100000:0.0:1746155570.193717:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12174 00000100:00100000:0.0:1746155570.193783:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29226:x1830976123810432:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155570.193798:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155570.193815:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ebdfc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11209 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.193837:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.193839:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.193846:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ebdfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11209 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.193859:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ebdfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11209 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.193869:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb9600, rc 0) 00000100:00100000:0.0:1746155570.193900:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29226:x1830976123810432:12345-192.168.202.51@tcp:101:cat.0 Request processed in 172us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.193905:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12174 00000100:00100000:0.0:1746155570.198868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.199742:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123810688 00000100:00100000:1.0:1746155570.199752:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123810688 00002000:00100000:1.0:1746155570.199793:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800a0a89880 x1830976123810688/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155570.199802:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a89880 with x1830976123810688 ext(1048576->2097151) 00002000:00010000:1.0:1746155570.199807:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a89880 00000100:00100000:1.0:1746155570.201828:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4697 00000100:00100000:1.0:1746155570.201843:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976123810688:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155570.219897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000001:00080000:2.0:1746155570.222460:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873201 is committed 00000001:00080000:2.0:1746155570.222480:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873176 is committed 00000001:00080000:2.0:1746155570.222486:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873175 is committed 00000001:00080000:2.0:1746155570.222492:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873202 is committed 00000001:00080000:2.0:1746155570.222525:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873204 is committed 00000001:00080000:2.0:1746155570.222572:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873205 is committed 00000100:00100000:3.0:1746155570.223741:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123810816 00000100:00100000:3.0:1746155570.223750:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123810816 00000100:00100000:3.0:1746155570.223790:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12175 00000100:00100000:3.0:1746155570.223797:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29219:x1830976123810816:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155570.223813:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.223828:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11210 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.223851:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 24 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.223858:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.223860:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.223863:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11210 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.223891:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 24 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.223902:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 24 pid: 20200 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.223912:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124599040:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.223981:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155570.225860:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976123810688:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24017us (26994us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155570.225869:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4697 00002000:00100000:1.0:1746155570.225878:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800a0a89880 x1830976123810688/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155570.225886:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a89880 with x1830976123810688 ext(1048576->2097151) 00002000:00010000:1.0:1746155570.225891:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a89880 00000100:00100000:2.0:1746155570.234091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.234885:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123810944 00000100:00100000:3.0:1746155570.234894:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123810944 00000100:00100000:3.0:1746155570.234927:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12176 00000100:00100000:3.0:1746155570.234933:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29223:x1830976123810944:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155570.234946:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.234960:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11217 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.234986:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111df expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.234993:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea96000/0x844e5faceb5ebdee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111fb expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.234999:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.235001:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.235004:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1110016->1961983] (req 1110016->1961983) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.235027:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ea96000/0x844e5faceb5ebdee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111fb expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.235036:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ea96000/0x844e5faceb5ebdee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111fb expref: 11 pid: 1625 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.235046:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124599168:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.235106:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111df expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.235114:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111df expref: 19 pid: 8437 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.235121:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124599296:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.235136:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.235164:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124599040:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.235182:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11210 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.235192:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bc4600, rc 0) 00000100:00100000:3.0:1746155570.235208:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:29219:x1830976123810816:12345-192.168.202.51@tcp:101:cat.0 Request processed in 11412us (15319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.235214:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12175 00000100:00100000:2.0:1746155570.235710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.237630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.238099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.238120:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123811456 00000100:00100000:0.0:1746155570.238127:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123811456 00000100:00100000:0.0:1746155570.238162:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10034 00000100:00100000:0.0:1746155570.238169:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:29229:x1830976123811456:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155570.238186:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155570.238202:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8a00/0x844e5faceb5ebe11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11225 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.238281:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9200/0x844e5faceb5ebe18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238292:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9200/0x844e5faceb5ebe18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238318:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9200/0x844e5faceb5ebe18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238329:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8400/0x844e5faceb5ebe1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238335:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8400/0x844e5faceb5ebe1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238340:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8400/0x844e5faceb5ebe1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238426:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebe26 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238434:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebe26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238440:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebe26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155570.238447:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155570.238537:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9200/0x844e5faceb5ebe18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238543:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9200/0x844e5faceb5ebe18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238548:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9200/0x844e5faceb5ebe18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238561:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbb9200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155570.238565:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9200/0x844e5faceb5ebe18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238570:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9200/0x844e5faceb5ebe18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238579:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155570.238582:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155570.238585:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9200/0x844e5faceb5ebe18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238589:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9200/0x844e5faceb5ebe18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238601:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8400/0x844e5faceb5ebe1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238605:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8400/0x844e5faceb5ebe1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238613:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8400/0x844e5faceb5ebe1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238617:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbb8400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155570.238619:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8400/0x844e5faceb5ebe1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238622:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8400/0x844e5faceb5ebe1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238627:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88008d58c100) 00010000:00010000:0.0:1746155570.238629:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155570.238631:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8400/0x844e5faceb5ebe1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238635:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8400/0x844e5faceb5ebe1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.238663:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8a00/0x844e5faceb5ebe11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11225 expref: 301 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.238672:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebe26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11225 expref: 300 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.238677:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155570.238678:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155570.238680:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb9400, rc 0) 00000100:00100000:0.0:1746155570.238713:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:29229:x1830976123811456:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 545us (615us total) trans 8589943984 rc 0/0 00000100:00100000:0.0:1746155570.238719:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10034 00000100:00100000:1.0:1746155570.238874:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123811072 00000100:00100000:1.0:1746155570.238878:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123811072 00002000:00100000:1.0:1746155570.238900:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2748415) req@ffff88012bdf7800 x1830976123811072/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155570.238908:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7800 with x1830976123811072 ext(2097152->2748415) 00010000:00010000:1.0:1746155570.238915:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 23 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.238928:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 23 pid: 20200 timeout: 799 lvb_type: 0 00002000:00010000:1.0:1746155570.238934:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bdf7800 00000100:00080000:3.0:1746155570.239037:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155570.239061:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 740 00000100:00100000:3.0:1746155570.239068:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123811072:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155570.241058:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124599168:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.241068:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124599296:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.241093:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1110016->1961983] (req 1110016->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.241105:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bc4200, rc 0) 00000100:00100000:2.0:1746155570.241129:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123811200 00000100:00100000:3.0:1746155570.241134:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29223:x1830976123810944:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6201us (7051us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.241136:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123811200 00000100:00100000:3.0:1746155570.241140:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12176 00000100:00100000:3.0:1746155570.241156:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12177 00000100:00100000:3.0:1746155570.241162:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29226:x1830976123811200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155570.241172:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.241183:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1121e expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.241199:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.241203:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2748416->3145727] (req 2748416->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1121e expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.241211:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2748416->3145727] (req 2748416->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1121e expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.241224:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28600, rc 0) 00000100:00100000:3.0:1746155570.241243:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+25:29226:x1830976123811200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 82us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.241248:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12177 00000100:00100000:2.0:1746155570.244631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.244878:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123811584 00000100:00100000:2.0:1746155570.244885:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123811584 00010000:00010000:2.0:1746155570.244910:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea96000/0x844e5faceb5ebdee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111fb expref: 11 pid: 1625 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746155570.244933:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6133 00000100:00100000:2.0:1746155570.244939:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123811584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.244950:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.244966:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ea96000/0x844e5faceb5ebdee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111fb expref: 11 pid: 1625 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.244976:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ea96000/0x844e5faceb5ebdee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111fb expref: 11 pid: 1625 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.244997:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea96000/0x844e5faceb5ebdee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111fb expref: 11 pid: 1625 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.245011:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.245039:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123811584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 100us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.245044:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6133 00000100:00100000:2.0:1746155570.249103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.249140:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.249160:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123811712 00000100:00100000:2.0:1746155570.249166:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123811712 00010000:00010000:2.0:1746155570.249190:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111df expref: 20 pid: 8437 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.249210:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123811840 00000100:00100000:2.0:1746155570.249212:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123811840 00000100:00100000:2.0:1746155570.249227:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6134 00000100:00100000:2.0:1746155570.249234:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123811712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.249243:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.249260:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111df expref: 20 pid: 8437 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.249269:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111df expref: 20 pid: 8437 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.249287:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bc4a00/0x844e5faceb5ebdb6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111df expref: 20 pid: 8437 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.249298:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.249300:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.249305:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.249312:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.249339:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.249350:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124599424:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155570.249397:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca296c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155570.249412:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 594 00000100:00100000:2.0:1746155570.249417:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1960:x1830976123811840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.249423:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.249434:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ebe26 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11225 expref: 300 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.249444:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155570.249447:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.249460:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1960:x1830976123811840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 43us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.249466:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 594 00000100:00100000:2.0:1746155570.254006:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124599424:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155570.254023:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.254067:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123811712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4833us (4968us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.254075:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6134 00000100:00100000:1.0:1746155570.257103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.257529:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123812096 00000100:00100000:2.0:1746155570.257535:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123812096 00002000:00100000:2.0:1746155570.257575:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1110016->1114111) req@ffff880131495500 x1830976123812096/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.257583:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495500 with x1830976123812096 ext(1110016->1114111) 00002000:00010000:2.0:1746155570.257588:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495500 00000100:00100000:2.0:1746155570.257608:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4698 00000100:00100000:2.0:1746155570.257614:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123812096:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155570.257719:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123812096:12345-192.168.202.51@tcp:3:cat.0 Request processed in 105us (622us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155570.257725:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4698 00002000:00100000:2.0:1746155570.257729:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1110016->1114111) req@ffff880131495500 x1830976123812096/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.257735:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495500 with x1830976123812096 ext(1110016->1114111) 00002000:00010000:2.0:1746155570.257738:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495500 00000100:00100000:3.0:1746155570.267123:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123811072:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 28048us (31407us total) trans 21474840588 rc 0/0 00000100:00100000:3.0:1746155570.267135:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 740 00002000:00100000:3.0:1746155570.267144:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2748415) req@ffff88012bdf7800 x1830976123811072/t21474840588(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/448 e 0 to 0 dl 1746155581 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.267153:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7800 with x1830976123811072 ext(2097152->2748415) 00010000:00010000:3.0:1746155570.267165:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 26 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.267178:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 26 pid: 20200 timeout: 799 lvb_type: 0 00002000:00010000:3.0:1746155570.267189:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bdf7800 00000100:00100000:0.0:1746155570.278763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.278839:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.279130:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123812352 00000100:00100000:3.0:1746155570.279139:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123812352 00002000:00100000:3.0:1746155570.279185:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1957888->1961983) req@ffff8800a0a8ad80 x1830976123812352/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.279194:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a8ad80 with x1830976123812352 ext(1957888->1961983) 00002000:00010000:3.0:1746155570.279200:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a8ad80 00000100:00100000:3.0:1746155570.279227:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4699 00000100:00100000:3.0:1746155570.279237:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123812352:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155570.279416:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123812352:12345-192.168.202.51@tcp:3:cat.0 Request processed in 177us (659us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155570.279423:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4699 00002000:00100000:3.0:1746155570.279430:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1957888->1961983) req@ffff8800a0a8ad80 x1830976123812352/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.279436:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a8ad80 with x1830976123812352 ext(1957888->1961983) 00002000:00010000:3.0:1746155570.279439:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a8ad80 00000100:00100000:2.0:1746155570.280422:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123812480 00000100:00100000:2.0:1746155570.280427:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123812480 00010000:00010000:2.0:1746155570.280447:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 26 pid: 20200 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.280467:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6135 00000100:00100000:2.0:1746155570.280473:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123812480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.280481:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.280496:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 26 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.280531:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 26 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.280549:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9000/0x844e5faceb5ebd3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->2748415) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111a0 expref: 26 pid: 20200 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.280568:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.280570:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.280576:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11210 expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.280583:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11210 expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.280590:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.280591:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.280594:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2748416->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1121e expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.280599:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2748416->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1121e expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.280627:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2748416->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1121e expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.280637:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124599552:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155570.280688:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11210 expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.280695:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124599680:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155570.280709:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155570.292678:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.294728:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124599552:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155570.294739:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124599680:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155570.294757:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.294806:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123812480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 14332us (15968us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.294814:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6135 00000100:00100000:0.0:1746155570.295039:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123812736 00000100:00100000:0.0:1746155570.295045:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123812736 00002000:00100000:0.0:1746155570.295083:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2748416->3145727) req@ffff880131496680 x1830976123812736/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155570.295091:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496680 with x1830976123812736 ext(2748416->3145727) 00002000:00010000:0.0:1746155570.295096:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131496680 00000100:00100000:0.0:1746155570.295112:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4700 00000100:00100000:0.0:1746155570.295118:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123812736:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155570.299154:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.299184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.299465:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123812992 00000100:00100000:2.0:1746155570.299473:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123812992 00002000:00100000:2.0:1746155570.299526:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880131495f80 x1830976123812992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.299536:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495f80 with x1830976123812992 ext(2097152->3145727) 00002000:00010000:2.0:1746155570.299541:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131495f80 00000100:00100000:2.0:1746155570.299563:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123813120 00000100:00100000:2.0:1746155570.299565:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123813120 00002000:00100000:2.0:1746155570.299577:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880131496d80 x1830976123813120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.299583:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496d80 with x1830976123813120 ext(3145728->4194303) 00002000:00010000:2.0:1746155570.299586:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131496d80 00000100:00100000:2.0:1746155570.299599:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4701 00000100:00100000:2.0:1746155570.299606:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123812992:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155570.300586:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4702 00000100:00100000:2.0:1746155570.300593:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123813120:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155570.308260:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123812736:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13135us (15581us total) trans 0 rc 397312/397312 00000100:00100000:0.0:1746155570.308271:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4700 00002000:00100000:0.0:1746155570.308281:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2748416->3145727) req@ffff880131496680 x1830976123812736/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 397312/397312 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155570.308290:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496680 with x1830976123812736 ext(2748416->3145727) 00002000:00010000:0.0:1746155570.308295:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131496680 00000100:00100000:3.0:1746155570.313350:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123813120:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12749us (14157us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155570.313360:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4702 00002000:00100000:3.0:1746155570.313369:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880131496d80 x1830976123813120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.313377:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496d80 with x1830976123813120 ext(3145728->4194303) 00002000:00010000:3.0:1746155570.313383:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131496d80 00000100:00100000:2.0:1746155570.314260:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123812992:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14650us (15107us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155570.314268:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4701 00002000:00100000:2.0:1746155570.314276:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880131495f80 x1830976123812992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.314283:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495f80 with x1830976123812992 ext(2097152->3145727) 00002000:00010000:2.0:1746155570.314287:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131495f80 00000100:00100000:0.0:1746155570.320713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.320859:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123813504 00000100:00100000:2.0:1746155570.320868:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123813504 00000100:00100000:2.0:1746155570.320903:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4055 00000100:00100000:2.0:1746155570.320910:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29226:x1830976123813504:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155570.321318:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29226:x1830976123813504:12345-192.168.202.51@tcp:35:cat.0 Request processed in 406us (608us total) trans 8589943985 rc 0/0 00000100:00100000:2.0:1746155570.321324:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4055 00000100:00100000:2.0:1746155570.321708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.321756:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123813632 00000100:00100000:3.0:1746155570.321760:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123813632 00000100:00100000:3.0:1746155570.321782:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12178 00000100:00100000:3.0:1746155570.321787:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123813632:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155570.321796:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.321810:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ebe3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1122c expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.321844:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124599808:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155570.321902:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.323115:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124599808:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155570.323136:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ebe3b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1122c expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.323147:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ebe3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1122c expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.323154:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009048e200, rc 0) 00000100:00100000:3.0:1746155570.323190:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123813632:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1401us (1480us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155570.323196:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12178 00000100:00100000:1.0:1746155570.332416:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.332727:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123813760 00000100:00100000:3.0:1746155570.332736:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123813760 00000100:00100000:3.0:1746155570.333125:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12179 00000100:00100000:3.0:1746155570.333137:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123813760:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155570.333159:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.333177:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ebe42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11233 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.333230:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124599936:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155570.333302:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.336344:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124599936:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155570.336377:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ebe42 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11233 expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.336392:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009048e200/0x844e5faceb5ebe42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11233 expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.336402:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009048e200, rc 0) 00000100:00100000:3.0:1746155570.336461:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123813760:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3324us (4049us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155570.336468:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12179 00000001:00080000:3.0:1746155570.337211:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840587 is committed 00000001:00080000:3.0:1746155570.337229:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840578 is committed 00000001:00080000:3.0:1746155570.337234:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840583 is committed 00000001:00080000:3.0:1746155570.337247:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840565 is committed 00000001:00080000:3.0:1746155570.337262:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840584 is committed 00000100:00100000:0.0:1746155570.338546:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.338679:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123813888 00000100:00100000:3.0:1746155570.338688:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123813888 00000100:00100000:3.0:1746155570.338745:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12180 00000100:00100000:3.0:1746155570.338755:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123813888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155570.338773:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.338787:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8800/0x844e5faceb5ebe49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1123a expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.338837:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124600064:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155570.338919:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.341664:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124600064:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155570.341689:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8800/0x844e5faceb5ebe49 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1123a expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.341700:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4fd8800/0x844e5faceb5ebe49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1123a expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.341709:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4fd8800, rc 0) 00000100:00100000:3.0:1746155570.341739:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123813888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2987us (3197us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155570.341746:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12180 00000100:00100000:0.0:1746155570.346586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.346840:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123814144 00000100:00100000:2.0:1746155570.346851:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123814144 00000100:00100000:2.0:1746155570.346922:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4056 00000100:00100000:2.0:1746155570.346933:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:29219:x1830976123814144:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155570.347387:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:29219:x1830976123814144:12345-192.168.202.51@tcp:35:cat.0 Request processed in 453us (806us total) trans 8589943986 rc 0/0 00000100:00100000:2.0:1746155570.347394:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4056 00000100:00100000:0.0:1746155570.383060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.383281:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123814272 00000100:00100000:3.0:1746155570.383289:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123814272 00000100:00100000:3.0:1746155570.383339:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12181 00000100:00100000:3.0:1746155570.383347:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:29229:x1830976123814272:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155570.383363:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.383378:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11241 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.383403:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ed expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.383411:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ebdfc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11209 expref: 10 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.383417:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.383419:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.383422:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1609728->2097151] (req 1609728->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.383447:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ebdfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11209 expref: 10 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.383458:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ebdfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11209 expref: 10 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.383468:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124600192:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.384253:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ed expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.384262:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ed expref: 15 pid: 8437 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.384270:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124600320:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.384321:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.387019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.387074:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123814400 00000100:00100000:1.0:1746155570.387081:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123814400 00010000:00010000:1.0:1746155570.387111:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ebdfc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11209 expref: 11 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.387197:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124600192:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.387208:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124600320:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.387229:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1609728->2097151] (req 1609728->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.387243:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a226e00, rc 0) 00000100:00100000:3.0:1746155570.387274:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:29229:x1830976123814272:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3928us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.387280:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12181 00000100:00100000:1.0:1746155570.387414:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6136 00000100:00100000:1.0:1746155570.387421:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123814400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.387431:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.387450:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ebdfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11209 expref: 11 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.387463:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ebdfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11209 expref: 11 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.387482:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ebdfc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11209 expref: 11 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.387528:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.387566:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123814400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 145us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.387571:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6136 00000100:00100000:0.0:1746155570.390309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.390446:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123814528 00000100:00100000:1.0:1746155570.390452:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123814528 00010000:00010000:1.0:1746155570.390478:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ed expref: 15 pid: 8437 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155570.390533:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6137 00000100:00100000:1.0:1746155570.390540:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123814528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.390562:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.390578:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ed expref: 15 pid: 8437 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.390588:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ed expref: 15 pid: 8437 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.390606:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bc5600/0x844e5faceb5ebde0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111ed expref: 15 pid: 8437 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.390618:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.390620:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.390625:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 14 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.390632:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 14 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.390757:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 14 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155570.390768:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124600448:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155570.391393:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fbe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155570.393682:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124600448:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155570.393698:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.393731:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123814528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3191us (3428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.393740:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6137 00000100:00100000:0.0:1746155570.394806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.395308:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123814784 00000100:00100000:2.0:1746155570.395315:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123814784 00002000:00100000:2.0:1746155570.395345:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1609728->1613823) req@ffff88009f3eca80 x1830976123814784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.395353:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3eca80 with x1830976123814784 ext(1609728->1613823) 00002000:00010000:2.0:1746155570.395357:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3eca80 00000100:00100000:2.0:1746155570.395459:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4703 00000100:00100000:2.0:1746155570.395465:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123814784:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155570.395763:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123814784:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 296us (957us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155570.395769:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4703 00002000:00100000:2.0:1746155570.395774:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (1609728->1613823) req@ffff88009f3eca80 x1830976123814784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.395781:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3eca80 with x1830976123814784 ext(1609728->1613823) 00002000:00010000:2.0:1746155570.395784:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3eca80 00000100:00100000:0.0:1746155570.400467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.400662:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123814912 00000100:00100000:3.0:1746155570.400670:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123814912 00000100:00100000:3.0:1746155570.400724:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12182 00000100:00100000:3.0:1746155570.400731:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:29229:x1830976123814912:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155570.400747:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.400761:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11248 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.400785:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11210 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.400794:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2748416->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1121e expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.400799:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.400801:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.400804:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [2097152->2490367] (req 2097152->2490367) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.400830:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2748416->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1121e expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.400841:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2748416->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1121e expref: 9 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.400850:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124600576:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.400936:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11210 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.400943:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11210 expref: 15 pid: 8437 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.400951:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124600704:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.400970:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.402753:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.403034:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123815040 00000100:00100000:1.0:1746155570.403039:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123815040 00010000:00010000:1.0:1746155570.403066:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2748416->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1121e expref: 10 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155570.403099:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6138 00000100:00100000:1.0:1746155570.403105:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123815040:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.403116:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.403133:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2748416->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1121e expref: 10 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.403143:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2748416->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1121e expref: 10 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.403162:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155570.403177:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5ebe34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2748416->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1121e expref: 10 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155570.403189:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976123815040:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.403191:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124600576:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155570.403195:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6138 00000100:00100000:3.0:1746155570.403201:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124600704:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.403221:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->2490367] (req 2097152->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.403235:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a226200, rc 0) 00000100:00100000:3.0:1746155570.403252:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:29229:x1830976123814912:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2522us (2794us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.403258:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12182 00000100:00100000:0.0:1746155570.406905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.406956:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123815168 00000100:00100000:1.0:1746155570.406964:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123815168 00010000:00010000:1.0:1746155570.406992:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11210 expref: 15 pid: 8437 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155570.407403:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6139 00000100:00100000:1.0:1746155570.407411:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976123815168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.407424:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.407440:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11210 expref: 15 pid: 8437 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.407450:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11210 expref: 15 pid: 8437 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.407467:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bc4600/0x844e5faceb5ebe03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11210 expref: 15 pid: 8437 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.407492:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.407493:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.407499:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 14 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.407526:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 14 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.407561:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 14 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155570.407571:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124600832:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155570.407630:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fbe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.412151:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.412235:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124600832:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155570.412252:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.412288:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1963:x1830976123815168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4877us (5390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.412297:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6139 00000100:00100000:2.0:1746155570.412382:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123815424 00000100:00100000:2.0:1746155570.412388:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123815424 00002000:00100000:2.0:1746155570.412416:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (2486272->2490367) req@ffff88009f244a80 x1830976123815424/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.412423:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f244a80 with x1830976123815424 ext(2486272->2490367) 00002000:00010000:2.0:1746155570.412427:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f244a80 00000100:00100000:2.0:1746155570.413475:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4704 00000100:00100000:2.0:1746155570.413484:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123815424:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155570.413632:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123815424:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 148us (1488us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155570.413638:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4704 00002000:00100000:2.0:1746155570.413643:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d9:0x0] (2486272->2490367) req@ffff88009f244a80 x1830976123815424/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.413651:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f244a80 with x1830976123815424 ext(2486272->2490367) 00002000:00010000:2.0:1746155570.413654:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f244a80 00000100:00100000:0.0:1746155570.416249:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.416821:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123815680 00000100:00100000:2.0:1746155570.416828:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123815680 00000100:00100000:2.0:1746155570.417104:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4057 00000100:00100000:2.0:1746155570.417112:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:29229:x1830976123815680:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155570.417385:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:29229:x1830976123815680:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 274us (1142us total) trans 8589943987 rc 0/0 00000100:00100000:2.0:1746155570.417391:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4057 00000100:00100000:0.0:1746155570.429748:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.429923:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123815808 00000100:00100000:2.0:1746155570.429935:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123815808 00000100:00100000:2.0:1746155570.429973:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10035 00000100:00100000:2.0:1746155570.429980:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29234:x1830976123815808:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155570.430002:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155570.430016:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4e00/0x844e5faceb5ebe5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1124f expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.430064:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5c00/0x844e5faceb5ebe65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.430074:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5c00/0x844e5faceb5ebe65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.430083:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5c00/0x844e5faceb5ebe65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.430099:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4400/0x844e5faceb5ebe6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.430104:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4400/0x844e5faceb5ebe6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.430108:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4400/0x844e5faceb5ebe6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.430195:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.430202:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110dc expref: 22 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.430209:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.430232:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110dc expref: 22 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.430243:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110dc expref: 22 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.430252:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124600960:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.430927:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bf200c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155570.433250:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124600960:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155570.433269:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155570.435174:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.435317:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123816064 00000100:00100000:2.0:1746155570.435324:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123816064 00000100:00100000:2.0:1746155570.435733:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4058 00000100:00100000:2.0:1746155570.435741:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+23:13789:x1830976123816064:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746155570.437022:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:13789:x1830976123816064:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 1278us (1848us total) trans 8589943988 rc 0/0 00000100:00100000:2.0:1746155570.437031:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4058 00000100:00100000:0.0:1746155570.443428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.443933:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123816192 00000100:00100000:1.0:1746155570.443941:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123816192 00010000:00010000:1.0:1746155570.443972:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110dc expref: 24 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155570.444009:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6140 00000100:00100000:1.0:1746155570.444016:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123816192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.444031:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.444036:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110dc expref: 24 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.444046:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110dc expref: 24 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.444064:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3c00/0x844e5faceb5ebbe1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110dc expref: 24 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.444486:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155570.444491:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.444500:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.444543:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.445285:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.445348:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123816192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1329us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.445358:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6140 00010000:00010000:2.0:1746155570.445608:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445615:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155570.445649:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155570.445652:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155570.445665:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445675:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445682:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5c00/0x844e5faceb5ebe65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445688:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5c00/0x844e5faceb5ebe65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445693:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5c00/0x844e5faceb5ebe65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445698:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942d5c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155570.445702:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5c00/0x844e5faceb5ebe65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445708:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5c00/0x844e5faceb5ebe65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445717:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155570.445719:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155570.445722:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5c00/0x844e5faceb5ebe65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445726:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5c00/0x844e5faceb5ebe65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445747:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4400/0x844e5faceb5ebe6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445752:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4400/0x844e5faceb5ebe6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445755:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4400/0x844e5faceb5ebe6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445759:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942d4400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155570.445761:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4400/0x844e5faceb5ebe6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445765:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4400/0x844e5faceb5ebe6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445771:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9c00) 00010000:00010000:2.0:1746155570.445773:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155570.445775:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4400/0x844e5faceb5ebe6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445783:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4400/0x844e5faceb5ebe6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.445813:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4e00/0x844e5faceb5ebe5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1124f expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.445822:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1124f expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.445829:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155570.445830:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155570.445832:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942d4a00, rc 0) 00000100:00100000:2.0:1746155570.445870:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29234:x1830976123815808:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 15887us (16125us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.445876:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10035 00000100:00100000:0.0:1746155570.450886:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.450912:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.450934:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.450941:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123816320 00000100:00100000:3.0:1746155570.450949:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123816320 00000100:00100000:0.0:1746155570.450954:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:3.0:1746155570.450972:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746155570.450996:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123816576 00000100:00100000:3.0:1746155570.450998:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123816576 00000100:00100000:0.0:1746155570.451002:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123816448 00000100:00100000:0.0:1746155570.451004:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123816448 00000100:00080000:3.0:1746155570.451007:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155570.451016:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123816704 00000100:00100000:0.0:1746155570.451018:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123816704 00000100:00100000:3.0:1746155570.451098:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12183 00000100:00100000:0.0:1746155570.451102:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12184 00000100:00100000:0.0:1746155570.451107:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123816448:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:3.0:1746155570.451109:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12185 00000100:00100000:3.0:1746155570.451113:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123816576:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155570.451122:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155570.451122:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.451134:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a226800/0x844e5faceb5ebe7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11264 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.451134:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca07e00/0x844e5faceb5ebe81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1125d expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.451172:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124601088:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155570.451172:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f245180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124601216:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155570.451225:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.451242:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12186 00000100:00100000:0.0:1746155570.451247:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123816704:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155570.451253:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155570.451259:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca06200/0x844e5faceb5ebe88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1126b expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.451273:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca06200/0x844e5faceb5ebe88 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1126b expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155570.451281:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca06200/0x844e5faceb5ebe88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1126b expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155570.451293:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca06200, rc 0) 00000100:00100000:2.0:1746155570.451380:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123816320:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155570.451387:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155570.451394:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942d5200/0x844e5faceb5ebe8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11256 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.451405:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.451407:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.451413:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942d5200/0x844e5faceb5ebe8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11256 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155570.451425:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942d5200/0x844e5faceb5ebe8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11256 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155570.451436:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942d5200, rc 0) 00000100:00100000:3.0:1746155570.451516:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.451568:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123816704:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 319us (610us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155570.451573:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12186 00000100:00100000:2.0:1746155570.451714:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123816320:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 608us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.451719:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12183 00000100:00100000:2.0:1746155570.452573:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f245180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124601216:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155570.452593:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca07e00/0x844e5faceb5ebe81 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1125d expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155570.452601:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca07e00/0x844e5faceb5ebe81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1125d expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155570.452608:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca07e00, rc 0) 00000100:00100000:3.0:1746155570.453290:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124601088:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155570.453304:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a226800/0x844e5faceb5ebe7a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11264 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.453313:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a226800/0x844e5faceb5ebe7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11264 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.453328:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a226800, rc 0) 00000100:00100000:3.0:1746155570.453751:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123816576:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2635us (2835us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155570.453758:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12185 00000100:00100000:2.0:1746155570.453800:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123816448:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2691us (2863us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155570.453807:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12184 00000100:00100000:0.0:1746155570.461600:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.461741:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123816960 00000100:00100000:2.0:1746155570.461749:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123816960 00000100:00100000:2.0:1746155570.461785:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10036 00000100:00100000:2.0:1746155570.461792:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29234:x1830976123816960:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155570.461810:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155570.461825:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4000/0x844e5faceb5ebe96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11272 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.461902:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.461914:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1124f expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.461920:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.461943:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1124f expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.461953:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1124f expref: 11 pid: 15474 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.461963:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124601344:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.462302:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bf200c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155570.465023:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124601344:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155570.465041:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155570.467750:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.468322:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123817088 00000100:00100000:1.0:1746155570.468329:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123817088 00010000:00010000:1.0:1746155570.468357:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1124f expref: 12 pid: 15474 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155570.468390:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6141 00000100:00100000:1.0:1746155570.468398:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123817088:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.468408:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.468412:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1124f expref: 12 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.468422:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1124f expref: 12 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.468438:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4a00/0x844e5faceb5ebe73 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1124f expref: 12 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.468453:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155570.468457:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.468465:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.468470:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.468661:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.468698:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123817088:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 300us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.468704:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6141 00010000:00010000:3.0:1746155570.468791:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.468798:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155570.468813:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155570.468917:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4000/0x844e5faceb5ebe96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11272 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.468930:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11272 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.468936:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155570.468938:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155570.468941:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942d4200, rc 0) 00000100:00100000:3.0:1746155570.468960:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29234:x1830976123816960:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 7169us (7368us total) trans 8589943989 rc 0/0 00000100:00100000:3.0:1746155570.468966:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10036 00000100:00100000:0.0:1746155570.471295:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.471416:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123817216 00000100:00100000:3.0:1746155570.471422:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123817216 00000100:00100000:3.0:1746155570.471750:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10037 00000100:00100000:3.0:1746155570.471758:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29234:x1830976123817216:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155570.471777:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.471792:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227200/0x844e5faceb5ebeab lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11279 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.471847:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227800/0x844e5faceb5ebeb2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.471857:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11272 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.471863:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227800/0x844e5faceb5ebeb2 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.471886:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11272 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.471896:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11272 expref: 12 pid: 15474 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.471905:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124601472:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.472907:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.473892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.473979:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123817344 00000100:00100000:2.0:1746155570.473985:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123817344 00010000:00010000:2.0:1746155570.474006:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11272 expref: 13 pid: 15474 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.474038:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6142 00000100:00100000:2.0:1746155570.474045:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123817344:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.474055:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.474059:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11272 expref: 13 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.474071:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11272 expref: 13 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.474087:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155570.474091:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227800/0x844e5faceb5ebeb2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.474099:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227800/0x844e5faceb5ebeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.474104:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227800/0x844e5faceb5ebeb2 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155570.474116:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.474146:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123817344:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 100us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.474151:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6142 00010000:00010000:3.0:1746155570.474224:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4200/0x844e5faceb5ebe9d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11272 expref: 12 pid: 15474 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.474234:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124601472:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.474247:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227800/0x844e5faceb5ebeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.474255:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227800/0x844e5faceb5ebeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.474260:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227800/0x844e5faceb5ebeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155570.474291:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155570.474296:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155570.474307:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227800/0x844e5faceb5ebeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.474330:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227200/0x844e5faceb5ebeab lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11279 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.474340:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227800/0x844e5faceb5ebeb2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11279 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.474346:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155570.474348:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155570.474350:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a227800, rc 0) 00000100:00100000:3.0:1746155570.474372:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29234:x1830976123817216:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2616us (3082us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.474377:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10037 00000100:00100000:0.0:1746155570.476441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.476485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.476601:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123817472 00000100:00100000:2.0:1746155570.476607:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123817472 00000100:00100000:2.0:1746155570.476633:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123817600 00000100:00100000:2.0:1746155570.476634:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123817600 00000100:00100000:2.0:1746155570.476657:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12187 00000100:00100000:2.0:1746155570.476663:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123817472:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155570.476675:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155570.476688:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942d5c00/0x844e5faceb5ebeb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11280 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.476725:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124601600:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155570.476785:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bf200c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.476845:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12188 00000100:00100000:3.0:1746155570.476852:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123817600:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155570.476858:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.476867:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a226800/0x844e5faceb5ebec0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11287 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.476888:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124601728:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155570.476910:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155570.477262:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.477530:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123817728 00000100:00100000:0.0:1746155570.477533:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123817728 00000100:00100000:0.0:1746155570.477706:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12189 00000100:00100000:0.0:1746155570.477713:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123817728:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155570.477720:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155570.477727:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca06400/0x844e5faceb5ebec7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1128e expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.477743:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca06400/0x844e5faceb5ebec7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1128e expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155570.477751:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca06400/0x844e5faceb5ebec7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1128e expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155570.477762:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca06400, rc 0) 00000100:00100000:0.0:1746155570.477784:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123817728:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 71us (522us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155570.477789:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12189 00000100:00100000:2.0:1746155570.478875:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124601600:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155570.478892:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942d5c00/0x844e5faceb5ebeb9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11280 expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155570.478900:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942d5c00/0x844e5faceb5ebeb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11280 expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155570.479012:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124601728:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155570.479026:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a226800/0x844e5faceb5ebec0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11287 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.479035:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a226800/0x844e5faceb5ebec0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11287 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.479042:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a226800, rc 0) 00000100:00100000:3.0:1746155570.479064:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123817600:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2213us (2578us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155570.479069:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12188 00010000:00010000:2.0:1746155570.479208:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942d5c00, rc 0) 00000100:00100000:2.0:1746155570.479479:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976123817472:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2815us (3042us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155570.479485:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12187 00000100:00100000:0.0:1746155570.481796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.481906:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123817984 00000100:00100000:3.0:1746155570.481914:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123817984 00000100:00100000:3.0:1746155570.481946:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10038 00000100:00100000:3.0:1746155570.481953:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29234:x1830976123817984:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155570.481967:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.481981:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226000/0x844e5faceb5ebece lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11295 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.482050:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ebed5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.482060:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ebed5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.482068:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ebed5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155570.482082:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155570.482167:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226000/0x844e5faceb5ebece lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11295 expref: 14 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.482179:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ebed5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11295 expref: 13 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.482186:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155570.482188:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155570.482190:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a227c00, rc 0) 00000100:00100000:3.0:1746155570.482237:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:29234:x1830976123817984:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 284us (445us total) trans 8589943990 rc 0/0 00000100:00100000:3.0:1746155570.482242:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10038 00000100:00100000:0.0:1746155570.484698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.484997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.485021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.485191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.485207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.485402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.485628:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123818240 00000100:00100000:3.0:1746155570.485635:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123818240 00000100:00100000:3.0:1746155570.485664:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123818496 00000100:00100000:3.0:1746155570.485666:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123818496 00000100:00100000:3.0:1746155570.485674:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123818752 00000100:00100000:3.0:1746155570.485675:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123818752 00000100:00100000:3.0:1746155570.485682:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123818112 00000100:00100000:3.0:1746155570.485683:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123818112 00000100:00100000:3.0:1746155570.485689:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123818368 00000100:00100000:3.0:1746155570.485690:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123818368 00000100:00100000:3.0:1746155570.485697:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123818624 00000100:00100000:3.0:1746155570.485698:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123818624 00000100:00100000:3.0:1746155570.485708:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12190 00000100:00100000:3.0:1746155570.485713:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123818240:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155570.485744:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.485759:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d1 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.485766:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942d5200/0x844e5faceb5ebe8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11256 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.485772:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea97a00/0x844e5faceb5ebde7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111f4 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.485777:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.485778:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.485781:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.485803:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ea97a00/0x844e5faceb5ebde7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111f4 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.485812:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ea97a00/0x844e5faceb5ebde7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111f4 expref: 9 pid: 1625 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.485822:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124601856:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.485874:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942d5200/0x844e5faceb5ebe8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11256 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.485880:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942d5200/0x844e5faceb5ebe8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11256 expref: 9 pid: 9235 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.485891:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124601984:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.485913:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d1 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.485921:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d1 expref: 18 pid: 8437 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.485928:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124602112:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.485944:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.485960:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12191 00000100:00100000:3.0:1746155570.485966:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123818496:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155570.485982:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.485991:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 13 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.485996:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.485997:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.485999:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486012:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 13 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486023:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 13 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.486031:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124602240:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.486049:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.486063:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12192 00000100:00100000:3.0:1746155570.486068:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123818752:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155570.486081:0:19959:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486090:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb995 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f9a expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.486096:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eba7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11003 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.486102:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5eba52 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd9 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.486107:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.486108:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.486110:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486122:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5eba52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd9 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.486129:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5eba52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd9 expref: 18 pid: 8436 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.486137:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124602368:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.486159:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eba7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11003 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.486165:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eba7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11003 expref: 9 pid: 18270 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.486172:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124602496:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.486189:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb995 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f9a expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.486196:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb995 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f9a expref: 9 pid: 20796 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.486203:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124602624:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.486214:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.486226:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12193 00000100:00100000:3.0:1746155570.486231:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123818112:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155570.486244:0:20796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486256:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5eb972 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f77 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.486262:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5a00/0x844e5faceb5eba59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe0 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.486268:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc3ee00/0x844e5faceb5eba2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fb6 expref: 13 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.486273:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.486274:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.486276:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486287:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc3ee00/0x844e5faceb5eba2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fb6 expref: 13 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.486294:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc3ee00/0x844e5faceb5eba2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fb6 expref: 13 pid: 29728 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.486300:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124602752:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.486322:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5a00/0x844e5faceb5eba59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe0 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.486330:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5a00/0x844e5faceb5eba59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe0 expref: 8 pid: 4461 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.486341:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124602880:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.486358:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5eb972 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f77 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.486365:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5eb972 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f77 expref: 9 pid: 20796 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.486372:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124603008:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.486385:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.486400:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12194 00000100:00100000:3.0:1746155570.486405:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123818368:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155570.486419:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486428:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486432:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.486434:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.486435:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486449:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486459:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 9 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.486465:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124603136:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.486479:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cbe6900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.486520:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12195 00000100:00100000:3.0:1746155570.486526:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123818624:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155570.486540:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486558:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 13 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486565:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11065 expref: 8 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486571:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11081 expref: 13 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486576:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746155570.486577:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746155570.486579:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486595:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11081 expref: 13 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486602:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11081 expref: 13 pid: 29728 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.486610:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124603264:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.486634:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11065 expref: 8 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486641:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11065 expref: 8 pid: 29728 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.486648:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124603392:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.486663:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 13 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.486670:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 13 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.486676:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124603520:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.486687:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.501315:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124601856:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.501675:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124601984:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.501685:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124602112:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.501703:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155570.501717:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.501723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.501737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.501745:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124602368:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.501748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.501752:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124602496:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.501760:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009018a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124602624:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.501763:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123819008 00000100:00100000:2.0:1746155570.501768:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123819008 00010000:00010000:3.0:1746155570.501777:0:19959:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.501795:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123819264 00010000:00010000:2.0:1746155570.501795:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942d5200/0x844e5faceb5ebe8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11256 expref: 10 pid: 9235 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.501798:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123819264 00000100:00100000:2.0:1746155570.501814:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123818880 00000100:00100000:2.0:1746155570.501816:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123818880 00002000:00100000:3.0:1746155570.501824:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1609728->2097151) req@ffff88009fb6ad80 x1830976123819264/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746155570.501825:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea97a00/0x844e5faceb5ebde7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111f4 expref: 10 pid: 1625 timeout: 799 lvb_type: 1 00002000:00100000:3.0:1746155570.501831:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6ad80 with x1830976123819264 ext(1609728->2097151) 00010000:00010000:3.0:1746155570.501838:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 14 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.501839:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123819136 00000100:00100000:2.0:1746155570.501841:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123819136 00010000:00010000:3.0:1746155570.501848:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 14 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.501849:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d1 expref: 19 pid: 8437 timeout: 799 lvb_type: 0 00002000:00010000:3.0:1746155570.501853:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb6ad80 00000100:00100000:2.0:1746155570.501861:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6143 00000100:00100000:3.0:1746155570.501867:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 741 00000100:00100000:2.0:1746155570.501867:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123819008:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155570.501872:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1962:x1830976123819264:12345-192.168.202.51@tcp:4:multiop.0 00010000:00010000:2.0:1746155570.501877:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.501895:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942d5200/0x844e5faceb5ebe8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11256 expref: 10 pid: 9235 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.501903:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942d5200/0x844e5faceb5ebe8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11256 expref: 10 pid: 9235 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.501920:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942d5200/0x844e5faceb5ebe8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11256 expref: 10 pid: 9235 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.501932:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.501959:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123819008:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 92us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.501964:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6143 00000100:00100000:2.0:1746155570.501974:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6144 00000100:00100000:2.0:1746155570.501978:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123818880:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.501983:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.501989:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ea97a00/0x844e5faceb5ebde7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111f4 expref: 10 pid: 1625 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.501996:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ea97a00/0x844e5faceb5ebde7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111f4 expref: 10 pid: 1625 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.502004:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea97a00/0x844e5faceb5ebde7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111f4 expref: 10 pid: 1625 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.502010:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.502019:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1962:x1830976123818880:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.502023:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6144 00000100:00100000:2.0:1746155570.502029:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6145 00000100:00100000:2.0:1746155570.502032:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123819136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.502036:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.502040:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d1 expref: 19 pid: 8437 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.502047:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d1 expref: 19 pid: 8437 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.502055:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9e00/0x844e5faceb5ebd8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f111d1 expref: 19 pid: 8437 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.502062:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.502064:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.502069:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.502075:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.502089:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.502098:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976123819136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 65us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.502102:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6145 00000100:00100000:2.0:1746155570.502127:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.502257:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123819392 00000100:00100000:3.0:1746155570.502261:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123819392 00010000:00010000:3.0:1746155570.502273:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5eba52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd9 expref: 18 pid: 8436 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746155570.502287:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124602752:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.502289:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6146 00000100:00100000:3.0:1746155570.502294:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976123819392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155570.502294:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124602880:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.502300:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155570.502300:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124603008:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.502310:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5eba52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd9 expref: 18 pid: 8436 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.502312:0:20796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.502317:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5eba52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd9 expref: 18 pid: 8436 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746155570.502326:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5eba52 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fd9 expref: 18 pid: 8436 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746155570.502327:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124603264:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.502332:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124603392:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.502336:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124603520:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.502337:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155570.502346:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.502357:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976123819392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 62us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.502361:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6146 00000100:00100000:2.0:1746155570.502363:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009018b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124603136:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155570.502374:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.502395:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.502402:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.502416:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.502423:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.502429:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.502434:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a226c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155570.502437:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.502443:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.502450:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.502455:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a226c00/0x844e5faceb5ebee3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.502495:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123818240:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 16781us (17802us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.502521:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12190 00000100:00100000:0.0:1746155570.502597:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124602240:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155570.502609:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155570.504444:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.504475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.504488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.504492:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123819648 00000100:00100000:1.0:1746155570.504498:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123819648 00000100:00100000:0.0:1746155570.504499:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.504532:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155570.504538:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc3ee00/0x844e5faceb5eba2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fb6 expref: 16 pid: 29728 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746155570.504547:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.504573:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.504574:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123819904 00000100:00100000:1.0:1746155570.504577:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123819904 00010000:00010000:1.0:1746155570.504586:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5eb972 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f77 expref: 10 pid: 20796 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746155570.504587:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123820032 00000100:00100000:0.0:1746155570.504590:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123820032 00000100:00100000:1.0:1746155570.504595:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123820160 00000100:00100000:1.0:1746155570.504596:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123820160 00010000:00010000:1.0:1746155570.504603:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11081 expref: 17 pid: 29728 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155570.504610:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123819520 00000100:00100000:1.0:1746155570.504612:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123819520 00002000:00100000:0.0:1746155570.504612:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1110016->1961983) req@ffff88013089ad80 x1830976123820032/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746155570.504618:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb995 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f9a expref: 8 pid: 20796 timeout: 799 lvb_type: 1 00002000:00100000:0.0:1746155570.504620:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089ad80 with x1830976123820032 ext(1110016->1961983) 00000100:00100000:1.0:1746155570.504625:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123819776 00010000:00010000:0.0:1746155570.504625:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 9 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155570.504627:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123819776 00010000:00010000:1.0:1746155570.504634:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5a00/0x844e5faceb5eba59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe0 expref: 9 pid: 4461 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746155570.504634:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 9 pid: 9235 timeout: 799 lvb_type: 0 00002000:00010000:0.0:1746155570.504639:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013089ad80 00000100:00100000:1.0:1746155570.504643:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6147 00000100:00100000:1.0:1746155570.504648:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123819648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155570.504650:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123820288 00000100:00100000:0.0:1746155570.504652:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123820288 00010000:00010000:1.0:1746155570.504656:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1746155570.504664:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2490367) req@ffff88009c212680 x1830976123820288/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:1.0:1746155570.504668:0:22680:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1893 -> 1895 00002000:00100000:0.0:1746155570.504670:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212680 with x1830976123820288 ext(2097152->2490367) 00010000:00010000:1.0:1746155570.504672:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc3ee00/0x844e5faceb5eba2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fb6 expref: 18 pid: 29728 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746155570.504674:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 18 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.504681:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 18 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.504686:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc3ee00/0x844e5faceb5eba2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fb6 expref: 18 pid: 29728 timeout: 799 lvb_type: 1 00002000:00010000:0.0:1746155570.504686:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c212680 00010000:00010000:1.0:1746155570.504700:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc3ee00/0x844e5faceb5eba2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fb6 expref: 18 pid: 29728 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746155570.504704:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 742 00000100:00100000:0.0:1746155570.504709:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123820032:12345-192.168.202.51@tcp:4:cat.0 00010000:00010000:1.0:1746155570.504713:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.504736:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123819648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.504741:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6147 00000100:00100000:1.0:1746155570.504751:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6148 00000100:00100000:1.0:1746155570.504755:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123819904:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.504760:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.504766:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5eb972 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f77 expref: 10 pid: 20796 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746155570.504773:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5eb972 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f77 expref: 10 pid: 20796 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746155570.504782:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5eb972 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f77 expref: 10 pid: 20796 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746155570.504789:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.504798:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123819904:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 43us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.504806:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6148 00000100:00100000:1.0:1746155570.504812:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6149 00000100:00100000:1.0:1746155570.504816:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123820160:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.504821:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.504827:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11081 expref: 16 pid: 29728 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.504835:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11081 expref: 16 pid: 29728 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.504843:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebb4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11081 expref: 16 pid: 29728 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.504850:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.504859:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123820160:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 43us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.504864:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6149 00000100:00100000:1.0:1746155570.504870:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6150 00000100:00100000:1.0:1746155570.504874:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123819520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.504880:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.504887:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb995 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f9a expref: 8 pid: 20796 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746155570.504894:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb995 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f9a expref: 8 pid: 20796 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746155570.504904:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130cb4400/0x844e5faceb5eb995 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10f9a expref: 8 pid: 20796 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746155570.504911:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.504920:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123819520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 45us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.504924:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6150 00000100:00100000:1.0:1746155570.504930:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6151 00000100:00100000:1.0:1746155570.504934:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123819776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.504939:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.504943:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5a00/0x844e5faceb5eba59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe0 expref: 9 pid: 4461 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746155570.504950:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5a00/0x844e5faceb5eba59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe0 expref: 9 pid: 4461 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746155570.504959:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5a00/0x844e5faceb5eba59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f10fe0 expref: 9 pid: 4461 timeout: 799 lvb_type: 1 00010000:00010000:1.0:1746155570.504965:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.504967:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.504970:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.504977:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.504996:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.505005:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123819776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 71us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.505010:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6151 00010000:00010000:1.0:1746155570.505022:0:20796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.505029:0:20796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.505300:0:20796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.505307:0:20796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.505313:0:20796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.505319:0:20796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090d06a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155570.505322:0:20796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.505328:0:20796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.505342:0:20796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.505347:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebef8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155570.505377:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123818112:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 19146us (20186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.505383:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12193 00000100:00100000:1.0:1746155570.505414:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 743 00000100:00100000:1.0:1746155570.505419:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123820288:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155570.505700:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.505737:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123820416 00000100:00100000:1.0:1746155570.505740:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123820416 00010000:00010000:1.0:1746155570.505750:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11065 expref: 8 pid: 29728 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155570.505766:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6152 00000100:00100000:1.0:1746155570.505770:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123820416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.505775:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.505781:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11065 expref: 8 pid: 29728 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.505788:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11065 expref: 8 pid: 29728 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.505803:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0de600/0x844e5faceb5ebb32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11065 expref: 8 pid: 29728 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.505810:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.505821:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+7:1961:x1830976123820416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.505825:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6152 00000100:00100000:0.0:1746155570.513546:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976123819264:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 11665us (11813us total) trans 21474840589 rc 0/0 00000100:00100000:0.0:1746155570.513565:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 741 00002000:00100000:0.0:1746155570.513575:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d8:0x0] (1609728->2097151) req@ffff88009fb6ad80 x1830976123819264/t21474840589(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/448 e 0 to 0 dl 1746155581 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155570.513583:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6ad80 with x1830976123819264 ext(1609728->2097151) 00010000:00010000:0.0:1746155570.513591:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 16 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.513602:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 16 pid: 9235 timeout: 799 lvb_type: 0 00002000:00010000:0.0:1746155570.513608:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb6ad80 00000100:00100000:0.0:1746155570.519071:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.519117:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.519431:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123820544 00000100:00100000:2.0:1746155570.519440:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123820544 00010000:00010000:2.0:1746155570.519468:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eba7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11003 expref: 11 pid: 18270 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746155570.519488:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123820672 00000100:00100000:2.0:1746155570.519490:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123820672 00010000:00010000:2.0:1746155570.519498:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 16 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.519530:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6153 00000100:00100000:2.0:1746155570.519536:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6154 00000100:00100000:3.0:1746155570.519540:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123820544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155570.519541:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123820672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.519559:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155570.519560:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.519576:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 16 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.519577:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eba7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11003 expref: 11 pid: 18270 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.519586:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 16 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.519587:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eba7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11003 expref: 11 pid: 18270 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746155570.519603:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009374dc00/0x844e5faceb5eba7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11003 expref: 11 pid: 18270 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.519603:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a226e00/0x844e5faceb5ebe50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11241 expref: 16 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.519675:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.519677:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.519681:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.519688:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.519708:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155570.519740:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123820544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 202us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.519746:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6153 00010000:00010000:3.0:1746155570.519789:0:19959:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.519796:0:19959:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.519812:0:19959:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.519819:0:19959:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.519825:0:19959:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.519830:0:19959:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a13c600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155570.519834:0:19959:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.519840:0:19959:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.519849:0:19959:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.519854:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a13c600/0x844e5faceb5ebef1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.519887:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976123818752:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 33819us (34865us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.519894:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12192 00010000:00010000:2.0:1746155570.521069:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.521072:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.521076:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.521082:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.521098:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.521131:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976123820672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1589us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.521137:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6154 00010000:00010000:1.0:1746155570.521209:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.521216:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.521231:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.521236:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.521242:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.521247:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fccc800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155570.521249:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.521259:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.521267:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.521272:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fccc800/0x844e5faceb5ebeea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155570.521301:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123818496:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 35336us (36304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.521308:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12191 00000100:00100000:0.0:1746155570.533626:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123820032:12345-192.168.202.51@tcp:4:cat.0 Request processed in 28908us (29069us total) trans 17179873207 rc 0/0 00000100:00100000:0.0:1746155570.533637:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 742 00002000:00100000:0.0:1746155570.533646:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1110016->1961983) req@ffff88013089ad80 x1830976123820032/t17179873207(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/448 e 0 to 0 dl 1746155581 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155570.533655:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089ad80 with x1830976123820032 ext(1110016->1961983) 00010000:00010000:0.0:1746155570.533664:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 10 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.533680:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 10 pid: 9235 timeout: 799 lvb_type: 0 00002000:00010000:0.0:1746155570.533686:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013089ad80 00000100:00100000:0.0:1746155570.535924:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123820288:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 30498us (31343us total) trans 21474840590 rc 0/0 00000100:00100000:0.0:1746155570.535933:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 743 00002000:00100000:0.0:1746155570.535942:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2490367) req@ffff88009c212680 x1830976123820288/t21474840590(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/448 e 0 to 0 dl 1746155581 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155570.535950:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212680 with x1830976123820288 ext(2097152->2490367) 00010000:00010000:0.0:1746155570.535958:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 15 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.535969:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 15 pid: 9235 timeout: 799 lvb_type: 0 00002000:00010000:0.0:1746155570.535976:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c212680 00000100:00100000:0.0:1746155570.539327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.540581:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.541388:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123820800 00000100:00100000:2.0:1746155570.541397:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123820800 00010000:00010000:2.0:1746155570.541429:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 10 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.541460:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123820928 00000100:00100000:2.0:1746155570.541463:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123820928 00010000:00010000:2.0:1746155570.541473:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 15 pid: 9235 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.541488:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6155 00000100:00100000:2.0:1746155570.541494:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123820800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.541518:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.541537:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 10 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.541547:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 10 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.541578:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bc4200/0x844e5faceb5ebe0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1110016->1961983) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11217 expref: 10 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.541603:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.541605:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.541608:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541615:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541635:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155570.541651:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541658:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541674:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541681:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541687:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541697:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009450d600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155570.541700:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541706:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541715:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541720:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5ebeff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.541772:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1961:x1830976123818368:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 55365us (56562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.541779:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12194 00000100:00100000:2.0:1746155570.541805:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976123820800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 311us (2484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.541809:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6155 00000100:00100000:2.0:1746155570.541818:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6156 00000100:00100000:2.0:1746155570.541822:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123820928:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.541829:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746155570.541839:0:7062:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155569 -> 1746155570 00010000:00010000:2.0:1746155570.541843:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 15 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.541852:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 15 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.541863:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a226200/0x844e5faceb5ebe57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11248 expref: 15 pid: 9235 timeout: 799 lvb_type: 0 00010000:00010000:2.0:1746155570.541870:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.541872:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.541874:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541879:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541891:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155570.541899:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541905:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541915:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541920:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541930:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541935:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009450d000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155570.541937:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541942:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541948:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.541952:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5ebf06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.541978:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976123818624:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 55453us (56575us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.541982:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12195 00000100:00100000:2.0:1746155570.542001:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123820928:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 179us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.542006:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6156 00000100:00100000:0.0:1746155570.550781:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.552305:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123821184 00000100:00100000:2.0:1746155570.552315:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123821184 00000100:00100000:2.0:1746155570.552379:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10039 00000100:00100000:2.0:1746155570.552388:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:29234:x1830976123821184:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155570.552431:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746155570.552453:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227800/0x844e5faceb5ebeb2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11279 expref: 13 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.552650:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df400/0x844e5faceb5ebaec lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11042 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.552661:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155570.552664:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155570.552688:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.552697:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1101f expref: 22 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.552703:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 300 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.552708:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 22 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.552712:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18dc00/0x844e5faceb5ebc0b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110e3 expref: 300 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.552717:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c000/0x844e5faceb5ebccf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1116f expref: 22 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.552722:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 8/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.552753:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c000/0x844e5faceb5ebccf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1116f expref: 22 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.552762:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c000/0x844e5faceb5ebccf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1116f expref: 22 pid: 15474 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.552773:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124603648:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155570.553589:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18dc00/0x844e5faceb5ebc0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110e3 expref: 300 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.553599:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18dc00/0x844e5faceb5ebc0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110e3 expref: 300 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.553607:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094087b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124603776:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155570.553972:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 22 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.553980:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 22 pid: 15474 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.553986:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124603904:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155570.554009:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 300 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.554015:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 300 pid: 15474 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.554025:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124604032:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155570.554038:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1101f expref: 22 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.554044:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1101f expref: 22 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.554049:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094087800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124604160:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.554058:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bf200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.555564:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.556267:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124603648:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.556276:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094087b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124603776:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155570.556333:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123821312 00000100:00100000:1.0:1746155570.556339:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123821312 00010000:00010000:1.0:1746155570.556370:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c000/0x844e5faceb5ebccf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1116f expref: 23 pid: 15474 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155570.556402:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6157 00000100:00100000:1.0:1746155570.556409:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123821312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.556420:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.556426:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c000/0x844e5faceb5ebccf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1116f expref: 23 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.556434:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c000/0x844e5faceb5ebccf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1116f expref: 23 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.556454:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c000/0x844e5faceb5ebccf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1116f expref: 23 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.556468:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155570.556473:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155570.556480:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.556780:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123821312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 370us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.556785:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6157 00000100:00100000:0.0:1746155570.556801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.556860:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124603904:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.556878:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124604032:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.556893:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094087800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124604160:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155570.556910:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155570.556926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.556938:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.556947:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123821440 00000100:00100000:2.0:1746155570.556950:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123821440 00010000:00010000:2.0:1746155570.556959:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18dc00/0x844e5faceb5ebc0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110e3 expref: 301 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.556974:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123821568 00000100:00100000:2.0:1746155570.556975:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123821568 00010000:00010000:2.0:1746155570.556981:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 22 pid: 15474 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.557914:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123821824 00000100:00100000:2.0:1746155570.557919:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123821824 00010000:00010000:2.0:1746155570.557932:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1101f expref: 23 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.558008:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6158 00000100:00100000:3.0:1746155570.558017:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1960:x1830976123821440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155570.558027:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155570.558034:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18dc00/0x844e5faceb5ebc0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110e3 expref: 301 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.558042:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18dc00/0x844e5faceb5ebc0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110e3 expref: 301 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.558054:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18dc00/0x844e5faceb5ebc0b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f110e3 expref: 301 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.558070:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155570.558073:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155570.558079:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155570.558103:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1960:x1830976123821440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.558108:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6158 00000100:00100000:3.0:1746155570.558119:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6159 00000100:00100000:3.0:1746155570.558123:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123821568:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155570.558130:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155570.558133:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 23 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.558139:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 23 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.558148:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e82c000/0x844e5faceb5ebade lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11034 expref: 23 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.558158:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155570.558161:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155570.558165:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155570.558178:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123821568:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.558182:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6159 00000100:00100000:3.0:1746155570.558190:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6160 00000100:00100000:3.0:1746155570.558194:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123821824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155570.558200:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155570.558203:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1101f expref: 21 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.558208:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1101f expref: 21 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.558216:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0df600/0x844e5faceb5ebac2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1101f expref: 21 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.558223:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155570.558226:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155570.558229:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155570.558241:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123821824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 47us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.558248:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6160 00000100:00100000:3.0:1746155570.558326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.558338:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123821696 00000100:00100000:3.0:1746155570.558340:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123821696 00010000:00010000:3.0:1746155570.558350:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 300 pid: 15474 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.558365:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6161 00000100:00100000:3.0:1746155570.558369:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1960:x1830976123821696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155570.558374:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155570.558377:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 300 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.558384:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 300 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.558392:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ebad7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1102d expref: 300 pid: 15474 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.558399:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155570.558402:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155570.558408:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155570.559737:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155570.562822:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155570.562898:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1960:x1830976123821696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4523us (4566us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.562910:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6161 00010000:00010000:2.0:1746155570.563659:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.563666:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000040:00080000:2.0:1746155570.564269:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2899, 88 off242496 00000004:00080000:2.0:1746155570.564275:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699713771557ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.564395:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2841, 88 off237120 00000004:00080000:2.0:1746155570.564399:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699713896002ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.564419:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2842, 88 off237208 00000004:00080000:2.0:1746155570.564422:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699713919132ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.564430:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2900, 88 off242584 00000004:00080000:2.0:1746155570.564432:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699713929622ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.564438:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2901, 88 off242672 00000004:00080000:2.0:1746155570.564440:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699713937312ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.564448:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2843, 88 off237296 00000004:00080000:2.0:1746155570.564451:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699713947838ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.564710:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2844, 88 off237384 00000004:00080000:2.0:1746155570.564714:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699714211200ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.564734:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2845, 88 off237472 00000004:00080000:2.0:1746155570.564737:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699714234120ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.564745:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2902, 88 off242760 00000004:00080000:2.0:1746155570.564748:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699714245441ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.564791:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2847, 88 off237656 00000004:00080000:2.0:1746155570.564795:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699714291801ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.564803:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2903, 88 off242848 00000004:00080000:2.0:1746155570.564807:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699714303936ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.564813:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2848, 88 off237744 00000004:00080000:2.0:1746155570.564815:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699714312307ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.564821:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2904, 88 off242936 00000004:00080000:2.0:1746155570.564823:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699714319937ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.564829:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2905, 88 off243024 00000004:00080000:2.0:1746155570.564831:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699714328015ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.564836:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2906, 88 off243112 00000004:00080000:2.0:1746155570.564839:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699714335695ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.564844:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2907, 88 off243200 00000004:00080000:2.0:1746155570.564846:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699714343438ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.564852:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2849, 88 off237832 00000004:00080000:2.0:1746155570.564854:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699714351297ns, next at 645866785986ns, rc = 0 00000004:00010000:2.0:1746155570.599681:0:27374:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c210700 reply state ffff88009f5d0800 transno 8589943991 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155570.599694:0:27374:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746155570.599783:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:29234:x1830976123821184:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 47393us (49005us total) trans 8589943991 rc 0/0 00000100:00100000:2.0:1746155570.599795:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10039 00000001:00080000:1.0:1746155570.599905:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943984 is committed 00000001:00080000:1.0:1746155570.599913:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943983 is committed 00000001:00080000:1.0:1746155570.599934:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943991 is committed 00000004:00080000:1.0:1746155570.599937:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2041 committed 00000004:00080000:1.0:1746155570.599942:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2106 committed 00000004:00080000:1.0:1746155570.599947:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2105 committed 00000004:00080000:1.0:1746155570.599948:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2104 committed 00000004:00080000:1.0:1746155570.599950:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2103 committed 00000004:00080000:1.0:1746155570.599951:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2040 committed 00000004:00080000:1.0:1746155570.599953:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2102 committed 00000004:00080000:1.0:1746155570.599954:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2039 committed 00000004:00080000:1.0:1746155570.599956:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2101 committed 00000004:00080000:1.0:1746155570.599958:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2038 committed 00000004:00080000:1.0:1746155570.599959:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2037 committed 00000004:00080000:1.0:1746155570.599961:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2036 committed 00000004:00080000:1.0:1746155570.599962:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2100 committed 00000004:00080000:1.0:1746155570.599964:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2099 committed 00000004:00080000:1.0:1746155570.599966:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2035 committed 00000004:00080000:1.0:1746155570.599967:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2034 committed 00000004:00080000:1.0:1746155570.599969:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2098 committed 00000001:00080000:1.0:1746155570.599972:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943988 is committed 00000001:00080000:1.0:1746155570.599975:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943987 is committed 00000100:00100000:3.0:1746155570.600456:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124604288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155570.600494:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155570.600543:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124604800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155570.600570:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155570.600586:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746155570.600590:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124604672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155570.600600:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155570.600609:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124605184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155570.600621:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155570.600640:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124604288 00000100:00100000:3.0:1746155570.600646:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124604288 00000100:00100000:3.0:1746155570.600676:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124604800 00000100:00100000:3.0:1746155570.600678:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124604800 00000100:00100000:3.0:1746155570.600687:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124604672 00000100:00100000:3.0:1746155570.600688:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124604672 00000100:00100000:3.0:1746155570.600696:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124605184 00000100:00100000:3.0:1746155570.600698:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124605184 00000100:00100000:3.0:1746155570.600710:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12196 00000100:00100000:3.0:1746155570.600715:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1830976124604288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155570.600878:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3296:x1830976124604288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (382us total) trans 17179873208 rc 0/0 00000100:00100000:3.0:1746155570.600883:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12196 00000100:00100000:3.0:1746155570.600894:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12197 00000100:00100000:3.0:1746155570.600898:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1830976124604800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155570.600990:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3296:x1830976124604800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (418us total) trans 17179873209 rc 0/0 00000100:00100000:3.0:1746155570.600996:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12197 00000100:00100000:3.0:1746155570.601005:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12198 00000100:00100000:3.0:1746155570.601009:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1830976124604672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155570.601059:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12199 00000100:00100000:1.0:1746155570.601064:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3296:x1830976124605184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155570.601076:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124605696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.601095:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155570.601096:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3296:x1830976124604672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (495us total) trans 17179873210 rc 0/0 00000100:00100000:3.0:1746155570.601102:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12198 00000100:00100000:1.0:1746155570.601107:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124606208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155570.601110:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124605696 00000100:00100000:3.0:1746155570.601112:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124605696 00000100:00100000:1.0:1746155570.601119:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155570.601127:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124606208 00000100:00100000:3.0:1746155570.601128:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124606208 00000100:00100000:1.0:1746155570.601128:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746155570.601132:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124605312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155570.601138:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12200 00000100:00100000:3.0:1746155570.601141:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3295:x1830976124605696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.601144:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.601153:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124605824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.601164:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.601177:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124605312 00002000:00010000:3.0:1746155570.601236:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:3.0:1746155570.601239:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155570.601241:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746155570.601243:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155570.601244:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:3.0:1746155570.601410:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3295:x1830976124605696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 268us (313us total) trans 21474840591 rc 0/0 00000100:00100000:3.0:1746155570.601415:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12200 00000100:00100000:3.0:1746155570.601423:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124605824 00000100:00100000:3.0:1746155570.601426:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124605824 00000100:00100000:3.0:1746155570.601435:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12201 00000100:00100000:3.0:1746155570.601438:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3295:x1830976124606208:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746155570.601602:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.601611:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.601617:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.601622:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942d4800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155570.601625:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.601631:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.601643:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:0.0:1746155570.601645:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155570.601648:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.601653:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d4800/0x844e5faceb5ebf0d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155570.601670:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124604416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.601690:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155570.601703:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124604928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.601715:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155570.601720:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124605440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.601731:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155570.601736:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124605952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.601746:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155570.601752:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746155570.601756:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124604544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.601769:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155570.601774:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124605056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.601784:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155570.601790:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124605568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.601800:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155570.601805:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124606080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.601815:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155570.601829:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124604416 00000100:00100000:0.0:1746155570.601832:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124604416 00000100:00100000:0.0:1746155570.601842:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124604928 00000100:00100000:0.0:1746155570.601843:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124604928 00000100:00100000:0.0:1746155570.601848:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124605440 00000100:00100000:0.0:1746155570.601850:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124605440 00000100:00100000:0.0:1746155570.601855:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124605952 00000100:00100000:0.0:1746155570.601857:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124605952 00000100:00100000:0.0:1746155570.601862:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124604544 00000100:00100000:0.0:1746155570.601863:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124604544 00000100:00100000:0.0:1746155570.601868:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124605056 00000100:00100000:0.0:1746155570.601870:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124605056 00000100:00100000:0.0:1746155570.601875:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124605568 00000100:00100000:0.0:1746155570.601876:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124605568 00000100:00100000:0.0:1746155570.601880:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124606080 00000100:00100000:0.0:1746155570.601882:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124606080 00000100:00100000:0.0:1746155570.601887:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12202 00000100:00100000:0.0:1746155570.601891:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976124605824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.601973:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976124605824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (807us total) trans 21474840593 rc 0/0 00000100:00100000:0.0:1746155570.601978:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12202 00000100:00100000:0.0:1746155570.601986:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12203 00000100:00100000:0.0:1746155570.601990:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976124604416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.602067:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976124604416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (376us total) trans 17179873211 rc 0/0 00000100:00100000:0.0:1746155570.602072:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12203 00000100:00100000:0.0:1746155570.602081:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12204 00000100:00100000:0.0:1746155570.602084:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976124604928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.602150:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976124604928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (433us total) trans 17179873212 rc 0/0 00000100:00100000:0.0:1746155570.602155:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12204 00000100:00100000:0.0:1746155570.602162:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12205 00000100:00100000:0.0:1746155570.602166:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976124605440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.602231:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976124605440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (499us total) trans 21474840594 rc 0/0 00000100:00100000:0.0:1746155570.602235:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12205 00000100:00100000:0.0:1746155570.602244:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12206 00000100:00100000:0.0:1746155570.602248:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976124605952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.602312:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976124605952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (564us total) trans 21474840595 rc 0/0 00000100:00100000:0.0:1746155570.602317:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12206 00000100:00100000:0.0:1746155570.602324:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12207 00000100:00100000:0.0:1746155570.602328:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976124604544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.602403:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976124604544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (632us total) trans 17179873213 rc 0/0 00000100:00100000:0.0:1746155570.602407:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12207 00000100:00100000:0.0:1746155570.602415:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12208 00000100:00100000:0.0:1746155570.602418:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976124605056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.602480:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976124605056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (694us total) trans 17179873214 rc 0/0 00000100:00100000:0.0:1746155570.602484:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12208 00000100:00100000:0.0:1746155570.602492:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12209 00000100:00100000:0.0:1746155570.602495:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976124605568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.602597:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976124605568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (795us total) trans 21474840596 rc 0/0 00000100:00100000:0.0:1746155570.602602:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12209 00000100:00100000:0.0:1746155570.602610:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12210 00000100:00100000:0.0:1746155570.602614:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976124606080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.602695:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976124606080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (878us total) trans 21474840597 rc 0/0 00000100:00100000:0.0:1746155570.602699:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12210 00000100:00100000:0.0:1746155570.602725:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873201 gen 2 00000004:00080000:0.0:1746155570.602729:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800944ac700, transno 17179873186 00000100:00100000:3.0:1746155570.602730:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976124606208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1290us (1610us total) trans 21474840592 rc 0/0 00000100:00100000:3.0:1746155570.602735:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12201 00000004:00080000:0.0:1746155570.602736:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800944af800, transno 17179873187 00000004:00080000:0.0:1746155570.602738:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28d180, transno 17179873188 00000004:00080000:0.0:1746155570.602740:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800944ae300, transno 17179873189 00000004:00080000:0.0:1746155570.602742:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6061180, transno 17179873190 00000004:00080000:0.0:1746155570.602744:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800944ac380, transno 17179873191 00000004:00080000:0.0:1746155570.602746:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6062680, transno 17179873192 00000004:00080000:0.0:1746155570.602748:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800944ac000, transno 17179873193 00000004:00080000:0.0:1746155570.602749:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9f480, transno 17179873194 00000004:00080000:0.0:1746155570.602751:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9c380, transno 17179873195 00000100:00080000:3.0:1746155570.602753:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746155570.602753:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9df80, transno 17179873196 00000004:00080000:0.0:1746155570.602755:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9d500, transno 17179873197 00000100:00080000:3.0:1746155570.602756:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746155570.602757:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9ce00, transno 17179873198 00000004:00080000:0.0:1746155570.602759:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9f800, transno 17179873199 00000004:00080000:0.0:1746155570.602760:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9e680, transno 17179873200 00000004:00080000:0.0:1746155570.602762:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9c000, transno 17179873201 00000100:00100000:0.0:1746155570.602766:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800910d9880 x1830976124604544/t17179873213(17179873213) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155586 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746155570.602774:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910d9880/2, rc 0, transno 17179873213 00000004:00080000:3.0:1746155570.602777:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910d8e00/2, rc 0, transno 17179873210 00000100:00100000:0.0:1746155570.602778:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124604544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155570.602780:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124604672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155570.602784:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910da680/2, rc 0, transno 17179873214 00000100:00100000:0.0:1746155570.602787:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124605056:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155570.602803:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910d9f80/2, rc 0, transno 17179873208 00000100:00100000:0.0:1746155570.602804:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840583 gen 2 00000100:00100000:3.0:1746155570.602806:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124604288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155570.602806:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8c000, transno 21474840566 00000004:00080000:0.0:1746155570.602812:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c31c00, transno 21474840567 00000004:00080000:3.0:1746155570.602813:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910d8700/2, rc 0, transno 17179873209 00000004:00080000:0.0:1746155570.602814:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8f480, transno 21474840568 00000100:00100000:3.0:1746155570.602815:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124604800:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155570.602816:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c30e00, transno 21474840569 00000004:00080000:0.0:1746155570.602818:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8d180, transno 21474840570 00000004:00080000:0.0:1746155570.602820:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ff19f80, transno 21474840571 00000004:00080000:0.0:1746155570.602822:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ff19180, transno 21474840572 00000004:00080000:0.0:1746155570.602824:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c32a00, transno 21474840573 00000004:00080000:0.0:1746155570.602826:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c32d80, transno 21474840574 00000004:00080000:0.0:1746155570.602828:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c30a80, transno 21474840575 00000004:00080000:0.0:1746155570.602830:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c31880, transno 21474840576 00000004:00080000:0.0:1746155570.602832:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c33800, transno 21474840577 00000004:00080000:0.0:1746155570.602834:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c33b80, transno 21474840578 00000004:00080000:0.0:1746155570.602836:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c31f80, transno 21474840579 00000004:00080000:0.0:1746155570.602837:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c31180, transno 21474840580 00000004:00080000:0.0:1746155570.602840:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c32300, transno 21474840581 00000004:00080000:0.0:1746155570.602841:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c30380, transno 21474840582 00000100:00100000:1.0:1746155570.602874:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124605312 00000100:00100000:1.0:1746155570.602896:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12211 00000100:00100000:1.0:1746155570.602900:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976124605312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.602994:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976124605312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (1848us total) trans 21474840598 rc 0/0 00000100:00100000:1.0:1746155570.602998:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12211 00000100:00100000:1.0:1746155570.603103:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3296:x1830976124605184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2039us (2481us total) trans 17179873215 rc 0/0 00000100:00100000:1.0:1746155570.603108:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12199 00000004:00080000:2.0:1746155570.604059:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c212a00/2, rc 0, transno 17179873215 00000100:00100000:2.0:1746155570.604063:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124605184:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155570.605172:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131497100, transno 21474840583 00000100:00100000:0.0:1746155570.605181:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880131495180 x1830976124605568/t21474840596(21474840596) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155586 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746155570.605190:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131495180/2, rc 0, transno 21474840596 00000100:00100000:0.0:1746155570.605193:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124605568:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155570.605314:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131497800/2, rc 0, transno 21474840598 00000100:00100000:1.0:1746155570.605319:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124605312:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155570.605335:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131494e00/2, rc 0, transno 21474840593 00000100:00100000:1.0:1746155570.605337:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124605824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155570.605343:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131494a80/2, rc 0, transno 21474840591 00000100:00100000:1.0:1746155570.605345:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124605696:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155570.605352:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ef100/2, rc 0, transno 21474840592 00000100:00100000:1.0:1746155570.605354:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124606208:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155570.606262:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131497b80/2, rc 0, transno 21474840597 00000100:00100000:0.0:1746155570.606267:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124606080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155570.606278:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910dbb80/2, rc 0, transno 17179873211 00000100:00100000:0.0:1746155570.606281:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124604416:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155570.606288:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910d8a80/2, rc 0, transno 17179873212 00000100:00100000:0.0:1746155570.606290:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124604928:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155570.606297:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131494000/2, rc 0, transno 21474840594 00000100:00100000:0.0:1746155570.606299:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124605440:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155570.606305:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131497480/2, rc 0, transno 21474840595 00000100:00100000:0.0:1746155570.606308:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124605952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155570.610003:0:14274:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 18 done 00000004:00080000:0.0:1746155570.610147:0:14277:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 16 done 00000100:00100000:2.0:1746155570.610757:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124606336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.610809:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155570.610970:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124606336 00000100:00100000:3.0:1746155570.610976:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124606336 00000100:00100000:3.0:1746155570.611007:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12212 00000100:00100000:3.0:1746155570.611014:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3296:x1830976124606336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155570.611335:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3296:x1830976124606336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 320us (524us total) trans 21474840599 rc 0/0 00000100:00100000:3.0:1746155570.611341:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12212 00000004:00080000:2.0:1746155570.611394:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c5880/2, rc 0, transno 21474840599 00000100:00100000:2.0:1746155570.611399:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124606336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.612647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.613197:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123821952 00000100:00100000:2.0:1746155570.613203:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123821952 00000100:00100000:2.0:1746155570.613237:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10040 00000100:00100000:2.0:1746155570.613243:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29234:x1830976123821952:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155570.613258:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155570.613273:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5a00/0x844e5faceb5ebf14 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1129c expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.613326:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5a00/0x844e5faceb5ebf14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1129c expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.613338:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5a00/0x844e5faceb5ebf14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1129c expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.613354:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:2.0:1746155570.613356:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155570.613359:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942d5a00, rc 0) 00000100:00100000:2.0:1746155570.613393:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29234:x1830976123821952:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 149us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.613400:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10040 00000100:00100000:1.0:1746155570.616624:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.617268:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123822080 00000100:00100000:3.0:1746155570.617276:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123822080 00000100:00100000:3.0:1746155570.618296:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10041 00000100:00100000:3.0:1746155570.618305:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29234:x1830976123822080:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155570.618322:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.618337:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ebf1b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112a3 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.618398:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebf22 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.618408:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebf22 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.618416:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebf22 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155570.618435:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155570.618438:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155570.618449:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebf22 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.618467:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ebf1b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112a3 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.618495:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebf22 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112a3 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.618513:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155570.618516:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155570.618519:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090d06a00, rc 0) 00000100:00100000:3.0:1746155570.618568:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29234:x1830976123822080:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 265us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.618573:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10041 00000100:00100000:1.0:1746155570.628095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.628129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.628142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.628155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.628173:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123822336 00000100:00100000:0.0:1746155570.628181:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123822336 00000100:00100000:1.0:1746155570.628182:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.628215:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12213 00000100:00100000:0.0:1746155570.628223:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1961:x1830976123822336:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155570.628242:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155570.628248:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155570.628257:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c173e00/0x844e5faceb5ebf29 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112b1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155570.628265:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123822208 00000100:00100000:1.0:1746155570.628268:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123822208 00002000:00010000:0.0:1746155570.628278:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3da:0x0] initial LVB size: 2097152, mtime: 0x68143832, atime: 0x68143832, ctime: 0x68143832, blocks: 0x821 00000100:00100000:1.0:1746155570.628286:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123822464 00000100:00100000:1.0:1746155570.628287:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123822464 00000100:00100000:1.0:1746155570.628295:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123822720 00000100:00100000:1.0:1746155570.628297:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123822720 00010000:00010000:0.0:1746155570.628298:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.628299:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746155570.628304:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123822592 00000100:00100000:1.0:1746155570.628306:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123822592 00010000:00010000:0.0:1746155570.628307:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c173e00/0x844e5faceb5ebf29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b1 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155570.628313:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123822848 00000100:00100000:1.0:1746155570.628314:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123822848 00010000:00010000:0.0:1746155570.628320:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c173e00/0x844e5faceb5ebf29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b1 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155570.628323:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12214 00000100:00100000:1.0:1746155570.628327:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123822208:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155570.628329:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c173e00, rc 0) 00010000:00010000:1.0:1746155570.628338:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155570.628347:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ebf30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112aa expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155570.628361:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x6814382f, atime: 0x6814382f, ctime: 0x6814382f, blocks: 0x767 00010000:00010000:1.0:1746155570.628368:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155570.628368:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123822336:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 145us (280us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155570.628369:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155570.628373:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12213 00010000:00010000:1.0:1746155570.628374:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ebf30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112aa expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155570.628383:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ebf30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112aa expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155570.628387:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12215 00010000:00010000:1.0:1746155570.628389:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0fa00, rc 0) 00000100:00100000:0.0:1746155570.628391:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123822464:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155570.628396:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155570.628402:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c173000/0x844e5faceb5ebf37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112b8 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155570.628404:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123822208:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.628409:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12214 00002000:00010000:0.0:1746155570.628410:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3db:0x0] initial LVB size: 2097152, mtime: 0x68143832, atime: 0x68143832, ctime: 0x68143832, blocks: 0x81d 00000100:00100000:1.0:1746155570.628418:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12216 00010000:00010000:0.0:1746155570.628418:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.628419:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746155570.628422:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123822720:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155570.628423:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c173000/0x844e5faceb5ebf37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b8 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155570.628426:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155570.628431:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c173000/0x844e5faceb5ebf37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b8 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155570.628432:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5ebf3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112c6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.628437:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c173000, rc 0) 00002000:00010000:1.0:1746155570.628440:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d9:0x0] initial LVB size: 4954272, mtime: 0x68143832, atime: 0x68143832, ctime: 0x68143832, blocks: 0x1613 00010000:00010000:1.0:1746155570.628446:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.628447:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.628451:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5ebf3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112c6 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155570.628451:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123822464:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 60us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.628456:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12215 00010000:00010000:1.0:1746155570.628458:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5ebf3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112c6 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155570.628463:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0f800, rc 0) 00000100:00100000:0.0:1746155570.628466:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12217 00000100:00100000:0.0:1746155570.628470:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123822592:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155570.628474:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123822720:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 52us (318us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155570.628476:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155570.628478:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12216 00010000:00010000:0.0:1746155570.628482:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ebf45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112bf expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155570.628485:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12218 00000100:00100000:1.0:1746155570.628488:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123822848:12345-192.168.202.51@tcp:101:lfs.0 00002000:00010000:0.0:1746155570.628491:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x68143832, atime: 0x68143832, ctime: 0x68143832, blocks: 0x821 00010000:00010000:1.0:1746155570.628492:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155570.628497:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.628498:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5ebf4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112cd expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.628499:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.628520:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ebf45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112bf expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746155570.628524:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3dc:0x0] initial LVB size: 4194304, mtime: 0x6814382e, atime: 0x6814382e, ctime: 0x6814382e, blocks: 0x1029 00010000:00010000:0.0:1746155570.628529:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ebf45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112bf expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155570.628530:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.628531:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.628534:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5ebf4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112cd expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155570.628541:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5ebf4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112cd expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155570.628547:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0e200, rc 0) 00000100:00100000:1.0:1746155570.628570:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123822848:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 80us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.628575:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12218 00010000:00010000:0.0:1746155570.628624:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3f38c00, rc 0) 00000100:00100000:0.0:1746155570.628641:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123822592:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 170us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.628646:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12217 00000100:00100000:0.0:1746155570.639132:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.639181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.639210:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123823232 00000100:00100000:2.0:1746155570.639218:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123823232 00000100:00100000:2.0:1746155570.639267:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123823360 00000100:00100000:2.0:1746155570.639270:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123823360 00000100:00100000:2.0:1746155570.639298:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4705 00000100:00100000:2.0:1746155570.639305:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123823232:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:0.0:1746155570.639322:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4706 00000100:00100000:0.0:1746155570.639330:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123823360:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155570.639334:0:25391:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800942d5600/0x844e5faceb5ebf53 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.639347:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.639348:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.639348:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf5a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.639352:0:25391:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942d5600/0x844e5faceb5ebf53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.639355:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.639356:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.639359:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf5a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.639363:0:25391:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942d5600/0x844e5faceb5ebf53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.639367:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf5a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155570.644446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.644475:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.644526:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123823616 00000100:00100000:0.0:1746155570.644526:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123823872 00000100:00100000:3.0:1746155570.644533:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123823616 00000100:00100000:0.0:1746155570.644533:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123823872 00000100:00100000:0.0:1746155570.644589:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4707 00000100:00100000:3.0:1746155570.644598:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4708 00000100:00100000:0.0:1746155570.644600:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123823872:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:3.0:1746155570.644605:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123823616:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155570.644626:0:2798:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090d07600/0x844e5faceb5ebf61 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.644626:0:10888:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebf68 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.644637:0:2798:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.644637:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.644639:0:2798:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.644639:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.644643:0:2798:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090d07600/0x844e5faceb5ebf61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.644643:0:10888:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebf68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.644653:0:2798:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090d07600/0x844e5faceb5ebf61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.644653:0:10888:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebf68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155570.659112:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.659143:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.663903:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123824384 00000100:00100000:2.0:1746155570.663914:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123824384 00000100:00100000:2.0:1746155570.663976:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123824256 00000100:00100000:2.0:1746155570.663978:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123824256 00000100:00100000:3.0:1746155570.665041:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4709 00000100:00100000:3.0:1746155570.665050:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123824384:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155570.665080:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3800/0x844e5faceb5ebf6f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.665091:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.665093:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.665097:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3800/0x844e5faceb5ebf6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.665107:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3800/0x844e5faceb5ebf6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.665609:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4710 00000100:00100000:2.0:1746155570.665616:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123824256:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155570.665630:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cc1d200/0x844e5faceb5ebf76 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.665636:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.665638:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.665641:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cc1d200/0x844e5faceb5ebf76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.665649:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cc1d200/0x844e5faceb5ebf76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155570.667283:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.667329:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.667913:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123824640 00000100:00100000:0.0:1746155570.667920:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123824640 00000100:00100000:0.0:1746155570.667956:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123824768 00000100:00100000:0.0:1746155570.667958:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123824768 00000100:00100000:0.0:1746155570.667970:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4711 00000100:00100000:0.0:1746155570.667975:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123824640:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155570.668001:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5ebf7d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.668012:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.668014:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.668018:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5ebf7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.668028:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5ebf7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155570.669006:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4712 00000100:00100000:0.0:1746155570.669013:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123824768:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155570.669028:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a01efe00/0x844e5faceb5ebf84 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.669036:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.669037:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.669040:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01efe00/0x844e5faceb5ebf84 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.669047:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01efe00/0x844e5faceb5ebf84 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.670100:0:2798:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090d07600/0x844e5faceb5ebf61 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.670109:0:2798:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090d07600/0x844e5faceb5ebf61 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.670120:0:2798:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090d07600/0x844e5faceb5ebf61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.670126:0:2798:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090d07600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155570.670130:0:2798:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090d07600/0x844e5faceb5ebf61 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.670136:0:2798:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090d07600/0x844e5faceb5ebf61 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.670151:0:2798:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090d07600/0x844e5faceb5ebf61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.670156:0:2798:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090d07600/0x844e5faceb5ebf61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.670205:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123823616:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 25599us (25765us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155570.670213:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4708 00010000:00010000:3.0:1746155570.681131:0:25391:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800942d5600/0x844e5faceb5ebf53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.681145:0:25391:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800942d5600/0x844e5faceb5ebf53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.681152:0:25391:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800942d5600/0x844e5faceb5ebf53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.681162:0:25391:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942d5600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155570.681166:0:25391:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800942d5600/0x844e5faceb5ebf53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.681173:0:25391:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800942d5600/0x844e5faceb5ebf53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.681188:0:25391:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800942d5600/0x844e5faceb5ebf53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.681193:0:25391:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942d5600/0x844e5faceb5ebf53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.681255:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1960:x1830976123823232:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 41945us (42125us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155570.681264:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4705 00010000:00010000:2.0:1746155570.682159:0:31250:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf5a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.682167:0:31250:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.682173:0:31250:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.682177:0:31250:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3f39400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155570.682179:0:31250:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.682184:0:31250:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.682194:0:31250:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.682199:0:31250:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.682240:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123823360:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 42910us (43056us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155570.682247:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4706 00010000:00010000:2.0:1746155570.687149:0:10888:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebf68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.687163:0:10888:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebf68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.687169:0:10888:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebf68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.687175:0:10888:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6040400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155570.687178:0:10888:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebf68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.687185:0:10888:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebf68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.687199:0:10888:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebf68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.687203:0:10888:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebf68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.687272:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123823872:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 42673us (42793us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155570.687280:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4707 00010000:00010000:0.0:1746155570.690633:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cc1d200/0x844e5faceb5ebf76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.690646:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cc1d200/0x844e5faceb5ebf76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.690652:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cc1d200/0x844e5faceb5ebf76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.690658:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cc1d200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155570.690661:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cc1d200/0x844e5faceb5ebf76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.690668:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cc1d200/0x844e5faceb5ebf76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.690682:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cc1d200/0x844e5faceb5ebf76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.690693:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cc1d200/0x844e5faceb5ebf76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155570.690756:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123824256:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 25137us (31608us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155570.690764:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4710 00010000:00010000:0.0:1746155570.697858:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5ebf7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.697871:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5ebf7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.697877:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5ebf7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.697883:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c85400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155570.697886:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5ebf7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.697892:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5ebf7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.697906:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5ebf7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.697911:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5ebf7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155570.698945:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123824640:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 30964us (31660us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155570.698953:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4711 00010000:00010000:2.0:1746155570.701660:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3800/0x844e5faceb5ebf6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.701673:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3800/0x844e5faceb5ebf6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.701680:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3800/0x844e5faceb5ebf6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.701685:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c7b3800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155570.701688:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3800/0x844e5faceb5ebf6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.701694:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3800/0x844e5faceb5ebf6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.701707:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3800/0x844e5faceb5ebf6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.701711:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3800/0x844e5faceb5ebf6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.701783:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123824384:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 36731us (42674us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155570.701791:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4709 00010000:00010000:2.0:1746155570.703103:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a01efe00/0x844e5faceb5ebf84 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.703112:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01efe00/0x844e5faceb5ebf84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.703122:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a01efe00/0x844e5faceb5ebf84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.703127:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01efe00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155570.703130:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a01efe00/0x844e5faceb5ebf84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.703136:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a01efe00/0x844e5faceb5ebf84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.703147:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a01efe00/0x844e5faceb5ebf84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.703152:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01efe00/0x844e5faceb5ebf84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.703205:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123824768:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 34189us (35872us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155570.703212:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4712 00000100:00100000:0.0:1746155570.706645:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.706730:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123825152 00000100:00100000:3.0:1746155570.706737:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123825152 00000100:00100000:3.0:1746155570.706781:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10042 00000100:00100000:3.0:1746155570.706789:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29234:x1830976123825152:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:3.0:1746155570.706829:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155570.706847:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06a00/0x844e5faceb5ebf22 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112a3 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.706870:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155570.706873:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155570.706902:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3000/0x844e5faceb5ebf8b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.706912:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3000/0x844e5faceb5ebf8b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.706920:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3000/0x844e5faceb5ebf8b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00010000:3.0:1746155570.707043:0:15474:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801317c6d80 reply state ffff88009f0ad000 transno 8589943992 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3000/0x844e5faceb5ebf8b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155570.707049:0:15474:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746155570.707108:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29234:x1830976123825152:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 319us (467us total) trans 8589943992 rc 0/0 00000100:00100000:3.0:1746155570.707113:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10042 00010000:00010000:1.0:1746155570.708178:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3000/0x844e5faceb5ebf8b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.708186:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3000/0x844e5faceb5ebf8b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.708190:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3000/0x844e5faceb5ebf8b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.708195:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c7b3000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155570.708198:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3000/0x844e5faceb5ebf8b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.708203:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3000/0x844e5faceb5ebf8b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.708212:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:1.0:1746155570.708215:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155570.708217:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3000/0x844e5faceb5ebf8b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.708221:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b3000/0x844e5faceb5ebf8b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155570.708340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.708901:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123825280 00000100:00100000:3.0:1746155570.708906:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123825280 00000100:00100000:3.0:1746155570.708937:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12219 00000100:00100000:3.0:1746155570.708943:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29234:x1830976123825280:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155570.708953:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.708964:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112d4 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.708982:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ebf30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112aa expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.708989:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.708990:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.708993:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112d4 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.709027:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ebf30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112aa expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.709037:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ebf30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112aa expref: 10 pid: 8437 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.709047:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124606464:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.709122:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.714834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.714972:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123825408 00000100:00100000:2.0:1746155570.714985:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123825408 00010000:00010000:2.0:1746155570.715015:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ebf30 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112aa expref: 11 pid: 8437 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.715030:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124606464:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.715049:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112d4 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.715062:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3f39400, rc 0) 00000100:00100000:3.0:1746155570.715105:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29234:x1830976123825280:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 6162us (6765us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.715114:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12219 00000100:00100000:2.0:1746155570.715320:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6162 00000100:00100000:2.0:1746155570.715329:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123825408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.715347:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.715364:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ebf30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112aa expref: 10 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.715374:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ebf30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112aa expref: 10 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.715392:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ebf30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112aa expref: 10 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.715403:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.715404:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.715409:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112d4 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.715416:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112d4 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.715437:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112d4 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.715446:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124606592:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155570.715527:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155570.718580:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124606592:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155570.718597:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.718636:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123825408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3306us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.718648:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6162 00000100:00100000:0.0:1746155570.718659:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.720188:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123825536 00000100:00100000:3.0:1746155570.720195:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123825536 00000100:00100000:3.0:1746155570.720234:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12220 00000100:00100000:3.0:1746155570.720241:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29234:x1830976123825536:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155570.720255:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.720269:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112db expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.720290:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c173e00/0x844e5faceb5ebf29 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b1 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.720297:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.720299:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.720302:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112db expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.720325:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c173e00/0x844e5faceb5ebf29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b1 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.720335:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c173e00/0x844e5faceb5ebf29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b1 expref: 9 pid: 8438 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.720345:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124606720:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.720404:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.724834:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124606720:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.724859:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112db expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.724900:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db86600, rc 0) 00000100:00100000:3.0:1746155570.724935:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29234:x1830976123825536:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4694us (6275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.724943:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12220 00000100:00100000:0.0:1746155570.725027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.725096:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123825664 00000100:00100000:2.0:1746155570.725101:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123825664 00010000:00010000:2.0:1746155570.725121:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c173e00/0x844e5faceb5ebf29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b1 expref: 9 pid: 8438 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746155570.725139:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6163 00000100:00100000:2.0:1746155570.725144:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123825664:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.725153:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.725169:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c173e00/0x844e5faceb5ebf29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b1 expref: 9 pid: 8438 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.725179:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c173e00/0x844e5faceb5ebf29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b1 expref: 9 pid: 8438 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.725196:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c173e00/0x844e5faceb5ebf29 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b1 expref: 9 pid: 8438 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.725207:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.725209:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.725214:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112db expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.725221:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112db expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.725243:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112db expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.725397:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124606848:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155570.726026:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.730105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.730159:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123825792 00000100:00100000:3.0:1746155570.730166:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123825792 00000100:00100000:3.0:1746155570.730200:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12221 00000100:00100000:3.0:1746155570.730207:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29234:x1830976123825792:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155570.730223:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.730237:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112e2 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.730260:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c173000/0x844e5faceb5ebf37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b8 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.730267:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.730268:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.730271:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e2 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.730295:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c173000/0x844e5faceb5ebf37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b8 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.730305:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c173000/0x844e5faceb5ebf37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b8 expref: 10 pid: 8438 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.730314:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124606976:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.730533:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124606848:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155570.730546:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.731399:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123825664:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6252us (6371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.731408:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6163 00000100:00100000:3.0:1746155570.731480:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.733323:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124606976:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155570.733327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155570.733345:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e2 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.733359:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b3000, rc 0) 00000100:00100000:2.0:1746155570.733393:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123825920 00000100:00100000:2.0:1746155570.733398:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123825920 00010000:00010000:2.0:1746155570.733416:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c173000/0x844e5faceb5ebf37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b8 expref: 10 pid: 8438 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746155570.733434:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6164 00000100:00100000:2.0:1746155570.733439:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123825920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.733449:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.733467:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c173000/0x844e5faceb5ebf37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b8 expref: 10 pid: 8438 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.733475:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c173000/0x844e5faceb5ebf37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b8 expref: 10 pid: 8438 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.733492:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c173000/0x844e5faceb5ebf37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112b8 expref: 10 pid: 8438 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.733528:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.733530:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.733535:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e2 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.733542:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e2 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.733578:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e2 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.733588:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124607104:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155570.733880:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29234:x1830976123825792:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3672us (3780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.733887:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12221 00000100:00100000:2.0:1746155570.734009:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.738313:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.738335:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124607104:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155570.738350:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155570.739493:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123826048 00000100:00100000:3.0:1746155570.739500:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123826048 00000100:00100000:3.0:1746155570.739557:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12222 00000100:00100000:3.0:1746155570.739563:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29234:x1830976123826048:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155570.739580:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.739594:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112e9 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.739616:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ebf45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112bf expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.739623:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.739624:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.739627:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e9 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.739648:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ebf45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112bf expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.739657:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ebf45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112bf expref: 10 pid: 8438 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.739666:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124607232:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.740094:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123825920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6653us (6767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.740103:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6164 00000100:00100000:3.0:1746155570.741085:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.745346:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124607232:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.745374:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e9 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.745389:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b2c00, rc 0) 00000100:00100000:3.0:1746155570.745431:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29234:x1830976123826048:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5867us (7124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.745439:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12222 00000100:00100000:0.0:1746155570.745656:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.745800:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123826176 00000100:00100000:2.0:1746155570.745806:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123826176 00010000:00010000:2.0:1746155570.745827:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ebf45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112bf expref: 10 pid: 8438 timeout: 799 lvb_type: 1 00000100:00100000:2.0:1746155570.745846:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6165 00000100:00100000:2.0:1746155570.745851:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123826176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.745863:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.745880:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ebf45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112bf expref: 10 pid: 8438 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.745889:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ebf45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112bf expref: 10 pid: 8438 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.745906:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5ebf45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112bf expref: 10 pid: 8438 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.746676:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.746678:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.746684:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e9 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.746693:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e9 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.746718:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e9 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.746727:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124607360:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155570.747879:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.749437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.749619:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124607360:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155570.749633:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.749677:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123826176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3825us (4020us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.749686:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6165 00000100:00100000:3.0:1746155570.749768:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123826304 00000100:00100000:3.0:1746155570.749774:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123826304 00000100:00100000:3.0:1746155570.749798:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12223 00000100:00100000:3.0:1746155570.749804:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29234:x1830976123826304:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155570.749816:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.749829:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112f0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.749849:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5ebf3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112c6 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.749856:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.749857:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.749860:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f0 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.749880:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5ebf3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112c6 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.749890:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5ebf3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112c6 expref: 10 pid: 8437 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.749900:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124607488:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.749949:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.752088:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124607488:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.752108:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f0 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.752121:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b3800, rc 0) 00000100:00100000:0.0:1746155570.752308:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.752351:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123826432 00000100:00100000:2.0:1746155570.752356:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123826432 00010000:00010000:2.0:1746155570.752374:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5ebf3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112c6 expref: 11 pid: 8437 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.752387:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29234:x1830976123826304:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2581us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.752394:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12223 00000100:00100000:2.0:1746155570.752403:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6166 00000100:00100000:2.0:1746155570.752409:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123826432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.752421:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.752439:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5ebf3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112c6 expref: 10 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.752447:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5ebf3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112c6 expref: 10 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.752463:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5ebf3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112c6 expref: 10 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:2.0:1746155570.752474:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.752475:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.752480:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f0 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.752486:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f0 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.752526:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f0 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.752574:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124607616:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155570.752622:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.754906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.754969:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123826560 00000100:00100000:3.0:1746155570.754973:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123826560 00000100:00100000:3.0:1746155570.755001:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12224 00000100:00100000:3.0:1746155570.755007:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29234:x1830976123826560:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155570.755019:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.755033:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112f7 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.755054:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5ebf4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112cd expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.755060:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.755062:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.755066:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.755090:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5ebf4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112cd expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155570.755100:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5ebf4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112cd expref: 9 pid: 8437 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.755109:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124607744:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.755157:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155570.755656:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124607616:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155570.755667:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.755688:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123826432:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3280us (3381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.755695:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6166 00000100:00100000:3.0:1746155570.758339:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124607744:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.758361:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.758374:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5610a00, rc 0) 00000100:00100000:3.0:1746155570.758786:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29234:x1830976123826560:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3778us (3882us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.758793:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12224 00000100:00100000:0.0:1746155570.758862:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.759001:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123826688 00000100:00100000:3.0:1746155570.759005:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123826688 00010000:00010000:3.0:1746155570.759022:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5ebf4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112cd expref: 9 pid: 8437 timeout: 799 lvb_type: 1 00000100:00100000:3.0:1746155570.759043:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6167 00000100:00100000:3.0:1746155570.759049:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123826688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155570.759058:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155570.759076:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5ebf4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112cd expref: 9 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746155570.759085:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5ebf4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112cd expref: 9 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746155570.759101:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5ebf4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112cd expref: 9 pid: 8437 timeout: 799 lvb_type: 1 00010000:00010000:3.0:1746155570.759115:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.759117:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.759122:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 8 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.759221:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 8 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.759245:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 8 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.759255:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124607872:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155570.759308:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.761005:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.761438:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123826816 00000100:00100000:2.0:1746155570.761445:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123826816 00000100:00100000:2.0:1746155570.761484:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12225 00000100:00100000:2.0:1746155570.761490:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123826816:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:0.0:1746155570.761569:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.761585:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123827072 00000100:00100000:1.0:1746155570.761589:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123827072 00000100:00100000:1.0:1746155570.761687:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12226 00000100:00100000:1.0:1746155570.761692:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123827072:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:3.0:1746155570.761720:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124607872:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155570.761732:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155570.761758:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123826688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2709us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.761765:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6167 00002000:00010000:1.0:1746155570.761793:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155570.761796:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.761797:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.761799:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155570 -> 1746155571 00002000:00010000:1.0:1746155570.761801:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746155570.761819:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123827072:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 127us (406us total) trans 17179873216 rc 0/0 00000100:00100000:1.0:1746155570.761824:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12226 00002000:00010000:2.0:1746155570.761972:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155570.761975:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155567 -> 1746155570 00002000:00010000:2.0:1746155570.761977:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155567 -> 1746155570 00002000:00010000:2.0:1746155570.761979:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155567 -> 1746155571 00002000:00010000:2.0:1746155570.761980:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:2.0:1746155570.762273:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123826816:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 782us (1269us total) trans 21474840600 rc 0/0 00000100:00100000:2.0:1746155570.762279:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12225 00000100:00100000:0.0:1746155570.762572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.762596:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.762608:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.762627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.762668:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123827328 00000100:00100000:3.0:1746155570.762672:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123827328 00000100:00100000:2.0:1746155570.762679:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123826944 00000100:00100000:2.0:1746155570.762683:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123826944 00000100:00100000:3.0:1746155570.762687:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123827200 00000100:00100000:3.0:1746155570.762689:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123827200 00000100:00100000:1.0:1746155570.762690:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123827456 00000100:00100000:1.0:1746155570.762694:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123827456 00000100:00100000:2.0:1746155570.762698:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12227 00000100:00100000:3.0:1746155570.762711:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12228 00000100:00100000:3.0:1746155570.762716:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123826944:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:1.0:1746155570.762722:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12229 00000100:00100000:1.0:1746155570.762728:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123827200:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155570.762792:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155570.762792:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155570.762794:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:3.0:1746155570.762795:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.762796:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:3.0:1746155570.762797:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.762798:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155570 -> 1746155571 00002000:00010000:3.0:1746155570.762799:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155570 -> 1746155571 00002000:00010000:1.0:1746155570.762800:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746155570.762801:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155570.762822:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123826944:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 105us (225us total) trans 17179873217 rc 0/0 00000100:00100000:1.0:1746155570.762822:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123827200:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 93us (212us total) trans 21474840601 rc 0/0 00000100:00100000:1.0:1746155570.762827:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12229 00000100:00100000:3.0:1746155570.762830:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12228 00000100:00100000:1.0:1746155570.762837:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12230 00000100:00100000:1.0:1746155570.762842:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123827456:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155570.762899:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155570.762901:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155566 -> 1746155570 00002000:00010000:1.0:1746155570.762903:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155566 -> 1746155570 00002000:00010000:1.0:1746155570.762905:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155566 -> 1746155571 00002000:00010000:1.0:1746155570.762907:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746155570.762922:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123827456:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 80us (294us total) trans 17179873218 rc 0/0 00000100:00100000:1.0:1746155570.762927:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12230 00000100:00100000:2.0:1746155570.762963:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123827328:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:2.0:1746155570.763030:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:2.0:1746155570.763032:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:2.0:1746155570.763034:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:2.0:1746155570.763036:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155570 -> 1746155571 00002000:00010000:2.0:1746155570.763037:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:2.0:1746155570.763065:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123827328:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 360us (492us total) trans 21474840602 rc 0/0 00000100:00100000:2.0:1746155570.763071:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12227 00000100:00100000:0.0:1746155570.767435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.767536:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123827712 00000100:00100000:2.0:1746155570.767543:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123827712 00000100:00100000:2.0:1746155570.767585:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4059 00000100:00100000:2.0:1746155570.767592:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29234:x1830976123827712:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:2.0:1746155570.767636:0:16336:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x35b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ebed5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11295 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.767669:0:16336:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155570.767679:0:16336:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5a00/0x844e5faceb5ebf14 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1129c expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.767685:0:16336:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155570.767707:0:16336:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5a00/0x844e5faceb5ebf14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1129c expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.767717:0:16336:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5a00/0x844e5faceb5ebf14 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1129c expref: 9 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:2.0:1746155570.767729:0:16336:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16336:1830976124608000:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.767799:0:16336:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155570.769489:0:16336:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16336:1830976124608000:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155570.769531:0:16336:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:0.0:1746155570.769951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.770426:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123827840 00000100:00100000:3.0:1746155570.770432:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123827840 00010000:00010000:3.0:1746155570.770459:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5a00/0x844e5faceb5ebf14 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1129c expref: 10 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.770480:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6168 00000100:00100000:3.0:1746155570.770487:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123827840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155570.770496:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155570.770516:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5a00/0x844e5faceb5ebf14 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1129c expref: 10 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.770525:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5a00/0x844e5faceb5ebf14 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1129c expref: 10 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.770545:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942d5a00/0x844e5faceb5ebf14 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1129c expref: 10 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.770839:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155570.770843:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155570.770851:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155570.770856:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155570.770949:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155570.770989:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123827840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 502us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.770995:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6168 00010000:00010000:2.0:1746155570.771045:0:16336:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155570.771052:0:16336:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000040:00080000:2.0:1746155570.771910:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2908, 88 off243288 00000004:00080000:2.0:1746155570.771916:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699921412969ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.771953:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2850, 88 off237920 00000004:00080000:2.0:1746155570.771957:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699921453707ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.772621:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2851, 88 off238008 00000004:00080000:2.0:1746155570.772626:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699922123474ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.772636:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2909, 88 off243376 00000004:00080000:2.0:1746155570.772638:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699922135035ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.772659:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2910, 88 off243464 00000004:00080000:2.0:1746155570.772662:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699922159346ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.772669:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2852, 88 off238096 00000004:00080000:2.0:1746155570.772671:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699922168252ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.772678:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2853, 88 off238184 00000004:00080000:2.0:1746155570.772680:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699922176994ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.772686:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2854, 88 off238272 00000004:00080000:2.0:1746155570.772689:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699922186396ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.772696:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2911, 88 off243552 00000004:00080000:2.0:1746155570.772698:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699922195224ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.772704:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2855, 88 off238360 00000004:00080000:2.0:1746155570.772706:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699922203636ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.772712:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2912, 88 off243640 00000004:00080000:2.0:1746155570.772715:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699922211694ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.772721:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2856, 88 off238448 00000004:00080000:2.0:1746155570.772723:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699922219664ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155570.772728:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2913, 88 off243728 00000004:00080000:2.0:1746155570.772730:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699922227559ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.772736:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2914, 88 off243816 00000004:00080000:2.0:1746155570.772739:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699922236514ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.772746:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2915, 88 off243904 00000004:00080000:2.0:1746155570.772748:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699922245295ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.772754:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2916, 88 off243992 00000004:00080000:2.0:1746155570.772756:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 699922253556ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155570.772779:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2857, 88 off238536 00000004:00080000:2.0:1746155570.772783:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699922279819ns, next at 645866785986ns, rc = 0 00000001:00080000:1.0:1746155570.793116:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943993 is committed 00000004:00080000:1.0:1746155570.793122:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2049 committed 00000004:00080000:1.0:1746155570.793127:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2115 committed 00000004:00080000:1.0:1746155570.793131:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2114 committed 00000004:00080000:1.0:1746155570.793133:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2113 committed 00000004:00080000:1.0:1746155570.793134:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2112 committed 00000004:00080000:1.0:1746155570.793136:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2048 committed 00000004:00080000:1.0:1746155570.793137:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2111 committed 00000004:00080000:1.0:1746155570.793139:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2047 committed 00000004:00080000:1.0:1746155570.793140:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2110 committed 00000004:00080000:1.0:1746155570.793142:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2046 committed 00000004:00080000:1.0:1746155570.793143:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2045 committed 00000004:00080000:1.0:1746155570.793144:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2044 committed 00000004:00080000:1.0:1746155570.793146:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2109 committed 00000004:00080000:1.0:1746155570.793147:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2108 committed 00000004:00080000:1.0:1746155570.793148:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2043 committed 00000004:00080000:1.0:1746155570.793150:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2042 committed 00000004:00080000:1.0:1746155570.793151:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2107 committed 00000004:00010000:3.0:1746155570.793201:0:16336:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008ff19180 reply state ffff88009349b000 transno 8589943993 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:3.0:1746155570.793210:0:16336:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746155570.793217:0:16336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155570.793219:0:16336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155570.793226:0:16336:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ebed5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11295 expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746155570.793305:0:16336:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746155570.793314:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29234:x1830976123827712:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 25722us (25884us total) trans 8589943993 rc 0/0 00000100:00100000:3.0:1746155570.793321:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4059 00010000:00010000:3.0:1746155570.793343:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155570.793349:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155570.793354:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155570.793358:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cc1cc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155570.793360:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155570.793365:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155570.793374:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fff0800) 00010000:00010000:3.0:1746155570.793375:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155570.793377:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155570.793381:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ebfbc lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16336 initiator: MDT0 00000100:00100000:2.0:1746155570.793653:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124608128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155570.793685:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.793711:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124608640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155570.793726:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.793738:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124609152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.793751:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.793763:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124609664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.793764:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124608128 00000100:00100000:0.0:1746155570.793770:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124608128 00000100:00100000:2.0:1746155570.793777:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.793789:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746155570.793791:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124608640 00000100:00100000:0.0:1746155570.793792:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124608640 00000100:00100000:2.0:1746155570.793793:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124608256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.793801:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12231 00000100:00100000:2.0:1746155570.793805:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155570.793807:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3297:x1830976124608128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155570.793815:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124608768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155570.793827:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.793837:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124609280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.793854:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.793864:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124609792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.793874:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.793890:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124609152 00000100:00100000:2.0:1746155570.793892:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124609152 00000100:00100000:2.0:1746155570.793905:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124609664 00000100:00100000:2.0:1746155570.793907:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124609664 00000100:00100000:2.0:1746155570.793913:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124608256 00000100:00100000:2.0:1746155570.793915:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124608256 00000100:00100000:2.0:1746155570.793920:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124608768 00000100:00100000:2.0:1746155570.793921:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124608768 00000100:00100000:2.0:1746155570.793926:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124609280 00000100:00100000:2.0:1746155570.793927:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124609280 00000100:00100000:2.0:1746155570.793932:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124609792 00000100:00100000:2.0:1746155570.793933:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124609792 00000100:00100000:2.0:1746155570.793940:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12232 00000100:00100000:2.0:1746155570.793943:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3297:x1830976124608640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155570.794032:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155570.794035:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:0.0:1746155570.794037:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:0.0:1746155570.794039:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:0.0:1746155570.794040:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155570.794052:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124608384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.794067:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3297:x1830976124608128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 260us (381us total) trans 17179873219 rc 0/0 00000100:00100000:1.0:1746155570.794073:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155570.794073:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12231 00000100:00100000:1.0:1746155570.794082:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124608896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.794083:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124608384 00000100:00100000:0.0:1746155570.794086:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124608384 00000100:00100000:1.0:1746155570.794092:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155570.794094:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124608896 00000100:00100000:0.0:1746155570.794096:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124608896 00000100:00100000:1.0:1746155570.794098:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124609408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.794104:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12233 00000100:00100000:1.0:1746155570.794108:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155570.794108:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3297:x1830976124609152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.794113:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124609920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.794123:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.794129:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746155570.794132:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124608512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155570.794141:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.794147:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124609024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155570.794157:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.794162:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124609536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.794171:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.794176:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124610048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.794185:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746155570.794191:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155570.794194:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:0.0:1746155570.794195:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00000100:00100000:1.0:1746155570.794196:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124609408 00002000:00010000:0.0:1746155570.794197:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00000100:00100000:1.0:1746155570.794198:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124609408 00002000:00010000:0.0:1746155570.794198:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:1.0:1746155570.794207:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124609920 00000100:00100000:1.0:1746155570.794209:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124609920 00000100:00100000:1.0:1746155570.794214:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124608512 00000100:00100000:1.0:1746155570.794215:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124608512 00000100:00100000:0.0:1746155570.794216:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976124609152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (464us total) trans 21474840603 rc 0/0 00000100:00100000:1.0:1746155570.794220:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124609024 00000100:00100000:0.0:1746155570.794220:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12233 00000100:00100000:1.0:1746155570.794221:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124609024 00000100:00100000:1.0:1746155570.794226:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124609536 00000100:00100000:1.0:1746155570.794228:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124609536 00000100:00100000:0.0:1746155570.794228:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124610048 00000100:00100000:0.0:1746155570.794230:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124610048 00000100:00100000:1.0:1746155570.794235:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12234 00000100:00100000:1.0:1746155570.794239:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124609664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.794241:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12235 00000100:00100000:0.0:1746155570.794245:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976124608256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155570.794310:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155570.794313:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00000100:00100000:1.0:1746155570.794315:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976124609664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (536us total) trans 21474840604 rc 0/0 00002000:00010000:0.0:1746155570.794315:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:0.0:1746155570.794317:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:0.0:1746155570.794318:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746155570.794322:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12234 00000100:00100000:1.0:1746155570.794330:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12236 00000100:00100000:1.0:1746155570.794334:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124608768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.794336:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124608256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (530us total) trans 17179873220 rc 0/0 00000100:00100000:0.0:1746155570.794341:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12235 00000100:00100000:0.0:1746155570.794350:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12237 00000100:00100000:0.0:1746155570.794354:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124609280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.794397:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124608768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (568us total) trans 17179873221 rc 0/0 00000100:00100000:1.0:1746155570.794401:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12236 00000100:00100000:1.0:1746155570.794409:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12238 00000100:00100000:1.0:1746155570.794412:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976124609792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155570.794415:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155570.794417:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:0.0:1746155570.794419:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:0.0:1746155570.794420:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:0.0:1746155570.794422:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155570.794440:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976124609280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (584us total) trans 21474840605 rc 0/0 00000100:00100000:0.0:1746155570.794445:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12237 00000100:00100000:0.0:1746155570.794454:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12239 00000100:00100000:0.0:1746155570.794458:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976124608384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155570.794469:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976124609792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (593us total) trans 21474840606 rc 0/0 00000100:00100000:1.0:1746155570.794473:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12238 00000100:00100000:1.0:1746155570.794483:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12240 00000100:00100000:1.0:1746155570.794486:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976124608896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155570.794567:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155570.794570:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:0.0:1746155570.794571:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:0.0:1746155570.794573:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:0.0:1746155570.794575:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746155570.794592:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124608896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (499us total) trans 17179873223 rc 0/0 00000100:00100000:0.0:1746155570.794595:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124608384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (521us total) trans 17179873222 rc 0/0 00000100:00100000:1.0:1746155570.794597:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12240 00000100:00100000:0.0:1746155570.794600:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12239 00000100:00100000:1.0:1746155570.794607:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12241 00000100:00100000:0.0:1746155570.794611:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12242 00000100:00100000:1.0:1746155570.794612:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124609408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.794616:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124609920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.794640:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12243 00000100:00100000:0.0:1746155570.794644:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976124608512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155570.794684:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:1.0:1746155570.794687:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.794688:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.794690:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:1.0:1746155570.794691:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:1.0:1746155570.794708:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124609408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (599us total) trans 21474840607 rc 0/0 00000100:00100000:1.0:1746155570.794713:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12241 00000100:00100000:0.0:1746155570.794720:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124608512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (576us total) trans 17179873224 rc 0/0 00000100:00100000:1.0:1746155570.794722:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12244 00000100:00100000:0.0:1746155570.794725:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12243 00000100:00100000:1.0:1746155570.794727:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124609024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.794735:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12245 00000100:00100000:0.0:1746155570.794740:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124609536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.794795:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124609024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (637us total) trans 17179873225 rc 0/0 00000100:00100000:1.0:1746155570.794799:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12244 00002000:00010000:0.0:1746155570.794800:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:0.0:1746155570.794803:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155570.794805:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155570.794807:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00000100:00100000:1.0:1746155570.794808:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12246 00002000:00010000:0.0:1746155570.794809:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:1.0:1746155570.794812:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124610048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.794825:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124609536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (652us total) trans 21474840608 rc 0/0 00000100:00100000:0.0:1746155570.794830:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12245 00000004:00080000:0.0:1746155570.794855:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f703b80/2, rc 0, transno 17179873220 00000100:00100000:0.0:1746155570.794859:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124608256:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155570.794866:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a1500/2, rc 0, transno 17179873221 00000100:00100000:0.0:1746155570.794869:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124608768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155570.794875:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a2680/2, rc 0, transno 21474840605 00000100:00100000:1.0:1746155570.794880:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124610048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (693us total) trans 21474840609 rc 0/0 00000100:00100000:0.0:1746155570.794882:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124609280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.794885:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12246 00000004:00080000:0.0:1746155570.794888:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a3100/2, rc 0, transno 21474840606 00000100:00100000:0.0:1746155570.794890:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124609792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155570.794896:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a3800/2, rc 0, transno 21474840604 00000100:00100000:0.0:1746155570.794899:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124609664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155570.794904:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a0700/2, rc 0, transno 21474840603 00000100:00100000:0.0:1746155570.794906:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124609152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155570.794910:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f702a00/2, rc 0, transno 17179873224 00000100:00100000:1.0:1746155570.794913:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124608512:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155570.794913:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131497100/2, rc 0, transno 17179873219 00000100:00100000:0.0:1746155570.794916:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124608128:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155570.794919:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a0380/2, rc 0, transno 17179873225 00000100:00100000:1.0:1746155570.794922:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124609024:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155570.794928:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a3b80/2, rc 0, transno 21474840608 00000100:00100000:1.0:1746155570.794930:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124609536:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155570.794936:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a0e00/2, rc 0, transno 21474840609 00000100:00100000:1.0:1746155570.794938:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124610048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.794942:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124610176:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155570.794943:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f700e00/2, rc 0, transno 17179873222 00000100:00100000:1.0:1746155570.794945:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124608384:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155570.794951:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a1880/2, rc 0, transno 17179873223 00000100:00100000:1.0:1746155570.794952:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124608896:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155570.794958:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a1c00/2, rc 0, transno 21474840607 00000100:00100000:0.0:1746155570.794959:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.794960:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124609408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.794970:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124610176 00000100:00100000:1.0:1746155570.794973:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124610176 00000100:00100000:1.0:1746155570.794986:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12247 00000100:00100000:1.0:1746155570.794990:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976124610176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155570.795034:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976124609920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 418us (910us total) trans 21474840610 rc 0/0 00000100:00100000:0.0:1746155570.795040:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12242 00000004:00080000:0.0:1746155570.795056:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a1f80/2, rc 0, transno 21474840610 00000100:00100000:0.0:1746155570.795059:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124609920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.795070:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3297:x1830976124610176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (109us total) trans 21474840611 rc 0/0 00000004:00080000:0.0:1746155570.795071:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a2d80/2, rc 0, transno 21474840611 00000100:00100000:0.0:1746155570.795073:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124610176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.795076:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12247 00000100:00100000:2.0:1746155570.795225:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976124608640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1280us (1497us total) trans 17179873226 rc 0/0 00000100:00100000:2.0:1746155570.795230:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12232 00000004:00080000:0.0:1746155570.795311:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f701180/2, rc 0, transno 17179873226 00000100:00100000:0.0:1746155570.795314:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124608640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155570.796790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.796835:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123827968 00000100:00100000:3.0:1746155570.796840:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123827968 00000100:00100000:3.0:1746155570.796875:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10043 00000100:00100000:3.0:1746155570.796880:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:29234:x1830976123827968:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155570.796896:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.796909:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebfc3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f112fe expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.796949:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebfc3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112fe expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.796962:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebfc3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112fe expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.796974:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155570.796976:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155570.796979:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6040400, rc 0) 00000100:00100000:3.0:1746155570.797019:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29234:x1830976123827968:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 138us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.797024:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10043 00000100:00100000:0.0:1746155570.801893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.801945:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123828224 00000100:00100000:3.0:1746155570.801953:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123828224 00000100:00100000:3.0:1746155570.801996:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4060 00000100:00100000:3.0:1746155570.802003:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea56850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29234:x1830976123828224:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155570.802192:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea56850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29234:x1830976123828224:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 189us (306us total) trans 8589943994 rc 0/0 00000100:00100000:3.0:1746155570.802198:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4060 00000100:00100000:1.0:1746155570.823457:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124610304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746155570.823529:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.823656:0:8439:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124610304 00000100:00100000:2.0:1746155570.823663:0:8439:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124610304 00000100:00100000:2.0:1746155570.823695:0:8439:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1746155570.823702:0:8439:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3298:x1830976124610304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746155570.823720:0:8439:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 452919296 pending 5111808 free 3847225344 avail 3830448128 00000100:00100000:2.0:1746155570.823757:0:8439:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3298:x1830976124610304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.823762:0:8439:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1746155570.823832:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124610304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746155570.823994:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124610432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746155570.824021:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.824683:0:10389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124610432 00000100:00100000:1.0:1746155570.824687:0:10389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124610432 00000100:00100000:1.0:1746155570.824708:0:10389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1746155570.824713:0:10389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124610432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746155570.824724:0:10389:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 454492160 pending 3407872 free 3850371072 avail 3832545280 00000100:00100000:1.0:1746155570.824763:0:10389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124610432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.824769:0:10389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1746155570.824796:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124610432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746155570.829431:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.829577:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123828480 00000100:00100000:2.0:1746155570.829585:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123828480 00000100:00100000:2.0:1746155570.830171:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10044 00000100:00100000:2.0:1746155570.830180:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+285:29240:x1830976123828480:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155570.830199:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155570.830215:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c85400/0x844e5faceb5ebfca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11305 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.830497:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ebfd1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.830524:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ebfd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.830534:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ebfd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.830544:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ebfd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.830561:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ebfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.830567:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ebfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.830650:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ebfdf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.830657:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ebfdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.830662:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ebfdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155570.830668:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155570.830728:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ebfd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.830733:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ebfd1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.830738:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ebfd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.830742:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a285c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155570.830745:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ebfd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.830750:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ebfd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.831968:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155570.831970:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155570.831974:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ebfd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.831979:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ebfd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.832004:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ebfd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.832009:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ebfd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.832013:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ebfd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.832017:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53e1200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155570.832019:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ebfd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.832023:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ebfd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.832030:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9200) 00010000:00010000:2.0:1746155570.832032:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155570.832034:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ebfd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.832038:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ebfd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.832077:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c85400/0x844e5faceb5ebfca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11305 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.832088:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ebfdf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11305 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.832094:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155570.832096:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155570.832099:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53e1a00, rc 0) 00000100:00100000:2.0:1746155570.832157:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29240:x1830976123828480:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1977us (2733us total) trans 8589943995 rc 0/0 00000100:00100000:2.0:1746155570.832163:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10044 00000100:00100000:0.0:1746155570.833583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.833650:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123828736 00000100:00100000:2.0:1746155570.833656:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123828736 00000100:00100000:2.0:1746155570.833697:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10045 00000100:00100000:2.0:1746155570.833703:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+6:29246:x1830976123828736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155570.833718:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155570.833730:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ebfed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1130c expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.833801:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebff4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.833810:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebff4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.833818:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebff4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.833827:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ebffb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.833831:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ebffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.833835:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ebffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.833907:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec002 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.833915:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec002 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.833921:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec002 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155570.833927:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155570.833985:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebff4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.833990:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebff4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.833995:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebff4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.833998:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3a800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155570.834001:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebff4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.834005:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebff4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.834012:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155570.834014:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155570.834017:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.834021:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ebff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.834028:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ebffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.834035:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ebffb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.834040:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ebffb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.834043:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3a600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155570.834045:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ebffb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.834049:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ebffb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.834053:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9f00) 00010000:00010000:2.0:1746155570.834055:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155570.834057:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ebffb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.834061:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ebffb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155570.834083:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ebfed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1130c expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.834093:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec002 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1130c expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.834098:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155570.834099:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155570.834101:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3a400, rc 0) 00000100:00100000:2.0:1746155570.834127:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29246:x1830976123828736:12345-192.168.202.51@tcp:101:cat.0 Request processed in 424us (546us total) trans 8589943996 rc 0/0 00000100:00100000:2.0:1746155570.834132:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10045 00000100:00100000:0.0:1746155570.835993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.836029:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.836031:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123828992 00000100:00100000:3.0:1746155570.836036:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123828992 00000100:00100000:3.0:1746155570.836062:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10046 00000100:00100000:3.0:1746155570.836068:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29244:x1830976123828992:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155570.836081:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.836092:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c85400/0x844e5faceb5ec010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11313 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.836141:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ec017 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155570.836150:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ec017 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155570.836157:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ec017 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155570.836165:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155570.836225:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c85400/0x844e5faceb5ec010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11313 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.836251:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ec017 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11313 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.836258:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155570.836261:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746155570.836263:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a285c00, rc 0) 00000100:00100000:3.0:1746155570.836287:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29244:x1830976123828992:12345-192.168.202.51@tcp:101:cat.0 Request processed in 219us (298us total) trans 8589943997 rc 0/0 00000100:00100000:3.0:1746155570.836292:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10046 00000100:00100000:3.0:1746155570.836310:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123829120 00000100:00100000:3.0:1746155570.836312:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123829120 00000100:00100000:3.0:1746155570.836328:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12248 00000100:00100000:3.0:1746155570.836333:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+7:29246:x1830976123829120:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155570.836339:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.836348:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1131a expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.836363:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112d4 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.836371:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.836373:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.836376:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1131a expref: 8 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.836396:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112d4 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.836406:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112d4 expref: 11 pid: 10591 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.836417:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124610560:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.837261:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.839635:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124610560:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.839657:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1131a expref: 8 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.839671:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cc1cc00, rc 0) 00000100:00100000:3.0:1746155570.839712:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29246:x1830976123829120:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3378us (3681us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.839719:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12248 00000100:00100000:2.0:1746155570.840795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.840795:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.840864:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.840923:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123829504 00000100:00100000:3.0:1746155570.840928:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123829504 00000100:00100000:3.0:1746155570.840953:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12249 00000100:00100000:3.0:1746155570.840958:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:29244:x1830976123829504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155570.840972:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.840984:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11328 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.841002:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.841006:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11328 expref: 15 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155570.841010:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123829632 00010000:00010000:3.0:1746155570.841013:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11328 expref: 15 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155570.841013:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123829632 00010000:00010000:3.0:1746155570.841021:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e82ce00, rc 0) 00010000:00010000:0.0:1746155570.841031:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112d4 expref: 12 pid: 10591 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746155570.841050:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6169 00000100:00100000:3.0:1746155570.841055:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:29244:x1830976123829504:12345-192.168.202.51@tcp:101:cat.0 Request processed in 96us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.841055:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123829632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155570.841060:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12249 00010000:00010000:0.0:1746155570.841062:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155570.841075:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123829376 00000100:00100000:3.0:1746155570.841078:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123829376 00000100:00100000:3.0:1746155570.841094:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10047 00000100:00100000:3.0:1746155570.841098:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29243:x1830976123829376:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155570.841109:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.841117:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11321 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.841156:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112d4 expref: 12 pid: 10591 timeout: 799 lvb_type: 0 00010000:00010000:3.0:1746155570.841182:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.841313:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112d4 expref: 12 pid: 10591 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.841330:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5ebf92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112d4 expref: 12 pid: 10591 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.841342:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.841343:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.841348:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1131a expref: 7 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.841355:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1131a expref: 7 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.841362:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.841363:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.841366:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11328 expref: 14 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.841372:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11328 expref: 14 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.841394:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11328 expref: 14 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155570.841403:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124610688:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155570.841464:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1131a expref: 7 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155570.841472:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124610816:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155570.841488:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b300 going to sleep for 11 seconds 00010000:00010000:3.0:1746155570.841748:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ebfdf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11305 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.841760:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec002 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1130c expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.841766:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155570.841785:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec002 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1130c expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.841794:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec002 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1130c expref: 9 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.841802:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124610944:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.843042:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ebfdf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11305 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.843052:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ebfdf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11305 expref: 288 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.843060:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124611072:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.843125:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155570.843199:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124610688:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155570.843208:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124610816:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155570.843222:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.843239:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123829632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2183us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.843247:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6169 00000100:00100000:3.0:1746155570.844652:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124610944:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.844858:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124611072:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.844875:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155570.845958:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.845987:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.846844:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123829760 00000100:00100000:1.0:1746155570.846851:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123829760 00000100:00100000:0.0:1746155570.846867:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155570.846878:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec002 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1130c expref: 10 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:1.0:1746155570.846897:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123829888 00000100:00100000:1.0:1746155570.846899:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123829888 00010000:00010000:1.0:1746155570.846908:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ebfdf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11305 expref: 289 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746155570.846912:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6170 00000100:00100000:0.0:1746155570.846921:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123829760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155570.846933:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155570.847040:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123830144 00000100:00100000:3.0:1746155570.847043:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123830144 00002000:00100000:3.0:1746155570.847064:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012f1f2d80 x1830976123830144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.847071:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2d80 with x1830976123830144 ext(0->1048575) 00002000:00010000:3.0:1746155570.847075:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f2d80 00000100:00100000:1.0:1746155570.847260:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6171 00000100:00100000:1.0:1746155570.847307:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1961:x1830976123829888:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.847313:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.847317:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ebfdf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11305 expref: 289 pid: 27374 timeout: 799 lvb_type: 0 00000100:00100000:3.0:1746155570.847332:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4713 00000100:00100000:3.0:1746155570.847338:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976123830144:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:0.0:1746155570.847523:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec002 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1130c expref: 10 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.847752:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ebfdf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11305 expref: 289 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.847794:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec002 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1130c expref: 10 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:1.0:1746155570.847821:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ebfdf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11305 expref: 289 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.848317:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec002 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1130c expref: 10 pid: 27374 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746155570.848328:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155570.848332:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.848342:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.848348:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155570.848368:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155570.848586:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123829760:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1666us (2630us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.848593:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6170 00010000:00010000:3.0:1746155570.849689:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155570.849693:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155570.849698:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155570.849718:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155570.850191:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155570.850195:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.850249:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1961:x1830976123829888:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2943us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.850257:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123830400 00000100:00100000:1.0:1746155570.850259:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6171 00000100:00100000:2.0:1746155570.850264:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123830400 00002000:00100000:2.0:1746155570.850288:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012f1f0e00 x1830976123830400/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.850296:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0e00 with x1830976123830400 ext(0->1048575) 00002000:00010000:2.0:1746155570.850300:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f0e00 00000100:00100000:2.0:1746155570.850327:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4714 00000100:00100000:2.0:1746155570.850333:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1960:x1830976123830400:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:3.0:1746155570.851158:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11321 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.851176:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11321 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.851183:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155570.851185:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155570.851187:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b025e00, rc 0) 00000100:00100000:3.0:1746155570.851211:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29243:x1830976123829376:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 10112us (10417us total) trans 8589943998 rc 0/0 00000100:00100000:3.0:1746155570.851217:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10047 00000100:00100000:3.0:1746155570.859828:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976123830144:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12481us (12953us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155570.859837:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4713 00002000:00100000:3.0:1746155570.859846:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012f1f2d80 x1830976123830144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.859854:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2d80 with x1830976123830144 ext(0->1048575) 00002000:00010000:3.0:1746155570.859859:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f2d80 00000100:00100000:2.0:1746155570.865779:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1960:x1830976123830400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15439us (16081us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155570.865788:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4714 00002000:00100000:2.0:1746155570.865797:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012f1f0e00 x1830976123830400/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.865804:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0e00 with x1830976123830400 ext(0->1048575) 00002000:00010000:2.0:1746155570.865809:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f0e00 00000100:00100000:0.0:1746155570.874905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.875001:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123830528 00000100:00100000:2.0:1746155570.875009:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123830528 00000100:00100000:2.0:1746155570.875057:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12250 00000100:00100000:2.0:1746155570.875063:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:29244:x1830976123830528:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155570.875079:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155570.875092:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1132f expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.875116:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112db expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.875122:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155570.875123:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155570.875126:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1132f expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.875152:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112db expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.875162:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112db expref: 10 pid: 10591 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155570.875172:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124611200:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.875245:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.876787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.877349:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123830656 00000100:00100000:1.0:1746155570.877354:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123830656 00010000:00010000:1.0:1746155570.877378:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112db expref: 11 pid: 10591 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155570.877397:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6172 00000100:00100000:1.0:1746155570.877403:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123830656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.877412:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.877428:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112db expref: 11 pid: 10591 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155570.877437:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112db expref: 11 pid: 10591 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155570.877454:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.877456:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.877461:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1132f expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.877468:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1132f expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.877489:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1132f expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155570.877497:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124611328:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155570.877650:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77000 going to sleep for 11 seconds 00010000:00010000:2.0:1746155570.878052:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db86600/0x844e5faceb5ebf99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112db expref: 11 pid: 10591 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746155570.880971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.881153:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124611200:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155570.881177:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1132f expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.881188:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b600, rc 0) 00000100:00100000:2.0:1746155570.881226:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:29244:x1830976123830528:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6162us (6327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.881233:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12250 00000100:00100000:2.0:1746155570.881252:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123830784 00000100:00100000:2.0:1746155570.881257:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123830784 00000100:00100000:2.0:1746155570.881279:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12251 00000100:00100000:2.0:1746155570.881285:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29246:x1830976123830784:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155570.881297:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155570.881308:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b200/0x844e5faceb5ec04f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11336 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.881322:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.881323:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.881329:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b200/0x844e5faceb5ec04f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11336 expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.881339:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b200/0x844e5faceb5ec04f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11336 expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.881344:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b200, rc 0) 00000100:00100000:2.0:1746155570.881358:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29246:x1830976123830784:12345-192.168.202.51@tcp:101:cat.0 Request processed in 73us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.881362:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12251 00000100:00100000:1.0:1746155570.881637:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124611328:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155570.881649:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.881668:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123830656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4265us (4885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.881675:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6172 00000100:00100000:3.0:1746155570.888194:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.888260:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123830912 00000100:00100000:0.0:1746155570.888267:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123830912 00000100:00100000:0.0:1746155570.888305:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10048 00000100:00100000:0.0:1746155570.888313:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29243:x1830976123830912:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155570.888335:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155570.888352:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb400/0x844e5faceb5ec056 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1133d expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.888402:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb400/0x844e5faceb5ec056 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1133d expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.888414:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb400/0x844e5faceb5ec056 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1133d expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.888428:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155570.888431:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155570.888434:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeb400, rc 0) 00000100:00100000:0.0:1746155570.888480:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29243:x1830976123830912:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 168us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.888486:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10048 00000100:00100000:0.0:1746155570.888839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.889157:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123831168 00000100:00100000:2.0:1746155570.889162:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123831168 00002000:00100000:2.0:1746155570.889188:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800910c8700 x1830976123831168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.889196:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8700 with x1830976123831168 ext(1048576->2097151) 00002000:00010000:2.0:1746155570.889200:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910c8700 00000100:00100000:2.0:1746155570.889223:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4715 00000100:00100000:2.0:1746155570.889229:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976123831168:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155570.894748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.895995:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123831424 00000100:00100000:3.0:1746155570.896003:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123831424 00000100:00100000:3.0:1746155570.896046:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10049 00000100:00100000:3.0:1746155570.896053:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29243:x1830976123831424:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155570.896070:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.896073:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746155570.896094:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb400/0x844e5faceb5ec056 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1133d expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.896120:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155570.896124:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155570.896133:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094219800/0x844e5faceb5ec05d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11344 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.896171:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.896180:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebfc3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112fe expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.896190:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ec017 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11313 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.896195:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155570.896221:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ec017 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11313 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.896231:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ec017 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11313 expref: 287 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155570.896241:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124611456:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.896308:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebfc3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112fe expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.896315:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebfc3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112fe expref: 7 pid: 15474 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155570.896322:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124611584:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.896337:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155570.897614:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976123831168:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8381us (8771us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155570.897623:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4715 00002000:00100000:2.0:1746155570.897630:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800910c8700 x1830976123831168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.897637:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8700 with x1830976123831168 ext(1048576->2097151) 00002000:00010000:2.0:1746155570.897641:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910c8700 00000100:00100000:0.0:1746155570.899215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.899790:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123831552 00000100:00100000:1.0:1746155570.899795:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123831552 00000100:00100000:3.0:1746155570.899916:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124611456:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.899925:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124611584:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.899943:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155570.900412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.900437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.900448:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123831808 00000100:00100000:0.0:1746155570.900451:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123831808 00010000:00010000:0.0:1746155570.900467:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebfc3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112fe expref: 8 pid: 15474 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746155570.900483:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123831680 00000100:00100000:0.0:1746155570.900485:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123831680 00010000:00010000:0.0:1746155570.900493:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ec017 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11313 expref: 288 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155570.900536:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10050 00000100:00100000:1.0:1746155570.900544:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29246:x1830976123831552:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155570.900566:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155570.900577:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1134b expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.900615:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.900622:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.900634:0:27374:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.900644:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.900653:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155570.900656:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155570.900658:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.900663:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fed8600, rc 0) 00000100:00100000:1.0:1746155570.900693:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29246:x1830976123831552:12345-192.168.202.51@tcp:101:cat.0 Request processed in 150us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.900698:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10050 00000100:00100000:0.0:1746155570.901593:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6173 00000100:00100000:0.0:1746155570.901599:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123831808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155570.901608:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155570.901613:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebfc3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112fe expref: 8 pid: 15474 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746155570.901620:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebfc3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112fe expref: 8 pid: 15474 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746155570.901634:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5ebfc3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112fe expref: 8 pid: 15474 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746155570.901649:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155570.901651:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.901656:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.901661:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155570.901679:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976123831808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.901684:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6173 00000100:00100000:0.0:1746155570.901695:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6174 00000100:00100000:0.0:1746155570.901699:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1961:x1830976123831680:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155570.901707:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155570.901710:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ec017 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11313 expref: 288 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746155570.901718:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ec017 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11313 expref: 288 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746155570.901727:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a285c00/0x844e5faceb5ec017 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11313 expref: 288 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746155570.901733:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155570.901736:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.901742:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.901747:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155570.901753:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.901765:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155570.901777:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1961:x1830976123831680:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.901782:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6174 00010000:00010000:1.0:1746155570.902086:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155570.902092:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155570.902719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000004:02000000:1.0:1746155570.903250:0:15474:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000100:00100000:3.0:1746155570.904061:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123831936 00000100:00100000:3.0:1746155570.904068:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123831936 00000100:00100000:3.0:1746155570.904110:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12252 00000100:00100000:3.0:1746155570.904117:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:29244:x1830976123831936:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155570.904129:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.904141:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11352 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.904162:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e2 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.904168:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.904169:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155570.904172:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11352 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.904193:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e2 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.904203:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e2 expref: 9 pid: 10591 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155570.904213:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124611712:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155570.904278:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.911317:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.911343:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123832064 00000100:00100000:0.0:1746155570.911350:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123832064 00010000:00010000:0.0:1746155570.911385:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e2 expref: 10 pid: 10591 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155570.911895:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124611712:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155570.911916:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11352 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.911931:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094219e00, rc 0) 00000100:00100000:3.0:1746155570.911983:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:29244:x1830976123831936:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7865us (9265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.911991:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12252 00000100:00100000:0.0:1746155570.913535:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6175 00000100:00100000:0.0:1746155570.913554:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123832064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155570.913567:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155570.913587:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e2 expref: 10 pid: 10591 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746155570.913598:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e2 expref: 10 pid: 10591 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746155570.913616:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5ebfa0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e2 expref: 10 pid: 10591 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746155570.913627:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.913629:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155570.913634:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11352 expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.913640:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11352 expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.913665:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11352 expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155570.913674:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124611840:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155570.913730:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b000 going to sleep for 11 seconds 00000040:00080000:1.0:1746155570.913913:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2917, 88 off244080 00000004:00080000:1.0:1746155570.913921:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 700063417393ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155570.913989:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2858, 88 off238624 00000004:00080000:1.0:1746155570.913993:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 700063489773ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155570.914032:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2859, 88 off238712 00000004:00080000:1.0:1746155570.914035:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 700063532298ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155570.914048:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2918, 88 off244168 00000004:00080000:1.0:1746155570.914050:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 700063547344ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155570.914060:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2919, 88 off244256 00000004:00080000:1.0:1746155570.914062:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 700063559298ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155570.914072:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2860, 88 off238800 00000004:00080000:1.0:1746155570.914074:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 700063571536ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155570.914083:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2861, 88 off238888 00000004:00080000:1.0:1746155570.914086:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 700063582774ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155570.914094:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2862, 88 off238976 00000004:00080000:1.0:1746155570.914096:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 700063593603ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155570.914106:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2920, 88 off244344 00000004:00080000:1.0:1746155570.914109:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 700063605668ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155570.914117:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2863, 88 off239064 00000004:00080000:1.0:1746155570.914120:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 700063616815ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155570.914129:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2921, 88 off244432 00000004:00080000:1.0:1746155570.914132:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 700063628598ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155570.914140:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2864, 88 off239152 00000004:00080000:1.0:1746155570.914143:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 700063639888ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155570.914151:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2922, 88 off244520 00000004:00080000:1.0:1746155570.914154:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 700063650865ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155570.914162:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2923, 88 off244608 00000004:00080000:1.0:1746155570.914164:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 700063661560ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155570.914173:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2924, 88 off244696 00000004:00080000:1.0:1746155570.914175:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 700063672413ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155570.914184:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2925, 88 off244784 00000004:00080000:1.0:1746155570.914186:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 700063683290ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155570.914196:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2865, 88 off239240 00000004:00080000:1.0:1746155570.914198:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 700063695103ns, next at 645866785986ns, rc = 0 00000100:00100000:1.0:1746155570.917949:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124611840:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155570.917961:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155570.917968:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.917981:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123832192 00000100:00100000:2.0:1746155570.917986:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123832192 00000100:00100000:1.0:1746155570.918005:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123832064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4461us (6694us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.918014:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6175 00000100:00100000:2.0:1746155570.918019:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10051 00000100:00100000:2.0:1746155570.918025:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29244:x1830976123832192:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155570.918042:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155570.918055:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11359 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.918107:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 288 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.918117:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 288 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.918130:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155570.918133:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155570.918136:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.918141:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3ac00, rc 0) 00000100:00100000:2.0:1746155570.918174:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29244:x1830976123832192:12345-192.168.202.51@tcp:101:cat.0 Request processed in 149us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.918180:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10051 00010000:00010000:2.0:1746155570.943133:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11344 expref: 13 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.943147:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155570.943150:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746155570.943154:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.943163:0:15474:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.943168:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.943175:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 287 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.943180:0:15474:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 287 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.943186:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 287 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.943215:0:15474:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 287 pid: 19870 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.943226:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124611968:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155570.943298:0:15474:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.943305:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124612096:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155570.943322:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94180 going to sleep for 11 seconds 00000001:00080000:1.0:1746155570.943568:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943999 is committed 00000004:00080000:1.0:1746155570.943574:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2057 committed 00000004:00080000:1.0:1746155570.943580:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2124 committed 00000004:00080000:1.0:1746155570.943584:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2123 committed 00000004:00080000:1.0:1746155570.943586:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2122 committed 00000004:00080000:1.0:1746155570.943588:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2121 committed 00000004:00080000:1.0:1746155570.943589:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2056 committed 00000004:00080000:1.0:1746155570.943590:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2120 committed 00000004:00080000:1.0:1746155570.943592:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2055 committed 00000004:00080000:1.0:1746155570.943593:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2119 committed 00000004:00080000:1.0:1746155570.943594:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2054 committed 00000004:00080000:1.0:1746155570.943595:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2053 committed 00000004:00080000:1.0:1746155570.943597:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2052 committed 00000004:00080000:1.0:1746155570.943598:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2118 committed 00000004:00080000:1.0:1746155570.943600:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2117 committed 00000004:00080000:1.0:1746155570.943602:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2051 committed 00000004:00080000:1.0:1746155570.943604:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2050 committed 00000004:00080000:1.0:1746155570.943605:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2116 committed 00000001:00080000:1.0:1746155570.943613:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943995 is committed 00000001:00080000:1.0:1746155570.943619:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943997 is committed 00000001:00080000:1.0:1746155570.943622:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943994 is committed 00000100:00100000:1.0:1746155570.943797:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124612480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155570.943830:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.943846:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124612992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155570.943860:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.943869:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124613504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.943884:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.943895:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124614016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.943906:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.943918:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746155570.943922:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124612352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155570.943934:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.943943:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124612864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155570.943954:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.943961:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124613376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.943971:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.943980:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124613888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.943990:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155570.944006:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124612480 00000100:00100000:1.0:1746155570.944011:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124612480 00000100:00100000:1.0:1746155570.944037:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124612992 00000100:00100000:1.0:1746155570.944039:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124612992 00000100:00100000:1.0:1746155570.944047:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124613504 00000100:00100000:1.0:1746155570.944049:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124613504 00000100:00100000:1.0:1746155570.944057:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124614016 00000100:00100000:1.0:1746155570.944058:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124614016 00000100:00100000:1.0:1746155570.944066:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124612352 00000100:00100000:1.0:1746155570.944068:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124612352 00000100:00100000:1.0:1746155570.944073:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124612864 00000100:00100000:1.0:1746155570.944074:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124612864 00000100:00100000:1.0:1746155570.944081:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124613376 00000100:00100000:1.0:1746155570.944083:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124613376 00000100:00100000:1.0:1746155570.944088:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124613888 00000100:00100000:1.0:1746155570.944089:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124613888 00000100:00100000:1.0:1746155570.944097:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12253 00000100:00100000:1.0:1746155570.944102:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3298:x1830976124612480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155570.944239:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155570.944242:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.944244:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.944245:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:1.0:1746155570.944247:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746155570.944274:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3298:x1830976124612480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (443us total) trans 17179873227 rc 0/0 00000100:00100000:1.0:1746155570.944280:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12253 00000100:00100000:1.0:1746155570.944293:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12254 00000100:00100000:1.0:1746155570.944297:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3298:x1830976124612992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155570.944369:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3298:x1830976124612992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (508us total) trans 17179873228 rc 0/0 00000100:00100000:1.0:1746155570.944374:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12254 00000100:00100000:1.0:1746155570.944382:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12255 00000100:00100000:1.0:1746155570.944386:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3298:x1830976124613504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155570.944468:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:1.0:1746155570.944470:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.944472:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.944473:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:1.0:1746155570.944475:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:1.0:1746155570.944492:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3298:x1830976124613504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (606us total) trans 21474840612 rc 0/0 00000100:00100000:1.0:1746155570.944497:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12255 00000100:00100000:1.0:1746155570.944618:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12256 00000100:00100000:1.0:1746155570.944623:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3298:x1830976124614016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.944700:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3298:x1830976124614016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (792us total) trans 21474840613 rc 0/0 00000100:00100000:1.0:1746155570.944705:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12256 00000100:00100000:1.0:1746155570.944713:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12257 00000100:00100000:1.0:1746155570.944718:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3298:x1830976124612352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155570.944778:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155570.944781:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.944782:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.944784:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:1.0:1746155570.944785:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746155570.944802:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3298:x1830976124612352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (866us total) trans 17179873229 rc 0/0 00000100:00100000:1.0:1746155570.944806:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12257 00000100:00100000:1.0:1746155570.944815:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12258 00000100:00100000:1.0:1746155570.944818:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3298:x1830976124612864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155570.944886:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3298:x1830976124612864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (930us total) trans 17179873230 rc 0/0 00000100:00100000:1.0:1746155570.944891:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12258 00000100:00100000:1.0:1746155570.944901:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12259 00000100:00100000:1.0:1746155570.944905:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3298:x1830976124613376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155570.944967:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155570.944969:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.944971:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:1.0:1746155570.944973:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:1.0:1746155570.944974:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155570.944991:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3298:x1830976124613376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1018us total) trans 21474840614 rc 0/0 00000100:00100000:1.0:1746155570.944996:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12259 00000100:00100000:1.0:1746155570.945005:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12260 00000100:00100000:1.0:1746155570.945010:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3298:x1830976124613888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155570.945078:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3298:x1830976124613888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (1086us total) trans 21474840615 rc 0/0 00000100:00100000:1.0:1746155570.945083:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12260 00000004:00080000:1.0:1746155570.945123:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca94000/2, rc 0, transno 17179873229 00000100:00100000:1.0:1746155570.945127:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124612352:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155570.945134:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6062680/2, rc 0, transno 17179873230 00000100:00100000:1.0:1746155570.945137:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124612864:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155570.945143:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6061c00/2, rc 0, transno 21474840614 00000100:00100000:1.0:1746155570.945149:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124613376:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155570.945155:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc5f80/2, rc 0, transno 21474840615 00000100:00100000:1.0:1746155570.945157:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124613888:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155570.945162:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca97480/2, rc 0, transno 17179873227 00000100:00100000:1.0:1746155570.945165:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124612480:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155570.945170:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6062a00/2, rc 0, transno 17179873228 00000100:00100000:1.0:1746155570.945172:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124612992:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155570.945177:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6060e00/2, rc 0, transno 21474840612 00000100:00100000:1.0:1746155570.945179:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124613504:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155570.945184:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc4a80/2, rc 0, transno 21474840613 00000100:00100000:1.0:1746155570.945187:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124614016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.945260:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124612224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155570.945279:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.945291:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124612736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155570.945301:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.945308:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124613248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.945318:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.945325:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124613760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.945334:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.945342:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124614272:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.945352:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.945362:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1746155570.945366:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124612608:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155570.945379:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.945388:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124613120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155570.945399:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.945404:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124613632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.945414:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.945420:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124614144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.945430:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155570.945444:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124612224 00000100:00100000:2.0:1746155570.945447:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124612224 00000100:00100000:2.0:1746155570.945459:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124612736 00000100:00100000:2.0:1746155570.945460:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124612736 00000100:00100000:2.0:1746155570.945466:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124613248 00000100:00100000:2.0:1746155570.945468:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124613248 00000100:00100000:2.0:1746155570.945473:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124613760 00000100:00100000:2.0:1746155570.945474:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124613760 00000100:00100000:2.0:1746155570.945479:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124614272 00000100:00100000:2.0:1746155570.945480:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124614272 00000100:00100000:2.0:1746155570.945485:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124612608 00000100:00100000:2.0:1746155570.945487:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124612608 00000100:00100000:2.0:1746155570.945493:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124613120 00000100:00100000:2.0:1746155570.945494:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124613120 00000100:00100000:2.0:1746155570.945520:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124613632 00000100:00100000:2.0:1746155570.945522:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124613632 00000100:00100000:2.0:1746155570.945530:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124614144 00000100:00100000:2.0:1746155570.945532:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124614144 00000100:00100000:2.0:1746155570.945539:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12261 00000100:00100000:2.0:1746155570.945543:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3296:x1830976124612224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155570.945625:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155570.945627:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:2.0:1746155570.945630:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:2.0:1746155570.945631:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:2.0:1746155570.945633:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155570.945653:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976124612224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (373us total) trans 17179873231 rc 0/0 00000100:00100000:2.0:1746155570.945659:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12261 00000100:00100000:2.0:1746155570.945667:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12262 00000100:00100000:2.0:1746155570.945671:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3296:x1830976124612736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155570.945740:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976124612736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (437us total) trans 17179873232 rc 0/0 00000100:00100000:2.0:1746155570.945744:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12262 00000100:00100000:2.0:1746155570.945753:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12263 00000100:00100000:2.0:1746155570.945757:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976124613248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155570.945819:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155570.945822:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:2.0:1746155570.945824:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:2.0:1746155570.945825:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:2.0:1746155570.945827:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:2.0:1746155570.945842:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3296:x1830976124613248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (523us total) trans 21474840616 rc 0/0 00000100:00100000:2.0:1746155570.945847:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12263 00000100:00100000:2.0:1746155570.945855:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12264 00000100:00100000:2.0:1746155570.945860:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976124613760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.945925:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3296:x1830976124613760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (590us total) trans 21474840617 rc 0/0 00000100:00100000:2.0:1746155570.945933:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12264 00000100:00100000:2.0:1746155570.945942:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12265 00000100:00100000:2.0:1746155570.945946:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976124614272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.946013:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3296:x1830976124614272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (659us total) trans 21474840618 rc 0/0 00000100:00100000:2.0:1746155570.946018:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12265 00000100:00100000:2.0:1746155570.946027:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12266 00000100:00100000:2.0:1746155570.946031:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3296:x1830976124612608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155570.946103:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976124612608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (722us total) trans 17179873233 rc 0/0 00000100:00100000:2.0:1746155570.946107:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12266 00000100:00100000:2.0:1746155570.946117:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12267 00000100:00100000:2.0:1746155570.946121:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3296:x1830976124613120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155570.946188:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976124613120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (787us total) trans 17179873234 rc 0/0 00000100:00100000:2.0:1746155570.946193:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12267 00000100:00100000:2.0:1746155570.946202:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12268 00000100:00100000:2.0:1746155570.946206:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976124613632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155570.946264:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:2.0:1746155570.946267:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155570.946269:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155570.946270:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155570.946272:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:2.0:1746155570.946288:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3296:x1830976124613632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (872us total) trans 21474840619 rc 0/0 00000100:00100000:2.0:1746155570.946293:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12268 00000100:00100000:2.0:1746155570.946303:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12269 00000100:00100000:2.0:1746155570.946307:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976124614144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155570.946373:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3296:x1830976124614144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (942us total) trans 21474840620 rc 0/0 00000100:00100000:2.0:1746155570.946378:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12269 00000004:00080000:2.0:1746155570.946405:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca95c00/2, rc 0, transno 17179873233 00000100:00100000:2.0:1746155570.946409:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124612608:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155570.946414:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6063100/2, rc 0, transno 17179873234 00000100:00100000:2.0:1746155570.946417:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124613120:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155570.946422:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6062d80/2, rc 0, transno 21474840619 00000100:00100000:2.0:1746155570.946424:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124613632:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155570.946429:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc7480/2, rc 0, transno 21474840620 00000100:00100000:2.0:1746155570.946431:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124614144:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155570.946436:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca94380/2, rc 0, transno 17179873231 00000100:00100000:2.0:1746155570.946438:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124612224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155570.946442:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6061180/2, rc 0, transno 17179873232 00000100:00100000:2.0:1746155570.946444:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124612736:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155570.946455:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6063b80/2, rc 0, transno 21474840616 00000100:00100000:2.0:1746155570.946458:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124613248:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155570.946463:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc6a00/2, rc 0, transno 21474840617 00000100:00100000:2.0:1746155570.946465:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124613760:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155570.946472:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800944ac700/2, rc 0, transno 21474840618 00000100:00100000:2.0:1746155570.946474:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124614272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155570.946818:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.946832:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.946838:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123832320 00000100:00100000:0.0:1746155570.946842:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123832320 00000100:00100000:3.0:1746155570.946857:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.946864:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123832448 00000100:00100000:0.0:1746155570.946866:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123832448 00000100:00100000:3.0:1746155570.946875:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4061 00000100:00100000:0.0:1746155570.946879:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4062 00000100:00100000:3.0:1746155570.946881:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29246:x1830976123832320:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:0.0:1746155570.946885:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29244:x1830976123832448:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:3.0:1746155570.946946:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29246:x1830976123832320:12345-192.168.202.51@tcp:49:cat.0 Request processed in 65us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.946946:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29244:x1830976123832448:12345-192.168.202.51@tcp:49:cat.0 Request processed in 61us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.946951:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4061 00000100:00100000:0.0:1746155570.946954:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4062 00000100:00100000:3.0:1746155570.947023:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124611968:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155570.947032:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124612096:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155570.947056:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094219800/0x844e5faceb5ec05d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11344 expref: 10 pid: 15474 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746155570.947074:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11344 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.947090:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094218200, rc 0) 00000100:00100000:3.0:1746155570.947110:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29243:x1830976123831424:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 51057us (52367us total) trans 8589943999 rc 0/0 00000100:00100000:3.0:1746155570.947118:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10049 00000100:00100000:3.0:1746155570.947131:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123832576 00000100:00100000:3.0:1746155570.947133:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123832576 00000100:00100000:3.0:1746155570.947148:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10052 00000100:00100000:3.0:1746155570.947152:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29240:x1830976123832576:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155570.947159:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155570.947168:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27c000/0x844e5faceb5ec080 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11360 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.947195:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27c000/0x844e5faceb5ec080 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11360 expref: 287 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.947204:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27c000/0x844e5faceb5ec080 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11360 expref: 287 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.947214:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155570.947216:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155570.947218:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a27c000, rc 0) 00000100:00100000:3.0:1746155570.947233:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29240:x1830976123832576:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 80us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.947237:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10052 00000100:00100000:0.0:1746155570.955381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.955413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.955686:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123833088 00000100:00100000:2.0:1746155570.955694:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123833088 00002000:00100000:2.0:1746155570.955729:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800910c8a80 x1830976123833088/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.955737:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8a80 with x1830976123833088 ext(1048576->2097151) 00002000:00010000:2.0:1746155570.955741:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910c8a80 00000100:00100000:2.0:1746155570.956740:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4716 00000100:00100000:2.0:1746155570.956747:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123833088:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155570.956886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.957807:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123833216 00000100:00100000:1.0:1746155570.957812:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123833216 00000100:00100000:3.0:1746155570.958132:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123832960 00000100:00100000:3.0:1746155570.958136:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123832960 00002000:00100000:3.0:1746155570.958155:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff8800910cb800 x1830976123832960/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.958163:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb800 with x1830976123832960 ext(1048576->2097151) 00002000:00010000:3.0:1746155570.958168:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910cb800 00000100:00100000:3.0:1746155570.958183:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4717 00000100:00100000:3.0:1746155570.958188:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123832960:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155570.958399:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 595 00000100:00100000:1.0:1746155570.958404:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1962:x1830976123833216:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155570.958413:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155570.958431:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27c000/0x844e5faceb5ec080 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11360 expref: 287 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.958443:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155570.958446:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155570.959081:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:1962:x1830976123833216:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 675us (3666us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.959087:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 595 00000100:00100000:3.0:1746155570.959211:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.959402:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123833344 00000100:00100000:1.0:1746155570.959405:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123833344 00000100:00100000:1.0:1746155570.959487:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12270 00000100:00100000:1.0:1746155570.959493:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29240:x1830976123833344:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155570.959515:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155570.959527:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11367 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.959554:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1132f expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.959561:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b200/0x844e5faceb5ec04f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11336 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.959566:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.959567:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.959570:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1413120->2097151] (req 1413120->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 22 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.959716:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b200/0x844e5faceb5ec04f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11336 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.959728:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b200/0x844e5faceb5ec04f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11336 expref: 11 pid: 1625 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155570.959738:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124614400:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155570.959947:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1132f expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.959954:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1132f expref: 22 pid: 1625 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155570.959962:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124614528:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155570.959983:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c640c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.969380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.969481:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124614400:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155570.969489:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124614528:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155570.969543:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1413120->2097151] (req 1413120->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 22 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.969568:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b4c00, rc 0) 00000100:00100000:1.0:1746155570.969607:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29240:x1830976123833344:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 10113us (10395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.969617:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12270 00000100:00100000:3.0:1746155570.969993:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123833472 00000100:00100000:3.0:1746155570.969998:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123833472 00010000:00010000:3.0:1746155570.970020:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1132f expref: 22 pid: 1625 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155570.970040:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6176 00000100:00100000:3.0:1746155570.970052:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123833472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155570.970061:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155570.970075:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1132f expref: 22 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155570.970083:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1132f expref: 22 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155570.970100:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec048 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1132f expref: 22 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155570.970114:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155570.970131:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123833472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.970136:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6176 00000100:00100000:2.0:1746155570.970752:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123833088:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14001us (15372us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155570.970760:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4716 00002000:00100000:2.0:1746155570.970768:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800910c8a80 x1830976123833088/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.970776:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8a80 with x1830976123833088 ext(1048576->2097151) 00010000:00010000:2.0:1746155570.970783:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b200/0x844e5faceb5ec04f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11336 expref: 10 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155570.970794:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b200/0x844e5faceb5ec04f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11336 expref: 10 pid: 1625 timeout: 800 lvb_type: 0 00002000:00010000:2.0:1746155570.970799:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910c8a80 00000100:00100000:2.0:1746155570.971821:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123832960:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13630us (14933us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155570.971828:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4717 00002000:00100000:2.0:1746155570.971834:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff8800910cb800 x1830976123832960/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.971841:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb800 with x1830976123832960 ext(1048576->2097151) 00002000:00010000:2.0:1746155570.971845:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910cb800 00000100:00100000:0.0:1746155570.980905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.980950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155570.980975:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123833600 00000100:00100000:1.0:1746155570.980983:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123833600 00000100:00100000:1.0:1746155570.981025:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123833728 00000100:00100000:1.0:1746155570.981028:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123833728 00000100:00100000:1.0:1746155570.981044:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12271 00000100:00100000:1.0:1746155570.981051:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29246:x1830976123833600:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155570.981067:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155570.981222:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5000/0x844e5faceb5ec08e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1136e expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.981247:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.981248:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155570.981255:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5000/0x844e5faceb5ec08e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1136e expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.981270:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5000/0x844e5faceb5ec08e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1136e expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.981280:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b5000, rc 0) 00000100:00100000:1.0:1746155570.981334:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29246:x1830976123833600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 283us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155570.981339:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12271 00000100:00100000:1.0:1746155570.981354:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12272 00000100:00100000:1.0:1746155570.981359:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29243:x1830976123833728:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155570.981365:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155570.981373:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11375 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.981387:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f0 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.981393:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155570.981394:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155570.981396:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2105344->2482175] (req 2105344->2482175) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 9 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.981420:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f0 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.981429:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f0 expref: 10 pid: 18270 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155570.981441:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124614656:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155570.981485:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155570.982999:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.983047:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123833856 00000100:00100000:2.0:1746155570.983053:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123833856 00010000:00010000:2.0:1746155570.983205:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b200/0x844e5faceb5ec04f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11336 expref: 11 pid: 1625 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155570.983274:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6177 00000100:00100000:2.0:1746155570.983279:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123833856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.983288:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.983305:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b200/0x844e5faceb5ec04f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11336 expref: 11 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155570.983314:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b200/0x844e5faceb5ec04f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11336 expref: 11 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155570.983330:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b200/0x844e5faceb5ec04f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11336 expref: 11 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155570.983350:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.983351:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.983824:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.983838:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.983865:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.983874:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124614784:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155570.984017:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124614656:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155570.984038:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2105344->2482175] (req 2105344->2482175) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 9 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155570.984047:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b5600, rc 0) 00000100:00100000:3.0:1746155570.984051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.984072:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29243:x1830976123833728:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2712us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155570.984078:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12272 00000100:00100000:1.0:1746155570.984109:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123833984 00000100:00100000:1.0:1746155570.984113:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123833984 00000100:00100000:1.0:1746155570.984132:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12273 00000100:00100000:1.0:1746155570.984136:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:29244:x1830976123833984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155570.984146:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155570.984156:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1137c expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.984176:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e9 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.984181:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155570.984182:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155570.984184:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1137c expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.984197:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e9 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155570.984205:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e9 expref: 10 pid: 18270 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155570.984212:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124614912:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.984376:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155570.984390:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.985985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.986031:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123834112 00000100:00100000:3.0:1746155570.986036:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123834112 00010000:00010000:3.0:1746155570.986059:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f0 expref: 11 pid: 18270 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155570.986081:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6178 00000100:00100000:0.0:1746155570.986081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155570.986087:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123834112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155570.986094:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155570.986115:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f0 expref: 11 pid: 18270 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155570.986123:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f0 expref: 11 pid: 18270 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155570.986138:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b3800/0x844e5faceb5ebfae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f0 expref: 11 pid: 18270 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155570.986152:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.986153:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155570.986158:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 8 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.986164:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 8 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.986183:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 8 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155570.986194:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976124615040:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155570.986248:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155570.986278:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124614912:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155570.986333:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124614784:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155570.986342:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.986359:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123833856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3080us (3367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.986364:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6177 00010000:00010000:3.0:1746155570.986742:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1137c expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155570.986753:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b4000, rc 0) 00000100:00100000:3.0:1746155570.986772:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:29244:x1830976123833984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2634us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.986777:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12273 00000100:00100000:3.0:1746155570.986795:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123834368 00000100:00100000:3.0:1746155570.986797:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123834368 00002000:00100000:3.0:1746155570.986819:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880094085c00 x1830976123834368/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.986826:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085c00 with x1830976123834368 ext(1048576->2097151) 00002000:00010000:3.0:1746155570.986830:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094085c00 00000100:00100000:3.0:1746155570.986841:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4718 00000100:00100000:3.0:1746155570.986846:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123834368:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155570.987948:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155570.987974:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.988096:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123834752 00000100:00100000:2.0:1746155570.988101:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123834752 00002000:00100000:2.0:1746155570.988119:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1413120->1417215) req@ffff880094084000 x1830976123834752/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.988127:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094084000 with x1830976123834752 ext(1413120->1417215) 00002000:00010000:2.0:1746155570.988131:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094084000 00000100:00100000:2.0:1746155570.988144:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4719 00000100:00100000:2.0:1746155570.988149:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123834752:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155570.988223:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123834752:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 74us (248us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155570.988229:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4719 00002000:00100000:2.0:1746155570.988233:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1413120->1417215) req@ffff880094084000 x1830976123834752/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.988239:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094084000 with x1830976123834752 ext(1413120->1417215) 00002000:00010000:2.0:1746155570.988241:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094084000 00000100:00100000:2.0:1746155570.988254:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123834496 00000100:00100000:2.0:1746155570.988256:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123834496 00010000:00010000:2.0:1746155570.988266:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e9 expref: 11 pid: 18270 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155570.988287:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6179 00000100:00100000:2.0:1746155570.988292:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123834496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155570.988300:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155570.988311:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e9 expref: 11 pid: 18270 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155570.988319:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e9 expref: 11 pid: 18270 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155570.988333:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5ebfa7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112e9 expref: 11 pid: 18270 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155570.988346:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.988348:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155570.988352:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1137c expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.988364:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1137c expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155570.988383:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1137c expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155570.988392:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124615168:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155570.988426:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155570.992922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.993005:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124615168:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155570.993020:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155570.993053:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123834496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4760us (5106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155570.993062:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6179 00000100:00100000:3.0:1746155570.993412:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976124615040:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155570.993422:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155570.993437:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123834112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7351us (7457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155570.993442:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6178 00000100:00100000:1.0:1746155570.994004:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123835008 00000100:00100000:1.0:1746155570.994011:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123835008 00002000:00100000:1.0:1746155570.994039:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2105344->2109439) req@ffff880094085180 x1830976123835008/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155570.994048:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085180 with x1830976123835008 ext(2105344->2109439) 00002000:00010000:1.0:1746155570.994051:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094085180 00000100:00100000:1.0:1746155570.994119:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4720 00000100:00100000:1.0:1746155570.994126:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123835008:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155570.994254:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123835008:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 128us (1339us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155570.994259:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4720 00002000:00100000:1.0:1746155570.994264:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2105344->2109439) req@ffff880094085180 x1830976123835008/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/4536 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155570.994271:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085180 with x1830976123835008 ext(2105344->2109439) 00002000:00010000:1.0:1746155570.994273:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094085180 00000100:00100000:0.0:1746155570.994570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155570.994778:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123835264 00000100:00100000:2.0:1746155570.994782:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123835264 00002000:00100000:2.0:1746155570.994797:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880094085f80 x1830976123835264/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/0 e 0 to 0 dl 1746155581 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155570.994804:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085f80 with x1830976123835264 ext(1048576->2097151) 00002000:00010000:2.0:1746155570.994807:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094085f80 00000100:00100000:2.0:1746155570.994818:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4721 00000100:00100000:2.0:1746155570.994822:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123835264:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155570.997394:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123834368:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10539us (11304us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155570.997404:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4718 00002000:00100000:3.0:1746155570.997411:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880094085c00 x1830976123834368/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155570.997419:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085c00 with x1830976123834368 ext(1048576->2097151) 00002000:00010000:3.0:1746155570.997424:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094085c00 00000100:00100000:0.0:1746155570.999927:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.000450:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123835392 00000100:00100000:3.0:1746155571.000459:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123835392 00000100:00100000:3.0:1746155571.000518:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12274 00000100:00100000:3.0:1746155571.000525:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:29240:x1830976123835392:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155571.000540:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.000563:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11383 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.000587:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11352 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.000595:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5000/0x844e5faceb5ec08e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1136e expref: 9 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.000600:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.000602:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.000605:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1097727] (req 1048576->1097727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 20 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.000629:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5000/0x844e5faceb5ec08e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1136e expref: 9 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.000639:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5000/0x844e5faceb5ec08e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1136e expref: 9 pid: 29728 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.000650:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124615296:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.000731:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11352 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.000738:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11352 expref: 20 pid: 4461 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.000746:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124615424:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.001080:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.003797:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123835264:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8966us (9219us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155571.003811:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4721 00002000:00100000:2.0:1746155571.003820:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880094085f80 x1830976123835264/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:641/0 lens 488/440 e 0 to 0 dl 1746155581 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.003829:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085f80 with x1830976123835264 ext(1048576->2097151) 00002000:00010000:2.0:1746155571.003835:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094085f80 00000100:00100000:0.0:1746155571.004245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.004329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.004344:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123835776 00000100:00100000:0.0:1746155571.004350:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123835776 00000100:00100000:0.0:1746155571.004380:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12275 00000100:00100000:0.0:1746155571.004385:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29246:x1830976123835776:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155571.004397:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155571.004410:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5ec0aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1138a expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.004428:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155571.004429:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155571.004434:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5ec0aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1138a expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.004445:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5ec0aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1138a expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.004453:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc03c00, rc 0) 00000100:00100000:0.0:1746155571.004470:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29246:x1830976123835776:12345-192.168.202.51@tcp:101:cat.0 Request processed in 85us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155571.004474:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12275 00000100:00080000:3.0:1746155571.004775:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746155571.004804:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124615296:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.004812:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124615424:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.004828:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->1097727] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 20 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.004837:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1800, rc 0) 00000100:00100000:3.0:1746155571.004855:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29240:x1830976123835392:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4331us (4936us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.004860:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12274 00000100:00100000:0.0:1746155571.005619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.005688:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123835648 00000100:00100000:2.0:1746155571.005692:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123835648 00002000:00100000:2.0:1746155571.005714:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2478080->2482175) req@ffff880094087b80 x1830976123835648/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.005721:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087b80 with x1830976123835648 ext(2478080->2482175) 00002000:00010000:2.0:1746155571.005724:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094087b80 00000100:00100000:2.0:1746155571.005735:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4722 00000100:00100000:2.0:1746155571.005739:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123835648:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155571.005834:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123835904 00000100:00100000:3.0:1746155571.005838:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123835904 00010000:00010000:3.0:1746155571.005850:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11352 expref: 20 pid: 4461 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.005877:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6180 00000100:00100000:3.0:1746155571.005882:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976123835904:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.005891:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.005906:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11352 expref: 20 pid: 4461 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.005915:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11352 expref: 20 pid: 4461 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.005928:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094219e00/0x844e5faceb5ec072 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11352 expref: 20 pid: 4461 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.005952:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.005972:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123835904:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 89us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.005976:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6180 00000100:00100000:2.0:1746155571.006323:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123835648:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 583us (2078us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155571.006328:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4722 00002000:00100000:2.0:1746155571.006333:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2478080->2482175) req@ffff880094087b80 x1830976123835648/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.006340:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087b80 with x1830976123835648 ext(2478080->2482175) 00002000:00010000:2.0:1746155571.006342:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094087b80 00000100:00100000:0.0:1746155571.008167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.008251:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123836032 00000100:00100000:2.0:1746155571.008257:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123836032 00000100:00100000:0.0:1746155571.008899:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155571.008984:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5000/0x844e5faceb5ec08e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1136e expref: 10 pid: 29728 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.009007:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6181 00000100:00100000:2.0:1746155571.009015:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123836032:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.009024:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.009041:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5000/0x844e5faceb5ec08e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1136e expref: 10 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.009051:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5000/0x844e5faceb5ec08e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1136e expref: 10 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.009067:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5000/0x844e5faceb5ec08e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1136e expref: 10 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.009096:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.009097:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.009103:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.009110:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.009137:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.009147:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124615552:192.168.202.51@tcp:105: 00000100:00080000:3.0:1746155571.009225:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155571.009791:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155571.010066:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123836288 00000100:00100000:1.0:1746155571.010071:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123836288 00002000:00100000:1.0:1746155571.010095:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880094086300 x1830976123836288/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.010102:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094086300 with x1830976123836288 ext(1048576->2097151) 00002000:00010000:1.0:1746155571.010106:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094086300 00000100:00100000:1.0:1746155571.010127:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4723 00000100:00100000:1.0:1746155571.010133:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123836288:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155571.011219:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124615552:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155571.011233:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.011274:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123836032:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2260us (3110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.011283:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6181 00000100:00100000:0.0:1746155571.013032:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.013781:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123836544 00000100:00100000:0.0:1746155571.013788:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123836544 00002000:00100000:0.0:1746155571.013819:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1093632->1097727) req@ffff880094085500 x1830976123836544/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155571.013827:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085500 with x1830976123836544 ext(1093632->1097727) 00002000:00010000:0.0:1746155571.013832:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094085500 00000100:00100000:0.0:1746155571.013849:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4724 00000100:00100000:0.0:1746155571.013855:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123836544:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155571.013974:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123836544:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 118us (945us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155571.013980:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4724 00002000:00100000:0.0:1746155571.013985:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1093632->1097727) req@ffff880094085500 x1830976123836544/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155571.013991:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094085500 with x1830976123836544 ext(1093632->1097727) 00002000:00010000:0.0:1746155571.013994:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094085500 00000100:00100000:1.0:1746155571.018969:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.019104:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123836672 00000100:00100000:1.0:1746155571.019108:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.019111:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123836672 00000100:00100000:3.0:1746155571.019141:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123836800 00000100:00100000:3.0:1746155571.019143:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123836800 00000100:00100000:1.0:1746155571.019184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.019221:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123837056 00000100:00100000:0.0:1746155571.019224:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123837056 00000100:00100000:0.0:1746155571.019243:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4063 00000100:00100000:0.0:1746155571.019249:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29240:x1830976123837056:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155571.019919:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12276 00000100:00100000:3.0:1746155571.019925:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976123836672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.019934:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.019947:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11391 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.019980:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124615680:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155571.020020:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12277 00000100:00100000:2.0:1746155571.020026:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123836800:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.020032:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.020040:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fed8400/0x844e5faceb5ec0b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11398 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.020058:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124615808:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155571.020099:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123836288:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9965us (11200us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155571.020106:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4723 00002000:00100000:1.0:1746155571.020119:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880094086300 x1830976123836288/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.020130:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094086300 with x1830976123836288 ext(1048576->2097151) 00002000:00010000:1.0:1746155571.020136:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094086300 00000100:00100000:0.0:1746155571.020185:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29240:x1830976123837056:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 936us (1001us total) trans 8589944000 rc 0/0 00000100:00100000:0.0:1746155571.020191:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4063 00000100:00100000:3.0:1746155571.020194:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.020282:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746155571.021455:0:8437:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 8 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155571.021456:0:8438:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime: 1746155570 -> 1746155571 00002000:00010000:3.0:1746155571.021459:0:8438:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155570 -> 1746155571 00000100:00100000:3.0:1746155571.021472:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124615680:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155571.021472:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124615808:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.021487:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0b1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11391 expref: 17 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.021487:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fed8400/0x844e5faceb5ec0b8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11398 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.021496:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11391 expref: 17 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.021496:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fed8400/0x844e5faceb5ec0b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11398 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.021522:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fed8400, rc 0) 00010000:00010000:3.0:1746155571.021642:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0e00, rc 0) 00000100:00100000:3.0:1746155571.021744:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976123836672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1817us (2781us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155571.021744:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123836800:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1717us (2634us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155571.021750:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12276 00000100:00100000:2.0:1746155571.021752:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12277 00000100:00100000:0.0:1746155571.025085:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.025198:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123837184 00000100:00100000:3.0:1746155571.025206:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123837184 00000100:00100000:0.0:1746155571.026040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.026235:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123837440 00000100:00100000:1.0:1746155571.026239:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123837440 00002000:00100000:1.0:1746155571.026266:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012f1f3b80 x1830976123837440/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 504/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.026275:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3b80 with x1830976123837440 ext(2097152->3145727) 00002000:00010000:1.0:1746155571.026280:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3b80 00000100:00100000:1.0:1746155571.026294:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4725 00000100:00100000:1.0:1746155571.026300:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123837440:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155571.026517:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12278 00000100:00100000:3.0:1746155571.026523:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:29244:x1830976123837184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.026531:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.026543:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1139f expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.026572:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 10 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.026579:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.026580:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.026583:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1139f expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.026604:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 10 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.026614:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 10 pid: 29728 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.026624:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124615936:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.026671:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155571.032069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.032430:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123837568 00000100:00100000:1.0:1746155571.032438:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123837568 00002000:00100000:1.0:1746155571.032470:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2105344->2482175) req@ffff88012f1f1180 x1830976123837568/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.032479:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1180 with x1830976123837568 ext(2105344->2482175) 00010000:00010000:1.0:1746155571.032486:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 12 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.032498:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 12 pid: 29728 timeout: 800 lvb_type: 0 00002000:00010000:1.0:1746155571.032525:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1f1180 00000100:00100000:1.0:1746155571.032542:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 744 00000100:00100000:1.0:1746155571.032557:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123837568:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155571.032639:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124615936:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.032659:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1139f expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.032675:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0c00, rc 0) 00000100:00100000:3.0:1746155571.032716:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:29244:x1830976123837184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6192us (7637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.032722:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12278 00000100:00100000:1.0:1746155571.033306:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123837440:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7005us (7266us total) trans 0 rc 671744/671744 00000100:00100000:1.0:1746155571.033312:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4725 00002000:00100000:1.0:1746155571.033318:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012f1f3b80 x1830976123837440/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 504/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 671744/671744 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.033325:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3b80 with x1830976123837440 ext(2097152->3145727) 00010000:00010000:1.0:1746155571.033329:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 12 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.033338:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 12 pid: 29728 timeout: 800 lvb_type: 0 00002000:00010000:1.0:1746155571.033343:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1f3b80 00000100:00100000:0.0:1746155571.038198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.038256:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123837696 00000100:00100000:3.0:1746155571.038264:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123837696 00000100:00100000:3.0:1746155571.038310:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12279 00000100:00100000:3.0:1746155571.038317:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29246:x1830976123837696:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.038333:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.038349:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113a6 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.038371:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 8 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.038377:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.038379:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.038382:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113a6 expref: 10 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.038406:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 8 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.038415:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 8 pid: 18270 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.038426:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124616064:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.038493:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110180 going to sleep for 11 seconds 00000100:00100000:1.0:1746155571.040003:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123837568:12345-192.168.202.51@tcp:4:cat.0 Request processed in 7444us (7937us total) trans 21474840621 rc 0/0 00000100:00100000:1.0:1746155571.040011:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 744 00002000:00100000:1.0:1746155571.040019:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2105344->2482175) req@ffff88012f1f1180 x1830976123837568/t21474840621(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/448 e 0 to 0 dl 1746155582 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.040027:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1180 with x1830976123837568 ext(2105344->2482175) 00010000:00010000:1.0:1746155571.040033:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 12 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.040043:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 12 pid: 29728 timeout: 800 lvb_type: 0 00002000:00010000:1.0:1746155571.040049:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1f1180 00000100:00100000:3.0:1746155571.042388:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124616064:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.042413:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113a6 expref: 10 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.042426:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0200, rc 0) 00000100:00100000:3.0:1746155571.042468:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29246:x1830976123837696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4150us (4276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.042475:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12279 00000100:00100000:0.0:1746155571.042728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.042865:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123837824 00000100:00100000:2.0:1746155571.042870:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123837824 00010000:00010000:2.0:1746155571.042895:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 9 pid: 18270 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.042923:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6182 00000100:00100000:2.0:1746155571.042929:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123837824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.042939:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.042957:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 9 pid: 18270 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.042966:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 9 pid: 18270 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.042983:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5610a00/0x844e5faceb5ebfb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f112f7 expref: 9 pid: 18270 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.042994:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.042996:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.043002:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113a6 expref: 9 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.043009:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113a6 expref: 9 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.043030:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113a6 expref: 9 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.043040:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124616192:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155571.043089:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155571.044960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.045028:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123837952 00000100:00100000:2.0:1746155571.045032:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123837952 00010000:00010000:2.0:1746155571.045051:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 12 pid: 29728 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.045070:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6183 00000100:00100000:2.0:1746155571.045076:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123837952:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.045085:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.045099:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 12 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.045108:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 12 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.045123:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b5600/0x844e5faceb5ec095 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2105344->2482175) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11375 expref: 12 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.045134:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.045136:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.045139:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1139f expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.045146:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1139f expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.045167:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1139f expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.045175:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a8aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976124616320:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155571.045913:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a943c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.048264:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976124616320:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155571.048283:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.048312:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123837952:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3236us (3356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.048321:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6183 00000100:00100000:2.0:1746155571.048390:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124616192:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155571.048398:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.048414:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123837824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5485us (5693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.048419:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6182 00000100:00100000:0.0:1746155571.050095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.050175:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123838208 00000100:00100000:1.0:1746155571.050181:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123838208 00002000:00100000:1.0:1746155571.050212:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012cdcc380 x1830976123838208/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.050220:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcc380 with x1830976123838208 ext(2097152->3145727) 00002000:00010000:1.0:1746155571.050224:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdcc380 00000100:00100000:1.0:1746155571.050250:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4726 00000100:00100000:1.0:1746155571.050256:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123838208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155571.054169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.054228:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123838464 00000100:00100000:2.0:1746155571.054235:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123838464 00002000:00100000:2.0:1746155571.054267:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012cdcea00 x1830976123838464/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.054275:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcea00 with x1830976123838464 ext(2097152->3145727) 00002000:00010000:2.0:1746155571.054279:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcea00 00000100:00100000:2.0:1746155571.054307:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4727 00000100:00100000:2.0:1746155571.054314:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123838464:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155571.061879:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123838208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11614us (11777us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155571.061890:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4726 00002000:00100000:1.0:1746155571.061899:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012cdcc380 x1830976123838208/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.061906:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcc380 with x1830976123838208 ext(2097152->3145727) 00002000:00010000:1.0:1746155571.061911:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdcc380 00000100:00100000:0.0:1746155571.069078:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.069157:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123838592 00000100:00100000:3.0:1746155571.069164:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123838592 00000100:00100000:2.0:1746155571.069193:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123838464:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14879us (15030us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155571.069195:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12280 00000100:00100000:3.0:1746155571.069201:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29246:x1830976123838592:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155571.069201:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4727 00002000:00100000:2.0:1746155571.069209:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012cdcea00 x1830976123838464/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746155571.069213:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746155571.069221:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcea00 with x1830976123838464 ext(2097152->3145727) 00002000:00010000:2.0:1746155571.069224:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcea00 00010000:00010000:3.0:1746155571.069226:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5ec0cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113ad expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.069244:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.069246:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.069252:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5ec0cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113ad expref: 12 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.069264:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5ec0cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113ad expref: 12 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.069272:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0000, rc 0) 00000100:00100000:3.0:1746155571.069288:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29246:x1830976123838592:12345-192.168.202.51@tcp:101:cat.0 Request processed in 87us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.069293:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12280 00000100:00100000:0.0:1746155571.073171:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.073943:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123838720 00000100:00100000:3.0:1746155571.073951:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123838720 00000100:00100000:3.0:1746155571.073997:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12281 00000100:00100000:3.0:1746155571.074004:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:29244:x1830976123838720:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.074019:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.074033:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5ec0d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113b4 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.074053:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.074054:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.074060:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5ec0d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113b4 expref: 20 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.074071:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5ec0d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113b4 expref: 20 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.074080:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1000, rc 0) 00000100:00100000:3.0:1746155571.074345:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29244:x1830976123838720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 340us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.074351:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12281 00000100:00100000:0.0:1746155571.074727:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.074875:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.074940:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123838976 00000100:00100000:1.0:1746155571.074944:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123838976 00002000:00100000:1.0:1746155571.074967:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012cdcc000 x1830976123838976/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.074974:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcc000 with x1830976123838976 ext(3145728->4194303) 00002000:00010000:1.0:1746155571.074978:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcc000 00000100:00100000:1.0:1746155571.074987:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123839232 00000100:00100000:1.0:1746155571.074989:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123839232 00002000:00100000:1.0:1746155571.074998:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012cdcfb80 x1830976123839232/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.075003:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcfb80 with x1830976123839232 ext(3145728->4194303) 00002000:00010000:1.0:1746155571.075005:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdcfb80 00000100:00100000:1.0:1746155571.075028:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4728 00000100:00100000:1.0:1746155571.075033:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123838976:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155571.075779:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4729 00000100:00100000:3.0:1746155571.075787:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123839232:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155571.091319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.091359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.092288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.093465:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123838976:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18429us (18735us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155571.093473:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4728 00002000:00100000:0.0:1746155571.093483:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012cdcc000 x1830976123838976/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155571.093491:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcc000 with x1830976123838976 ext(3145728->4194303) 00002000:00010000:0.0:1746155571.093496:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcc000 00000100:00100000:2.0:1746155571.093568:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123839488 00000100:00100000:2.0:1746155571.093577:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123839488 00002000:00100000:2.0:1746155571.093609:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012cdcd180 x1830976123839488/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.093615:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcd180 with x1830976123839488 ext(2097152->3145727) 00002000:00010000:2.0:1746155571.093619:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdcd180 00000100:00100000:2.0:1746155571.093637:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123839744 00000100:00100000:2.0:1746155571.093639:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123839744 00002000:00100000:2.0:1746155571.093650:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012cdcf480 x1830976123839744/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.093656:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcf480 with x1830976123839744 ext(3145728->4194303) 00002000:00010000:2.0:1746155571.093658:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdcf480 00000100:00100000:2.0:1746155571.093666:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123840000 00000100:00100000:2.0:1746155571.093668:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123840000 00002000:00100000:2.0:1746155571.093678:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012cdce680 x1830976123840000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.093684:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdce680 with x1830976123840000 ext(3145728->4194303) 00002000:00010000:2.0:1746155571.093686:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdce680 00000100:00100000:2.0:1746155571.093696:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4730 00000100:00100000:2.0:1746155571.093701:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123839488:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155571.094819:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4731 00000100:00100000:2.0:1746155571.094826:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123839744:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155571.095848:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4732 00000100:00100000:2.0:1746155571.095854:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976123840000:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155571.102268:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123839232:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26475us (27386us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155571.102278:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4729 00002000:00100000:1.0:1746155571.102287:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012cdcfb80 x1830976123839232/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.102295:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcfb80 with x1830976123839232 ext(3145728->4194303) 00002000:00010000:1.0:1746155571.102300:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdcfb80 00000100:00100000:2.0:1746155571.106105:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123839488:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12394us (14784us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155571.106115:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4730 00002000:00100000:2.0:1746155571.106126:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012cdcd180 x1830976123839488/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.106135:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcd180 with x1830976123839488 ext(2097152->3145727) 00002000:00010000:2.0:1746155571.106140:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdcd180 00000100:00100000:3.0:1746155571.110614:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976123840000:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14752us (18318us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155571.110624:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4732 00002000:00100000:3.0:1746155571.110633:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012cdce680 x1830976123840000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.110644:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdce680 with x1830976123840000 ext(3145728->4194303) 00002000:00010000:3.0:1746155571.110648:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdce680 00000100:00100000:2.0:1746155571.111375:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123839744:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16550us (20015us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155571.111382:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4731 00002000:00100000:2.0:1746155571.111388:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012cdcf480 x1830976123839744/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.111395:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcf480 with x1830976123839744 ext(3145728->4194303) 00002000:00010000:2.0:1746155571.111399:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdcf480 00000100:00100000:0.0:1746155571.111624:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.111659:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.111669:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123840128 00000100:00100000:3.0:1746155571.111675:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123840128 00000100:00100000:2.0:1746155571.111744:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123840256 00000100:00100000:2.0:1746155571.111747:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123840256 00000100:00100000:2.0:1746155571.111980:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12282 00000100:00100000:2.0:1746155571.111990:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123840256:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.112001:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.112146:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f83fe00/0x844e5faceb5ec0db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113c2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.112227:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124616448:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155571.112272:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155571.113057:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12283 00000100:00100000:0.0:1746155571.113063:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123840128:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155571.113072:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155571.113079:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136ab2000/0x844e5faceb5ec0e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113bb expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155571.113098:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124616576:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155571.113141:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949180 going to sleep for 11 seconds 00002000:00010000:2.0:1746155571.114608:0:20796:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155570 -> 1746155571 00002000:00010000:2.0:1746155571.114612:0:20796:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155570 -> 1746155571 00000100:00100000:2.0:1746155571.114628:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124616576:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155571.114651:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136ab2000/0x844e5faceb5ec0e2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113bb expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.114661:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136ab2000/0x844e5faceb5ec0e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113bb expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.114678:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136ab2000, rc 0) 00000100:00100000:2.0:1746155571.114712:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123840128:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1649us (3088us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155571.114719:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12283 00002000:00010000:3.0:1746155571.115155:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime: 1746155570 -> 1746155571 00002000:00010000:3.0:1746155571.115158:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime: 1746155570 -> 1746155571 00000100:00100000:3.0:1746155571.115167:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124616448:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.115184:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f83fe00/0x844e5faceb5ec0db lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113c2 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.115192:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f83fe00/0x844e5faceb5ec0db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113c2 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.115212:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f83fe00, rc 0) 00000100:00100000:3.0:1746155571.115241:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123840256:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3254us (3581us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155571.115247:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12282 00000100:00100000:0.0:1746155571.116688:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.116918:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123840512 00000100:00100000:2.0:1746155571.116923:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123840512 00002000:00100000:2.0:1746155571.116951:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009451d880 x1830976123840512/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.116959:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d880 with x1830976123840512 ext(4194304->4956159) 00002000:00010000:2.0:1746155571.116963:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451d880 00000100:00100000:2.0:1746155571.117279:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4733 00000100:00100000:2.0:1746155571.117286:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123840512:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155571.118542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.119088:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123840768 00000100:00100000:3.0:1746155571.119093:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123840768 00002000:00100000:3.0:1746155571.119116:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009451d180 x1830976123840768/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.119123:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d180 with x1830976123840768 ext(4194304->4956159) 00002000:00010000:3.0:1746155571.119127:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451d180 00000100:00100000:3.0:1746155571.119154:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4734 00000100:00100000:3.0:1746155571.119160:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123840768:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:1.0:1746155571.120246:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746155571.132067:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123840768:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12900us (13519us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155571.132077:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4734 00002000:00100000:3.0:1746155571.132087:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009451d180 x1830976123840768/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.132095:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d180 with x1830976123840768 ext(4194304->4956159) 00002000:00010000:3.0:1746155571.132100:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451d180 00000100:00100000:2.0:1746155571.133761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.133952:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123841024 00000100:00100000:3.0:1746155571.133959:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123841024 00000100:00080000:2.0:1746155571.134175:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155571.134219:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10053 00000100:00100000:3.0:1746155571.134230:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29250:x1830976123841024:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155571.134247:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155571.134257:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155571.134262:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec0e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113c9 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155571.134317:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123841152 00000100:00100000:0.0:1746155571.134321:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123841152 00010000:00010000:3.0:1746155571.134340:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00000100:00100000:0.0:1746155571.134349:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10054 00010000:00010000:3.0:1746155571.134350:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00000100:00100000:0.0:1746155571.134355:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:29251:x1830976123841152:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155571.134359:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155571.134364:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.134369:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5ec0f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155571.134371:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610e00/0x844e5faceb5ec0fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113d0 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.134374:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5ec0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134382:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5ec0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155571.134397:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611600/0x844e5faceb5ec105 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155571.134404:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611600/0x844e5faceb5ec105 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155571.134411:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611600/0x844e5faceb5ec105 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155571.134417:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611800/0x844e5faceb5ec10c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155571.134422:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611800/0x844e5faceb5ec10c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155571.134430:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611800/0x844e5faceb5ec10c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.134461:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5ec113 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134467:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5ec113 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134473:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5ec113 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155571.134479:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155571.134480:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155571.134487:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11321 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.134493:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155571.134533:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11321 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.134554:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11321 expref: 11 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746155571.134565:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451f100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124616704:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.134568:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134574:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134579:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134584:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb0e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155571.134586:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134592:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134601:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155571.134603:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155571.134606:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134613:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec0f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134624:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5ec0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134627:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5ec0f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134632:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5ec0f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00000100:00100000:0.0:1746155571.134632:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949240 going to sleep for 11 seconds 00010000:00010000:3.0:1746155571.134636:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb1400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155571.134637:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5ec0f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134640:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5ec0f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134645:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801366f8f00) 00010000:00010000:3.0:1746155571.134647:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155571.134648:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5ec0f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134652:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5ec0f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155571.134676:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec0e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113c9 expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.134685:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5ec113 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113c9 expref: 11 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.134694:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00000100:00080000:2.0:1746155571.134729:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746155571.135757:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123840512:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18470us (19068us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155571.135765:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4733 00002000:00100000:2.0:1746155571.135773:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009451d880 x1830976123840512/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.135782:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d880 with x1830976123840512 ext(4194304->4956159) 00002000:00010000:2.0:1746155571.135786:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451d880 00010000:00010000:3.0:1746155571.136139:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155571.136143:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.136150:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.136156:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0a00, rc 0) 00000100:00100000:3.0:1746155571.136189:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29250:x1830976123841024:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1961us (2432us total) trans 8589944001 rc 0/0 00000100:00100000:3.0:1746155571.136194:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10053 00000100:00100000:1.0:1746155571.143069:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.143099:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.143138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.143162:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.143186:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123841664 00000100:00100000:1.0:1746155571.143192:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123841664 00000100:00100000:1.0:1746155571.143218:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123841920 00000100:00100000:1.0:1746155571.143220:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123841920 00000100:00100000:1.0:1746155571.143232:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4064 00000100:00100000:1.0:1746155571.143239:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29244:x1830976123841664:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155571.143388:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29244:x1830976123841664:12345-192.168.202.51@tcp:35:cat.0 Request processed in 149us (248us total) trans 8589944002 rc 0/0 00000100:00100000:1.0:1746155571.143394:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4064 00000100:00100000:1.0:1746155571.143405:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4065 00000100:00100000:1.0:1746155571.143410:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea56450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:7661:x1830976123841920:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746155571.143466:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea56450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:7661:x1830976123841920:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 56us (303us total) trans 8589944003 rc 0/0 00000100:00100000:1.0:1746155571.143471:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4065 00000100:00100000:1.0:1746155571.143555:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123841280 00000100:00100000:1.0:1746155571.143558:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123841280 00000100:00100000:1.0:1746155571.143573:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123841408 00000100:00100000:1.0:1746155571.143575:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123841408 00000100:00100000:1.0:1746155571.143585:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12284 00000100:00100000:1.0:1746155571.143589:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123841280:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155571.143597:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.143610:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a125000/0x844e5faceb5ec128 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113d7 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155571.143645:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124616832:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155571.143685:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c64180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.143700:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12285 00000100:00100000:3.0:1746155571.143708:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123841408:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.143714:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.143721:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec12f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113de expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.143741:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124616960:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155571.143762:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155571.143885:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451f100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124616704:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155571.143900:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155571.148296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.148475:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124616832:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155571.148521:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a125000/0x844e5faceb5ec128 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113d7 expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.148535:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a125000/0x844e5faceb5ec128 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113d7 expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.148559:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a125000, rc 0) 00000100:00100000:2.0:1746155571.148594:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123841280:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5003us (5532us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155571.148601:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12284 00000100:00100000:2.0:1746155571.148627:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123842048 00000100:00100000:2.0:1746155571.148632:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123842048 00010000:00010000:2.0:1746155571.148651:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11321 expref: 12 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.148671:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6184 00000100:00100000:2.0:1746155571.148677:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123842048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.148686:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.148690:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11321 expref: 12 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.148699:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11321 expref: 12 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.148712:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec03a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11321 expref: 12 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.148724:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.148728:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148736:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148741:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148755:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.148769:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123842048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 92us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.148774:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6184 00010000:00010000:2.0:1746155571.148802:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148812:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155571.148843:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155571.148847:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155571.148858:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148866:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148873:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611600/0x844e5faceb5ec105 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148878:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611600/0x844e5faceb5ec105 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148884:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611600/0x844e5faceb5ec105 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148888:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5611600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.148891:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611600/0x844e5faceb5ec105 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148897:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611600/0x844e5faceb5ec105 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148904:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155571.148906:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.148909:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611600/0x844e5faceb5ec105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148913:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611600/0x844e5faceb5ec105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148921:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611800/0x844e5faceb5ec10c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148926:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611800/0x844e5faceb5ec10c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148930:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611800/0x844e5faceb5ec10c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148934:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5611800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.148935:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611800/0x844e5faceb5ec10c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148939:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611800/0x844e5faceb5ec10c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148944:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801366f8f00) 00010000:00010000:2.0:1746155571.148946:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.148948:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611800/0x844e5faceb5ec10c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148952:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5611800/0x844e5faceb5ec10c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.148974:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610e00/0x844e5faceb5ec0fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113d0 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.148983:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113d0 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.148988:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.148990:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155571.148992:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5610a00, rc 0) 00000100:00100000:2.0:1746155571.149010:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29251:x1830976123841152:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 14655us (14755us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.149016:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10054 00000100:00100000:3.0:1746155571.149182:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124616960:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.149197:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec12f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113de expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.149205:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec12f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113de expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.149224:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1e00, rc 0) 00000100:00100000:3.0:1746155571.149244:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123841408:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5537us (6144us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155571.149249:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12285 00000100:00100000:0.0:1746155571.152216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.153894:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123842176 00000100:00100000:3.0:1746155571.153904:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123842176 00000100:00100000:3.0:1746155571.153951:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12286 00000100:00100000:3.0:1746155571.153958:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123842176:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155571.153971:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.153984:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec136 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113e5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.154002:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.154004:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.154011:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec136 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113e5 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.154023:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec136 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113e5 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.154032:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0400, rc 0) 00000100:00100000:3.0:1746155571.154296:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123842176:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 337us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.154302:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12286 00000100:00100000:1.0:1746155571.154426:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.154662:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123842432 00000100:00100000:3.0:1746155571.154666:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123842432 00000100:00100000:1.0:1746155571.154927:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.155105:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.155139:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123842688 00000100:00100000:3.0:1746155571.155142:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123842688 00000100:00100000:3.0:1746155571.155158:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12287 00000100:00100000:3.0:1746155571.155164:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123842432:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155571.155182:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.155193:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec13d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113f3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.155237:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124617088:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155571.155278:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.155337:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12288 00000100:00100000:3.0:1746155571.155342:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123842688:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155571.155348:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.155356:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec144 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11401 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.155366:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.155367:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.155371:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec144 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11401 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.155381:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec144 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11401 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.155388:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a227c00, rc 0) 00000100:00100000:3.0:1746155571.155405:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123842688:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 63us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.155413:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12288 00000100:00100000:1.0:1746155571.155643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.155655:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.155667:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.155701:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.155715:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123842304 00000100:00100000:1.0:1746155571.155718:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123842304 00000100:00100000:2.0:1746155571.155727:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123842560 00000100:00100000:2.0:1746155571.155731:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123842560 00000100:00100000:1.0:1746155571.155732:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123842816 00000100:00100000:1.0:1746155571.155734:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123842816 00000100:00100000:1.0:1746155571.155743:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123842944 00000100:00100000:1.0:1746155571.155745:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123842944 00000100:00100000:1.0:1746155571.155755:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123843072 00000100:00100000:1.0:1746155571.155756:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123843072 00000100:00100000:2.0:1746155571.155768:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12289 00000100:00100000:2.0:1746155571.155774:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123842304:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155571.155780:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.155787:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ec14b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113ec expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.155808:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124617216:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155571.155836:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.155849:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12290 00000100:00100000:2.0:1746155571.155854:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123842816:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155571.155859:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.155865:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a600/0x844e5faceb5ec152 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11408 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.155873:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.155875:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.155879:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a600/0x844e5faceb5ec152 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11408 expref: 13 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.155887:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a600/0x844e5faceb5ec152 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11408 expref: 13 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.155894:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3a600, rc 0) 00000100:00100000:2.0:1746155571.155907:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123842816:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 54us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.155912:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12290 00000100:00100000:2.0:1746155571.155921:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12291 00000100:00100000:2.0:1746155571.155925:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123842560:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155571.155930:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.155936:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec159 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f113fa expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.155944:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.155945:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.155948:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec159 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113fa expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.155956:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec159 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113fa expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.155962:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b200, rc 0) 00000100:00100000:2.0:1746155571.155975:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123842560:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 49us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.155978:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12292 00000100:00100000:2.0:1746155571.155981:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12291 00000100:00100000:1.0:1746155571.155983:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123842944:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155571.155989:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155571.155991:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12293 00010000:00010000:1.0:1746155571.155994:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a125000/0x844e5faceb5ec160 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1140f expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.155995:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976123843072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.156001:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.156006:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ae00/0x844e5faceb5ec167 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11416 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155571.156014:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124617344:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155571.156026:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124617472:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155571.156034:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c64b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.156044:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155571.156261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.156584:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123843328 00000100:00100000:2.0:1746155571.156587:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123843328 00000100:00100000:2.0:1746155571.156674:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10055 00000100:00100000:2.0:1746155571.156680:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29253:x1830976123843328:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155571.156691:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.156700:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b000/0x844e5faceb5ec16e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1141d expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.156775:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec175 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.156785:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec175 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.156792:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec175 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.156802:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec17c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.156807:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec17c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.156811:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec17c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157284:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2600/0x844e5faceb5ec183 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157292:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2600/0x844e5faceb5ec183 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157298:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2600/0x844e5faceb5ec183 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155571.157306:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155571.157369:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec175 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157375:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec175 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157380:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec175 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157385:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3bc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.157388:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec175 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157394:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec175 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157402:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155571.157404:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.157407:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec175 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157412:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec175 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157849:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec17c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157855:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec17c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157860:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec17c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157863:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b025e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.157866:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec17c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157870:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec17c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157877:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9300) 00010000:00010000:2.0:1746155571.157879:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.157881:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec17c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157885:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b025e00/0x844e5faceb5ec17c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.157921:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3b000/0x844e5faceb5ec16e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1141d expref: 291 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.157930:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2600/0x844e5faceb5ec183 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1141d expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.157936:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.157938:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155571.157940:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136ab2600, rc 0) 00000100:00100000:2.0:1746155571.157982:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29253:x1830976123843328:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1301us (1721us total) trans 8589944004 rc 0/0 00000100:00100000:2.0:1746155571.157989:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10055 00000100:00100000:2.0:1746155571.158964:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124617088:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155571.158987:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec13d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113f3 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.158997:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5ec13d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113f3 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.159004:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0e00, rc 0) 00000100:00100000:2.0:1746155571.159027:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123842432:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3863us (4601us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155571.159033:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12287 00000100:00100000:1.0:1746155571.159582:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124617344:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155571.159598:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a125000/0x844e5faceb5ec160 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1140f expref: 13 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.159606:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a125000/0x844e5faceb5ec160 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1140f expref: 13 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.159616:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a125000, rc 0) 00000100:00100000:1.0:1746155571.159635:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123842944:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3652us (3967us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155571.159640:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12292 00000100:00100000:3.0:1746155571.159855:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124617472:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.159870:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ae00/0x844e5faceb5ec167 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11416 expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.159877:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ae00/0x844e5faceb5ec167 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11416 expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.159888:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3ae00, rc 0) 00000100:00100000:3.0:1746155571.159909:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123843072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3913us (4206us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155571.159914:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12293 00000100:00100000:2.0:1746155571.160071:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124617216:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155571.160085:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ec14b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113ec expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.160092:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ec14b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113ec expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.160099:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3a400, rc 0) 00000100:00100000:2.0:1746155571.160117:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123842304:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4344us (5013us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155571.160126:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12289 00000100:00100000:0.0:1746155571.167043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.167121:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123843584 00000100:00100000:3.0:1746155571.167130:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123843584 00000100:00100000:3.0:1746155571.167177:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4066 00000100:00100000:3.0:1746155571.167185:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29246:x1830976123843584:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155571.167874:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29246:x1830976123843584:12345-192.168.202.51@tcp:35:cat.0 Request processed in 688us (837us total) trans 8589944005 rc 0/0 00000100:00100000:3.0:1746155571.167880:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4066 00000100:00100000:2.0:1746155571.167969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.167988:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123843840 00000100:00100000:2.0:1746155571.167991:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123843840 00000100:00100000:0.0:1746155571.167991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.168009:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10056 00000100:00100000:2.0:1746155571.168013:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29251:x1830976123843840:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155571.168022:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.168035:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab3600/0x844e5faceb5ec191 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11424 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.168088:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.168099:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113d0 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.168105:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2600/0x844e5faceb5ec183 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1141d expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.168110:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.168137:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2600/0x844e5faceb5ec183 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1141d expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.168146:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2600/0x844e5faceb5ec183 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1141d expref: 289 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.168155:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124617600:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155571.168196:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113d0 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.168202:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113d0 expref: 8 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.168208:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124617728:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155571.168220:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.168232:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123843968 00000100:00100000:2.0:1746155571.168234:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123843968 00000100:00100000:2.0:1746155571.168378:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12294 00000100:00100000:2.0:1746155571.168383:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29253:x1830976123843968:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155571.168390:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.168399:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1142b expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.168413:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113a6 expref: 9 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.168420:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a600/0x844e5faceb5ec152 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11408 expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.168425:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5ec0d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113b4 expref: 21 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.168431:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.168432:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.168435:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2809856->3051519] (req 2809856->3051519) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 21 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.168449:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5ec0d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113b4 expref: 21 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.168456:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5ec0d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113b4 expref: 21 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.168463:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124617856:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155571.168519:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a600/0x844e5faceb5ec152 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11408 expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.168527:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a600/0x844e5faceb5ec152 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11408 expref: 8 pid: 1625 timeout: 800 lvb_type: 1 00000100:00100000:2.0:1746155571.168534:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124617984:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155571.168591:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113a6 expref: 9 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.168598:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113a6 expref: 9 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.168604:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124618112:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155571.171076:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.171104:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.171158:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124617600:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.171165:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124617728:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.171181:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155571.171202:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123844224 00000100:00100000:3.0:1746155571.171206:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123844224 00010000:00010000:3.0:1746155571.171224:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113d0 expref: 9 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.171238:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123844096 00000100:00100000:3.0:1746155571.171240:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123844096 00010000:00010000:3.0:1746155571.171246:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2600/0x844e5faceb5ec183 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1141d expref: 290 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.171256:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6185 00000100:00100000:3.0:1746155571.171261:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123844224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.171269:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.171273:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113d0 expref: 9 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.171281:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113d0 expref: 9 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.171294:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5610a00/0x844e5faceb5ec11a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113d0 expref: 9 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.171304:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.171307:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.171313:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.171317:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.171339:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123844224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.171344:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6185 00000100:00100000:3.0:1746155571.171354:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6186 00000100:00100000:3.0:1746155571.171358:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1960:x1830976123844096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.171363:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.171366:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2600/0x844e5faceb5ec183 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1141d expref: 290 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.171372:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2600/0x844e5faceb5ec183 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1141d expref: 290 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.171380:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2600/0x844e5faceb5ec183 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1141d expref: 290 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.171386:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.171389:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.171394:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.171398:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.171408:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.171417:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1960:x1830976123844096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 59us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.171421:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6186 00010000:00010000:3.0:1746155571.171430:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.171435:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155571.171446:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155571.171560:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab3600/0x844e5faceb5ec191 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11424 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.171571:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11424 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.171576:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.171578:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155571.171580:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136ab2000, rc 0) 00000100:00100000:3.0:1746155571.171597:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29251:x1830976123843840:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3584us (3629us total) trans 8589944006 rc 0/0 00000100:00100000:3.0:1746155571.171602:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10056 00000100:00100000:2.0:1746155571.171895:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.172241:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124617856:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155571.172249:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124617984:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155571.176388:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.176439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.176630:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123844480 00000100:00100000:1.0:1746155571.176638:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123844480 00010000:00010000:1.0:1746155571.176664:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5ec0d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113b4 expref: 22 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155571.176688:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6187 00000100:00100000:1.0:1746155571.176695:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123844480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155571.176705:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155571.176722:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5ec0d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113b4 expref: 22 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.176732:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5ec0d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113b4 expref: 22 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.176749:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5ec0d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113b4 expref: 22 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.176767:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155571.176797:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123844480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 102us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.176802:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6187 00000100:00100000:0.0:1746155571.180132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.180159:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.180177:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123844608 00000100:00100000:0.0:1746155571.180182:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123844608 00010000:00010000:0.0:1746155571.180206:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a600/0x844e5faceb5ec152 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11408 expref: 9 pid: 1625 timeout: 800 lvb_type: 1 00000100:00100000:0.0:1746155571.180228:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123844736 00000100:00100000:0.0:1746155571.180231:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123844736 00010000:00010000:0.0:1746155571.180240:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113a6 expref: 10 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746155571.180254:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6188 00000100:00100000:0.0:1746155571.180260:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123844608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155571.180269:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155571.180286:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a600/0x844e5faceb5ec152 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11408 expref: 9 pid: 1625 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746155571.180295:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a600/0x844e5faceb5ec152 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11408 expref: 9 pid: 1625 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746155571.180311:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a600/0x844e5faceb5ec152 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11408 expref: 9 pid: 1625 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746155571.180326:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155571.180353:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123844608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 93us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155571.180359:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6188 00000100:00100000:0.0:1746155571.180370:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6189 00000100:00100000:0.0:1746155571.180375:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123844736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155571.180380:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155571.180388:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113a6 expref: 10 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746155571.180395:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113a6 expref: 10 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746155571.180406:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155571.180408:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155571.180413:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.180420:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.180444:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155571.180455:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124618240:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155571.180500:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949240 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.180703:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123844352 00000100:00100000:3.0:1746155571.180708:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123844352 00000100:00100000:3.0:1746155571.180731:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10057 00000100:00100000:3.0:1746155571.180735:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29251:x1830976123844352:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155571.180749:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.180761:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1200/0x844e5faceb5ec1ad lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11432 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.180813:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.180822:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11424 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.180828:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.180844:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11424 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.180852:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11424 expref: 9 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.180859:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124618368:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.180886:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110840 going to sleep for 11 seconds 00010000:00010000:3.0:1746155571.180915:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0200/0x844e5faceb5ec0c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113a6 expref: 10 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.180923:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124618112:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.180941:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.180947:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b600, rc 0) 00000100:00100000:3.0:1746155571.180963:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29253:x1830976123843968:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 12580us (12973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.180969:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12294 00000100:00100000:2.0:1746155571.182053:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124618240:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155571.182064:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.183512:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976123844736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3122us (3337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.183520:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6189 00000100:00100000:1.0:1746155571.185075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.185649:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.185834:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123844992 00000100:00100000:3.0:1746155571.185841:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123844992 00002000:00100000:3.0:1746155571.185872:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2809856->2813951) req@ffff88008e26df80 x1830976123844992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.185886:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26df80 with x1830976123844992 ext(2809856->2813951) 00002000:00010000:3.0:1746155571.185891:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26df80 00000100:00100000:3.0:1746155571.185910:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4735 00000100:00100000:3.0:1746155571.185916:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123844992:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155571.186041:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123844992:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 124us (967us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155571.186047:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4735 00002000:00100000:3.0:1746155571.186052:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2809856->2813951) req@ffff88008e26df80 x1830976123844992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.186058:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26df80 with x1830976123844992 ext(2809856->2813951) 00002000:00010000:3.0:1746155571.186061:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26df80 00000100:00100000:3.0:1746155571.186082:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123845120 00000100:00100000:3.0:1746155571.186084:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123845120 00010000:00010000:3.0:1746155571.186096:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11424 expref: 10 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.186111:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6190 00000100:00100000:3.0:1746155571.186116:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123845120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.186124:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.186129:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11424 expref: 10 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.186138:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11424 expref: 10 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.186160:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.186164:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.186172:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.186177:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.186188:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.186203:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123845120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.186208:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6190 00010000:00010000:2.0:1746155571.186356:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136ab2000/0x844e5faceb5ec198 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11424 expref: 9 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.186372:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124618368:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155571.186385:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.186392:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.186396:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155571.186426:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155571.186430:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155571.186441:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.186464:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1200/0x844e5faceb5ec1ad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11432 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.186474:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11432 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.186484:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.186487:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155571.186488:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0600, rc 0) 00000100:00100000:2.0:1746155571.186523:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29251:x1830976123844352:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5787us (10142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.186529:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10057 00000100:00100000:0.0:1746155571.193209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.193244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.193729:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.194075:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123845248 00000100:00100000:3.0:1746155571.194083:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123845248 00000100:00100000:0.0:1746155571.194093:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.194159:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123845504 00000100:00100000:3.0:1746155571.194162:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123845504 00000100:00100000:1.0:1746155571.194168:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123845376 00000100:00100000:1.0:1746155571.194174:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123845376 00000100:00100000:3.0:1746155571.194177:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12295 00000100:00100000:3.0:1746155571.194185:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123845248:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155571.194215:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12296 00000100:00100000:3.0:1746155571.194220:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12297 00000100:00100000:1.0:1746155571.194224:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123845504:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:3.0:1746155571.194226:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123845376:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155571.194244:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.194245:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.194261:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136ab2600/0x844e5faceb5ec1c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11440 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.194261:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a124200/0x844e5faceb5ec1bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11447 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.194303:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124618496:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155571.194305:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124618624:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155571.194393:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123845760 00000100:00100000:2.0:1746155571.194398:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123845760 00002000:00100000:2.0:1746155571.194428:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3047424->3051519) req@ffff88009366f100 x1830976123845760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746155571.194489:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110240 going to sleep for 11 seconds 00010000:00010000:3.0:1746155571.194514:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.194519:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fed9c00/0x844e5faceb5ec1c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11439 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.194537:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124618752:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155571.194568:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1106c0 going to sleep for 11 seconds 00002000:00100000:2.0:1746155571.196342:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366f100 with x1830976123845760 ext(3047424->3051519) 00002000:00010000:2.0:1746155571.196348:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366f100 00000100:00100000:2.0:1746155571.196378:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4736 00000100:00100000:2.0:1746155571.196390:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976123845760:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155571.196611:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976123845760:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 223us (2517us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155571.196618:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4736 00002000:00100000:2.0:1746155571.196626:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3047424->3051519) req@ffff88009366f100 x1830976123845760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.196633:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366f100 with x1830976123845760 ext(3047424->3051519) 00002000:00010000:2.0:1746155571.196636:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366f100 00000100:00100000:1.0:1746155571.197355:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c64180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.198090:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124618496:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.198118:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136ab2600/0x844e5faceb5ec1c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11440 expref: 13 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.198128:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136ab2600/0x844e5faceb5ec1c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11440 expref: 13 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.198745:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136ab2600, rc 0) 00000100:00100000:3.0:1746155571.198772:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123845376:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4545us (5043us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155571.198778:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12297 00000100:00100000:0.0:1746155571.202741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.202910:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124618752:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.202942:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fed9c00/0x844e5faceb5ec1c9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11439 expref: 11 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.202957:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fed9c00/0x844e5faceb5ec1c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11439 expref: 11 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.202967:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fed9c00, rc 0) 00000100:00100000:3.0:1746155571.203013:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123845248:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8828us (9811us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155571.203021:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12295 00002000:00010000:1.0:1746155571.203177:0:1625:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime: 1746155570 -> 1746155571 00002000:00010000:1.0:1746155571.203181:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime: 1746155570 -> 1746155571 00000100:00100000:1.0:1746155571.203190:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124618624:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155571.203204:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a124200/0x844e5faceb5ec1bb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11447 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.203213:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a124200/0x844e5faceb5ec1bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11447 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.203228:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a124200, rc 0) 00000100:00100000:1.0:1746155571.203247:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123845504:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 9025us (10002us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155571.203252:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12296 00000100:00100000:2.0:1746155571.203275:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123846016 00000100:00100000:2.0:1746155571.203283:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123846016 00000100:00100000:2.0:1746155571.203625:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4067 00000100:00100000:2.0:1746155571.203635:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29253:x1830976123846016:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155571.204287:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29253:x1830976123846016:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 654us (1554us total) trans 8589944007 rc 0/0 00000100:00100000:2.0:1746155571.204293:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4067 00000100:00100000:0.0:1746155571.213796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.213910:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123846272 00000100:00100000:2.0:1746155571.213919:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123846272 00000100:00100000:2.0:1746155571.213957:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10058 00000100:00100000:2.0:1746155571.213964:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29251:x1830976123846272:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155571.213980:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.213995:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec1d0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1144e expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.214067:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480200/0x844e5faceb5ec1d7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.214078:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093480200/0x844e5faceb5ec1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.214087:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093480200/0x844e5faceb5ec1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.214096:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480200/0x844e5faceb5ec1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.214101:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093480200/0x844e5faceb5ec1d7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.214106:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093480200/0x844e5faceb5ec1d7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.214114:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093480200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.214117:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093480200/0x844e5faceb5ec1d7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.214122:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093480200/0x844e5faceb5ec1d7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.214129:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.214131:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155571.214133:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093480200/0x844e5faceb5ec1d7 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.214137:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093480200/0x844e5faceb5ec1d7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.215654:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec1d0 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1144e expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.215662:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec1d0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1144e expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.215672:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093481000, rc 0) 00000100:00100000:2.0:1746155571.215717:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29251:x1830976123846272:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1753us (1930us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155571.215723:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10058 00000100:00100000:0.0:1746155571.219394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.220272:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123846528 00000100:00100000:2.0:1746155571.220282:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123846528 00000100:00100000:2.0:1746155571.221140:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4068 00000100:00100000:2.0:1746155571.221150:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29251:x1830976123846528:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:2.0:1746155571.221339:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29251:x1830976123846528:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 190us (1952us total) trans 8589944008 rc 0/0 00000100:00100000:2.0:1746155571.221344:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4068 00000100:00100000:0.0:1746155571.225732:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.226016:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123846656 00000100:00100000:1.0:1746155571.226023:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123846656 00000100:00100000:1.0:1746155571.226214:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12298 00000100:00100000:1.0:1746155571.226223:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29250:x1830976123846656:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155571.226237:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.226253:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11455 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.226276:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1137c expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.226284:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec159 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113fa expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.226290:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5ec0aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1138a expref: 13 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.226296:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.226297:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.226300:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1720320->2097151] (req 1720320->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.226327:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5ec0aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1138a expref: 13 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.226337:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5ec0aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1138a expref: 13 pid: 20796 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155571.226347:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124618880:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155571.226434:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec159 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113fa expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.226442:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec159 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113fa expref: 11 pid: 1625 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746155571.226449:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124619008:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155571.226478:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1137c expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.226485:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1137c expref: 16 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155571.226491:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124619136:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155571.226532:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c64180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155571.231015:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.231270:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123846784 00000100:00100000:3.0:1746155571.231277:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123846784 00000100:00100000:0.0:1746155571.231286:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155571.231306:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec159 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113fa expref: 12 pid: 1625 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746155571.231338:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124618880:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155571.231349:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124619008:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155571.231355:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124619136:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155571.231390:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1720320->2097151] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.231400:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a125e00, rc 0) 00000100:00100000:1.0:1746155571.231439:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29250:x1830976123846656:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5218us (5714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.231446:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12298 00000100:00100000:3.0:1746155571.231489:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123846912 00000100:00100000:3.0:1746155571.231492:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123846912 00010000:00010000:3.0:1746155571.231522:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1137c expref: 17 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746155571.231529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.231536:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123847040 00000100:00100000:3.0:1746155571.231538:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123847040 00010000:00010000:3.0:1746155571.231556:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5ec0aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1138a expref: 13 pid: 20796 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746155571.231557:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6191 00000100:00100000:0.0:1746155571.231564:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123846784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155571.231568:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6192 00000100:00100000:3.0:1746155571.231572:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123846912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155571.231574:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.231577:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.231590:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1137c expref: 17 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746155571.231590:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec159 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113fa expref: 12 pid: 1625 timeout: 800 lvb_type: 1 00010000:00010000:3.0:1746155571.231599:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1137c expref: 17 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.231638:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6193 00000100:00100000:2.0:1746155571.231644:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123847040:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.231649:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155571.231689:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec159 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113fa expref: 12 pid: 1625 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746155571.231706:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec159 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113fa expref: 12 pid: 1625 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746155571.231718:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155571.231733:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123846784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 170us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155571.231738:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6191 00010000:00010000:2.0:1746155571.231801:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5ec0aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1138a expref: 13 pid: 20796 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.231810:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5ec0aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1138a expref: 13 pid: 20796 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.231820:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5ec0aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1138a expref: 13 pid: 20796 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.231843:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.231860:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123847040:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 217us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.231866:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6193 00010000:00010000:3.0:1746155571.232089:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b4000/0x844e5faceb5ec09c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1137c expref: 17 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.232151:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.232152:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.232158:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.232166:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.232189:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.232200:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124619264:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155571.232495:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1106c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155571.233765:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.233839:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124619264:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155571.233851:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.233875:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123846912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2302us (2589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.233883:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6192 00000100:00100000:2.0:1746155571.233944:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123847296 00000100:00100000:2.0:1746155571.233948:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123847296 00002000:00100000:2.0:1746155571.233973:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1720320->1724415) req@ffff88009b880e00 x1830976123847296/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.233981:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880e00 with x1830976123847296 ext(1720320->1724415) 00002000:00010000:2.0:1746155571.233984:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b880e00 00000100:00100000:2.0:1746155571.234004:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4737 00000100:00100000:2.0:1746155571.234010:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123847296:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155571.234132:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123847296:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 121us (368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155571.234138:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4737 00002000:00100000:2.0:1746155571.234143:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1720320->1724415) req@ffff88009b880e00 x1830976123847296/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.234149:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880e00 with x1830976123847296 ext(1720320->1724415) 00002000:00010000:2.0:1746155571.234152:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b880e00 00000100:00100000:0.0:1746155571.237482:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.237602:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123847424 00000100:00100000:1.0:1746155571.237609:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123847424 00000100:00100000:1.0:1746155571.237825:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12299 00000100:00100000:1.0:1746155571.237833:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29250:x1830976123847424:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155571.237846:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.237859:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1145c expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.237882:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1139f expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.237889:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec144 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11401 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.237895:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5ec0cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113ad expref: 13 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.237900:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.237902:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.237905:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->2338815] (req 2097152->2338815) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.237928:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5ec0cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113ad expref: 13 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.237938:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5ec0cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113ad expref: 13 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155571.237948:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124619392:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155571.238252:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec144 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11401 expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.238261:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec144 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11401 expref: 10 pid: 8438 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746155571.238269:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124619520:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155571.238290:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1139f expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.238296:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1139f expref: 15 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155571.238303:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124619648:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155571.238316:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c64180 going to sleep for 11 seconds 00000100:00100000:1.0:1746155571.240559:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124619392:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155571.240571:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124619520:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155571.241000:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.241128:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123847552 00000100:00100000:3.0:1746155571.241134:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123847552 00010000:00010000:3.0:1746155571.241163:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec144 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11401 expref: 11 pid: 8438 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746155571.241187:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124619648:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.241198:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6194 00000100:00100000:3.0:1746155571.241204:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123847552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155571.241209:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->2338815] (req 2097152->2338815) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.241214:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155571.241222:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a125200, rc 0) 00010000:00010000:3.0:1746155571.241233:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec144 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11401 expref: 11 pid: 8438 timeout: 800 lvb_type: 1 00010000:00010000:3.0:1746155571.241242:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec144 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11401 expref: 11 pid: 8438 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746155571.241255:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29250:x1830976123847424:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3423us (3778us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155571.241259:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec144 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11401 expref: 11 pid: 8438 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746155571.241262:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12299 00010000:00010000:3.0:1746155571.241271:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.241289:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123847552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.241294:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6194 00000100:00100000:0.0:1746155571.243863:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.243951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.244205:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123847808 00000100:00100000:3.0:1746155571.244212:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123847808 00010000:00010000:3.0:1746155571.244239:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1139f expref: 16 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.244262:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123847680 00000100:00100000:3.0:1746155571.244264:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123847680 00010000:00010000:3.0:1746155571.244273:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5ec0cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113ad expref: 13 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.244301:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6195 00000100:00100000:3.0:1746155571.244308:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123847808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.244319:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.244339:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1139f expref: 16 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.244349:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1139f expref: 16 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.244367:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec0bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1139f expref: 16 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.244379:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.244413:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976123847808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 105us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.244419:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6195 00000100:00100000:3.0:1746155571.244436:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6196 00000100:00100000:3.0:1746155571.244441:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123847680:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.244447:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.244454:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5ec0cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113ad expref: 13 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.244462:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5ec0cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113ad expref: 13 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.244471:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5ec0cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113ad expref: 13 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.244479:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.244481:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.244487:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.244494:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.244542:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.244565:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124619776:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155571.244613:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110240 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.246367:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124619776:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155571.246382:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.246954:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123847680:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2511us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.246962:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6196 00000100:00100000:0.0:1746155571.250115:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.250361:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123848064 00000100:00100000:3.0:1746155571.250368:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123848064 00002000:00100000:3.0:1746155571.250401:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2334720->2338815) req@ffff880095269f80 x1830976123848064/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.250409:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269f80 with x1830976123848064 ext(2334720->2338815) 00002000:00010000:3.0:1746155571.250414:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095269f80 00000100:00100000:2.0:1746155571.250624:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4738 00000100:00100000:2.0:1746155571.250632:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123848064:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155571.250771:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123848064:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 139us (661us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155571.250777:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4738 00002000:00100000:2.0:1746155571.250782:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2334720->2338815) req@ffff880095269f80 x1830976123848064/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.250789:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269f80 with x1830976123848064 ext(2334720->2338815) 00002000:00010000:2.0:1746155571.250792:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095269f80 00000100:00100000:0.0:1746155571.252351:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.252535:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123848320 00000100:00100000:2.0:1746155571.252552:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123848320 00000100:00100000:2.0:1746155571.252587:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4069 00000100:00100000:2.0:1746155571.252593:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29250:x1830976123848320:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155571.252813:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29250:x1830976123848320:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 219us (464us total) trans 8589944009 rc 0/0 00000100:00100000:2.0:1746155571.252820:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4069 00000100:00100000:0.0:1746155571.265055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.265218:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123848576 00000100:00100000:2.0:1746155571.265226:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123848576 00000100:00100000:2.0:1746155571.265263:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10059 00000100:00100000:2.0:1746155571.265270:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29263:x1830976123848576:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.265291:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.265307:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093480c00/0x844e5faceb5ec1ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11463 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.265389:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec1f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265399:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec1f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265408:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec1f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265417:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec1fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265421:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec1fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265425:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec1fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265525:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec201 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265532:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec201 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265537:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec201 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155571.265734:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155571.265802:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec1f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265808:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec1f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265812:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec1f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265817:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093480000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.265820:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec1f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265826:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec1f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265835:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155571.265837:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.265840:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec1f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265844:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec1f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265865:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec1fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265869:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec1fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265876:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec1fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265880:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093480800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.265882:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec1fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265886:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec1fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265890:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9f00) 00010000:00010000:2.0:1746155571.265892:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.265894:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec1fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265897:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec1fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.265923:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093480c00/0x844e5faceb5ec1ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11463 expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.265932:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec201 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11463 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.265936:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.265938:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155571.265939:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093481000, rc 0) 00000100:00100000:2.0:1746155571.266265:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:29263:x1830976123848576:12345-192.168.202.51@tcp:101:cat.0 Request processed in 994us (1217us total) trans 8589944010 rc 0/0 00000100:00100000:2.0:1746155571.266271:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10059 00000100:00100000:0.0:1746155571.268058:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.268095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.268297:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123848704 00000100:00100000:1.0:1746155571.268302:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123848704 00000100:00100000:1.0:1746155571.268335:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123848832 00000100:00100000:1.0:1746155571.268337:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123848832 00000100:00100000:1.0:1746155571.268350:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12300 00000100:00100000:1.0:1746155571.268356:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123848704:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155571.268366:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.268378:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a124800/0x844e5faceb5ec20f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1146a expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155571.268415:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124619904:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155571.268468:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c64180 going to sleep for 11 seconds 00000100:00100000:1.0:1746155571.268492:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12301 00000100:00100000:1.0:1746155571.268497:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976123848832:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155571.268524:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.268530:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a124400/0x844e5faceb5ec216 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11471 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155571.269182:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124620032:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155571.269644:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c640c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746155571.273961:0:1625:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155570 -> 1746155571 00002000:00010000:1.0:1746155571.273968:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155570 -> 1746155571 00000100:00100000:1.0:1746155571.273987:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124619904:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155571.274013:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a124800/0x844e5faceb5ec20f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1146a expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.274024:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a124800/0x844e5faceb5ec20f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1146a expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.274037:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a124800, rc 0) 00000100:00100000:1.0:1746155571.274073:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976123848704:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5716us (6017us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155571.274080:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12300 00000100:00100000:2.0:1746155571.274332:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124620032:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155571.274347:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a124400/0x844e5faceb5ec216 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11471 expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.274355:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a124400/0x844e5faceb5ec216 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11471 expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.274375:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a124400, rc 0) 00000100:00100000:2.0:1746155571.274396:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976123848832:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5897us (6300us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155571.274401:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12301 00000100:00100000:0.0:1746155571.286740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.286779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.286819:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.286903:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123849088 00000100:00100000:1.0:1746155571.286903:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123849344 00000100:00100000:2.0:1746155571.286911:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123849088 00000100:00100000:1.0:1746155571.286911:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123849344 00002000:00100000:2.0:1746155571.286951:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009526b800 x1830976123849088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.286952:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1413119) req@ffff88009526a300 x1830976123849344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.286960:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526b800 with x1830976123849088 ext(0->1048575) 00002000:00100000:1.0:1746155571.286960:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526a300 with x1830976123849344 ext(1048576->1413119) 00002000:00010000:2.0:1746155571.286965:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009526b800 00002000:00010000:1.0:1746155571.286965:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526a300 00000100:00100000:2.0:1746155571.286979:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123849600 00000100:00100000:2.0:1746155571.286981:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123849600 00002000:00100000:2.0:1746155571.286991:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1097728->2097151) req@ffff88009526a680 x1830976123849600/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.286997:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526a680 with x1830976123849600 ext(1097728->2097151) 00002000:00010000:2.0:1746155571.287000:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526a680 00000100:00100000:1.0:1746155571.287082:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4739 00000100:00100000:1.0:1746155571.287089:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976123849088:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155571.287229:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4740 00000100:00100000:2.0:1746155571.287235:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976123849344:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155571.287338:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4741 00000100:00100000:2.0:1746155571.287343:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976123849600:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155571.294172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.294258:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123849856 00000100:00100000:2.0:1746155571.294265:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123849856 00000100:00100000:2.0:1746155571.294301:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10060 00000100:00100000:2.0:1746155571.294308:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29266:x1830976123849856:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.294327:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.294344:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093480c00/0x844e5faceb5ec21d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11478 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.294438:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec224 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294448:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec224 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294457:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec224 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294468:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec22b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294473:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec22b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294477:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec22b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294595:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec232 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294605:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec232 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294610:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec232 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155571.294617:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155571.294685:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec224 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294691:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec224 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294697:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec224 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294702:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093480800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.294710:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec224 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294715:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec224 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294723:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155571.294726:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.294729:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294736:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093480800/0x844e5faceb5ec224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294806:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec22b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294815:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec22b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294819:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec22b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294823:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093480000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.294826:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec22b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294834:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec22b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294841:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9200) 00010000:00010000:2.0:1746155571.294843:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.294845:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec22b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294849:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5ec22b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.294881:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093480c00/0x844e5faceb5ec21d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11478 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.294891:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec232 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11478 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.294896:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.294898:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155571.294900:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a227c00, rc 0) 00000100:00100000:2.0:1746155571.294946:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29266:x1830976123849856:12345-192.168.202.51@tcp:101:cat.0 Request processed in 638us (782us total) trans 8589944011 rc 0/0 00000100:00100000:2.0:1746155571.294953:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10060 00000100:00100000:3.0:1746155571.298077:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123849344:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10834us (11289us total) trans 0 rc 364544/364544 00000100:00100000:3.0:1746155571.298087:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4740 00002000:00100000:3.0:1746155571.298097:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1413119) req@ffff88009526a300 x1830976123849344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 364544/364544 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.298106:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526a300 with x1830976123849344 ext(1048576->1413119) 00002000:00010000:3.0:1746155571.298111:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526a300 00000100:00100000:2.0:1746155571.300093:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976123849600:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12744us (13268us total) trans 0 rc 999424/999424 00000100:00100000:2.0:1746155571.300103:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4741 00002000:00100000:2.0:1746155571.300110:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1097728->2097151) req@ffff88009526a680 x1830976123849600/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.300118:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526a680 with x1830976123849600 ext(1097728->2097151) 00002000:00010000:2.0:1746155571.300122:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526a680 00000100:00100000:0.0:1746155571.301240:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976123849088:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14149us (14505us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155571.301247:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4739 00002000:00100000:0.0:1746155571.301252:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009526b800 x1830976123849088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155571.301259:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526b800 with x1830976123849088 ext(0->1048575) 00002000:00010000:0.0:1746155571.301262:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009526b800 00000100:00100000:0.0:1746155571.305310:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.305344:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.305359:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123849984 00000100:00100000:2.0:1746155571.305366:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123849984 00000100:00100000:0.0:1746155571.305421:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.305423:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123850112 00000100:00100000:2.0:1746155571.305426:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123850112 00000100:00100000:1.0:1746155571.305872:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123850240 00000100:00100000:1.0:1746155571.305876:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123850240 00000100:00100000:2.0:1746155571.305891:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12302 00000100:00100000:2.0:1746155571.305900:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123849984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.305917:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.305932:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ec240 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1147f expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.305970:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124620160:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155571.306045:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.306060:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12303 00000100:00100000:2.0:1746155571.306065:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123850112:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.306071:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.306077:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec247 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11486 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.306099:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124620288:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155571.306116:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.308091:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12304 00000100:00100000:3.0:1746155571.308101:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123850240:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.308112:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.308123:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9d400/0x844e5faceb5ec24e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1148d expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.308154:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124620416:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155571.308223:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.310572:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124620160:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155571.310600:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ec240 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1147f expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.310610:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ec240 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1147f expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.310628:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093480400, rc 0) 00000100:00100000:2.0:1746155571.310660:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123849984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4761us (5356us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155571.310666:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12302 00000100:00100000:3.0:1746155571.311207:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124620288:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.311222:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec247 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11486 expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.311230:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0c00/0x844e5faceb5ec247 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11486 expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.311474:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0c00, rc 0) 00000100:00100000:3.0:1746155571.311521:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123850112:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5455us (6174us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155571.311527:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12303 00000100:00100000:1.0:1746155571.322909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.322909:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.323134:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123850368 00000100:00100000:3.0:1746155571.323142:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123850368 00000100:00100000:0.0:1746155571.323700:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124620416:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155571.323725:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9d400/0x844e5faceb5ec24e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1148d expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155571.323742:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9d400/0x844e5faceb5ec24e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1148d expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155571.323754:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b9d400, rc 0) 00000100:00100000:0.0:1746155571.323789:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976123850240:12345-192.168.202.51@tcp:101:cat.0 Request processed in 15690us (18367us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155571.323795:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12304 00000100:00100000:0.0:1746155571.323819:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12305 00000100:00100000:0.0:1746155571.323842:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:29263:x1830976123850368:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155571.323913:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123850624 00000100:00100000:2.0:1746155571.323917:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123850624 00010000:00010000:3.0:1746155571.323933:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155571.323944:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10061 00010000:00010000:3.0:1746155571.323946:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11494 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.323949:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:29268:x1830976123850624:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155571.323960:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.323967:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.323970:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec25c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1149b expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.323973:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.323975:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.323978:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11494 expref: 16 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.324000:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.324011:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 11 pid: 1625 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.324024:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124620544:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155571.324038:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.324047:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11432 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.324055:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec201 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11463 expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.324060:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec232 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11478 expref: 14 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.324065:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155571.324073:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1103c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746155571.324080:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec232 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11478 expref: 14 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.324087:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec232 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11478 expref: 14 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.324095:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124620672:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155571.324124:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec201 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11463 expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.324130:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec201 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11463 expref: 293 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.324138:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124620800:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155571.324158:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11432 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.324165:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11432 expref: 8 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.324172:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124620928:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155571.324193:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.325773:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124620672:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.325901:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124620544:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.325917:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11494 expref: 16 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.325929:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b9c000, rc 0) 00000100:00100000:3.0:1746155571.325985:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:29263:x1830976123850368:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2159us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.325991:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12305 00000100:00100000:0.0:1746155571.326047:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.326099:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123850880 00000100:00100000:3.0:1746155571.326103:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123850880 00010000:00010000:3.0:1746155571.326118:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec232 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11478 expref: 15 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.326146:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6197 00000100:00100000:3.0:1746155571.326151:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123850880:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.326160:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.326164:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec232 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11478 expref: 15 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.326172:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec232 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11478 expref: 15 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.326188:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227c00/0x844e5faceb5ec232 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11478 expref: 15 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.326232:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.326236:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.326242:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.326246:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.326274:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123850880:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 122us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.326279:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6197 00000100:00100000:0.0:1746155571.327157:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.327181:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.327195:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123850752 00000100:00100000:1.0:1746155571.327199:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123850752 00002000:00100000:1.0:1746155571.327223:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1720320->2097151) req@ffff88012cded500 x1830976123850752/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.327231:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded500 with x1830976123850752 ext(1720320->2097151) 00010000:00010000:1.0:1746155571.327236:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.327245:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00002000:00010000:1.0:1746155571.327251:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cded500 00000100:00100000:2.0:1746155571.327263:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124620800:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155571.327265:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 745 00000100:00100000:1.0:1746155571.327270:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123850752:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155571.327341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.327352:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124620928:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155571.327368:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155571.327380:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123851008 00000100:00100000:2.0:1746155571.327382:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123851008 00010000:00010000:2.0:1746155571.327394:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec201 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11463 expref: 294 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.327408:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123851136 00000100:00100000:2.0:1746155571.327410:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123851136 00010000:00010000:2.0:1746155571.327416:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11432 expref: 9 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.327426:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6198 00000100:00100000:2.0:1746155571.327430:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1960:x1830976123851008:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.327436:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.327440:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec201 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11463 expref: 294 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.327447:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec201 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11463 expref: 294 pid: 27374 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.327449:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6199 00000100:00100000:3.0:1746155571.327457:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123851136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.327460:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec201 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11463 expref: 294 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.327464:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.327472:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.327473:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11432 expref: 9 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.327475:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.327481:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.327484:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.327523:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1960:x1830976123851008:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 91us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.327528:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6198 00010000:00010000:3.0:1746155571.327573:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11432 expref: 9 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.327585:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0600/0x844e5faceb5ec1b4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11432 expref: 9 pid: 27374 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.327594:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.327596:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.327602:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.327608:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155571.327617:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.327633:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123851136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 178us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.327638:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6199 00000100:00100000:0.0:1746155571.328070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.328269:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123851392 00000100:00100000:3.0:1746155571.328273:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123851392 00002000:00100000:3.0:1746155571.328288:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012cdee300 x1830976123851392/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.328295:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdee300 with x1830976123851392 ext(0->1048575) 00002000:00010000:3.0:1746155571.328298:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdee300 00000100:00100000:3.0:1746155571.328311:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4742 00000100:00100000:3.0:1746155571.328317:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123851392:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:2.0:1746155571.328537:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.328553:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155571.328569:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155571.328663:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec25c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1149b expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.328674:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1149b expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.328680:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.328682:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155571.328685:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1000, rc 0) 00000100:00100000:2.0:1746155571.328717:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:29268:x1830976123850624:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4767us (5810us total) trans 8589944012 rc 0/0 00000100:00100000:2.0:1746155571.328723:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10061 00000100:00100000:1.0:1746155571.336112:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123850752:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 8832us (8946us total) trans 21474840622 rc 0/0 00000100:00100000:1.0:1746155571.336122:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 745 00002000:00100000:1.0:1746155571.336133:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1720320->2097151) req@ffff88012cded500 x1830976123850752/t21474840622(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/448 e 0 to 0 dl 1746155582 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.336142:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded500 with x1830976123850752 ext(1720320->2097151) 00010000:00010000:1.0:1746155571.336154:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 16 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.336167:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 16 pid: 1625 timeout: 800 lvb_type: 0 00002000:00010000:1.0:1746155571.336173:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cded500 00000100:00100000:0.0:1746155571.339262:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.339367:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123851520 00000100:00100000:1.0:1746155571.339374:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123851520 00010000:00010000:1.0:1746155571.339398:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 16 pid: 1625 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155571.339420:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6200 00000100:00100000:1.0:1746155571.339427:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123851520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155571.339436:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155571.339451:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 16 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.339465:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 16 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.339483:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a125e00/0x844e5faceb5ec1de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11455 expref: 16 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.339498:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.339500:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.339519:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11494 expref: 15 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.339526:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11494 expref: 15 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.339566:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11494 expref: 15 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155571.339576:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124621056:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155571.339640:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c64180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.340285:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123851392:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11966us (12213us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155571.340563:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4742 00002000:00100000:3.0:1746155571.340572:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012cdee300 x1830976123851392/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.340580:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdee300 with x1830976123851392 ext(0->1048575) 00002000:00010000:3.0:1746155571.340584:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdee300 00000100:00100000:1.0:1746155571.341461:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124621056:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155571.341474:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155571.341495:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123851520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2068us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.341520:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6200 00000100:00100000:0.0:1746155571.343713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.343800:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123851776 00000100:00100000:3.0:1746155571.343807:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123851776 00002000:00100000:3.0:1746155571.343837:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012cdece00 x1830976123851776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.343845:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdece00 with x1830976123851776 ext(1048576->2097151) 00002000:00010000:3.0:1746155571.343850:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdece00 00000100:00100000:3.0:1746155571.343878:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4743 00000100:00100000:3.0:1746155571.343885:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123851776:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155571.350555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.350727:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123851904 00000100:00100000:3.0:1746155571.350739:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123851904 00000100:00100000:3.0:1746155571.350778:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12306 00000100:00100000:3.0:1746155571.350785:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29266:x1830976123851904:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.350801:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.350815:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114a2 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.350838:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.350844:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.350846:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.350850:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a2 expref: 10 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.350872:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.350883:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 19 pid: 29728 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.350894:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124621184:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.351435:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.353499:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123851776:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9607us (9785us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155571.353534:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4743 00002000:00100000:3.0:1746155571.353554:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012cdece00 x1830976123851776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.353563:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdece00 with x1830976123851776 ext(1048576->2097151) 00002000:00010000:3.0:1746155571.353568:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdece00 00000100:00100000:0.0:1746155571.354906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.354999:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124621184:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.355023:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a2 expref: 10 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.355037:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b9c600, rc 0) 00000100:00100000:3.0:1746155571.355078:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29266:x1830976123851904:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4294us (4541us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.355086:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12306 00000100:00100000:2.0:1746155571.355377:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123852032 00000100:00100000:2.0:1746155571.355384:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123852032 00002000:00100000:2.0:1746155571.355411:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1413120->2097151) req@ffff88012cdef800 x1830976123852032/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.355419:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdef800 with x1830976123852032 ext(1413120->2097151) 00010000:00010000:2.0:1746155571.355425:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 20 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.355435:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 20 pid: 29728 timeout: 800 lvb_type: 0 00002000:00010000:2.0:1746155571.355441:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdef800 00000100:00100000:2.0:1746155571.355465:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 746 00000100:00100000:2.0:1746155571.355472:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123852032:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155571.358916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.360390:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123852160 00000100:00100000:3.0:1746155571.360399:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123852160 00000100:00100000:3.0:1746155571.360443:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12307 00000100:00100000:3.0:1746155571.360450:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:29263:x1830976123852160:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.360467:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.360481:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114a9 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.360518:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.360525:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.360527:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.360529:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a9 expref: 17 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.360564:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.360574:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.360585:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124621312:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.360652:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.365340:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124621312:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.365365:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a9 expref: 17 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.365381:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b9ca00, rc 0) 00000100:00100000:3.0:1746155571.365429:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:29263:x1830976123852160:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4978us (6518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.365436:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12307 00000100:00100000:2.0:1746155571.365566:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.365588:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123852288 00000100:00100000:1.0:1746155571.365595:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123852288 00002000:00100000:1.0:1746155571.365632:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2338815) req@ffff88012fe8f480 x1830976123852288/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.365641:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8f480 with x1830976123852288 ext(2097152->2338815) 00010000:00010000:1.0:1746155571.365648:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 13 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.365657:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 13 pid: 1625 timeout: 800 lvb_type: 0 00002000:00010000:1.0:1746155571.365664:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fe8f480 00000100:00100000:1.0:1746155571.365691:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 747 00000100:00100000:1.0:1746155571.365698:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123852288:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155571.368218:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123852288:12345-192.168.202.51@tcp:4:cat.0 Request processed in 2514us (2646us total) trans 21474840623 rc 0/0 00000100:00100000:1.0:1746155571.368226:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 747 00002000:00100000:1.0:1746155571.368234:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2338815) req@ffff88012fe8f480 x1830976123852288/t21474840623(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/448 e 0 to 0 dl 1746155582 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.368241:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8f480 with x1830976123852288 ext(2097152->2338815) 00010000:00010000:1.0:1746155571.368249:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 15 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.368259:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 15 pid: 1625 timeout: 800 lvb_type: 0 00002000:00010000:1.0:1746155571.368264:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fe8f480 00000100:00100000:3.0:1746155571.371203:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123852032:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 15723us (16290us total) trans 17179873235 rc 0/0 00000100:00100000:3.0:1746155571.371213:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 746 00002000:00100000:3.0:1746155571.371222:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1413120->2097151) req@ffff88012cdef800 x1830976123852032/t17179873235(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/448 e 0 to 0 dl 1746155582 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.371231:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdef800 with x1830976123852032 ext(1413120->2097151) 00010000:00010000:3.0:1746155571.371239:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 22 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.371249:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 22 pid: 29728 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746155571.371255:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdef800 00000100:00100000:0.0:1746155571.371498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.371594:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123852416 00000100:00100000:1.0:1746155571.371602:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123852416 00010000:00010000:1.0:1746155571.371625:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 15 pid: 1625 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155571.371657:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6201 00000100:00100000:1.0:1746155571.371663:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1962:x1830976123852416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155571.371674:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155571.371688:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 15 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.371697:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 15 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.371717:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a125200/0x844e5faceb5ec1e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2338815) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1145c expref: 15 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.371730:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.371732:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.371738:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a9 expref: 16 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.371745:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a9 expref: 16 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.371769:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a9 expref: 16 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155571.371783:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124621440:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155571.371836:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c64180 going to sleep for 11 seconds 00000100:00100000:1.0:1746155571.375185:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124621440:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155571.375204:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155571.375256:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123852416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3591us (3757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.375266:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6201 00000100:00100000:0.0:1746155571.376264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.376328:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123852544 00000100:00100000:1.0:1746155571.376334:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123852544 00010000:00010000:1.0:1746155571.376356:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 22 pid: 29728 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155571.376375:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6202 00000100:00100000:1.0:1746155571.376381:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123852544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155571.376392:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155571.376410:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 22 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.376420:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 22 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.376439:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b4c00/0x844e5faceb5ec087 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11367 expref: 22 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.376457:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.376459:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.376465:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a2 expref: 9 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.376472:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a2 expref: 9 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.376520:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a2 expref: 9 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155571.376532:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124621568:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155571.376607:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155571.378375:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.378443:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123852800 00000100:00100000:2.0:1746155571.378448:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123852800 00000100:00100000:2.0:1746155571.378473:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10062 00000100:00100000:2.0:1746155571.378479:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29271:x1830976123852800:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155571.378496:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.378527:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec27f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114b0 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155571.379192:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124621568:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155571.379204:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155571.379244:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123852544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2862us (2981us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155571.379250:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6202 00010000:00010000:2.0:1746155571.379434:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58800/0x844e5faceb5ec286 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379445:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58800/0x844e5faceb5ec286 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379454:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58800/0x844e5faceb5ec286 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379466:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec28d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379471:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec28d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379476:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec28d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379665:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec294 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379673:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec294 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379679:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec294 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155571.379686:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155571.379757:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58800/0x844e5faceb5ec286 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379763:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58800/0x844e5faceb5ec286 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379770:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58800/0x844e5faceb5ec286 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379775:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca58800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.379778:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58800/0x844e5faceb5ec286 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379782:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58800/0x844e5faceb5ec286 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379789:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155571.379791:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.379794:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58800/0x844e5faceb5ec286 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379798:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58800/0x844e5faceb5ec286 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379810:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec28d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379814:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec28d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379818:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec28d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379821:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca59400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.379823:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec28d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379828:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec28d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379836:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9f00) 00010000:00010000:2.0:1746155571.379838:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.379839:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec28d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379843:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec28d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.379876:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec27f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b0 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.379886:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec294 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b0 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.379892:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.379894:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155571.379896:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca58600, rc 0) 00000100:00100000:2.0:1746155571.380730:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29271:x1830976123852800:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2249us (2355us total) trans 8589944013 rc 0/0 00000100:00100000:2.0:1746155571.380736:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10062 00000100:00100000:0.0:1746155571.381045:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.381088:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123853056 00000100:00100000:3.0:1746155571.381093:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123853056 00002000:00100000:3.0:1746155571.381117:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88012cdee680 x1830976123853056/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.381125:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdee680 with x1830976123853056 ext(1048576->2097151) 00002000:00010000:3.0:1746155571.381128:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdee680 00000100:00100000:1.0:1746155571.381178:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4744 00000100:00100000:1.0:1746155571.381186:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123853056:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155571.384356:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.385049:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123853312 00000100:00100000:2.0:1746155571.385057:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123853312 00000100:00100000:2.0:1746155571.385101:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 596 00000100:00100000:2.0:1746155571.385117:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123853312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.385131:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.385158:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec294 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b0 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.385189:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.385193:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155571.385996:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.386034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.386065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.386413:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123853312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1303us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155571.386413:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123853440 00000100:00100000:0.0:1746155571.386419:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123853440 00000100:00100000:2.0:1746155571.386422:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 596 00002000:00100000:0.0:1746155571.386448:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800944ae680 x1830976123853440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155571.386456:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ae680 with x1830976123853440 ext(2097152->3145727) 00002000:00010000:0.0:1746155571.386459:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ae680 00000100:00100000:0.0:1746155571.386469:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123853696 00000100:00100000:0.0:1746155571.386471:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123853696 00002000:00100000:0.0:1746155571.386480:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800944ad880 x1830976123853696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155571.386486:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ad880 with x1830976123853696 ext(3145728->4194303) 00002000:00010000:0.0:1746155571.386488:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ad880 00000100:00100000:0.0:1746155571.386496:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123853952 00000100:00100000:0.0:1746155571.386497:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123853952 00002000:00100000:0.0:1746155571.386522:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3387391) req@ffff8800944ace00 x1830976123853952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 504/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155571.386528:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ace00 with x1830976123853952 ext(2097152->3387391) 00002000:00010000:0.0:1746155571.386531:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944ace00 00000100:00100000:0.0:1746155571.386541:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4745 00000100:00100000:0.0:1746155571.386576:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976123853440:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155571.386582:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4746 00000100:00100000:1.0:1746155571.386590:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976123853696:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155571.386630:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4747 00000100:00100000:1.0:1746155571.386635:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123853952:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155571.388739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.388912:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123854208 00000100:00100000:3.0:1746155571.388919:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123854208 00002000:00100000:3.0:1746155571.388949:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3387392->4194303) req@ffff88012fe8d180 x1830976123854208/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.388956:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8d180 with x1830976123854208 ext(3387392->4194303) 00002000:00010000:3.0:1746155571.388961:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fe8d180 00000100:00100000:3.0:1746155571.388977:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4748 00000100:00100000:3.0:1746155571.388983:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123854208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155571.392944:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123853056:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11748us (11888us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155571.392957:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4744 00002000:00100000:1.0:1746155571.392967:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88012cdee680 x1830976123853056/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.392976:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdee680 with x1830976123853056 ext(1048576->2097151) 00002000:00010000:1.0:1746155571.392980:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdee680 00000100:00100000:2.0:1746155571.393403:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.395812:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123854336 00000100:00100000:3.0:1746155571.395822:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123854336 00000100:00100000:0.0:1746155571.395904:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12308 00000100:00100000:0.0:1746155571.395913:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29271:x1830976123854336:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155571.395930:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155571.395944:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114b7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.395967:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11494 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.395974:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155571.395976:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155571.395979:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1265664->1527807] (req 1265664->1527807) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.396004:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11494 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.396015:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11494 expref: 20 pid: 20200 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746155571.396025:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124621696:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155571.396099:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.398475:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123853440:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11892us (12474us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155571.398484:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4745 00002000:00100000:2.0:1746155571.398493:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800944ae680 x1830976123853440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.398525:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ae680 with x1830976123853440 ext(2097152->3145727) 00002000:00010000:2.0:1746155571.398530:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ae680 00000100:00100000:2.0:1746155571.400275:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124621696:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155571.400299:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1265664->1527807] (req 1265664->1527807) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.400313:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fed9600, rc 0) 00000100:00100000:2.0:1746155571.400346:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29271:x1830976123854336:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4434us (6943us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.400353:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12308 00000100:00100000:3.0:1746155571.400657:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123853952:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14020us (14590us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155571.400664:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4747 00002000:00100000:3.0:1746155571.400671:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3387391) req@ffff8800944ace00 x1830976123853952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 504/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.400678:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ace00 with x1830976123853952 ext(2097152->3387391) 00002000:00010000:3.0:1746155571.400682:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944ace00 00000100:00100000:0.0:1746155571.404764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.405742:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976123853696:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19151us (19703us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155571.405752:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4746 00002000:00100000:1.0:1746155571.405761:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800944ad880 x1830976123853696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.405769:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ad880 with x1830976123853696 ext(3145728->4194303) 00002000:00010000:1.0:1746155571.405773:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ad880 00000100:00100000:0.0:1746155571.405914:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.406038:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123854464 00000100:00100000:2.0:1746155571.406044:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123854464 00010000:00010000:2.0:1746155571.406066:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11494 expref: 17 pid: 20200 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.406090:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6203 00000100:00100000:2.0:1746155571.406096:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123854464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.406105:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.406119:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11494 expref: 17 pid: 20200 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.406128:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11494 expref: 17 pid: 20200 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.406144:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec255 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11494 expref: 17 pid: 20200 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.406158:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.406159:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.406165:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 14 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.406171:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 14 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.406193:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 14 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.406201:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124621824:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155571.406237:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.406265:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976123854208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17281us (17530us total) trans 0 rc 806912/806912 00000100:00100000:3.0:1746155571.406274:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4748 00002000:00100000:3.0:1746155571.406279:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3387392->4194303) req@ffff88012fe8d180 x1830976123854208/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 806912/806912 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.406286:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8d180 with x1830976123854208 ext(3387392->4194303) 00002000:00010000:3.0:1746155571.406289:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fe8d180 00000100:00100000:2.0:1746155571.406393:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123854592 00000100:00100000:2.0:1746155571.406396:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123854592 00000100:00100000:2.0:1746155571.406424:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12309 00000100:00100000:2.0:1746155571.406429:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29266:x1830976123854592:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.406440:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.406450:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114be expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.406466:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 20 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.406472:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155571.406473:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155571.406476:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114be expref: 11 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.406492:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 20 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.406523:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 20 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.406533:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124621952:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155571.406569:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.408360:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124621952:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.408379:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114be expref: 11 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.408389:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca59200, rc 0) 00000100:00100000:0.0:1746155571.408421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.408425:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29266:x1830976123854592:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1995us (2510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.408431:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12309 00000100:00100000:3.0:1746155571.408452:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123854720 00000100:00100000:3.0:1746155571.408455:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123854720 00000100:00100000:2.0:1746155571.408496:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124621824:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155571.408528:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.408557:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123854464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2460us (3803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.408564:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6203 00000100:00100000:0.0:1746155571.408701:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:3.0:1746155571.408933:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1454079) req@ffff880093a45c00 x1830976123854720/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 504/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.408942:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a45c00 with x1830976123854720 ext(1048576->1454079) 00010000:00010000:3.0:1746155571.408948:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 21 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.408959:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 21 pid: 8438 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746155571.408970:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093a45c00 00000100:00100000:3.0:1746155571.409172:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123854976 00000100:00100000:3.0:1746155571.409175:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123854976 00002000:00100000:3.0:1746155571.409190:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1265664->1269759) req@ffff880093a46680 x1830976123854976/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.409197:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a46680 with x1830976123854976 ext(1265664->1269759) 00002000:00010000:3.0:1746155571.409200:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a46680 00000100:00100000:1.0:1746155571.409249:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 748 00000100:00100000:1.0:1746155571.409256:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123854720:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155571.409578:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4749 00000100:00100000:3.0:1746155571.409585:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123854976:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155571.409995:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123854976:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 409us (1293us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155571.410001:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4749 00002000:00100000:3.0:1746155571.410007:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1265664->1269759) req@ffff880093a46680 x1830976123854976/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.410014:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a46680 with x1830976123854976 ext(1265664->1269759) 00002000:00010000:3.0:1746155571.410016:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a46680 00000100:00100000:1.0:1746155571.412789:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123854720:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3528us (4364us total) trans 17179873236 rc 0/0 00000100:00100000:1.0:1746155571.412798:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 748 00002000:00100000:1.0:1746155571.412805:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->1454079) req@ffff880093a45c00 x1830976123854720/t17179873236(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 504/448 e 0 to 0 dl 1746155582 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.412813:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a45c00 with x1830976123854720 ext(1048576->1454079) 00010000:00010000:1.0:1746155571.412820:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 23 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:1.0:1746155571.412837:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 23 pid: 8438 timeout: 800 lvb_type: 0 00002000:00010000:1.0:1746155571.412844:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093a45c00 00000100:00100000:0.0:1746155571.413077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.413107:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.413128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.413173:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123855232 00000100:00100000:2.0:1746155571.413178:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123855232 00000100:00100000:2.0:1746155571.413201:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123855104 00000100:00100000:2.0:1746155571.413202:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123855104 00000100:00100000:2.0:1746155571.413211:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123855360 00000100:00100000:2.0:1746155571.413212:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123855360 00000100:00100000:2.0:1746155571.413224:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12310 00000100:00100000:2.0:1746155571.413230:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976123855232:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.413241:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.413258:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca58000/0x844e5faceb5ec2b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114cc expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.413280:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12311 00000100:00100000:3.0:1746155571.413286:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123855104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.413292:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155571.413294:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124622080:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.413298:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ec2b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114c5 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.413307:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.413309:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.413314:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ec2b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114c5 expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.413323:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ec2b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114c5 expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.413329:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe3e00, rc 0) 00000100:00100000:2.0:1746155571.413334:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.413343:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123855104:12345-192.168.202.51@tcp:101:cat.0 Request processed in 58us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.413346:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12311 00000100:00100000:2.0:1746155571.413350:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12312 00000100:00100000:2.0:1746155571.413356:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123855360:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.413362:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.413369:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec2be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114d3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.413389:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124622208:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155571.413408:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155571.416615:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.416675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.416746:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123855744 00000100:00100000:1.0:1746155571.416753:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123855744 00002000:00100000:1.0:1746155571.416785:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1523712->1527807) req@ffff880093a47100 x1830976123855744/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.416794:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a47100 with x1830976123855744 ext(1523712->1527807) 00002000:00010000:1.0:1746155571.416799:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a47100 00000100:00100000:1.0:1746155571.416832:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4750 00000100:00100000:1.0:1746155571.416841:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123855744:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155571.416911:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123855616 00000100:00100000:2.0:1746155571.416914:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123855616 00010000:00010000:2.0:1746155571.416932:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 26 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.416959:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6204 00000100:00100000:2.0:1746155571.416963:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123855616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.416972:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.416986:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 26 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.416995:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 26 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.417013:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.417015:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.417020:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114be expref: 10 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.417027:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114be expref: 10 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155571.417029:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123855744:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 188us (420us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155571.417034:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4750 00002000:00100000:1.0:1746155571.417038:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1523712->1527807) req@ffff880093a47100 x1830976123855744/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.417044:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a47100 with x1830976123855744 ext(1523712->1527807) 00002000:00010000:1.0:1746155571.417046:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a47100 00010000:00010000:2.0:1746155571.417049:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114be expref: 10 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.417058:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136633100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124622336:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155571.417211:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155571.419054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.419163:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124622208:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.419188:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec2be lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114d3 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.419198:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec2be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114d3 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.419221:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca59800, rc 0) 00000100:00100000:2.0:1746155571.419234:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123856000 00000100:00100000:2.0:1746155571.419238:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123856000 00000100:00100000:3.0:1746155571.419257:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123855360:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5900us (6128us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155571.419262:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12312 00000100:00100000:2.0:1746155571.419263:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4070 00000100:00100000:2.0:1746155571.419269:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29271:x1830976123856000:12345-192.168.202.51@tcp:35:multiop.0 00010000:00010000:3.0:1746155571.419297:0:20200:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.51@tcp) returned -22 from glimpse AST (req@ffff88012fe8c000 x1830976124622080) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 26 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.419313:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec0a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11383 expref: 26 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.419321:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124622080:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.419334:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca58000/0x844e5faceb5ec2b0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114cc expref: 25 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.419341:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca58000/0x844e5faceb5ec2b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114cc expref: 25 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.419348:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca58000, rc 0) 00000100:00100000:3.0:1746155571.419362:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976123855232:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6132us (6286us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155571.419367:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12310 00000100:00100000:3.0:1746155571.419385:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136633100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124622336:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155571.419392:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.419398:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29271:x1830976123856000:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 128us (346us total) trans 8589944014 rc 0/0 00000100:00100000:2.0:1746155571.419403:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4070 00000100:00100000:3.0:1746155571.419405:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976123855616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2442us (2730us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.419411:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6204 00000100:00100000:0.0:1746155571.423776:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.423808:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.423998:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123856256 00000100:00100000:3.0:1746155571.424006:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123856256 00002000:00100000:3.0:1746155571.424041:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880093a47480 x1830976123856256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.424049:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a47480 with x1830976123856256 ext(1048576->2097151) 00002000:00010000:3.0:1746155571.424054:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093a47480 00000100:00100000:3.0:1746155571.424079:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123856640 00000100:00100000:3.0:1746155571.424081:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123856640 00002000:00100000:3.0:1746155571.424093:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880093a45880 x1830976123856640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.424100:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a45880 with x1830976123856640 ext(4194304->4956159) 00002000:00010000:3.0:1746155571.424102:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a45880 00000100:00100000:3.0:1746155571.424115:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4751 00000100:00100000:3.0:1746155571.424122:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123856256:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155571.424178:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4752 00000100:00100000:1.0:1746155571.424184:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976123856640:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155571.425086:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.425628:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123856768 00000100:00100000:2.0:1746155571.425632:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123856768 00002000:00100000:2.0:1746155571.425651:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880093a45500 x1830976123856768/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 504/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.425658:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a45500 with x1830976123856768 ext(1048576->2097151) 00002000:00010000:2.0:1746155571.425661:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a45500 00000100:00100000:2.0:1746155571.425673:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4753 00000100:00100000:2.0:1746155571.425678:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123856768:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155571.431758:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976123856640:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7567us (7942us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155571.431768:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4752 00002000:00100000:1.0:1746155571.431777:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880093a45880 x1830976123856640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.431785:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a45880 with x1830976123856640 ext(4194304->4956159) 00002000:00010000:1.0:1746155571.431790:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a45880 00000100:00100000:3.0:1746155571.435456:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123856256:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11327us (11680us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155571.435465:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4751 00002000:00100000:3.0:1746155571.435474:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880093a47480 x1830976123856256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.435482:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a47480 with x1830976123856256 ext(1048576->2097151) 00002000:00010000:3.0:1746155571.435487:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093a47480 00000100:00100000:0.0:1746155571.439306:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123856768:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13619us (14213us total) trans 0 rc 786432/786432 00000100:00100000:0.0:1746155571.439316:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4753 00002000:00100000:0.0:1746155571.439325:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880093a45500 x1830976123856768/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 504/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 786432/786432 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155571.439333:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a45500 with x1830976123856768 ext(1048576->2097151) 00002000:00010000:0.0:1746155571.439338:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a45500 00000100:00100000:0.0:1746155571.440287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.440568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.440638:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123856896 00000100:00100000:3.0:1746155571.440644:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123856896 00000100:00100000:3.0:1746155571.441183:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123857024 00000100:00100000:3.0:1746155571.441186:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123857024 00000100:00100000:3.0:1746155571.441211:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12313 00000100:00100000:3.0:1746155571.441218:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123856896:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155571.441226:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12314 00000100:00100000:0.0:1746155571.441231:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123857024:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.441238:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155571.441238:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.441252:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2e00/0x844e5faceb5ec2cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114da expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.441252:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a124200/0x844e5faceb5ec2c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114e1 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.441269:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.441270:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.441276:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2e00/0x844e5faceb5ec2cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114da expref: 24 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.441289:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2e00/0x844e5faceb5ec2cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114da expref: 24 pid: 20200 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155571.441289:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124622464:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.441298:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe2e00, rc 0) 00000100:00100000:3.0:1746155571.441331:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123856896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 112us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.441335:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12313 00000100:00100000:0.0:1746155571.441345:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.442949:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124622464:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155571.442973:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a124200/0x844e5faceb5ec2c5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114e1 expref: 17 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.442983:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a124200/0x844e5faceb5ec2c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114e1 expref: 17 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.443006:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a124200, rc 0) 00000100:00100000:2.0:1746155571.443044:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123857024:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1811us (2474us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155571.443050:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12314 00000100:00100000:0.0:1746155571.445812:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.445844:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.445871:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123857280 00000100:00100000:0.0:1746155571.445875:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.445878:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123857280 00000100:00100000:2.0:1746155571.445908:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123857152 00000100:00100000:2.0:1746155571.445911:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123857152 00000100:00100000:3.0:1746155571.445915:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123857408 00000100:00100000:3.0:1746155571.445918:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123857408 00000100:00100000:2.0:1746155571.445926:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12315 00000100:00100000:2.0:1746155571.445932:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123857280:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155571.445936:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12316 00000100:00100000:3.0:1746155571.445940:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123857152:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155571.445942:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12317 00010000:00010000:3.0:1746155571.445947:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.445947:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155571.445950:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123857408:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155571.445957:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.445960:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ec2d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114e8 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.445960:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca58000/0x844e5faceb5ec2da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114ef expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.445965:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ec2e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114f6 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.445976:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.445977:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.445984:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ec2d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114e8 expref: 16 pid: 20200 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155571.445995:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136633100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124622720:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155571.445995:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124622592:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.445996:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ec2d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114e8 expref: 16 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.446003:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe3a00, rc 0) 00000100:00100000:1.0:1746155571.446136:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c640c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.446861:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123857152:12345-192.168.202.51@tcp:101:cat.0 Request processed in 918us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.446867:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12316 00000100:00100000:2.0:1746155571.447389:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a943c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155571.448854:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124622592:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155571.448878:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ec2e1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114f6 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.448888:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ec2e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114f6 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.449164:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b800, rc 0) 00000100:00100000:1.0:1746155571.449247:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123857408:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3297us (3370us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155571.449253:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12317 00000100:00100000:3.0:1746155571.449587:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136633100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124622720:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.449605:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca58000/0x844e5faceb5ec2da lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114ef expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.449614:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca58000/0x844e5faceb5ec2da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114ef expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.449634:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca58000, rc 0) 00000100:00100000:3.0:1746155571.449654:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123857280:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3722us (3847us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155571.449660:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12315 00000100:00100000:2.0:1746155571.453784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.453854:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123857664 00000100:00100000:1.0:1746155571.453861:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123857664 00000100:00100000:1.0:1746155571.453895:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4071 00000100:00100000:1.0:1746155571.453901:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea56050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:29263:x1830976123857664:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155571.454072:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea56050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29263:x1830976123857664:12345-192.168.202.51@tcp:35:cat.0 Request processed in 171us (293us total) trans 8589944015 rc 0/0 00000100:00100000:1.0:1746155571.454077:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4071 00000100:00100000:0.0:1746155571.455099:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.455353:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123857920 00000100:00100000:2.0:1746155571.455358:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123857920 00002000:00100000:2.0:1746155571.455383:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880093a44e00 x1830976123857920/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.455391:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a44e00 with x1830976123857920 ext(2097152->3145727) 00002000:00010000:2.0:1746155571.455395:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a44e00 00000100:00100000:2.0:1746155571.455420:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4754 00000100:00100000:2.0:1746155571.455426:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123857920:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155571.461841:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123857920:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6406us (6734us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155571.461852:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4754 00002000:00100000:2.0:1746155571.461861:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880093a44e00 x1830976123857920/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.461876:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a44e00 with x1830976123857920 ext(2097152->3145727) 00002000:00010000:2.0:1746155571.461881:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093a44e00 00000100:00100000:0.0:1746155571.464862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.464990:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123858048 00000100:00100000:3.0:1746155571.464997:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123858048 00000100:00100000:3.0:1746155571.466016:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12318 00000100:00100000:3.0:1746155571.466024:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29266:x1830976123858048:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.466038:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.466052:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f114fd expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.466075:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 23 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.466082:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.466084:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.466087:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114fd expref: 12 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.466110:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 23 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.466120:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 23 pid: 20200 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.466131:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124622848:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.466476:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.468540:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124622848:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.468571:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114fd expref: 12 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.468584:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe3600, rc 0) 00000100:00100000:3.0:1746155571.468620:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29266:x1830976123858048:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2597us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.468628:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12318 00000100:00100000:0.0:1746155571.468782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.468885:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123858176 00000100:00100000:3.0:1746155571.468890:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123858176 00002000:00100000:3.0:1746155571.468914:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2809856->3051519) req@ffff88009fe90a80 x1830976123858176/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.468922:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe90a80 with x1830976123858176 ext(2809856->3051519) 00010000:00010000:3.0:1746155571.468928:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 24 pid: 20200 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.468941:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 24 pid: 20200 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746155571.468947:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe90a80 00000100:00100000:3.0:1746155571.468967:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 749 00000100:00100000:3.0:1746155571.468972:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123858176:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155571.473306:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123858176:12345-192.168.202.51@tcp:4:cat.0 Request processed in 4326us (4517us total) trans 17179873237 rc 0/0 00000100:00100000:3.0:1746155571.473315:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 749 00002000:00100000:3.0:1746155571.473324:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2809856->3051519) req@ffff88009fe90a80 x1830976123858176/t17179873237(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/448 e 0 to 0 dl 1746155582 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.473332:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe90a80 with x1830976123858176 ext(2809856->3051519) 00010000:00010000:3.0:1746155571.473340:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 26 pid: 20200 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.473352:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 26 pid: 20200 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746155571.473358:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe90a80 00000100:00100000:0.0:1746155571.481435:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.483150:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123858304 00000100:00100000:3.0:1746155571.483158:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123858304 00010000:00010000:3.0:1746155571.483188:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 26 pid: 20200 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.485276:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6205 00000100:00100000:3.0:1746155571.485288:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123858304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.485301:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.485320:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 26 pid: 20200 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.485332:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 26 pid: 20200 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.485351:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b600/0x844e5faceb5ec19f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3051519) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1142b expref: 26 pid: 20200 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.485380:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.485381:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.485386:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114fd expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.485394:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114fd expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.485424:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114fd expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.485435:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124622976:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155571.485519:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.488626:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124622976:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155571.488642:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.489335:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123858304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4049us (7904us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.489345:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6205 00000100:00100000:0.0:1746155571.495408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.495571:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123858560 00000100:00100000:3.0:1746155571.495579:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123858560 00002000:00100000:3.0:1746155571.495617:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009fe93480 x1830976123858560/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.495625:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe93480 with x1830976123858560 ext(2097152->3145727) 00002000:00010000:3.0:1746155571.495630:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe93480 00000100:00100000:3.0:1746155571.495645:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4755 00000100:00100000:3.0:1746155571.495651:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123858560:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155571.495654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.495668:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123859072 00000100:00100000:1.0:1746155571.495671:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123859072 00002000:00100000:1.0:1746155571.495686:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800944adf80 x1830976123859072/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.495693:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944adf80 with x1830976123859072 ext(3145728->4194303) 00002000:00010000:1.0:1746155571.495696:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944adf80 00000100:00100000:1.0:1746155571.495722:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4756 00000100:00100000:1.0:1746155571.495726:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123859072:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155571.497376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.497399:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123858816 00000100:00100000:1.0:1746155571.497403:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123858816 00002000:00100000:1.0:1746155571.497424:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800944adc00 x1830976123858816/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.497431:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944adc00 with x1830976123858816 ext(3145728->4194303) 00002000:00010000:1.0:1746155571.497434:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944adc00 00000100:00100000:1.0:1746155571.497458:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4757 00000100:00100000:1.0:1746155571.497463:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123858816:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155571.515625:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123859072:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19889us (19961us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155571.515635:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4756 00002000:00100000:2.0:1746155571.515646:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800944adf80 x1830976123859072/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.515654:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944adf80 with x1830976123859072 ext(3145728->4194303) 00002000:00010000:2.0:1746155571.515659:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944adf80 00000100:00100000:3.0:1746155571.522345:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123858560:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26687us (26937us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155571.522354:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4755 00002000:00100000:3.0:1746155571.522363:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009fe93480 x1830976123858560/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.522371:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe93480 with x1830976123858560 ext(2097152->3145727) 00002000:00010000:3.0:1746155571.522375:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe93480 00000100:00100000:0.0:1746155571.527675:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123858816:12345-192.168.202.51@tcp:3:cat.0 Request processed in 30029us (30119us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155571.527687:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4757 00002000:00100000:0.0:1746155571.527696:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800944adc00 x1830976123858816/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155571.527704:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944adc00 with x1830976123858816 ext(3145728->4194303) 00002000:00010000:0.0:1746155571.527709:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944adc00 00000100:00100000:0.0:1746155571.537840:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.537953:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123859328 00000100:00100000:1.0:1746155571.537960:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123859328 00002000:00100000:1.0:1746155571.537997:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009fe91880 x1830976123859328/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.538006:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe91880 with x1830976123859328 ext(4194304->4956159) 00002000:00010000:1.0:1746155571.538011:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe91880 00000100:00100000:1.0:1746155571.538037:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4758 00000100:00100000:1.0:1746155571.538044:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123859328:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155571.546033:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123859328:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7980us (8191us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155571.546043:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4758 00002000:00100000:2.0:1746155571.546052:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009fe91880 x1830976123859328/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.546061:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe91880 with x1830976123859328 ext(4194304->4956159) 00002000:00010000:2.0:1746155571.546066:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe91880 00000100:00100000:0.0:1746155571.555207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.555282:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123859584 00000100:00100000:2.0:1746155571.555290:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123859584 00000100:00100000:2.0:1746155571.555740:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4072 00000100:00100000:2.0:1746155571.555748:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29266:x1830976123859584:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155571.555937:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29266:x1830976123859584:12345-192.168.202.51@tcp:35:cat.0 Request processed in 189us (735us total) trans 8589944016 rc 0/0 00000100:00100000:2.0:1746155571.555943:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4072 00000100:00100000:0.0:1746155571.571813:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.572908:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123859840 00000100:00100000:2.0:1746155571.572917:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123859840 00000100:00100000:2.0:1746155571.572995:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10063 00000100:00100000:2.0:1746155571.573002:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29275:x1830976123859840:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155571.573025:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.573041:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58400/0x844e5faceb5ec2ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11504 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.573132:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5ec2f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573143:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5ec2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573152:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5ec2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573163:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5ec2fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573168:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5ec2fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573173:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5ec2fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573263:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58c00/0x844e5faceb5ec304 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573270:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58c00/0x844e5faceb5ec304 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573275:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58c00/0x844e5faceb5ec304 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155571.573282:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155571.573347:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5ec2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573353:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5ec2f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573358:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5ec2f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573363:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca59600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.573366:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5ec2f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573371:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5ec2f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573381:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155571.573384:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.573387:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5ec2f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573392:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5ec2f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573882:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5ec2fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573887:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5ec2fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573892:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5ec2fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573898:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca59a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.573900:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5ec2fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573904:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5ec2fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573910:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9a00) 00010000:00010000:2.0:1746155571.573912:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.573914:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5ec2fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573918:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5ec2fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.573950:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58400/0x844e5faceb5ec2ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11504 expref: 297 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.573960:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58c00/0x844e5faceb5ec304 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11504 expref: 296 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.573965:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.573967:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155571.573969:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca58c00, rc 0) 00000100:00100000:2.0:1746155571.574275:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:29275:x1830976123859840:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1272us (2468us total) trans 8589944017 rc 0/0 00000100:00100000:2.0:1746155571.574281:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10063 00000100:00100000:0.0:1746155571.576436:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.576915:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123860096 00000100:00100000:2.0:1746155571.576922:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123860096 00000100:00100000:2.0:1746155571.576971:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4073 00000100:00100000:2.0:1746155571.576977:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:29275:x1830976123860096:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155571.577255:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29275:x1830976123860096:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 277us (824us total) trans 8589944018 rc 0/0 00000100:00100000:2.0:1746155571.577261:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4073 00000100:00100000:0.0:1746155571.582138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.582281:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123860352 00000100:00100000:2.0:1746155571.582289:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123860352 00000100:00100000:2.0:1746155571.582325:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10064 00000100:00100000:2.0:1746155571.582332:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29279:x1830976123860352:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.582350:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.582365:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1150b expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.582454:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec319 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582464:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582474:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582486:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec320 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582491:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582496:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582618:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec327 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582625:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec327 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582631:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec327 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155571.582639:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155571.582703:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582709:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec319 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582714:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec319 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582720:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca58000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.582722:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec319 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582728:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec319 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582737:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155571.582740:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.582743:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec319 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582748:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec319 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582761:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582766:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec320 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582770:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582774:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca58a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.582776:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582780:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec320 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582786:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9300) 00010000:00010000:2.0:1746155571.582788:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.582790:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec320 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582794:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec320 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.582823:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1150b expref: 300 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.582832:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec327 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1150b expref: 299 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.582838:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.582840:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155571.582843:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca59800, rc 0) 00000100:00100000:2.0:1746155571.583875:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:29279:x1830976123860352:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1541us (1752us total) trans 8589944019 rc 0/0 00000100:00100000:2.0:1746155571.583882:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10064 00000100:00100000:0.0:1746155571.584637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.584696:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123860480 00000100:00100000:3.0:1746155571.584701:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123860480 00000100:00100000:3.0:1746155571.585309:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12319 00000100:00100000:3.0:1746155571.585317:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:29275:x1830976123860480:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155571.585329:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.585399:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11512 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.585421:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114be expref: 11 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.585428:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2e00/0x844e5faceb5ec2cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114da expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.585434:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.585435:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.585438:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1662976->1863679] (req 1662976->1863679) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.585460:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2e00/0x844e5faceb5ec2cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114da expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.585471:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2e00/0x844e5faceb5ec2cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114da expref: 26 pid: 20200 timeout: 800 lvb_type: 1 00000100:00100000:3.0:1746155571.585482:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124623104:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.586190:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114be expref: 11 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.586199:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114be expref: 11 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.586206:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124623232:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.586227:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155571.586449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.586486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.586549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.586581:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123860736 00000100:00100000:0.0:1746155571.586584:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123860736 00000100:00100000:0.0:1746155571.586605:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123860864 00000100:00100000:0.0:1746155571.586607:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123860864 00000100:00100000:0.0:1746155571.586618:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12320 00000100:00100000:0.0:1746155571.586624:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123860736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155571.586632:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155571.586641:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5faba00/0x844e5faceb5ec33c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11519 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155571.586666:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124623360:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155571.586689:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.586838:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12321 00000100:00100000:2.0:1746155571.586846:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123860864:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.586852:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.586859:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5ec343 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11520 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.586869:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.586870:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.586876:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5ec343 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11520 expref: 28 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.586888:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5ec343 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11520 expref: 28 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.586897:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca58800, rc 0) 00000100:00100000:2.0:1746155571.586920:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123860864:12345-192.168.202.51@tcp:101:cat.0 Request processed in 76us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.586926:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12321 00000100:00100000:3.0:1746155571.587109:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123860608 00000100:00100000:3.0:1746155571.587113:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123860608 00000100:00100000:3.0:1746155571.587136:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 597 00000100:00100000:3.0:1746155571.587142:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1960:x1830976123860608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.587149:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.587163:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec327 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1150b expref: 299 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.587177:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.587180:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.587196:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1960:x1830976123860608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.587201:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 597 00000100:00100000:3.0:1746155571.590270:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124623104:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.590283:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124623232:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155571.590309:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1662976->1863679] (req 1662976->1863679) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.590323:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009528a000, rc 0) 00000100:00100000:3.0:1746155571.590357:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29275:x1830976123860480:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5040us (5720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.590365:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12319 00002000:00010000:1.0:1746155571.590450:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155571 -> 1746155572 00000100:00100000:1.0:1746155571.590467:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124623360:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155571.590487:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5faba00/0x844e5faceb5ec33c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11519 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.590497:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5faba00/0x844e5faceb5ec33c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11519 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.590645:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5faba00, rc 0) 00000100:00100000:1.0:1746155571.590665:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123860736:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4041us (4178us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155571.590670:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12320 00000100:00100000:0.0:1746155571.593025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.594265:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.594644:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123861120 00000100:00100000:3.0:1746155571.594652:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123861120 00010000:00010000:3.0:1746155571.594679:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114be expref: 12 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.594702:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123860992 00000100:00100000:3.0:1746155571.594704:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123860992 00010000:00010000:3.0:1746155571.594713:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2e00/0x844e5faceb5ec2cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114da expref: 27 pid: 20200 timeout: 800 lvb_type: 1 00000100:00100000:3.0:1746155571.595069:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6206 00000100:00100000:3.0:1746155571.595078:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123861120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.595090:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.595108:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114be expref: 12 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.595118:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114be expref: 12 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.595135:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca59200/0x844e5faceb5ec2a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114be expref: 12 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.595149:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.595185:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1962:x1830976123861120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 109us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.595190:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6206 00000100:00100000:3.0:1746155571.595225:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6207 00000100:00100000:3.0:1746155571.595229:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123860992:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.595235:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.595241:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2e00/0x844e5faceb5ec2cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114da expref: 27 pid: 20200 timeout: 800 lvb_type: 1 00010000:00010000:3.0:1746155571.595249:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2e00/0x844e5faceb5ec2cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114da expref: 27 pid: 20200 timeout: 800 lvb_type: 1 00010000:00010000:3.0:1746155571.595258:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2e00/0x844e5faceb5ec2cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114da expref: 27 pid: 20200 timeout: 800 lvb_type: 1 00010000:00010000:3.0:1746155571.595266:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.595267:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.595273:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.595280:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.595303:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.595312:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124623488:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155571.595352:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155571.597952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.598049:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123861376 00000100:00100000:2.0:1746155571.598055:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123861376 00002000:00100000:2.0:1746155571.598088:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009fe91500 x1830976123861376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155571.598088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:2.0:1746155571.598102:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe91500 with x1830976123861376 ext(1048576->2097151) 00002000:00010000:2.0:1746155571.598106:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe91500 00000100:00100000:2.0:1746155571.598118:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123861632 00000100:00100000:2.0:1746155571.598120:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123861632 00000100:00100000:0.0:1746155571.598128:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4759 00002000:00100000:2.0:1746155571.598129:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1662976->1667071) req@ffff88009fe92d80 x1830976123861632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155571.598134:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123861376:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:2.0:1746155571.598135:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe92d80 with x1830976123861632 ext(1662976->1667071) 00002000:00010000:2.0:1746155571.598138:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe92d80 00000100:00100000:2.0:1746155571.598151:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4760 00000100:00100000:2.0:1746155571.598155:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123861632:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155571.598267:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123861632:12345-192.168.202.51@tcp:3:cat.0 Request processed in 110us (178us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155571.598272:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4760 00002000:00100000:2.0:1746155571.598276:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1662976->1667071) req@ffff88009fe92d80 x1830976123861632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.598283:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe92d80 with x1830976123861632 ext(1662976->1667071) 00002000:00010000:2.0:1746155571.598285:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe92d80 00000100:00100000:3.0:1746155571.598362:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124623488:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155571.598375:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.598798:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123860992:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3567us (4534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.598805:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6207 00000100:00100000:0.0:1746155571.604721:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.604784:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123861888 00000100:00100000:3.0:1746155571.604791:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123861888 00002000:00100000:3.0:1746155571.604822:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1859584->1863679) req@ffff880130899500 x1830976123861888/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.604830:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899500 with x1830976123861888 ext(1859584->1863679) 00002000:00010000:3.0:1746155571.604835:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899500 00000100:00100000:2.0:1746155571.604850:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123861376:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6714us (6903us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155571.604852:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4761 00000100:00100000:2.0:1746155571.604857:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4759 00000100:00100000:3.0:1746155571.604858:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123861888:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:2.0:1746155571.604861:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009fe91500 x1830976123861376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.604867:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe91500 with x1830976123861376 ext(1048576->2097151) 00002000:00010000:2.0:1746155571.604870:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe91500 00000100:00100000:3.0:1746155571.604955:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123861888:12345-192.168.202.51@tcp:3:cat.0 Request processed in 97us (241us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155571.604962:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4761 00002000:00100000:3.0:1746155571.604966:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1859584->1863679) req@ffff880130899500 x1830976123861888/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.604972:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899500 with x1830976123861888 ext(1859584->1863679) 00002000:00010000:3.0:1746155571.604974:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899500 00000100:00100000:0.0:1746155571.609009:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.610218:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123862144 00000100:00100000:3.0:1746155571.610228:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123862144 00002000:00100000:3.0:1746155571.610263:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88013089aa00 x1830976123862144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 504/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.610272:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089aa00 with x1830976123862144 ext(1048576->2097151) 00002000:00010000:3.0:1746155571.610277:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013089aa00 00000100:00100000:3.0:1746155571.610305:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4762 00000100:00100000:3.0:1746155571.610312:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123862144:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155571.615426:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976123862144:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5107us (6416us total) trans 0 rc 847872/847872 00000100:00100000:3.0:1746155571.615436:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4762 00002000:00100000:3.0:1746155571.615445:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88013089aa00 x1830976123862144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 504/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 847872/847872 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.615453:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089aa00 with x1830976123862144 ext(1048576->2097151) 00002000:00010000:3.0:1746155571.615457:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013089aa00 00000100:00100000:0.0:1746155571.618279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.619537:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123862272 00000100:00100000:1.0:1746155571.619553:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123862272 00000100:00100000:1.0:1746155571.619682:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12322 00000100:00100000:1.0:1746155571.619690:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:29279:x1830976123862272:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155571.619708:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.619723:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11527 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.619747:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.619755:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155571.619757:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155571.619760:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11527 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.619783:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.619793:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 15 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155571.619803:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124623616:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155571.621160:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43cef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155571.622692:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124623616:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155571.622714:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11527 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.622785:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913f0c00, rc 0) 00000100:00100000:1.0:1746155571.622828:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:29279:x1830976123862272:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3137us (4555us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.622836:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12322 00000100:00100000:0.0:1746155571.623217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.623829:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123862400 00000100:00100000:3.0:1746155571.623836:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123862400 00002000:00100000:3.0:1746155571.623865:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1265664->1527807) req@ffff880130898a80 x1830976123862400/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.623873:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898a80 with x1830976123862400 ext(1265664->1527807) 00010000:00010000:3.0:1746155571.623879:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 16 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.623890:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 16 pid: 8438 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746155571.623895:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130898a80 00000100:00100000:3.0:1746155571.623917:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 750 00000100:00100000:3.0:1746155571.623923:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123862400:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155571.631572:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123862400:12345-192.168.202.51@tcp:4:cat.0 Request processed in 7640us (8347us total) trans 21474840624 rc 0/0 00000100:00100000:3.0:1746155571.631582:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 750 00002000:00100000:3.0:1746155571.631593:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1265664->1527807) req@ffff880130898a80 x1830976123862400/t21474840624(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/448 e 0 to 0 dl 1746155582 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.631607:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898a80 with x1830976123862400 ext(1265664->1527807) 00010000:00010000:3.0:1746155571.631615:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 18 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.631628:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 18 pid: 8438 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746155571.631635:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130898a80 00000100:00100000:0.0:1746155571.637987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.638694:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123862528 00000100:00100000:3.0:1746155571.638702:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123862528 00010000:00010000:3.0:1746155571.638729:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 18 pid: 8438 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.638761:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6208 00000100:00100000:3.0:1746155571.638767:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123862528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.638779:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.638794:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 18 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.638804:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 18 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.638820:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5ec2a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1527807) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114b7 expref: 18 pid: 8438 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.638844:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.638846:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.638852:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11527 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.638858:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11527 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.638886:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11527 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.638896:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124623744:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155571.639133:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.644462:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124623744:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155571.644481:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.644556:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123862528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5787us (6575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.644564:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6208 00000100:00100000:0.0:1746155571.645328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.645364:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123862784 00000100:00100000:3.0:1746155571.645370:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123862784 00002000:00100000:3.0:1746155571.645401:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880130898380 x1830976123862784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.645410:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898380 with x1830976123862784 ext(1048576->2097151) 00002000:00010000:3.0:1746155571.645414:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130898380 00000100:00100000:3.0:1746155571.645438:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4763 00000100:00100000:3.0:1746155571.645444:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123862784:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155571.648351:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.649094:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123863040 00000100:00100000:2.0:1746155571.649102:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123863040 00000100:00100000:2.0:1746155571.649145:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10065 00000100:00100000:2.0:1746155571.649153:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29282:x1830976123863040:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155571.649170:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.649185:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1152e expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.649266:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec358 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649276:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec358 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649285:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec358 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649295:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec35f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649300:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec35f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649304:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec35f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649390:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec366 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649398:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec366 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649407:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec366 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155571.649414:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155571.649483:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec358 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649489:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec358 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649494:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec358 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649499:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca58a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.649520:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec358 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649526:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec358 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649535:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155571.649537:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.649550:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec358 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649555:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec358 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649570:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec35f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649575:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec35f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649582:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec35f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649586:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca58000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.649588:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec35f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649591:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec35f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649597:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9200) 00010000:00010000:2.0:1746155571.649599:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.649601:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec35f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649605:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec35f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.649637:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1152e expref: 20 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.649647:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec366 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1152e expref: 19 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.649653:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.649654:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155571.649656:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca59800, rc 0) 00000100:00100000:2.0:1746155571.649680:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29282:x1830976123863040:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 528us (1334us total) trans 8589944020 rc 0/0 00000100:00100000:2.0:1746155571.649686:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10065 00000100:00100000:3.0:1746155571.657340:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123862784:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11888us (12005us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155571.657350:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4763 00002000:00100000:3.0:1746155571.657359:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880130898380 x1830976123862784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.657367:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898380 with x1830976123862784 ext(1048576->2097151) 00002000:00010000:3.0:1746155571.657372:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130898380 00000100:00100000:0.0:1746155571.664915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.664977:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123863168 00000100:00100000:3.0:1746155571.664985:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123863168 00000100:00100000:3.0:1746155571.665034:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 598 00000100:00100000:3.0:1746155571.665042:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123863168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.665053:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.665071:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec366 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1152e expref: 19 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.665095:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.665098:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.665139:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123863168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.665145:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 598 00000100:00100000:0.0:1746155571.693135:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.693196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.693214:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123863552 00000100:00100000:3.0:1746155571.693222:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123863552 00002000:00100000:3.0:1746155571.693263:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009f244e00 x1830976123863552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.693272:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f244e00 with x1830976123863552 ext(3145728->4194303) 00002000:00010000:3.0:1746155571.693277:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f244e00 00000100:00100000:2.0:1746155571.693277:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123863424 00000100:00100000:2.0:1746155571.693281:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123863424 00000100:00100000:3.0:1746155571.693294:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4764 00002000:00100000:2.0:1746155571.693294:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009f246a00 x1830976123863424/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.693300:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f246a00 with x1830976123863424 ext(2097152->3145727) 00000100:00100000:3.0:1746155571.693301:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123863552:12345-192.168.202.51@tcp:3:cat.0 00002000:00010000:2.0:1746155571.693303:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f246a00 00000100:00100000:2.0:1746155571.693317:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4765 00000100:00100000:2.0:1746155571.693321:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123863424:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155571.705859:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.708912:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123863936 00000100:00100000:1.0:1746155571.708922:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123863936 00000100:00100000:1.0:1746155571.708986:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10066 00000100:00100000:1.0:1746155571.708994:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29285:x1830976123863936:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155571.709016:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.709031:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f1000/0x844e5faceb5ec374 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11535 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.709141:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5ec37b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709152:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5ec37b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709162:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5ec37b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709173:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5ec382 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709178:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5ec382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709183:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5ec382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709280:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0600/0x844e5faceb5ec389 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709287:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0600/0x844e5faceb5ec389 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709293:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0600/0x844e5faceb5ec389 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:1.0:1746155571.709300:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155571.709367:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5ec37b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709373:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5ec37b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709377:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5ec37b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709381:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913f0400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155571.709384:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5ec37b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709388:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5ec37b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709397:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155571.709400:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155571.709403:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5ec37b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.709406:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0400/0x844e5faceb5ec37b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00000100:00100000:2.0:1746155571.710096:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123863424:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16770us (16895us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155571.710105:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4765 00002000:00100000:2.0:1746155571.710114:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009f246a00 x1830976123863424/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.710122:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f246a00 with x1830976123863424 ext(2097152->3145727) 00002000:00010000:2.0:1746155571.710125:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f246a00 00010000:00010000:1.0:1746155571.711217:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5ec382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.711225:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5ec382 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.711235:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5ec382 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.711240:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913f0200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155571.711242:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5ec382 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.711247:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5ec382 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.711257:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51800) 00010000:00010000:1.0:1746155571.711259:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155571.711261:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5ec382 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.711265:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0200/0x844e5faceb5ec382 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155571.711315:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f1000/0x844e5faceb5ec374 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11535 expref: 21 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.711326:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0600/0x844e5faceb5ec389 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11535 expref: 20 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.711332:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155571.711334:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155571.711336:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913f0600, rc 0) 00000100:00100000:1.0:1746155571.711361:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29285:x1830976123863936:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2368us (5507us total) trans 8589944021 rc 0/0 00000100:00100000:1.0:1746155571.711367:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10066 00000100:00100000:2.0:1746155571.712642:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.712719:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123864064 00000100:00100000:1.0:1746155571.712725:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123864064 00000100:00100000:1.0:1746155571.712753:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12323 00000100:00100000:1.0:1746155571.712760:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29282:x1830976123864064:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155571.712772:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.712785:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1153c expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.712805:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a2 expref: 12 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.712813:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ec2b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114c5 expref: 27 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.712820:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.712821:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.712825:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1613824->2088959] (req 1613824->2088959) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.712848:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ec2b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114c5 expref: 27 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.712858:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ec2b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114c5 expref: 27 pid: 8438 timeout: 800 lvb_type: 1 00000100:00100000:1.0:1746155571.712869:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124623872:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155571.712933:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a2 expref: 12 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.712942:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a2 expref: 12 pid: 20200 timeout: 800 lvb_type: 0 00000100:00100000:1.0:1746155571.712950:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124624000:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155571.712969:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43cef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.713481:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976123863552:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20179us (20352us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155571.713489:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4764 00002000:00100000:3.0:1746155571.713497:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009f244e00 x1830976123863552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.713524:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f244e00 with x1830976123863552 ext(3145728->4194303) 00002000:00010000:3.0:1746155571.713528:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f244e00 00000100:00100000:0.0:1746155571.713948:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.713995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.714026:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.714065:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123864320 00000100:00100000:0.0:1746155571.714070:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123864320 00000100:00100000:0.0:1746155571.714088:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123864192 00000100:00100000:0.0:1746155571.714090:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123864192 00000100:00100000:0.0:1746155571.714101:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12324 00000100:00100000:0.0:1746155571.714106:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976123864320:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155571.714114:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155571.714123:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ec39e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1154a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.714136:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155571.714138:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155571.714143:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ec39e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1154a expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155571.714154:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ec39e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1154a expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155571.714161:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136951c00, rc 0) 00000100:00100000:0.0:1746155571.714178:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123864320:12345-192.168.202.51@tcp:101:cat.0 Request processed in 73us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155571.714183:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12324 00000100:00100000:0.0:1746155571.714193:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12325 00000100:00100000:0.0:1746155571.714196:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123864192:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155571.714201:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155571.714207:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec3a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11543 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155571.714238:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f244000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124624128:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155571.714268:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155571.714293:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123864448 00000100:00100000:0.0:1746155571.714295:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123864448 00000100:00100000:0.0:1746155571.714314:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 599 00000100:00100000:0.0:1746155571.714319:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123864448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155571.714326:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155571.714340:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913f0600/0x844e5faceb5ec389 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11535 expref: 20 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155571.714354:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155571.714356:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155571.714369:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976123864448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155571.714373:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 599 00002000:00010000:2.0:1746155571.718958:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime: 1746155571 -> 1746155572 00002000:00010000:2.0:1746155571.718965:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime: 1746155571 -> 1746155572 00002000:00010000:2.0:1746155571.718966:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime: 1746155571 -> 1746155572 00000100:00100000:2.0:1746155571.718989:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f244000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124624128:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155571.719020:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec3a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11543 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.719032:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec3a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11543 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155571.719061:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4c8000, rc 0) 00000100:00100000:2.0:1746155571.719105:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123864192:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4906us (5107us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155571.719113:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12325 00000100:00100000:1.0:1746155571.720257:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124623872:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155571.720268:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124624000:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155571.720285:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1613824->2088959] (req 1613824->2088959) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.720298:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369b9800, rc 0) 00000100:00100000:1.0:1746155571.720335:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29282:x1830976123864064:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7575us (7695us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.720341:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12323 00000100:00100000:0.0:1746155571.721482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.721903:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123864576 00000100:00100000:2.0:1746155571.721910:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123864576 00010000:00010000:2.0:1746155571.721934:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a2 expref: 12 pid: 20200 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.721967:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6209 00000100:00100000:2.0:1746155571.721974:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123864576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.721984:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.722002:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a2 expref: 12 pid: 20200 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.722012:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a2 expref: 12 pid: 20200 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.722031:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c600/0x844e5faceb5ec271 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a2 expref: 12 pid: 20200 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.722041:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.722770:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123864576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 795us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.722775:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6209 00000100:00100000:0.0:1746155571.724308:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.724346:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.724417:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.724609:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123864832 00000100:00100000:1.0:1746155571.724615:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123864832 00000100:00100000:1.0:1746155571.724640:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123864960 00000100:00100000:1.0:1746155571.724642:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123864960 00000100:00100000:1.0:1746155571.724655:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12326 00000100:00100000:1.0:1746155571.724661:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976123864832:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155571.724665:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12327 00000100:00100000:3.0:1746155571.724672:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29285:x1830976123864960:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155571.724676:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.724679:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.724689:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11558 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.724689:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbb8400/0x844e5faceb5ec3b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11551 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.724707:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155571.724712:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1613824->2088959] (req 1613824->2088959) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.724718:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.724721:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11558 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.724908:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123864704 00000100:00100000:2.0:1746155571.724911:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123864704 00010000:00010000:2.0:1746155571.724925:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ec2b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114c5 expref: 28 pid: 8438 timeout: 800 lvb_type: 1 00000100:00100000:2.0:1746155571.724941:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6210 00000100:00100000:2.0:1746155571.724946:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123864704:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.724954:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155571.725161:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.725173:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbb8400/0x844e5faceb5ec3b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11551 expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.725182:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb8400/0x844e5faceb5ec3b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11551 expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.725186:0:8437:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 7 type: EXT [1613824->2088959] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.725197:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11558 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.725198:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb8400, rc 0) 00010000:00010000:3.0:1746155571.725206:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3400, rc 0) 00000100:00100000:1.0:1746155571.725229:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123864832:12345-192.168.202.51@tcp:101:cat.0 Request processed in 568us (882us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155571.725230:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29285:x1830976123864960:12345-192.168.202.51@tcp:101:cat.0 Request processed in 558us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.725234:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12326 00000100:00100000:3.0:1746155571.725238:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12327 00010000:00010000:2.0:1746155571.725356:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ec2b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114c5 expref: 26 pid: 8438 timeout: 800 lvb_type: 1 00010000:00010000:2.0:1746155571.725365:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ec2b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114c5 expref: 26 pid: 8438 timeout: 800 lvb_type: 1 00010000:00010000:2.0:1746155571.725376:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3e00/0x844e5faceb5ec2b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114c5 expref: 26 pid: 8438 timeout: 800 lvb_type: 1 00010000:00010000:2.0:1746155571.725384:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.725385:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.725390:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.725396:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.725416:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.725434:0:7064:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 11 pid: 1625 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.725443:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124624384:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155571.725528:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.730099:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124624384:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155571.730120:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155571.730132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.730170:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976123864704:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5222us (5864us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.730184:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6210 00000100:00100000:3.0:1746155571.732098:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123865088 00000100:00100000:3.0:1746155571.732108:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123865088 00000100:00100000:3.0:1746155571.732161:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12328 00000100:00100000:3.0:1746155571.732168:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123865088:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.732193:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.732210:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1155f expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.732260:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124624512:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155571.732338:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155571.732901:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.732959:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123865344 00000100:00100000:3.0:1746155571.732963:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123865344 00002000:00100000:3.0:1746155571.732984:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1613824->1617919) req@ffff8800944aed80 x1830976123865344/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.732992:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944aed80 with x1830976123865344 ext(1613824->1617919) 00010000:00010000:3.0:1746155571.732998:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.733009:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746155571.733019:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800944aed80 00000100:00100000:3.0:1746155571.733042:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 751 00000100:00100000:3.0:1746155571.733047:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123865344:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155571.733172:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123865344:12345-192.168.202.51@tcp:3:cat.0 Request processed in 123us (271us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155571.733177:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 751 00002000:00100000:3.0:1746155571.733183:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1613824->1617919) req@ffff8800944aed80 x1830976123865344/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.733189:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944aed80 with x1830976123865344 ext(1613824->1617919) 00010000:00010000:3.0:1746155571.733193:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.733201:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746155571.733206:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800944aed80 00002000:00010000:3.0:1746155571.734560:0:8438:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155571 -> 1746155572 00002000:00010000:3.0:1746155571.734565:0:8438:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155571 -> 1746155572 00002000:00010000:3.0:1746155571.734566:0:8438:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155571 -> 1746155572 00000100:00100000:3.0:1746155571.734582:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124624512:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.734608:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3ba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1155f expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.734623:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1155f expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.734642:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db2a00, rc 0) 00000100:00100000:2.0:1746155571.734752:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123865088:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2584us (4619us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155571.734759:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12328 00000100:00100000:0.0:1746155571.737793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.737971:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.738049:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123865600 00000100:00100000:2.0:1746155571.738056:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123865600 00002000:00100000:2.0:1746155571.738089:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (2084864->2088959) req@ffff88009fb68700 x1830976123865600/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.738097:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68700 with x1830976123865600 ext(2084864->2088959) 00010000:00010000:2.0:1746155571.738104:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.738116:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00002000:00010000:2.0:1746155571.738127:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb68700 00000100:00100000:2.0:1746155571.738143:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 752 00000100:00100000:2.0:1746155571.738150:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123865600:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155571.738226:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123865728 00000100:00100000:3.0:1746155571.738229:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123865728 00000100:00100000:3.0:1746155571.738248:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12329 00000100:00100000:3.0:1746155571.738252:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123865728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.738259:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.738270:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11566 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155571.738303:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124624640:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155571.739110:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1103c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.739246:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123865600:12345-192.168.202.51@tcp:3:cat.0 Request processed in 1095us (1459us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155571.739252:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 752 00002000:00100000:2.0:1746155571.739259:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (2084864->2088959) req@ffff88009fb68700 x1830976123865600/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.739266:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68700 with x1830976123865600 ext(2084864->2088959) 00010000:00010000:2.0:1746155571.739271:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.739280:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00002000:00010000:2.0:1746155571.739285:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb68700 00000100:00100000:3.0:1746155571.743444:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124624640:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155571.743473:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11566 expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.743485:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11566 expref: 26 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155571.743498:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db2c00, rc 0) 00000100:00100000:3.0:1746155571.743569:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123865728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5315us (5597us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155571.743579:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12329 00000100:00100000:2.0:1746155571.744860:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.744988:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.745157:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123866240 00000100:00100000:0.0:1746155571.745163:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123866240 00000100:00100000:0.0:1746155571.745202:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4074 00000100:00100000:0.0:1746155571.745207:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29282:x1830976123866240:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155571.745416:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29282:x1830976123866240:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 208us (556us total) trans 8589944022 rc 0/0 00000100:00100000:0.0:1746155571.745421:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4074 00000100:00100000:3.0:1746155571.746527:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123865984 00000100:00100000:3.0:1746155571.746533:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123865984 00002000:00100000:3.0:1746155571.746568:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1613824->2088959) req@ffff88012fef0a80 x1830976123865984/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.746577:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0a80 with x1830976123865984 ext(1613824->2088959) 00010000:00010000:3.0:1746155571.746584:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.746596:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 12 pid: 1625 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746155571.746602:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fef0a80 00000100:00100000:3.0:1746155571.746621:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 753 00000100:00100000:3.0:1746155571.746626:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123865984:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155571.747832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.747901:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123866496 00000100:00100000:1.0:1746155571.747905:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123866496 00000100:00100000:1.0:1746155571.747926:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4075 00000100:00100000:1.0:1746155571.747931:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:29279:x1830976123866496:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155571.748067:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:29279:x1830976123866496:12345-192.168.202.51@tcp:35:cat.0 Request processed in 135us (236us total) trans 8589944023 rc 0/0 00000100:00100000:1.0:1746155571.748073:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4075 00000100:00100000:3.0:1746155571.755307:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123865984:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8672us (10309us total) trans 17179873238 rc 0/0 00000100:00100000:3.0:1746155571.755317:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 753 00002000:00100000:3.0:1746155571.755327:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1613824->2088959) req@ffff88012fef0a80 x1830976123865984/t17179873238(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/448 e 0 to 0 dl 1746155582 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.755337:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0a80 with x1830976123865984 ext(1613824->2088959) 00010000:00010000:3.0:1746155571.755345:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 14 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.755362:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 14 pid: 1625 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746155571.755369:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fef0a80 00000100:00100000:0.0:1746155571.760400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.760532:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123866624 00000100:00100000:2.0:1746155571.760550:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123866624 00010000:00010000:2.0:1746155571.760583:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 14 pid: 1625 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.760616:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6211 00000100:00100000:2.0:1746155571.760624:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976123866624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.760637:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.760654:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 14 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.760665:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 14 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.760682:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801369b9800/0x844e5faceb5ec397 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1613824->2088959) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1153c expref: 14 pid: 1625 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.760711:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.760713:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.760719:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11558 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.760726:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11558 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.760754:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11558 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.760765:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124624768:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155571.760838:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.762305:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124624768:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155571.762324:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.762348:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976123866624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1724us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.762355:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6211 00000100:00100000:0.0:1746155571.765108:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.765258:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123866880 00000100:00100000:3.0:1746155571.765265:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123866880 00002000:00100000:3.0:1746155571.765295:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880090189880 x1830976123866880/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.765302:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189880 with x1830976123866880 ext(1048576->2097151) 00002000:00010000:3.0:1746155571.765307:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090189880 00000100:00100000:3.0:1746155571.765329:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4766 00000100:00100000:3.0:1746155571.765334:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123866880:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155571.773230:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123866880:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7887us (8120us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155571.773240:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4766 00002000:00100000:3.0:1746155571.773249:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880090189880 x1830976123866880/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.773258:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189880 with x1830976123866880 ext(1048576->2097151) 00002000:00010000:3.0:1746155571.773263:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090189880 00000100:00100000:0.0:1746155571.776192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.776298:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123867008 00000100:00100000:3.0:1746155571.776306:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123867008 00000100:00100000:3.0:1746155571.776889:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12330 00000100:00100000:3.0:1746155571.776898:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29285:x1830976123867008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155571.776914:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.776928:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1156d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.776951:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.776957:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.776959:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155571.776962:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1156d expref: 14 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.776986:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.776996:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 24 pid: 29728 timeout: 800 lvb_type: 0 00000100:00100000:3.0:1746155571.777007:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124624896:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155571.777370:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155571.778805:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1830976124625152:0@lo:400:kworker.0 00000100:00100000:1.0:1746155571.778839:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155571.778859:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746155571.778864:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3298:1830976124625024:0@lo:400:kworker.0 00000100:00100000:1.0:1746155571.778885:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155571.778916:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124625152 00000100:00100000:1.0:1746155571.778920:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124625152 00000100:00080000:2.0:1746155571.779397:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155571.779529:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830976124625280:0@lo:400:kworker.0 00000100:00100000:0.0:1746155571.779562:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155571.779650:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830976124625408:0@lo:400:kworker.0 00000100:00100000:0.0:1746155571.779850:0:14230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124625024 00000100:00100000:0.0:1746155571.779854:0:14230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124625024 00000100:00100000:0.0:1746155571.779872:0:14230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1746155571.779877:0:14230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3298:x1830976124625024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746155571.779909:0:14230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3298:x1830976124625024:12345-0@lo:400:kworker.0 Request processed in 31us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155571.779914:0:14230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1746155571.780025:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124625280 00000100:00100000:1.0:1746155571.780028:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124625280 00000100:00100000:1.0:1746155571.780048:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1746155571.780052:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830976124625152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155571.780074:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830976124625152:12345-0@lo:400:kworker.0 Request processed in 22us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.780078:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1746155571.780086:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1746155571.780089:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830976124625280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155571.780103:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830976124625280:12345-0@lo:400:kworker.0 Request processed in 14us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.780107:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1746155571.780127:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3298:1830976124625024:0@lo:400:kworker.0 00000100:00100000:1.0:1746155571.780135:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1830976124625152:0@lo:400:kworker.0 00000100:00100000:1.0:1746155571.780171:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124624896:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155571.780188:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1156d expref: 14 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.780200:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db2a00, rc 0) 00000100:00100000:1.0:1746155571.780223:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29285:x1830976123867008:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3327us (4039us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.780228:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12330 00000100:00080000:1.0:1746155571.780306:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155571.780375:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830976124625280:0@lo:400:kworker.0 00000100:00100000:3.0:1746155571.780420:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155571.780482:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124625408 00000100:00100000:2.0:1746155571.780485:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124625408 00000100:00100000:2.0:1746155571.780518:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1746155571.780524:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830976124625408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746155571.780562:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830976124625408:12345-0@lo:400:kworker.0 Request processed in 38us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.780566:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1746155571.780723:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830976124625408:0@lo:400:kworker.0 00000100:00100000:1.0:1746155571.780867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.781096:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123867136 00000100:00100000:3.0:1746155571.781099:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123867136 00002000:00100000:3.0:1746155571.781121:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1662976->1863679) req@ffff8800944ac380 x1830976123867136/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.781134:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ac380 with x1830976123867136 ext(1662976->1863679) 00010000:00010000:3.0:1746155571.781140:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 25 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.781149:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 25 pid: 29728 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746155571.781156:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800944ac380 00000100:00100000:3.0:1746155571.781222:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 754 00000100:00100000:3.0:1746155571.781228:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976123867136:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155571.784007:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123867136:12345-192.168.202.51@tcp:4:cat.0 Request processed in 2773us (3134us total) trans 17179873239 rc 0/0 00000100:00100000:3.0:1746155571.784016:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 754 00002000:00100000:3.0:1746155571.784027:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1662976->1863679) req@ffff8800944ac380 x1830976123867136/t17179873239(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:642/0 lens 488/448 e 0 to 0 dl 1746155582 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155571.784035:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ac380 with x1830976123867136 ext(1662976->1863679) 00010000:00010000:3.0:1746155571.784042:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 27 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:3.0:1746155571.784054:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 27 pid: 29728 timeout: 800 lvb_type: 0 00002000:00010000:3.0:1746155571.784060:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800944ac380 00000100:00100000:0.0:1746155571.789974:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.790068:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123867264 00000100:00100000:2.0:1746155571.790076:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123867264 00010000:00010000:2.0:1746155571.790105:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 27 pid: 29728 timeout: 800 lvb_type: 0 00000100:00100000:2.0:1746155571.790314:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6212 00000100:00100000:2.0:1746155571.790322:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123867264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.790334:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.790352:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 27 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.790364:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 27 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.790381:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009528a000/0x844e5faceb5ec335 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1662976->1863679) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11512 expref: 27 pid: 29728 timeout: 800 lvb_type: 0 00010000:00010000:2.0:1746155571.790813:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.790816:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.790823:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1156d expref: 13 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.790831:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1156d expref: 13 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.790858:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1156d expref: 13 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.790869:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124625536:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155571.791367:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155571.793924:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124625536:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155571.793945:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.793981:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123867264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3658us (4012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.793990:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6212 00000100:00100000:0.0:1746155571.801051:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.801410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.801479:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123867520 00000100:00100000:1.0:1746155571.801486:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123867520 00002000:00100000:1.0:1746155571.801551:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff8800948e4a80 x1830976123867520/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.801559:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4a80 with x1830976123867520 ext(1048576->2097151) 00002000:00010000:1.0:1746155571.801564:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e4a80 00000100:00100000:1.0:1746155571.801576:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123867776 00000100:00100000:1.0:1746155571.801578:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123867776 00002000:00100000:1.0:1746155571.801587:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800948e6a00 x1830976123867776/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.801593:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e6a00 with x1830976123867776 ext(1048576->2097151) 00002000:00010000:1.0:1746155571.801595:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e6a00 00000100:00100000:1.0:1746155571.801614:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4767 00000100:00100000:1.0:1746155571.801619:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123867520:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155571.803313:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4768 00000100:00100000:2.0:1746155571.803321:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123867776:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155571.810334:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123867520:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8705us (9281us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155571.810345:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4767 00002000:00100000:1.0:1746155571.810356:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff8800948e4a80 x1830976123867520/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155571.810364:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4a80 with x1830976123867520 ext(1048576->2097151) 00002000:00010000:1.0:1746155571.810369:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e4a80 00000100:00100000:2.0:1746155571.811077:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123867776:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7756us (9666us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155571.811084:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4768 00002000:00100000:2.0:1746155571.811090:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800948e6a00 x1830976123867776/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/440 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.811096:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e6a00 with x1830976123867776 ext(1048576->2097151) 00002000:00010000:2.0:1746155571.811099:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e6a00 00000100:00100000:0.0:1746155571.838642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.838689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.839163:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123868032 00000100:00100000:3.0:1746155571.839171:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123868032 00000100:00100000:3.0:1746155571.839219:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10067 00000100:00100000:3.0:1746155571.839227:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:29290:x1830976123868032:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155571.839247:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.839263:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5ec3cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11574 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.839352:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839362:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839370:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839381:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec3dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839386:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec3dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839391:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec3dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839471:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec3e4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839480:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839485:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155571.839491:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155571.839605:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839611:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839617:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839621:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0db2c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155571.839624:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839630:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839639:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155571.839641:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155571.839644:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839648:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec3d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839666:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec3dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839674:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec3dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839679:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec3dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839682:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0db3c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155571.839684:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec3dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839688:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec3dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839693:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801366f8100) 00010000:00010000:3.0:1746155571.839695:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155571.839697:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec3dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839701:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec3dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.839728:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5ec3cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11574 expref: 302 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.839737:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec3e4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11574 expref: 301 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.839742:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.839744:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155571.839745:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3a00, rc 0) 00000100:00100000:3.0:1746155571.839782:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:29290:x1830976123868032:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 556us (1148us total) trans 8589944024 rc 0/0 00000100:00100000:3.0:1746155571.839788:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10067 00000100:00100000:1.0:1746155571.839946:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123868288 00000100:00100000:1.0:1746155571.839951:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123868288 00000100:00100000:1.0:1746155571.839980:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4076 00000100:00100000:1.0:1746155571.839986:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29285:x1830976123868288:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155571.840079:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29285:x1830976123868288:12345-192.168.202.51@tcp:35:cat.0 Request processed in 93us (1390us total) trans 8589944025 rc 0/0 00000100:00100000:1.0:1746155571.840084:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4076 00000100:00100000:0.0:1746155571.844726:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.845351:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.845436:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123868672 00000100:00100000:1.0:1746155571.845444:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123868672 00000100:00100000:1.0:1746155571.845486:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4077 00000100:00100000:1.0:1746155571.845493:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:29290:x1830976123868672:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155571.845996:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123868416 00000100:00100000:3.0:1746155571.846000:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123868416 00000100:00100000:3.0:1746155571.846038:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 600 00000100:00100000:3.0:1746155571.846043:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:1963:x1830976123868416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.846054:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.846073:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec3e4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11574 expref: 302 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.846088:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.846091:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.846122:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1963:x1830976123868416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.846128:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 600 00000100:00100000:1.0:1746155571.846450:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:29290:x1830976123868672:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 956us (1099us total) trans 8589944026 rc 0/0 00000100:00100000:1.0:1746155571.846456:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4077 00000100:00100000:0.0:1746155571.882872:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.882960:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123868928 00000100:00100000:3.0:1746155571.882967:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123868928 00000100:00100000:3.0:1746155571.883014:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10068 00000100:00100000:3.0:1746155571.883021:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29293:x1830976123868928:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155571.883038:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155571.883054:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec3f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1157b expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.883136:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5ec3f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883146:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5ec3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883160:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5ec3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883170:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec400 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883175:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883180:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883261:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec407 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883268:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec407 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883275:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec407 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155571.883282:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155571.883355:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5ec3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883361:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5ec3f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883365:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5ec3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883371:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0db2e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155571.883374:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5ec3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883381:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5ec3f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883390:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155571.883392:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155571.883395:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5ec3f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883399:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2e00/0x844e5faceb5ec3f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883411:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883415:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec400 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883419:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883423:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0db3c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155571.883424:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883428:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec400 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883434:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801366f8500) 00010000:00010000:3.0:1746155571.883436:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155571.883437:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec400 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883441:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec400 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155571.883472:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec3f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1157b expref: 24 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.883481:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec407 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1157b expref: 23 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.883486:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.883488:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155571.883490:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db2c00, rc 0) 00000100:00100000:3.0:1746155571.883564:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29293:x1830976123868928:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 542us (698us total) trans 8589944027 rc 0/0 00000100:00100000:3.0:1746155571.883570:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10068 00000100:00100000:0.0:1746155571.886958:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.887014:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123869056 00000100:00100000:3.0:1746155571.887020:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123869056 00000100:00100000:3.0:1746155571.887052:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 601 00000100:00100000:3.0:1746155571.887058:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123869056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.887071:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.887088:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec407 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1157b expref: 23 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.887116:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.887119:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.887149:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123869056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 91us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.887154:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 601 00000100:00100000:0.0:1746155571.889440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.889619:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123869184 00000100:00100000:1.0:1746155571.889626:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123869184 00000100:00100000:1.0:1746155571.889656:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12331 00000100:00100000:1.0:1746155571.889662:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29293:x1830976123869184:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155571.889675:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.889689:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11582 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.889710:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a9 expref: 16 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.889717:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ec2d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114e8 expref: 19 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.889728:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.889729:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.889733:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2875392->3092479] (req 2875392->3092479) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 19 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.889755:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ec2d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114e8 expref: 19 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.889764:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ec2d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114e8 expref: 19 pid: 20200 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746155571.889774:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124625664:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155571.889853:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a9 expref: 16 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.889862:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a9 expref: 16 pid: 20200 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155571.889869:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124625792:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155571.889884:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155571.894881:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124625664:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155571.894891:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976124625792:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155571.894914:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2875392->3092479] (req 2875392->3092479) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 19 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.894935:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6600, rc 0) 00000100:00100000:1.0:1746155571.894982:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29293:x1830976123869184:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5319us (5546us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.894989:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12331 00000100:00100000:0.0:1746155571.897048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.897135:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123869312 00000100:00100000:2.0:1746155571.897142:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123869312 00010000:00010000:2.0:1746155571.897167:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a9 expref: 17 pid: 20200 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155571.897249:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6213 00000100:00100000:2.0:1746155571.897257:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123869312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.897267:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.897285:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a9 expref: 17 pid: 20200 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155571.897294:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a9 expref: 17 pid: 20200 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155571.897313:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ec278 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114a9 expref: 17 pid: 20200 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155571.897753:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.897959:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123869312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 701us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.897965:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6213 00000100:00100000:1.0:1746155571.899082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.899385:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123869440 00000100:00100000:2.0:1746155571.899390:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123869440 00010000:00010000:2.0:1746155571.899407:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ec2d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114e8 expref: 19 pid: 20200 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746155571.899629:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6214 00000100:00100000:2.0:1746155571.899636:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976123869440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.899645:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.899659:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ec2d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114e8 expref: 19 pid: 20200 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155571.899669:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ec2d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114e8 expref: 19 pid: 20200 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155571.899683:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3a00/0x844e5faceb5ec2d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114e8 expref: 19 pid: 20200 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155571.899693:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.899694:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155571.899700:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.899707:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.899733:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155571.899744:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124625920:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155571.900227:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.902554:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124625920:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155571.902576:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.902607:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123869440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2970us (3525us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.902615:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6214 00000100:00100000:0.0:1746155571.903416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.903521:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123869696 00000100:00100000:2.0:1746155571.903527:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123869696 00002000:00100000:2.0:1746155571.903567:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3088384->3092479) req@ffff880094c30e00 x1830976123869696/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/0 e 0 to 0 dl 1746155582 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.903574:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c30e00 with x1830976123869696 ext(3088384->3092479) 00002000:00010000:2.0:1746155571.903578:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c30e00 00000100:00100000:2.0:1746155571.903692:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4769 00000100:00100000:2.0:1746155571.903699:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123869696:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155571.903962:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123869696:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 263us (546us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155571.903968:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4769 00002000:00100000:2.0:1746155571.903973:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3088384->3092479) req@ffff880094c30e00 x1830976123869696/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:642/0 lens 488/4536 e 0 to 0 dl 1746155582 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155571.903980:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c30e00 with x1830976123869696 ext(3088384->3092479) 00002000:00010000:2.0:1746155571.903983:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c30e00 00000100:00100000:0.0:1746155571.906950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.907270:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123869952 00000100:00100000:1.0:1746155571.907277:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123869952 00000100:00100000:1.0:1746155571.907321:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4078 00000100:00100000:1.0:1746155571.907328:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29293:x1830976123869952:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155571.907529:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29293:x1830976123869952:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 200us (584us total) trans 8589944028 rc 0/0 00000100:00100000:1.0:1746155571.907535:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4078 00000100:00100000:0.0:1746155571.970435:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.970574:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123870208 00000100:00100000:2.0:1746155571.970582:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123870208 00000100:00100000:2.0:1746155571.970632:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10069 00000100:00100000:2.0:1746155571.970640:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:29299:x1830976123870208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.970660:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.970676:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58400/0x844e5faceb5ec41c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11589 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.971186:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5ec423 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971202:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5ec423 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971211:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5ec423 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971222:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec42a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971227:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec42a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971231:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec42a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971326:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec431 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971334:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec431 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971340:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec431 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155571.971348:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155571.971418:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5ec423 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971424:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5ec423 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971430:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5ec423 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971437:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca58e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.971441:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5ec423 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971447:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5ec423 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971456:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155571.971459:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.971462:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5ec423 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971466:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5ec423 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971553:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec42a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971558:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec42a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971562:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec42a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971566:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca59800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.971568:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec42a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971573:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec42a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971579:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9200) 00010000:00010000:2.0:1746155571.971581:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.971584:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec42a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971588:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59800/0x844e5faceb5ec42a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.971621:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58400/0x844e5faceb5ec41c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11589 expref: 304 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.971633:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec431 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11589 expref: 303 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.971638:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.971640:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155571.971642:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca58000, rc 0) 00000100:00100000:2.0:1746155571.973325:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:29299:x1830976123870208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2680us (2891us total) trans 8589944029 rc 0/0 00000100:00100000:2.0:1746155571.973334:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10069 00000100:00100000:1.0:1746155571.975014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155571.975114:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123870464 00000100:00100000:2.0:1746155571.975121:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123870464 00000100:00100000:2.0:1746155571.975155:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10070 00000100:00100000:2.0:1746155571.975161:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29300:x1830976123870464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155571.975178:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155571.975192:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec43f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11590 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.975275:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec446 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975286:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec446 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975295:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec446 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975305:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59200/0x844e5faceb5ec44d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975310:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59200/0x844e5faceb5ec44d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975315:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59200/0x844e5faceb5ec44d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975397:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec454 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975404:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec454 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975408:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec454 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155571.975414:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155571.975479:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec446 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975486:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec446 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975490:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec446 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975495:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca58600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.975498:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec446 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975528:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec446 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975544:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155571.975547:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.975550:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975554:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5ec446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975566:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59200/0x844e5faceb5ec44d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975570:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59200/0x844e5faceb5ec44d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975575:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59200/0x844e5faceb5ec44d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975578:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca59200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155571.975580:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59200/0x844e5faceb5ec44d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975584:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59200/0x844e5faceb5ec44d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975590:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9900) 00010000:00010000:2.0:1746155571.975591:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155571.975593:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59200/0x844e5faceb5ec44d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975597:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59200/0x844e5faceb5ec44d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155571.975628:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58a00/0x844e5faceb5ec43f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11590 expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.975638:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec454 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11590 expref: 25 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.975643:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.975645:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155571.975647:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca59400, rc 0) 00000100:00100000:2.0:1746155571.975685:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+25:29300:x1830976123870464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 523us (673us total) trans 8589944030 rc 0/0 00000100:00100000:2.0:1746155571.975690:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10070 00000100:00100000:0.0:1746155571.977336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.977754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.977776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155571.977791:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123870720 00000100:00100000:0.0:1746155571.977797:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123870720 00000100:00100000:2.0:1746155571.977846:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123870976 00000100:00100000:2.0:1746155571.977849:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123870976 00000100:00100000:0.0:1746155571.977972:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123870592 00000100:00100000:0.0:1746155571.977975:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123870592 00000100:00100000:1.0:1746155571.978010:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12332 00000100:00100000:1.0:1746155571.978021:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12333 00000100:00100000:1.0:1746155571.978027:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123870592:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155571.978040:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.978053:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6a00/0x844e5faceb5ec462 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11597 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.978071:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.978072:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.978080:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6a00/0x844e5faceb5ec462 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11597 expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.978097:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6a00/0x844e5faceb5ec462 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11597 expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.978106:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6a00, rc 0) 00000100:00100000:1.0:1746155571.978140:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123870592:12345-192.168.202.51@tcp:101:cat.0 Request processed in 114us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.978146:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12333 00000100:00100000:1.0:1746155571.978163:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123870720:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155571.978168:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.978173:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ec469 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1159e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155571.978184:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.978185:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155571.978189:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ec469 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1159e expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.978197:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ec469 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1159e expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.978202:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6e00, rc 0) 00000100:00100000:1.0:1746155571.978214:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123870720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 198us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155571.978219:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12332 00000100:00100000:1.0:1746155571.978251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155571.978262:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123870848 00000100:00100000:1.0:1746155571.978265:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123870848 00000100:00100000:1.0:1746155571.978278:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12334 00000100:00100000:1.0:1746155571.978281:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123870848:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155571.978287:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155571.978294:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ec470 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115a5 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155571.978326:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124626048:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155571.978376:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155571.978518:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 602 00000100:00100000:2.0:1746155571.978525:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:1962:x1830976123870976:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155571.978534:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155571.978560:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58000/0x844e5faceb5ec431 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11589 expref: 303 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155571.978573:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155571.978576:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155571.978610:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:1962:x1830976123870976:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155571.978616:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 602 00000100:00100000:0.0:1746155571.978985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155571.979023:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123871104 00000100:00100000:3.0:1746155571.979027:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123871104 00000100:00100000:3.0:1746155571.979047:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 603 00000100:00100000:3.0:1746155571.979052:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123871104:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155571.979058:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155571.979069:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5ec454 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11590 expref: 25 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155571.979080:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155571.979083:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155571.979101:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123871104:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155571.979107:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 603 00002000:00010000:1.0:1746155571.981747:0:1625:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime: 1746155571 -> 1746155572 00002000:00010000:1.0:1746155571.981753:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155571 -> 1746155572 00002000:00010000:1.0:1746155571.981754:0:1625:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime: 1746155571 -> 1746155572 00000100:00100000:1.0:1746155571.981771:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124626048:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155571.981791:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ec470 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115a5 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.981799:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ec470 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115a5 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155571.981816:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6200, rc 0) 00000100:00100000:1.0:1746155571.981848:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123870848:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3565us (3595us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155571.981854:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12334 00000100:00100000:0.0:1746155572.011116:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.011648:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.011667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.011684:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123871360 00000100:00100000:0.0:1746155572.011691:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123871360 00002000:00100000:0.0:1746155572.011725:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3362815) req@ffff880094c33b80 x1830976123871360/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 504/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.011733:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c33b80 with x1830976123871360 ext(2097152->3362815) 00002000:00010000:0.0:1746155572.011738:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c33b80 00000100:00100000:0.0:1746155572.011763:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123871616 00000100:00100000:0.0:1746155572.011765:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123871616 00002000:00100000:0.0:1746155572.011775:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3362816->4194303) req@ffff880094c31f80 x1830976123871616/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.011782:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c31f80 with x1830976123871616 ext(3362816->4194303) 00002000:00010000:0.0:1746155572.011785:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c31f80 00000100:00100000:0.0:1746155572.011792:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123871872 00000100:00100000:0.0:1746155572.011794:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123871872 00002000:00100000:0.0:1746155572.011811:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094c31180 x1830976123871872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.011817:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c31180 with x1830976123871872 ext(1048576->2097151) 00002000:00010000:0.0:1746155572.011820:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c31180 00000100:00100000:0.0:1746155572.011829:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4770 00000100:00100000:0.0:1746155572.011834:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123871360:12345-192.168.202.51@tcp:3:cat.0 00000100:00080000:1.0:1746155572.012741:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746155572.012756:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4771 00000100:00100000:1.0:1746155572.012764:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123871616:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155572.014634:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4772 00000100:00100000:3.0:1746155572.014649:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123871872:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155572.014860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.016493:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123872128 00000100:00100000:0.0:1746155572.016512:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123872128 00002000:00100000:0.0:1746155572.016555:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880094c32300 x1830976123872128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.016563:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c32300 with x1830976123872128 ext(1048576->2097151) 00002000:00010000:0.0:1746155572.016568:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c32300 00000100:00100000:0.0:1746155572.016583:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4773 00000100:00100000:0.0:1746155572.016594:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123872128:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.034966:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123871616:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22196us (23311us total) trans 0 rc 831488/831488 00000100:00100000:1.0:1746155572.034975:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4771 00002000:00100000:1.0:1746155572.034984:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (3362816->4194303) req@ffff880094c31f80 x1830976123871616/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 831488/831488 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.034993:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c31f80 with x1830976123871616 ext(3362816->4194303) 00002000:00010000:1.0:1746155572.034997:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c31f80 00000100:00100000:3.0:1746155572.041096:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123871872:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26445us (29418us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155572.041107:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4772 00002000:00100000:3.0:1746155572.041117:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094c31180 x1830976123871872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.041126:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c31180 with x1830976123871872 ext(1048576->2097151) 00002000:00010000:3.0:1746155572.041131:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c31180 00000100:00100000:2.0:1746155572.044690:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123872128:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28093us (29823us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155572.044700:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4773 00002000:00100000:2.0:1746155572.044709:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880094c32300 x1830976123872128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.044716:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c32300 with x1830976123872128 ext(1048576->2097151) 00002000:00010000:2.0:1746155572.044721:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c32300 00000100:00100000:0.0:1746155572.048349:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.049402:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123872384 00000100:00100000:3.0:1746155572.049411:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123872384 00000100:00100000:3.0:1746155572.049464:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10071 00000100:00100000:3.0:1746155572.049470:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29302:x1830976123872384:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155572.049492:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.049534:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5ec477 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115ac expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.049626:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec47e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049636:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec47e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049645:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec47e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049655:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec485 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049660:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049665:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049745:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec48c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049752:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec48c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049758:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec48c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155572.049765:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155572.049830:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec47e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049838:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec47e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049843:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec47e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049847:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0db2c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155572.049850:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec47e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049854:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec47e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049863:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155572.049865:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155572.049868:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec47e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049872:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2c00/0x844e5faceb5ec47e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049892:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049896:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec485 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049900:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049902:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0db3a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155572.049904:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049911:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec485 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049916:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801366f8f00) 00010000:00010000:3.0:1746155572.049917:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155572.049919:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec485 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049923:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3a00/0x844e5faceb5ec485 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.049953:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3800/0x844e5faceb5ec477 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ac expref: 27 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.049960:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec48c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ac expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.049965:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155572.049966:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155572.049968:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3c00, rc 0) 00000100:00100000:3.0:1746155572.050023:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29302:x1830976123872384:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 552us (1681us total) trans 8589944031 rc 0/0 00000100:00100000:3.0:1746155572.050029:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10071 00000100:00100000:0.0:1746155572.050579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.050623:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123872512 00000100:00100000:1.0:1746155572.050627:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123872512 00000100:00100000:1.0:1746155572.050657:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12335 00000100:00080000:0.0:1746155572.050657:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746155572.050662:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:29290:x1830976123872512:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155572.050669:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.050678:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115b3 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.050693:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 19 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.050699:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155572.050700:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155572.050703:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.050722:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 19 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.050735:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 19 pid: 8438 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.050744:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124626176:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155572.050811:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155572.055464:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123871360:12345-192.168.202.51@tcp:3:cat.0 Request processed in 43619us (44344us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155572.055474:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4770 00002000:00100000:3.0:1746155572.055484:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3362815) req@ffff880094c33b80 x1830976123871360/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 504/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.055499:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c33b80 with x1830976123871360 ext(2097152->3362815) 00010000:00010000:3.0:1746155572.055522:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 18 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.055534:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 18 pid: 8438 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746155572.055553:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c33b80 00000100:00100000:0.0:1746155572.065757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.065810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.065839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.065868:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123872768 00000100:00100000:0.0:1746155572.065875:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123872768 00002000:00100000:0.0:1746155572.065907:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2875392->3092479) req@ffff880094c30700 x1830976123872768/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.065915:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c30700 with x1830976123872768 ext(2875392->3092479) 00010000:00010000:0.0:1746155572.065923:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 18 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.065933:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 18 pid: 8438 timeout: 801 lvb_type: 0 00002000:00010000:0.0:1746155572.065939:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c30700 00000100:00100000:0.0:1746155572.065950:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123873024 00000100:00100000:0.0:1746155572.065952:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123873024 00002000:00100000:0.0:1746155572.065960:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880094c33100 x1830976123873024/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.065966:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c33100 with x1830976123873024 ext(4194304->4956159) 00010000:00010000:0.0:1746155572.065970:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 19 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.065977:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 19 pid: 8438 timeout: 801 lvb_type: 0 00002000:00010000:0.0:1746155572.065982:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c33100 00000100:00100000:0.0:1746155572.065992:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 755 00000100:00100000:0.0:1746155572.065998:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123872768:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155572.066231:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 756 00000100:00100000:0.0:1746155572.066236:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123873024:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155572.067954:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123872640 00000100:00100000:2.0:1746155572.067959:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123872640 00000100:00100000:2.0:1746155572.067988:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12336 00000100:00100000:2.0:1746155572.067993:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:29299:x1830976123872640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155572.068003:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.068015:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115ba expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.068032:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155572.068036:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.068041:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746155572.068044:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ba expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.068071:0:8437:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.068080:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ba expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.068092:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4000, rc 0) 00000100:00100000:2.0:1746155572.068127:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:29299:x1830976123872640:12345-192.168.202.51@tcp:101:cat.0 Request processed in 134us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.068132:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12336 00000100:00100000:1.0:1746155572.068156:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124626176:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155572.068170:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.068178:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6400, rc 0) 00000100:00100000:1.0:1746155572.068196:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:29290:x1830976123872512:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 17534us (17618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.068201:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12335 00000100:00100000:0.0:1746155572.078037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.078903:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123873024:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12664us (13061us total) trans 0 rc 761856/761856 00000100:00100000:0.0:1746155572.078913:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 756 00002000:00100000:0.0:1746155572.078923:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880094c33100 x1830976123873024/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:H/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.078932:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c33100 with x1830976123873024 ext(4194304->4956159) 00010000:00010000:0.0:1746155572.078940:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 20 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.078953:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 20 pid: 8438 timeout: 801 lvb_type: 0 00002000:00010000:0.0:1746155572.078959:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c33100 00000100:00100000:2.0:1746155572.079134:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123873152 00000100:00100000:2.0:1746155572.079140:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123873152 00000100:00100000:2.0:1746155572.079182:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 604 00000100:00100000:2.0:1746155572.079189:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123873152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.079199:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155572.079222:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db3c00/0x844e5faceb5ec48c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ac expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.079248:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.079255:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155572.079272:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123873152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 84us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.079277:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 604 00000100:00100000:1.0:1746155572.079978:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123872768:12345-192.168.202.51@tcp:4:cat.0 Request processed in 13976us (14163us total) trans 21474840625 rc 0/0 00000100:00100000:1.0:1746155572.079986:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 755 00002000:00100000:1.0:1746155572.079993:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2875392->3092479) req@ffff880094c30700 x1830976123872768/t21474840625(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/448 e 0 to 0 dl 1746155583 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.080000:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c30700 with x1830976123872768 ext(2875392->3092479) 00010000:00010000:1.0:1746155572.080006:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 20 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.080018:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 20 pid: 8438 timeout: 801 lvb_type: 0 00002000:00010000:1.0:1746155572.080024:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c30700 00000100:00100000:0.0:1746155572.080267:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.083617:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123873280 00000100:00100000:1.0:1746155572.083628:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123873280 00000100:00100000:1.0:1746155572.083675:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12337 00000100:00100000:1.0:1746155572.083681:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29300:x1830976123873280:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.083696:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.083711:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115c1 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.083732:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155572.083734:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155572.083737:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c1 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.083748:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c1 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.083757:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450c600, rc 0) 00000100:00100000:1.0:1746155572.083816:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29300:x1830976123873280:12345-192.168.202.51@tcp:101:cat.0 Request processed in 134us (3549us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.083821:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12337 00000100:00100000:0.0:1746155572.084696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.084756:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123873408 00000100:00100000:2.0:1746155572.084760:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123873408 00010000:00010000:2.0:1746155572.084776:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 21 pid: 8438 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.084804:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6215 00000100:00100000:2.0:1746155572.084809:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123873408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.084818:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155572.084834:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 21 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.084843:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 21 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.084858:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6600/0x844e5faceb5ec415 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2875392->3092479) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11582 expref: 21 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.084866:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.084867:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.084872:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.084878:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.084901:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.084911:0:7063:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 17 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.084921:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124626432:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155572.084986:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155572.097936:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124626432:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155572.097960:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155572.098002:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123873408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 13192us (13306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.098012:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6215 00000100:00100000:1.0:1746155572.098194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.098245:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123873664 00000100:00100000:1.0:1746155572.098250:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123873664 00002000:00100000:1.0:1746155572.098283:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2588672->2592767) req@ffff880090189c00 x1830976123873664/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.098297:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189c00 with x1830976123873664 ext(2588672->2592767) 00010000:00010000:1.0:1746155572.098305:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.098317:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00002000:00010000:1.0:1746155572.098323:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090189c00 00000100:00100000:1.0:1746155572.098337:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 757 00000100:00100000:1.0:1746155572.098343:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976123873664:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.098459:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976123873664:12345-192.168.202.51@tcp:3:cat.0 Request processed in 116us (265us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155572.098464:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 757 00002000:00100000:1.0:1746155572.098468:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2588672->2592767) req@ffff880090189c00 x1830976123873664/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.098474:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189c00 with x1830976123873664 ext(2588672->2592767) 00010000:00010000:1.0:1746155572.098478:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.098486:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00002000:00010000:1.0:1746155572.098491:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090189c00 00000100:00100000:0.0:1746155572.105984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.106025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.106090:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123873920 00000100:00100000:2.0:1746155572.106096:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123873920 00000100:00100000:2.0:1746155572.106135:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12338 00000100:00100000:2.0:1746155572.106141:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:29290:x1830976123873920:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155572.106155:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.106169:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115c8 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.106190:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114fd expref: 13 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.106197:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5ec343 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11520 expref: 29 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.106202:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.106204:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.106206:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->2519039] (req 2097152->2519039) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.106229:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5ec343 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11520 expref: 29 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.106238:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5ec343 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11520 expref: 29 pid: 4461 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746155572.106247:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124626560:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.106334:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114fd expref: 13 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.106341:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114fd expref: 13 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.106349:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124626688:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.106366:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155572.106603:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123874048 00000100:00100000:1.0:1746155572.106607:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123874048 00002000:00100000:1.0:1746155572.106629:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (2588672->3145727) req@ffff880130c9f480 x1830976123874048/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.106637:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9f480 with x1830976123874048 ext(2588672->3145727) 00010000:00010000:1.0:1746155572.106643:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.106652:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00002000:00010000:1.0:1746155572.106658:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130c9f480 00000100:00100000:1.0:1746155572.106670:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 758 00000100:00100000:1.0:1746155572.106676:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976123874048:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155572.115952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.116337:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124626560:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155572.116347:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124626688:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.116371:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->2519039] (req 2097152->2519039) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.116386:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4a00, rc 0) 00000100:00100000:2.0:1746155572.116807:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123874176 00000100:00100000:2.0:1746155572.116815:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123874176 00000100:00100000:3.0:1746155572.116864:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29290:x1830976123873920:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 10722us (10887us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.116874:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12338 00000100:00100000:3.0:1746155572.116934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.116950:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123874304 00000100:00100000:3.0:1746155572.116953:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123874304 00010000:00010000:3.0:1746155572.116968:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114fd expref: 14 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.116989:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6216 00000100:00100000:3.0:1746155572.116995:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123874304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155572.117004:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155572.117025:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114fd expref: 14 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.117037:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114fd expref: 14 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.117056:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3600/0x844e5faceb5ec2e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f114fd expref: 14 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.117072:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155572.117106:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123874304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 107us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.117112:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6216 00010000:00010000:2.0:1746155572.117143:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5ec343 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11520 expref: 30 pid: 4461 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746155572.117167:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6217 00000100:00100000:2.0:1746155572.117172:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123874176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.117268:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155572.117278:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5ec343 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11520 expref: 29 pid: 4461 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.117285:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5ec343 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11520 expref: 29 pid: 4461 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.117297:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca58800/0x844e5faceb5ec343 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11520 expref: 29 pid: 4461 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.117311:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.117313:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.117319:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 28 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.117325:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 28 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.117347:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 28 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.117357:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124626816:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155572.117403:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155572.119456:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123874048:12345-192.168.202.51@tcp:4:cat.0 Request processed in 12775us (13424us total) trans 21474840626 rc 0/0 00000100:00100000:1.0:1746155572.119466:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 758 00002000:00100000:1.0:1746155572.119474:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (2588672->3145727) req@ffff880130c9f480 x1830976123874048/t21474840626(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/448 e 0 to 0 dl 1746155583 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.119482:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9f480 with x1830976123874048 ext(2588672->3145727) 00010000:00010000:1.0:1746155572.119489:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.119517:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00002000:00010000:1.0:1746155572.119523:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130c9f480 00010000:00010000:2.0:1746155572.121213:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746155572.123779:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124626816:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155572.123805:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155572.123854:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123874176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6680us (7908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.123864:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6217 00000100:00100000:0.0:1746155572.125079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.126035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.126205:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123874432 00000100:00100000:3.0:1746155572.126213:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123874432 00010000:00010000:3.0:1746155572.126240:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.126275:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6218 00000100:00100000:3.0:1746155572.126281:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123874432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155572.126292:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155572.126310:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.126321:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.126339:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec49a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2588672->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115b3 expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.126350:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.126351:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.126356:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ba expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.126363:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ba expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.126370:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.126371:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.126374:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c1 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.126384:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c1 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.126409:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c1 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155572.126419:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124626944:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155572.126484:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ba expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155572.126492:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124627072:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155572.126533:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110180 going to sleep for 11 seconds 00000100:00100000:1.0:1746155572.126586:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123874688 00000100:00100000:1.0:1746155572.126590:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123874688 00002000:00100000:1.0:1746155572.126615:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2514944->2519039) req@ffff880130c9d500 x1830976123874688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.126832:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9d500 with x1830976123874688 ext(2514944->2519039) 00002000:00010000:1.0:1746155572.126836:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9d500 00000100:00100000:1.0:1746155572.126856:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4774 00000100:00100000:1.0:1746155572.126862:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123874688:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.126998:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123874688:12345-192.168.202.51@tcp:3:cat.0 Request processed in 134us (962us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155572.127004:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4774 00002000:00100000:1.0:1746155572.127009:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2514944->2519039) req@ffff880130c9d500 x1830976123874688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.127015:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9d500 with x1830976123874688 ext(2514944->2519039) 00002000:00010000:1.0:1746155572.127018:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9d500 00000100:00100000:3.0:1746155572.135829:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124626944:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155572.135838:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124627072:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155572.135854:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155572.135857:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.135888:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123874432:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9606us (10810us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.135895:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6218 00000100:00100000:2.0:1746155572.135968:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123874944 00000100:00100000:2.0:1746155572.135973:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123874944 00002000:00100000:2.0:1746155572.135998:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880130c9ce00 x1830976123874944/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.136006:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ce00 with x1830976123874944 ext(3145728->4194303) 00002000:00010000:2.0:1746155572.136010:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9ce00 00000100:00100000:2.0:1746155572.136031:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4775 00000100:00100000:2.0:1746155572.136036:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123874944:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155572.143034:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.143067:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.143093:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.143108:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123875200 00000100:00100000:0.0:1746155572.143108:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123875456 00000100:00100000:1.0:1746155572.143114:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123875200 00000100:00100000:0.0:1746155572.143114:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123875456 00002000:00100000:1.0:1746155572.143144:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880130c9f800 x1830976123875200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.143144:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880130c9e680 x1830976123875456/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.143152:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9f800 with x1830976123875200 ext(2097152->3145727) 00002000:00100000:0.0:1746155572.143152:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9e680 with x1830976123875456 ext(3145728->4194303) 00002000:00010000:1.0:1746155572.143157:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9f800 00002000:00010000:0.0:1746155572.143157:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9e680 00000100:00100000:1.0:1746155572.143177:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123875712 00000100:00100000:1.0:1746155572.143179:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123875712 00000100:00100000:0.0:1746155572.143185:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4776 00002000:00100000:1.0:1746155572.143189:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2519040->3567615) req@ffff880130c9c000 x1830976123875712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155572.143191:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123875200:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:1.0:1746155572.143201:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9c000 with x1830976123875712 ext(2519040->3567615) 00002000:00010000:1.0:1746155572.143204:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9c000 00000100:00100000:1.0:1746155572.143220:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4777 00000100:00100000:1.0:1746155572.143226:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976123875456:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155572.143264:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4778 00000100:00100000:2.0:1746155572.143272:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123875712:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155572.144212:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.144290:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123875968 00000100:00100000:3.0:1746155572.144294:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123875968 00002000:00100000:3.0:1746155572.144310:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3567616->4194303) req@ffff880130c9d880 x1830976123875968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.144316:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9d880 with x1830976123875968 ext(3567616->4194303) 00002000:00010000:3.0:1746155572.144319:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9d880 00000100:00100000:3.0:1746155572.144329:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4779 00000100:00100000:3.0:1746155572.144334:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123875968:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155572.156650:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123874944:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20605us (20786us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155572.156659:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4775 00002000:00100000:3.0:1746155572.156669:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880130c9ce00 x1830976123874944/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.156678:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ce00 with x1830976123874944 ext(3145728->4194303) 00002000:00010000:3.0:1746155572.156683:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9ce00 00000100:00100000:0.0:1746155572.156700:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123875200:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13508us (13673us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155572.156707:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4776 00002000:00100000:0.0:1746155572.156714:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880130c9f800 x1830976123875200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.156722:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9f800 with x1830976123875200 ext(2097152->3145727) 00002000:00010000:0.0:1746155572.156725:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9f800 00000100:00100000:2.0:1746155572.164548:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123875712:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21255us (21432us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155572.164560:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4778 00002000:00100000:2.0:1746155572.164571:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2519040->3567615) req@ffff880130c9c000 x1830976123875712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.164580:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9c000 with x1830976123875712 ext(2519040->3567615) 00002000:00010000:2.0:1746155572.164586:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9c000 00000100:00100000:1.0:1746155572.165261:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123875456:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22033us (22191us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155572.165267:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4777 00002000:00100000:1.0:1746155572.165272:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880130c9e680 x1830976123875456/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.165279:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9e680 with x1830976123875456 ext(3145728->4194303) 00002000:00010000:1.0:1746155572.165282:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9e680 00000100:00100000:3.0:1746155572.165764:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123875968:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21428us (21552us total) trans 0 rc 626688/626688 00000100:00100000:3.0:1746155572.165770:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4779 00002000:00100000:3.0:1746155572.165775:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3567616->4194303) req@ffff880130c9d880 x1830976123875968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 626688/626688 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.165781:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9d880 with x1830976123875968 ext(3567616->4194303) 00002000:00010000:3.0:1746155572.165784:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9d880 00000100:00100000:0.0:1746155572.167092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.167124:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.167170:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123876096 00000100:00100000:1.0:1746155572.167176:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123876096 00000100:00100000:1.0:1746155572.167210:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123876224 00000100:00100000:1.0:1746155572.167212:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123876224 00000100:00100000:1.0:1746155572.167226:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12339 00000100:00100000:1.0:1746155572.167232:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29300:x1830976123876096:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.167245:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.167259:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115cf expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.167280:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.167291:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155572.167293:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155572.167296:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115cf expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.167320:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.167330:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 27 pid: 8438 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.167340:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124627200:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155572.167403:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155572.167425:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12340 00000100:00100000:1.0:1746155572.167430:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29302:x1830976123876224:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155572.167437:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.167445:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115d6 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.167457:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ba expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.167464:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c1 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.167473:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.167474:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.167477:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.167489:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c1 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.167496:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c1 expref: 21 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.167519:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094084380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124627328:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155572.167564:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ba expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.167571:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ba expref: 18 pid: 8437 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.167578:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124627456:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155572.167592:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155572.171872:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094084380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124627328:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155572.171879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.171918:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124627456:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155572.171918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.171932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155572.171943:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155572.171954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155572.171961:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc02200, rc 0) 00000100:00100000:1.0:1746155572.172003:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29302:x1830976123876224:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4569us (4874us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.172010:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12340 00000100:00100000:2.0:1746155572.172031:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123876736 00000100:00100000:1.0:1746155572.172031:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123876480 00000100:00100000:2.0:1746155572.172035:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123876736 00000100:00100000:1.0:1746155572.172035:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123876480 00010000:00010000:2.0:1746155572.172052:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ba expref: 20 pid: 8437 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.172056:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12341 00000100:00100000:1.0:1746155572.172062:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29299:x1830976123876480:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155572.172065:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123876608 00000100:00100000:2.0:1746155572.172066:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123876608 00010000:00010000:2.0:1746155572.172072:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c1 expref: 21 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.172072:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.172081:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc33e00/0x844e5faceb5ec4c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115dd expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.172083:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6219 00000100:00100000:2.0:1746155572.172087:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123876736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.172094:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.172096:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.172098:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.172102:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc33e00/0x844e5faceb5ec4c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115dd expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155572.172146:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123876352 00000100:00100000:3.0:1746155572.172149:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123876352 00002000:00100000:3.0:1746155572.172171:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2519039) req@ffff880094f08700 x1830976123876352/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.172179:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08700 with x1830976123876352 ext(2097152->2519039) 00010000:00010000:3.0:1746155572.172185:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 28 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.172198:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 28 pid: 8438 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746155572.172208:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f08700 00000100:00100000:3.0:1746155572.172221:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 759 00000100:00100000:3.0:1746155572.172225:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123876352:12345-192.168.202.51@tcp:4:cat.0 00010000:00010000:2.0:1746155572.172334:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ba expref: 21 pid: 8437 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.172343:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ba expref: 21 pid: 8437 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.172356:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4000/0x844e5faceb5ec4a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115ba expref: 21 pid: 8437 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.172368:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155572.172386:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123876736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 299us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.172391:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6219 00000100:00100000:2.0:1746155572.172402:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6220 00000100:00100000:2.0:1746155572.172407:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123876608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.172412:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155572.172419:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c1 expref: 21 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.172426:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c1 expref: 21 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.172437:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450c600/0x844e5faceb5ec4a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c1 expref: 21 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.172443:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.172445:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.172448:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 20 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.172455:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 20 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155572.172599:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124627200:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.172612:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115cf expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.172621:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009520c600, rc 0) 00000100:00100000:3.0:1746155572.172635:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29300:x1830976123876096:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5404us (5546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.172641:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12339 00010000:00010000:2.0:1746155572.172903:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 20 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.172914:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976124627584:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155572.172929:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc33e00/0x844e5faceb5ec4c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115dd expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.172939:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc33e00, rc 0) 00000100:00100000:2.0:1746155572.172953:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94180 going to sleep for 11 seconds 00000100:00100000:1.0:1746155572.172958:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:29299:x1830976123876480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 896us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.172964:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12341 00000100:00100000:2.0:1746155572.177148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.177193:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123876992 00000100:00100000:0.0:1746155572.177201:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123876992 00002000:00100000:0.0:1746155572.177235:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3100672->3104767) req@ffff88012fef0380 x1830976123876992/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.177250:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0380 with x1830976123876992 ext(3100672->3104767) 00002000:00010000:0.0:1746155572.177254:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef0380 00000100:00100000:0.0:1746155572.177281:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4780 00000100:00100000:0.0:1746155572.177288:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123876992:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155572.177309:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976124627584:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155572.177329:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155572.177367:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123876608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4958us (5411us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.177376:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6220 00000100:00100000:0.0:1746155572.177420:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123876992:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 132us (279us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155572.177426:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4780 00002000:00100000:0.0:1746155572.177431:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3100672->3104767) req@ffff88012fef0380 x1830976123876992/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.177437:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0380 with x1830976123876992 ext(3100672->3104767) 00002000:00010000:0.0:1746155572.177440:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef0380 00000100:00100000:0.0:1746155572.180033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.180647:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123877248 00000100:00100000:1.0:1746155572.180654:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123877248 00002000:00100000:1.0:1746155572.180680:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094f09880 x1830976123877248/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.180688:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09880 with x1830976123877248 ext(3145728->4194303) 00002000:00010000:1.0:1746155572.180692:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f09880 00000100:00100000:1.0:1746155572.180719:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4781 00000100:00100000:1.0:1746155572.180725:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123877248:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155572.181910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.182597:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123876352:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10370us (10716us total) trans 17179873240 rc 0/0 00000100:00100000:3.0:1746155572.182606:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 759 00002000:00100000:3.0:1746155572.182613:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2519039) req@ffff880094f08700 x1830976123876352/t17179873240(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/448 e 0 to 0 dl 1746155583 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.182621:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08700 with x1830976123876352 ext(2097152->2519039) 00010000:00010000:3.0:1746155572.182628:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 30 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.182639:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 30 pid: 8438 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746155572.182645:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f08700 00000100:00100000:1.0:1746155572.182714:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123877376 00000100:00100000:1.0:1746155572.182719:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123877376 00000100:00100000:1.0:1746155572.182802:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12342 00000100:00100000:1.0:1746155572.182809:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29302:x1830976123877376:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155572.182820:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.182832:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115e4 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.182850:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155572.182852:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155572.182856:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->2629631] (req 2097152->2629631) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 15 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.182865:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->2629631] (req 2097152->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 15 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.182873:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc03c00, rc 0) 00000100:00100000:1.0:1746155572.183157:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29302:x1830976123877376:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 347us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.183164:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12342 00000100:00100000:1.0:1746155572.188711:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123877248:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7975us (8673us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155572.188722:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4781 00002000:00100000:1.0:1746155572.188948:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094f09880 x1830976123877248/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.188958:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09880 with x1830976123877248 ext(3145728->4194303) 00002000:00010000:1.0:1746155572.188962:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f09880 00000100:00100000:0.0:1746155572.189022:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.189353:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123877504 00000100:00100000:3.0:1746155572.189360:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123877504 00010000:00010000:3.0:1746155572.189382:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 30 pid: 8438 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.189405:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6221 00000100:00100000:3.0:1746155572.189411:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123877504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155572.189422:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155572.189437:0:7064:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155571 -> 1746155572 00002000:00010000:3.0:1746155572.189439:0:7064:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155571 -> 1746155572 00010000:00010000:3.0:1746155572.189443:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 30 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.189452:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 30 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.189471:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec4af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115c8 expref: 30 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.189598:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.189600:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.189607:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115cf expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.189614:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115cf expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.189621:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.189622:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.189625:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 14 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.189630:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 14 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.189653:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 14 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155572.189662:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124627712:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155572.189964:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115cf expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155572.189972:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124627840:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155572.189991:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155572.193528:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.193587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.193743:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123877760 00000100:00100000:1.0:1746155572.193751:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123877760 00002000:00100000:1.0:1746155572.193787:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012fef3480 x1830976123877760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.193796:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef3480 with x1830976123877760 ext(3145728->4194303) 00002000:00010000:1.0:1746155572.193801:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef3480 00000100:00100000:1.0:1746155572.193817:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4782 00000100:00100000:1.0:1746155572.193824:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123877760:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155572.195290:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124627712:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155572.195299:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124627840:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155572.195325:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155572.195338:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123877888 00000100:00100000:0.0:1746155572.195342:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123877888 00000100:00100000:3.0:1746155572.195355:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123877504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5944us (6333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.195364:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6221 00000100:00100000:0.0:1746155572.195364:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12343 00000100:00100000:0.0:1746155572.195368:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29299:x1830976123877888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155572.195375:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155572.195387:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ec4d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115eb expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.195402:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155572.195403:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155572.195408:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ec4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115eb expref: 30 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.195418:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ec4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115eb expref: 30 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.195424:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b5800, rc 0) 00000100:00100000:0.0:1746155572.195438:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29299:x1830976123877888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 71us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155572.195442:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12343 00000100:00100000:0.0:1746155572.195632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.195649:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123878144 00000100:00100000:2.0:1746155572.195653:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123878144 00002000:00100000:2.0:1746155572.195678:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2625536->2629631) req@ffff880094f0aa00 x1830976123878144/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.195687:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0aa00 with x1830976123878144 ext(2625536->2629631) 00002000:00010000:2.0:1746155572.195691:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f0aa00 00000100:00100000:2.0:1746155572.195742:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4783 00000100:00100000:2.0:1746155572.195749:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123878144:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155572.195837:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123878144:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 88us (204us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155572.195843:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4783 00002000:00100000:2.0:1746155572.195848:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2625536->2629631) req@ffff880094f0aa00 x1830976123878144/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.195855:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0aa00 with x1830976123878144 ext(2625536->2629631) 00002000:00010000:2.0:1746155572.195857:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f0aa00 00000100:00100000:0.0:1746155572.201738:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.201800:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123878400 00000100:00100000:3.0:1746155572.201808:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123878400 00002000:00100000:3.0:1746155572.201848:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880094f0b800 x1830976123878400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.201856:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0b800 with x1830976123878400 ext(3145728->4194303) 00002000:00010000:3.0:1746155572.201861:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f0b800 00000100:00100000:3.0:1746155572.201895:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4784 00000100:00100000:3.0:1746155572.201902:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123878400:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.202531:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123877760:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8705us (9028us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155572.202551:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4782 00002000:00100000:1.0:1746155572.202557:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012fef3480 x1830976123877760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.202564:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef3480 with x1830976123877760 ext(3145728->4194303) 00002000:00010000:1.0:1746155572.202567:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef3480 00000100:00100000:0.0:1746155572.202895:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.203130:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123878656 00000100:00100000:2.0:1746155572.203134:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123878656 00000100:00100000:2.0:1746155572.203165:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4079 00000100:00100000:2.0:1746155572.203171:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:29302:x1830976123878656:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155572.203309:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29302:x1830976123878656:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 137us (413us total) trans 8589944032 rc 0/0 00000100:00100000:2.0:1746155572.203314:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4079 00000100:00100000:0.0:1746155572.212670:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.212709:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.212766:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123878784 00000100:00100000:1.0:1746155572.212774:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123878784 00000100:00100000:1.0:1746155572.212818:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123878912 00000100:00100000:1.0:1746155572.212821:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123878912 00000100:00100000:2.0:1746155572.212838:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12344 00000100:00100000:2.0:1746155572.212854:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123878784:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155572.212854:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12345 00000100:00100000:1.0:1746155572.212862:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123878912:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155572.212875:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.212877:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.212893:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5400/0x844e5faceb5ec4e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115f2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.212893:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18000/0x844e5faceb5ec4d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f115f9 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.212917:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18000/0x844e5faceb5ec4d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115f9 expref: 16 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.212919:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5400/0x844e5faceb5ec4e0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115f2 expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.212927:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18000/0x844e5faceb5ec4d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115f9 expref: 16 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.212929:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5400/0x844e5faceb5ec4e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115f2 expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.212939:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e18000, rc 0) 00010000:00010000:2.0:1746155572.212948:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd5400, rc 0) 00000100:00100000:1.0:1746155572.212976:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123878912:12345-192.168.202.51@tcp:101:cat.0 Request processed in 114us (266us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155572.212980:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12345 00000100:00100000:2.0:1746155572.212984:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123878784:12345-192.168.202.51@tcp:101:cat.0 Request processed in 136us (321us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155572.212988:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12344 00000100:00100000:3.0:1746155572.214116:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123878400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12211us (12383us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155572.214124:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4784 00002000:00100000:3.0:1746155572.214131:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880094f0b800 x1830976123878400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.214139:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0b800 with x1830976123878400 ext(3145728->4194303) 00002000:00010000:3.0:1746155572.214143:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f0b800 00000100:00100000:0.0:1746155572.215642:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.216253:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123879040 00000100:00100000:3.0:1746155572.216259:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123879040 00000100:00100000:3.0:1746155572.217197:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12346 00000100:00100000:3.0:1746155572.217206:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29300:x1830976123879040:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155572.217221:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.217235:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a272200/0x844e5faceb5ec4e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11600 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.217255:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.217257:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.217264:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a272200/0x844e5faceb5ec4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11600 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.217276:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a272200/0x844e5faceb5ec4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11600 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.217285:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a272200, rc 0) 00000100:00100000:3.0:1746155572.217329:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29300:x1830976123879040:12345-192.168.202.51@tcp:101:cat.0 Request processed in 124us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155572.217523:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.217545:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123879168 00000100:00100000:0.0:1746155572.217548:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123879168 00000100:00100000:1.0:1746155572.217577:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.217577:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12347 00000100:00100000:0.0:1746155572.217582:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123879168:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155572.217589:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155572.217590:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123879296 00000100:00100000:1.0:1746155572.217593:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123879296 00010000:00010000:0.0:1746155572.217595:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013136a800/0x844e5faceb5ec4ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11607 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.217613:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013136a800/0x844e5faceb5ec4ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11607 expref: 20 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155572.217616:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12348 00000100:00100000:1.0:1746155572.217620:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123879296:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155572.217625:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013136a800/0x844e5faceb5ec4ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11607 expref: 20 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.217626:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.217636:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec4f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1160e expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.217636:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013136a800, rc 0) 00010000:00010000:1.0:1746155572.217651:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec4f5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1160e expref: 31 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.217658:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5ec4f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1160e expref: 31 pid: 29728 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155572.217660:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123879168:12345-192.168.202.51@tcp:101:cat.0 Request processed in 79us (138us total) trans 0 rc 301/301 00010000:00010000:1.0:1746155572.217665:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1800, rc 0) 00000100:00100000:0.0:1746155572.217666:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12347 00000100:00100000:1.0:1746155572.217677:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123879296:12345-192.168.202.51@tcp:101:cat.0 Request processed in 56us (101us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155572.217681:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12348 00000100:00100000:3.0:1746155572.217748:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12346 00000100:00100000:0.0:1746155572.221243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.221324:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123879552 00000100:00100000:3.0:1746155572.221332:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123879552 00002000:00100000:3.0:1746155572.221369:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880094f09f80 x1830976123879552/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.221378:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09f80 with x1830976123879552 ext(4194304->4956159) 00002000:00010000:3.0:1746155572.221382:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f09f80 00000100:00100000:2.0:1746155572.221655:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4785 00000100:00100000:2.0:1746155572.221671:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123879552:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155572.221827:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.221885:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123879808 00000100:00100000:1.0:1746155572.221889:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123879808 00002000:00100000:1.0:1746155572.221905:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880094f09500 x1830976123879808/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.221912:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09500 with x1830976123879808 ext(4194304->4956159) 00002000:00010000:1.0:1746155572.221915:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f09500 00000100:00100000:1.0:1746155572.221938:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4786 00000100:00100000:1.0:1746155572.221985:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123879808:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.229315:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123879808:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7363us (7481us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155572.229325:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4786 00002000:00100000:1.0:1746155572.229334:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880094f09500 x1830976123879808/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.229349:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09500 with x1830976123879808 ext(4194304->4956159) 00002000:00010000:1.0:1746155572.229354:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f09500 00000100:00100000:3.0:1746155572.231690:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123879552:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10019us (10450us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155572.231700:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4785 00002000:00100000:3.0:1746155572.231707:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880094f09f80 x1830976123879552/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.231719:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09f80 with x1830976123879552 ext(4194304->4956159) 00002000:00010000:3.0:1746155572.231722:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f09f80 00000100:00100000:0.0:1746155572.234239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.234987:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.235072:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123880064 00000100:00100000:2.0:1746155572.235077:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123879936 00000100:00100000:3.0:1746155572.235080:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123880064 00000100:00100000:2.0:1746155572.235088:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123879936 00000100:00100000:3.0:1746155572.235131:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12349 00000100:00100000:3.0:1746155572.235139:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123880064:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155572.235144:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12350 00000100:00100000:2.0:1746155572.235152:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123879936:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155572.235156:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.235167:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.235171:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a273800/0x844e5faceb5ec4fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1161c expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.235182:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4200/0x844e5faceb5ec503 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11615 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.235204:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a273800/0x844e5faceb5ec4fc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1161c expref: 31 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.235208:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4200/0x844e5faceb5ec503 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11615 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.235213:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a273800/0x844e5faceb5ec4fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1161c expref: 31 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.235222:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd4200/0x844e5faceb5ec503 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11615 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.235231:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a273800, rc 0) 00010000:00010000:2.0:1746155572.235238:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4200, rc 0) 00000100:00100000:3.0:1746155572.235271:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123880064:12345-192.168.202.51@tcp:101:cat.0 Request processed in 133us (1036us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155572.235277:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12349 00000100:00100000:2.0:1746155572.235277:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123879936:12345-192.168.202.51@tcp:101:cat.0 Request processed in 126us (290us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155572.235284:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12350 00000100:00100000:0.0:1746155572.237978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.238047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.238129:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.238386:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.238414:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123880192 00000100:00100000:1.0:1746155572.238420:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123880192 00000100:00100000:2.0:1746155572.238451:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123880320 00000100:00100000:2.0:1746155572.238454:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123880320 00000100:00100000:1.0:1746155572.238678:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123880576 00000100:00100000:1.0:1746155572.238681:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123880576 00000100:00100000:1.0:1746155572.238695:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123880448 00000100:00100000:1.0:1746155572.238697:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123880448 00000100:00100000:1.0:1746155572.238710:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12351 00000100:00100000:1.0:1746155572.238715:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123880192:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.238728:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.238740:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec50a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11623 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.238761:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec50a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11623 expref: 22 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.238770:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec50a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11623 expref: 22 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.238787:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e18000, rc 0) 00000100:00100000:1.0:1746155572.238819:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123880192:12345-192.168.202.51@tcp:101:cat.0 Request processed in 104us (845us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155572.238824:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12351 00000100:00100000:1.0:1746155572.238836:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12352 00000100:00100000:1.0:1746155572.238840:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1962:x1830976123880320:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.238847:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.238854:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e19200/0x844e5faceb5ec511 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1162a expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.238867:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e19200/0x844e5faceb5ec511 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1162a expref: 16 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.238874:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e19200/0x844e5faceb5ec511 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1162a expref: 16 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.238882:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e19200, rc 0) 00000100:00100000:1.0:1746155572.238894:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1962:x1830976123880320:12345-192.168.202.51@tcp:101:cat.0 Request processed in 53us (847us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155572.238898:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12352 00000100:00100000:1.0:1746155572.238907:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12353 00000100:00100000:1.0:1746155572.238911:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123880576:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.238916:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.238921:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec518 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11638 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.238931:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec518 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11638 expref: 31 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.238938:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec518 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11638 expref: 31 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.238949:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1e00, rc 0) 00000100:00100000:1.0:1746155572.238960:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123880576:12345-192.168.202.51@tcp:101:cat.0 Request processed in 49us (831us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155572.238964:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12353 00000100:00100000:1.0:1746155572.238972:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12354 00000100:00100000:1.0:1746155572.238976:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123880448:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.238980:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.238985:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1800/0x844e5faceb5ec51f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11631 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.238996:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1800/0x844e5faceb5ec51f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11631 expref: 20 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.239003:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1800/0x844e5faceb5ec51f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11631 expref: 20 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.239010:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1800, rc 0) 00000100:00100000:1.0:1746155572.239019:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123880448:12345-192.168.202.51@tcp:101:cat.0 Request processed in 43us (635us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155572.239024:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12354 00000100:00100000:0.0:1746155572.243601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.244483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.244651:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123880832 00000100:00100000:2.0:1746155572.244658:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123880832 00000100:00100000:1.0:1746155572.244681:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123880960 00000100:00100000:1.0:1746155572.244685:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123880960 00000100:00100000:2.0:1746155572.244704:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4080 00000100:00100000:2.0:1746155572.244710:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:29299:x1830976123880832:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155572.244723:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12355 00000100:00100000:3.0:1746155572.244731:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123880960:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155572.244741:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.244754:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec526 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1163f expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.244780:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec526 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1163f expref: 22 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.244790:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec526 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1163f expref: 22 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.244812:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a273000, rc 0) 00000100:00080000:1.0:1746155572.244831:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155572.244850:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123880960:12345-192.168.202.51@tcp:101:cat.0 Request processed in 119us (367us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155572.244855:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12355 00000100:00100000:2.0:1746155572.244859:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:29299:x1830976123880832:12345-192.168.202.51@tcp:35:cat.0 Request processed in 148us (1265us total) trans 8589944033 rc 0/0 00000100:00100000:2.0:1746155572.244865:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4080 00000100:00100000:0.0:1746155572.245012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.245044:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123881088 00000100:00100000:3.0:1746155572.245048:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123881088 00000100:00100000:3.0:1746155572.245066:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12356 00000100:00100000:3.0:1746155572.245071:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123881088:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155572.245078:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.245087:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a272e00/0x844e5faceb5ec52d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11646 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.245101:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a272e00/0x844e5faceb5ec52d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11646 expref: 16 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.245109:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a272e00/0x844e5faceb5ec52d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11646 expref: 16 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.245116:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a272e00, rc 0) 00000100:00100000:3.0:1746155572.245147:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123881088:12345-192.168.202.51@tcp:101:cat.0 Request processed in 75us (135us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155572.245152:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12356 00000100:00100000:1.0:1746155572.251262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.251976:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123881344 00000100:00100000:2.0:1746155572.251983:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123881344 00000100:00100000:2.0:1746155572.252029:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4081 00000100:00100000:2.0:1746155572.252037:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29300:x1830976123881344:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155572.252207:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+27:29300:x1830976123881344:12345-192.168.202.51@tcp:35:cat.0 Request processed in 170us (951us total) trans 8589944034 rc 0/0 00000100:00100000:2.0:1746155572.252213:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4081 00000100:00100000:0.0:1746155572.259664:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.260214:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123881600 00000100:00100000:2.0:1746155572.260223:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123881600 00000100:00100000:2.0:1746155572.260551:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10072 00000100:00100000:2.0:1746155572.260559:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:29308:x1830976123881600:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155572.260578:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.260592:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4600/0x844e5faceb5ec534 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1164d expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.260673:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4800/0x844e5faceb5ec53b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260685:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4800/0x844e5faceb5ec53b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260694:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4800/0x844e5faceb5ec53b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260704:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5ec542 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260709:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5ec542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260715:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5ec542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260793:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4400/0x844e5faceb5ec549 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260800:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4400/0x844e5faceb5ec549 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260805:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4400/0x844e5faceb5ec549 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155572.260816:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155572.260878:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4800/0x844e5faceb5ec53b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260884:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4800/0x844e5faceb5ec53b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260889:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4800/0x844e5faceb5ec53b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260893:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdd4800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155572.260896:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4800/0x844e5faceb5ec53b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260901:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4800/0x844e5faceb5ec53b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260909:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155572.260911:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155572.260914:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4800/0x844e5faceb5ec53b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260918:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4800/0x844e5faceb5ec53b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260937:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5ec542 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260942:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5ec542 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260947:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5ec542 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260954:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdd5c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155572.260956:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5ec542 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260960:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5ec542 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260966:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9200) 00010000:00010000:2.0:1746155572.260968:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155572.260970:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5ec542 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.260974:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd5c00/0x844e5faceb5ec542 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.261002:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4600/0x844e5faceb5ec534 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1164d expref: 306 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.261012:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4400/0x844e5faceb5ec549 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1164d expref: 305 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.261018:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.261020:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155572.261021:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4400, rc 0) 00000100:00100000:2.0:1746155572.262591:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:29308:x1830976123881600:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2028us (2927us total) trans 8589944035 rc 0/0 00000100:00100000:2.0:1746155572.262599:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10072 00000100:00100000:0.0:1746155572.264593:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.265170:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123881856 00000100:00100000:2.0:1746155572.265177:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123881856 00000100:00100000:2.0:1746155572.265217:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4082 00000100:00100000:2.0:1746155572.265223:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:29308:x1830976123881856:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155572.265400:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:29308:x1830976123881856:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 175us (811us total) trans 8589944036 rc 0/0 00000100:00100000:2.0:1746155572.265406:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4082 00000100:00100000:1.0:1746155572.266917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.266964:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123881984 00000100:00100000:3.0:1746155572.266968:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123881984 00000100:00100000:3.0:1746155572.267001:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 605 00000100:00100000:3.0:1746155572.267007:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:1963:x1830976123881984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155572.267015:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155572.267033:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4400/0x844e5faceb5ec549 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1164d expref: 306 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.267056:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155572.267060:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155572.267080:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:1963:x1830976123881984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 73us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.267085:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 605 00000100:00100000:0.0:1746155572.286792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.287696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.287725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.287874:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123882368 00000100:00100000:2.0:1746155572.287882:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123882368 00000100:00100000:1.0:1746155572.287927:0:14231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123882112 00000100:00100000:1.0:1746155572.287931:0:14231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123882112 00000100:00100000:1.0:1746155572.287957:0:14231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 169 00000100:00100000:1.0:1746155572.287964:0:14231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06793f43-a06c-4add-b66d-476e36bacde6+15:1962:x1830976123882112:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:1.0:1746155572.288011:0:14231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06793f43-a06c-4add-b66d-476e36bacde6+15:1962:x1830976123882112:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 48us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.288016:0:14231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 169 00000100:00080000:1.0:1746155572.288040:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155572.288625:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 336 00000100:00100000:2.0:1746155572.288633:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123882368:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:2.0:1746155572.288662:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123882368:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 31us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.288668:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 336 00000100:00100000:0.0:1746155572.288681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.288695:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123882496 00000100:00100000:2.0:1746155572.288697:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123882496 00000100:00100000:2.0:1746155572.288721:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 337 00000100:00100000:2.0:1746155572.288725:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123882496:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:2.0:1746155572.288749:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123882496:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 23us (67us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.288755:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 337 00000100:00080000:1.0:1746155572.288813:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746155572.288849:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123882240 00000100:00100000:3.0:1746155572.288854:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123882240 00000100:00100000:3.0:1746155572.288877:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 149 00000100:00100000:3.0:1746155572.288882:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123882240:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:3.0:1746155572.288912:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123882240:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 29us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.288916:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 149 00000100:00100000:0.0:1746155572.294703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.296046:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123882624 00000100:00100000:1.0:1746155572.296053:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123882624 00000100:00100000:1.0:1746155572.296101:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12357 00000100:00100000:1.0:1746155572.296108:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29308:x1830976123882624:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155572.296122:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.296137:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11654 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.296159:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1156d expref: 14 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.296167:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ec469 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1159e expref: 31 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.296172:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.296174:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.296177:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1396736->1781759] (req 1396736->1781759) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 31 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.296206:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ec469 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1159e expref: 31 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.296217:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ec469 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1159e expref: 31 pid: 8438 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746155572.296228:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124627968:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155572.296730:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1156d expref: 14 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.296738:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1156d expref: 14 pid: 8438 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.296745:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdcd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124628096:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155572.297000:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155572.302594:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124627968:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155572.302604:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdcd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124628096:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155572.302627:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1396736->1781759] (req 1396736->1781759) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 31 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.302642:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093480600, rc 0) 00000100:00100000:1.0:1746155572.302694:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29308:x1830976123882624:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6585us (7996us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.302704:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12357 00000100:00100000:0.0:1746155572.303187:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.303577:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123882752 00000100:00100000:1.0:1746155572.303583:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123882752 00010000:00010000:1.0:1746155572.303769:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ec469 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1159e expref: 31 pid: 8438 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746155572.303875:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6222 00000100:00100000:1.0:1746155572.303883:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123882752:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.304006:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.304026:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ec469 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1159e expref: 31 pid: 8438 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.304036:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ec469 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1159e expref: 31 pid: 8438 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.304053:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ec469 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1159e expref: 31 pid: 8438 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.304076:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.304099:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123882752:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 217us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.304105:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6222 00000100:00100000:0.0:1746155572.307790:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.307846:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123882880 00000100:00100000:1.0:1746155572.307853:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123882880 00010000:00010000:1.0:1746155572.307882:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1156d expref: 15 pid: 8438 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.307919:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6223 00000100:00100000:1.0:1746155572.307925:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976123882880:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.307936:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.307952:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1156d expref: 15 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.307963:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1156d expref: 15 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.307981:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec3c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1156d expref: 15 pid: 8438 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.308003:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.308005:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.308011:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 29 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.308018:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 29 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.308043:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 29 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.308055:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124628224:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155572.308690:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155572.311131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.311398:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123883136 00000100:00100000:3.0:1746155572.311404:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123883136 00002000:00100000:3.0:1746155572.311437:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1396736->1400831) req@ffff88009a6d9880 x1830976123883136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.311451:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d9880 with x1830976123883136 ext(1396736->1400831) 00002000:00010000:3.0:1746155572.311455:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6d9880 00000100:00100000:3.0:1746155572.311471:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4787 00000100:00100000:3.0:1746155572.311477:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123883136:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155572.311623:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123883136:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 145us (496us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155572.311629:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4787 00002000:00100000:3.0:1746155572.311634:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1396736->1400831) req@ffff88009a6d9880 x1830976123883136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.311641:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d9880 with x1830976123883136 ext(1396736->1400831) 00002000:00010000:3.0:1746155572.311644:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6d9880 00000100:00100000:1.0:1746155572.311749:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124628224:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155572.311764:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.311796:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976123882880:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3870us (4012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.311803:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6223 00000100:00100000:0.0:1746155572.316316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.316453:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123883392 00000100:00100000:2.0:1746155572.316461:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123883392 00002000:00100000:2.0:1746155572.316530:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1777664->1781759) req@ffff88009a6d9f80 x1830976123883392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.316565:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d9f80 with x1830976123883392 ext(1777664->1781759) 00002000:00010000:2.0:1746155572.316570:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6d9f80 00000100:00100000:2.0:1746155572.316810:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4788 00000100:00100000:2.0:1746155572.316817:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123883392:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155572.316954:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976123883392:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 137us (650us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155572.316959:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4788 00002000:00100000:2.0:1746155572.316964:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1777664->1781759) req@ffff88009a6d9f80 x1830976123883392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.316970:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d9f80 with x1830976123883392 ext(1777664->1781759) 00002000:00010000:2.0:1746155572.316973:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6d9f80 00000100:00100000:0.0:1746155572.329223:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.329627:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123883520 00000100:00100000:3.0:1746155572.329635:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123883520 00000100:00100000:3.0:1746155572.329674:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10073 00000100:00100000:3.0:1746155572.329682:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29310:x1830976123883520:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155572.329698:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.329713:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec55e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1165b expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.329764:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec565 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.329775:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.329784:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.329795:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34c00/0x844e5faceb5ec56c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.329800:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34c00/0x844e5faceb5ec56c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.329805:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34c00/0x844e5faceb5ec56c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.329886:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.329895:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1149b expref: 304 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.329900:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.329926:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1149b expref: 304 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.329936:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1149b expref: 304 pid: 27374 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.329946:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124628352:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155572.330027:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155572.333336:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124628352:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.333358:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155572.337122:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.337260:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123883776 00000100:00100000:1.0:1746155572.337268:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123883776 00000100:00100000:1.0:1746155572.337319:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4083 00000100:00100000:1.0:1746155572.337327:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea55c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:27127:x1830976123883776:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746155572.337529:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea55c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:27127:x1830976123883776:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 202us (414us total) trans 8589944037 rc 0/0 00000100:00100000:1.0:1746155572.337542:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4083 00000100:00100000:0.0:1746155572.338626:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.338682:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123883904 00000100:00100000:1.0:1746155572.338687:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123883904 00010000:00010000:1.0:1746155572.338706:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1149b expref: 306 pid: 27374 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.338736:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6224 00000100:00100000:1.0:1746155572.338741:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:1960:x1830976123883904:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.338750:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.338755:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1149b expref: 306 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.338763:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1149b expref: 306 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.338781:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5ec263 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1149b expref: 306 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.338792:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155572.338796:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155572.338803:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155572.338809:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155572.340194:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.340400:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:1960:x1830976123883904:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1653us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.340409:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6224 00010000:00010000:3.0:1746155572.340602:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.340611:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155572.340651:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155572.340656:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155572.340671:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.340683:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.340692:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.340698:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec565 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.340703:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec565 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.340708:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a273800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155572.340711:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec565 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.340717:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec565 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.340727:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155572.340730:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155572.340733:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec565 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.341139:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec565 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.341166:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34c00/0x844e5faceb5ec56c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.341171:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34c00/0x844e5faceb5ec56c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.341176:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34c00/0x844e5faceb5ec56c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.341180:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acd34c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155572.341182:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34c00/0x844e5faceb5ec56c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.341187:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34c00/0x844e5faceb5ec56c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.341194:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8801366f8f00) 00010000:00010000:3.0:1746155572.341196:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155572.341198:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34c00/0x844e5faceb5ec56c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.341202:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34c00/0x844e5faceb5ec56c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.341231:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec55e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1165b expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.341241:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1165b expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.341251:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155572.341253:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155572.341255:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd34600, rc 0) 00000100:00100000:3.0:1746155572.341293:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29310:x1830976123883520:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 11612us (12078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.341299:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10073 00000100:00100000:0.0:1746155572.343297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.343315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.343327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.343338:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.343354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.343404:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123884032 00000100:00100000:2.0:1746155572.343439:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123884160 00000100:00100000:2.0:1746155572.343446:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123884160 00000100:00100000:2.0:1746155572.343488:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123884288 00000100:00100000:2.0:1746155572.343491:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123884288 00000100:00100000:1.0:1746155572.343531:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123884032 00000100:00100000:3.0:1746155572.343733:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123884416 00000100:00100000:3.0:1746155572.343737:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123884416 00000100:00100000:2.0:1746155572.343738:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123884544 00000100:00100000:2.0:1746155572.343740:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123884544 00000100:00100000:2.0:1746155572.343753:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12358 00000100:00100000:2.0:1746155572.343759:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123884160:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155572.343773:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155572.343774:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12359 00000100:00100000:0.0:1746155572.343779:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123884288:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155572.343785:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4800/0x844e5faceb5ec57a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11669 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.343785:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155572.343792:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x844e5faceb5ec581 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11670 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.343802:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155572.343803:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155572.343810:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x844e5faceb5ec581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11670 expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155572.343820:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x844e5faceb5ec581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11670 expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155572.343821:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124628480:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155572.343827:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28400, rc 0) 00000100:00100000:0.0:1746155572.343854:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123884288:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 75us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155572.343859:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12359 00000100:00100000:2.0:1746155572.343866:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155572.343870:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12360 00000100:00100000:0.0:1746155572.343874:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123884032:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155572.343878:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155572.343884:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd29800/0x844e5faceb5ec588 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11662 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.343889:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12361 00010000:00010000:0.0:1746155572.343892:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155572.343893:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746155572.343894:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123884544:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155572.343897:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29800/0x844e5faceb5ec588 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11662 expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.343902:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155572.343905:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29800/0x844e5faceb5ec588 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11662 expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.343906:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5ec58f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1167e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.343911:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29800, rc 0) 00010000:00010000:2.0:1746155572.343919:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5ec58f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1167e expref: 13 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155572.343924:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123884032:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 50us (632us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155572.343926:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd5800/0x844e5faceb5ec58f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1167e expref: 13 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155572.343928:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12360 00000100:00100000:0.0:1746155572.343937:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12362 00010000:00010000:2.0:1746155572.343938:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd5800, rc 0) 00000100:00100000:0.0:1746155572.343942:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123884416:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155572.343947:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155572.343952:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec596 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11677 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.343954:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123884544:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 60us (599us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155572.343958:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12361 00010000:00010000:0.0:1746155572.343962:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec596 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11677 expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155572.343970:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec596 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11677 expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155572.343978:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28c00, rc 0) 00000100:00100000:0.0:1746155572.343989:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123884416:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 47us (651us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155572.343993:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12362 00000100:00100000:3.0:1746155572.345427:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124628480:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155572.345444:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4800/0x844e5faceb5ec57a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11669 expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.345452:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4800/0x844e5faceb5ec57a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11669 expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.345459:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4800, rc 0) 00000100:00100000:3.0:1746155572.345478:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123884160:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 1720us (2162us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155572.345484:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12358 00000100:00100000:0.0:1746155572.347682:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.347820:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123884800 00000100:00100000:3.0:1746155572.347826:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123884800 00000100:00100000:3.0:1746155572.347857:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10074 00000100:00100000:3.0:1746155572.347863:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29310:x1830976123884800:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155572.347877:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.347891:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec59d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11685 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.347962:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec5a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.347974:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1165b expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.347980:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec5a4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.348002:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1165b expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.348011:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1165b expref: 10 pid: 15474 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.348021:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124628608:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155572.348089:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155572.351214:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.351318:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124628608:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.351337:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec5a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155572.351412:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123884928 00000100:00100000:1.0:1746155572.351417:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123884928 00010000:00010000:1.0:1746155572.351441:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1165b expref: 11 pid: 15474 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.351474:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6225 00000100:00100000:1.0:1746155572.351480:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123884928:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.351490:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.351495:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1165b expref: 11 pid: 15474 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.351547:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1165b expref: 11 pid: 15474 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.351564:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acd34600/0x844e5faceb5ec573 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1165b expref: 11 pid: 15474 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.351586:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155572.351589:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec5a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155572.351595:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec5a4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155572.351600:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec5a4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155572.351612:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.351640:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123884928:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 161us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.351646:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6225 00010000:00010000:3.0:1746155572.351701:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec5a4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.351706:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec5a4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155572.351723:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155572.351836:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0db2a00/0x844e5faceb5ec59d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11685 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.351851:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec5a4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11685 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.351857:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155572.351859:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155572.351861:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a273000, rc 0) 00000100:00100000:3.0:1746155572.351883:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29310:x1830976123884800:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 4020us (4205us total) trans 8589944038 rc 0/0 00000100:00100000:3.0:1746155572.351888:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10074 00000100:00100000:0.0:1746155572.354215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.354415:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123885184 00000100:00100000:3.0:1746155572.354422:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123885184 00000100:00100000:3.0:1746155572.354467:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10075 00000100:00100000:3.0:1746155572.354474:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29310:x1830976123885184:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155572.354492:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.354495:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746155572.354553:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec5a4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11685 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.354567:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155572.354570:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155572.354580:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ec5b2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1168c expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.354648:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ec5b9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.354658:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ec5b9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.354666:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ec5b9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155572.354674:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155572.354749:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b8a00/0x844e5faceb5ec5b2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1168c expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.354759:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ec5b9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1168c expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.354765:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155572.354767:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155572.354769:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369b9400, rc 0) 00000100:00100000:3.0:1746155572.354819:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29310:x1830976123885184:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 344us (609us total) trans 8589944039 rc 0/0 00000100:00100000:3.0:1746155572.354825:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10075 00000100:00100000:0.0:1746155572.358731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.359351:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123885312 00000100:00100000:2.0:1746155572.359359:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123885312 00000100:00100000:2.0:1746155572.359408:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10076 00000100:00100000:2.0:1746155572.359416:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29310:x1830976123885312:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155572.359435:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.359449:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec5c7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11693 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.359496:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec5c7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11693 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.359544:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec5c7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11693 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.359565:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.359567:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155572.359570:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4a00, rc 0) 00000100:00100000:2.0:1746155572.359612:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:29310:x1830976123885312:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 196us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.359618:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10076 00000100:00100000:0.0:1746155572.364609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.364647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.364675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.364707:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.364849:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.364910:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123885440 00000100:00100000:3.0:1746155572.364921:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123885696 00000100:00100000:3.0:1746155572.364928:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123885696 00000100:00100000:0.0:1746155572.364942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.364964:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123885952 00000100:00100000:3.0:1746155572.364973:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123885952 00000100:00100000:3.0:1746155572.364987:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123885568 00000100:00100000:3.0:1746155572.364989:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123885568 00000100:00100000:3.0:1746155572.365000:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123885824 00000100:00100000:3.0:1746155572.365001:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123885824 00000100:00100000:3.0:1746155572.365010:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123886080 00000100:00100000:3.0:1746155572.365012:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123886080 00000100:00100000:3.0:1746155572.365026:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12363 00000100:00100000:3.0:1746155572.365033:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123885696:12345-192.168.202.51@tcp:1:mirror_io.0 00000100:00100000:2.0:1746155572.365095:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12364 00000100:00100000:2.0:1746155572.365103:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123885952:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:2.0:1746155572.365143:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.365161:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 20 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.365170:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc33e00/0x844e5faceb5ec4c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115dd expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.365176:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a272200/0x844e5faceb5ec4e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11600 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.365181:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746155572.365183:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746155572.365185:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.365213:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a272200/0x844e5faceb5ec4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11600 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.365224:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a272200/0x844e5faceb5ec4e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11600 expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.365235:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124628736:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.365293:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc33e00/0x844e5faceb5ec4c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115dd expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.365301:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc33e00/0x844e5faceb5ec4c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115dd expref: 18 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.365307:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124628864:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.365327:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 20 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.365334:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 20 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.365340:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124628992:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.365353:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155572.365368:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12365 00000100:00100000:2.0:1746155572.365373:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123885568:12345-192.168.202.51@tcp:1:mirror_io.0 00000100:00100000:1.0:1746155572.365400:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123885440 00000100:00100000:0.0:1746155572.365409:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12366 00000100:00100000:0.0:1746155572.365415:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976123885824:12345-192.168.202.51@tcp:1:mirror_io.0 00000100:00100000:1.0:1746155572.365423:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12367 00000100:00100000:1.0:1746155572.365428:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123886080:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155572.365430:0:10591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.365438:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11527 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.365449:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x844e5faceb5ec581 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11670 expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155572.365463:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ec39e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1154a expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155572.365468:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155572.365469:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155572.365471:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.365483:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ec39e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1154a expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155572.365490:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ec39e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1154a expref: 20 pid: 8437 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746155572.365497:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124629120:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.365531:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.365552:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 29 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.365555:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x844e5faceb5ec581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11670 expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.365558:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155572.365560:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155572.365562:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.365563:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x844e5faceb5ec581 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11670 expref: 13 pid: 9235 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746155572.365570:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124629248:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.365579:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 29 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.365587:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 29 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.365595:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124629376:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155572.365597:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11527 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.365604:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11527 expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.365610:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124629504:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155572.365616:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155572.365623:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949240 going to sleep for 11 seconds 00000100:00100000:3.0:1746155572.365629:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12368 00000100:00100000:3.0:1746155572.365634:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123885440:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:3.0:1746155572.365648:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.365658:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1131a expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.365669:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec136 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113e5 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.365679:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11328 expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.365685:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.365687:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.365691:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.365706:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11328 expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.365713:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11328 expref: 18 pid: 4461 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.365721:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124629632:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.365754:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec136 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113e5 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.365762:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec136 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113e5 expref: 13 pid: 8437 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746155572.365769:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124629760:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.365787:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1131a expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.365800:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1131a expref: 20 pid: 4461 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.365807:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124629888:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155572.365819:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110240 going to sleep for 11 seconds 00010000:00010000:1.0:1746155572.366102:0:9235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.366103:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.366112:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 13 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.366117:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11558 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.366119:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115cf expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.366123:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29800/0x844e5faceb5ec588 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11662 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.366127:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ec4d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115eb expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.366129:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6a00/0x844e5faceb5ec462 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11597 expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.366132:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746155572.366134:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.366134:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746155572.366135:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.366136:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.366137:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.366150:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ec4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115eb expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.366151:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6a00/0x844e5faceb5ec462 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11597 expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.366157:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ec4d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115eb expref: 29 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.366159:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6a00/0x844e5faceb5ec462 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11597 expref: 29 pid: 1625 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746155572.366166:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136633100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124630144:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155572.366167:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdcd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124630016:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.366190:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd29800/0x844e5faceb5ec588 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11662 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.366194:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115cf expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.366197:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29800/0x844e5faceb5ec588 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11662 expref: 11 pid: 9235 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.366202:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115cf expref: 13 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.366209:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124630272:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155572.366210:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124630400:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.366230:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11558 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.366231:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 13 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.366237:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11558 expref: 13 pid: 8437 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.366243:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124630528:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155572.366243:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 13 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.366250:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124630656:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.366257:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a94c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155572.366261:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155572.368114:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124628864:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.368122:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124628992:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.368664:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124628736:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.368688:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.378566:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124629120:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.378576:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124629248:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155572.380419:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124629376:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.380442:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.381479:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.381520:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.381549:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123886592 00000100:00100000:1.0:1746155572.381555:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123886592 00000100:00100000:3.0:1746155572.381579:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124629632:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155572.381580:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ec39e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1154a expref: 21 pid: 8437 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746155572.381587:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124629760:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155572.381594:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124629888:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.381609:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155572.381626:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123886336 00000100:00100000:3.0:1746155572.381629:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123886336 00002000:00100000:3.0:1746155572.381652:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3100672->3145727) req@ffff880094f0a680 x1830976123886336/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155572.381657:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdcd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124630016:192.168.202.51@tcp:104: 00002000:00100000:3.0:1746155572.381659:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0a680 with x1830976123886336 ext(3100672->3145727) 00000100:00100000:1.0:1746155572.381659:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6226 00010000:00010000:3.0:1746155572.381666:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 22 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.381666:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123886592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.381678:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155572.381679:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 22 pid: 29728 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746155572.381685:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f0a680 00010000:00010000:1.0:1746155572.381695:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ec39e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1154a expref: 22 pid: 8437 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746155572.381703:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 760 00010000:00010000:1.0:1746155572.381703:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ec39e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1154a expref: 22 pid: 8437 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746155572.381709:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123886336:12345-192.168.202.51@tcp:4:cat.0 00010000:00010000:1.0:1746155572.381721:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136951c00/0x844e5faceb5ec39e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1154a expref: 22 pid: 8437 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.381736:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.381782:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123886592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 116us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.381788:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6226 00000100:00100000:1.0:1746155572.381857:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136633100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124630144:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155572.381890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.381905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.381915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.381925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.381926:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123887104 00000100:00100000:0.0:1746155572.381930:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123887104 00000100:00100000:1.0:1746155572.381936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155572.381944:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11328 expref: 19 pid: 4461 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.381948:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123887360 00000100:00100000:1.0:1746155572.381951:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123887360 00000100:00100000:0.0:1746155572.381959:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123887616 00010000:00010000:1.0:1746155572.381960:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1131a expref: 21 pid: 4461 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.381961:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123887616 00010000:00010000:0.0:1746155572.381968:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ec4d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115eb expref: 30 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.381973:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123886208 00000100:00100000:1.0:1746155572.381975:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123886208 00000100:00100000:0.0:1746155572.381978:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6227 00010000:00010000:1.0:1746155572.381983:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc33e00/0x844e5faceb5ec4c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115dd expref: 20 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.381983:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123887104:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155572.381988:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155572.381993:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6228 00000100:00100000:1.0:1746155572.381998:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123887360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155572.381999:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11328 expref: 20 pid: 4461 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.382004:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155572.382006:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11328 expref: 20 pid: 4461 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.382013:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1131a expref: 21 pid: 4461 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.382017:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e82ce00/0x844e5faceb5ec02c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11328 expref: 20 pid: 4461 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.382020:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1131a expref: 21 pid: 4461 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.382030:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155572.382044:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6229 00000100:00100000:0.0:1746155572.382049:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123887616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155572.382055:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.382060:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cc1cc00/0x844e5faceb5ec025 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1131a expref: 21 pid: 4461 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.382067:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ec4d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115eb expref: 30 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.382068:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155572.382075:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ec4d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115eb expref: 30 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.382081:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123887360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.382085:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6228 00010000:00010000:0.0:1746155572.382085:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b5800/0x844e5faceb5ec4d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115eb expref: 30 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.382093:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6230 00010000:00010000:0.0:1746155572.382094:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.382097:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123886208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.382102:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.382108:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc33e00/0x844e5faceb5ec4c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115dd expref: 19 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.382110:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123887616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 61us (183us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155572.382115:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc33e00/0x844e5faceb5ec4c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115dd expref: 19 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.382115:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6229 00010000:00010000:1.0:1746155572.382123:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc33e00/0x844e5faceb5ec4c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115dd expref: 19 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.382130:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155572.382136:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123887104:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 153us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.382140:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123886208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 43us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155572.382141:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6227 00000100:00100000:1.0:1746155572.382145:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6230 00000100:00100000:1.0:1746155572.382188:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.382203:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.382210:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123886464 00000100:00100000:1.0:1746155572.382212:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123886464 00010000:00010000:1.0:1746155572.382219:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a272200/0x844e5faceb5ec4e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11600 expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.382228:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123886720 00000100:00100000:1.0:1746155572.382230:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123886720 00010000:00010000:1.0:1746155572.382235:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x844e5faceb5ec581 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11670 expref: 14 pid: 9235 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746155572.382239:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124629504:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155572.382244:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6231 00000100:00100000:1.0:1746155572.382248:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123886464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.382252:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155572.382256:0:10591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.382257:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a272200/0x844e5faceb5ec4e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11600 expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.382264:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a272200/0x844e5faceb5ec4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11600 expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.382272:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a272200/0x844e5faceb5ec4e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11600 expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.382278:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155572.382285:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6232 00000100:00100000:1.0:1746155572.382287:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976123886464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 39us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.382291:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123886720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155572.382292:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6231 00010000:00010000:2.0:1746155572.382298:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155572.382307:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x844e5faceb5ec581 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11670 expref: 14 pid: 9235 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746155572.382310:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155572.382315:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x844e5faceb5ec581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11670 expref: 14 pid: 9235 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746155572.382316:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123886976 00000100:00100000:1.0:1746155572.382318:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123886976 00010000:00010000:1.0:1746155572.382325:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11527 expref: 17 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.382326:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28400/0x844e5faceb5ec581 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11670 expref: 14 pid: 9235 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746155572.382334:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6233 00010000:00010000:2.0:1746155572.382337:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.382337:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123886976:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.382342:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.382347:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11527 expref: 17 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.382353:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123886720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 63us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155572.382353:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11527 expref: 17 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.382359:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6232 00010000:00010000:1.0:1746155572.382361:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913f0c00/0x844e5faceb5ec34a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11527 expref: 17 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.382367:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.382369:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.382372:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.382375:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123886848 00000100:00100000:2.0:1746155572.382377:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123886848 00010000:00010000:1.0:1746155572.382379:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746155572.382391:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1396736->1781759) req@ffff880094f09c00 x1830976123886848/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746155572.382393:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746155572.382398:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09c00 with x1830976123886848 ext(1396736->1781759) 00000100:00100000:1.0:1746155572.382402:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123886976:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 64us (92us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155572.382403:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 29 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.382409:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6233 00010000:00010000:2.0:1746155572.382415:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 29 pid: 1625 timeout: 801 lvb_type: 0 00002000:00010000:2.0:1746155572.382421:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f09c00 00000100:00100000:1.0:1746155572.382433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.382436:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 761 00000100:00100000:1.0:1746155572.382439:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123887232 00000100:00100000:2.0:1746155572.382440:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123886848:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155572.382441:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123887232 00010000:00010000:1.0:1746155572.382447:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec136 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113e5 expref: 13 pid: 8437 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746155572.382457:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6234 00000100:00100000:1.0:1746155572.382460:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123887232:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.382464:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.382469:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec136 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113e5 expref: 13 pid: 8437 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.382475:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec136 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113e5 expref: 13 pid: 8437 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.382484:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec136 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113e5 expref: 13 pid: 8437 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.382491:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.382492:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.382495:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.382515:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.382543:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155572.382553:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.382557:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123887232:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (123us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155572.382561:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.382562:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6234 00010000:00010000:3.0:1746155572.382578:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.382584:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.382590:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.382593:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155572.382595:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c4c4400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155572.382598:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.382602:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123887488 00000100:00100000:1.0:1746155572.382605:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123887488 00010000:00010000:3.0:1746155572.382609:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.382613:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6a00/0x844e5faceb5ec462 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11597 expref: 30 pid: 1625 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746155572.382619:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.382624:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c4c4400/0x844e5faceb5ec5e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.382625:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6235 00000100:00100000:1.0:1746155572.382629:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123887488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.382635:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.382642:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6a00/0x844e5faceb5ec462 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11597 expref: 30 pid: 1625 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.382650:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6a00/0x844e5faceb5ec462 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11597 expref: 30 pid: 1625 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.382660:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6a00/0x844e5faceb5ec462 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11597 expref: 30 pid: 1625 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746155572.382662:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123885440:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 17026us (18059us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.382668:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12368 00010000:00010000:1.0:1746155572.382668:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.382679:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123887488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.382687:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6235 00010000:00010000:3.0:1746155572.382689:0:10591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.382695:0:10591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.382705:0:10591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.382711:0:10591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.382716:0:10591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.382725:0:10591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd28c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155572.382727:0:10591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.382733:0:10591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.382741:0:10591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.382746:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5ec5d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155572.382772:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123885824:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 17357us (17923us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.382777:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12366 00000100:00100000:0.0:1746155572.383104:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124630272:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155572.383115:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124630528:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155572.383129:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.383155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.383173:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123887744 00000100:00100000:0.0:1746155572.383176:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123887744 00010000:00010000:0.0:1746155572.383187:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29800/0x844e5faceb5ec588 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11662 expref: 12 pid: 9235 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746155572.383207:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6236 00000100:00100000:0.0:1746155572.383211:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123887744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155572.383217:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155572.383224:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd29800/0x844e5faceb5ec588 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11662 expref: 12 pid: 9235 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746155572.383232:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd29800/0x844e5faceb5ec588 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11662 expref: 12 pid: 9235 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746155572.383242:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29800/0x844e5faceb5ec588 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11662 expref: 12 pid: 9235 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746155572.383249:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155572.383370:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123887744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 157us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155572.383376:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6236 00000100:00100000:1.0:1746155572.383914:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.383973:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123887872 00000100:00100000:3.0:1746155572.383976:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123887872 00002000:00100000:3.0:1746155572.383993:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2629631) req@ffff88009a6da680 x1830976123887872/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.384001:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6da680 with x1830976123887872 ext(2097152->2629631) 00010000:00010000:3.0:1746155572.384006:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 14 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.384014:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 14 pid: 29728 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746155572.384021:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6da680 00000100:00100000:3.0:1746155572.384042:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 762 00000100:00100000:3.0:1746155572.384047:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123887872:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155572.384281:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124630400:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.384289:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124630656:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.384304:0:9235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.386016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.386152:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.386168:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123888128 00000100:00100000:1.0:1746155572.386173:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123888128 00010000:00010000:1.0:1746155572.386198:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115cf expref: 16 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.386216:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123888000 00000100:00100000:1.0:1746155572.386218:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123888000 00010000:00010000:1.0:1746155572.386226:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11558 expref: 17 pid: 8437 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.386237:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6237 00000100:00100000:1.0:1746155572.386242:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123888128:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.386253:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.386266:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115cf expref: 17 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.386274:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115cf expref: 17 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.386291:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ec4b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115cf expref: 17 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.386307:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.386334:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123888128:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.386340:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6237 00000100:00100000:1.0:1746155572.386351:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6238 00000100:00100000:1.0:1746155572.386355:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976123888000:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.386359:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.386369:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11558 expref: 15 pid: 8437 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.386376:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11558 expref: 15 pid: 8437 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.386384:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0db3400/0x844e5faceb5ec3ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11558 expref: 15 pid: 8437 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.386391:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.386393:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.386396:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.386404:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.386426:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155572.386432:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.386439:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976123888000:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 84us (287us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155572.386439:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.386444:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6238 00010000:00010000:0.0:1746155572.386454:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.386461:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.386467:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.386473:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdd4200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155572.386476:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.386483:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.386492:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.386497:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec5f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155572.386570:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123885568:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 21196us (21861us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155572.386577:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12365 00000100:00100000:3.0:1746155572.387106:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123886336:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5395us (5627us total) trans 21474840627 rc 0/0 00000100:00100000:3.0:1746155572.387114:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 760 00002000:00100000:3.0:1746155572.387836:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3100672->3145727) req@ffff880094f0a680 x1830976123886336/t21474840627(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/448 e 0 to 0 dl 1746155583 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.387845:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0a680 with x1830976123886336 ext(3100672->3145727) 00010000:00010000:3.0:1746155572.387852:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 20 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.387862:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 20 pid: 29728 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746155572.387868:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f0a680 00000100:00100000:2.0:1746155572.389920:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123886848:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 7474us (8024us total) trans 17179873241 rc 0/0 00000100:00100000:2.0:1746155572.389928:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 761 00002000:00100000:2.0:1746155572.389936:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3db:0x0] (1396736->1781759) req@ffff880094f09c00 x1830976123886848/t17179873241(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/448 e 0 to 0 dl 1746155583 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.389942:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09c00 with x1830976123886848 ext(1396736->1781759) 00010000:00010000:2.0:1746155572.389949:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 30 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.389959:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 30 pid: 1625 timeout: 801 lvb_type: 0 00002000:00010000:2.0:1746155572.389969:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f09c00 00000100:00100000:2.0:1746155572.391964:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.391986:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123888256 00000100:00100000:2.0:1746155572.391992:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123888256 00010000:00010000:2.0:1746155572.392016:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 20 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.392343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.392685:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123888384 00000100:00100000:2.0:1746155572.392688:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123888384 00000100:00100000:0.0:1746155572.392691:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6239 00000100:00100000:0.0:1746155572.392699:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123888256:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.392700:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 30 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.392710:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155572.392714:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6240 00000100:00100000:2.0:1746155572.392718:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123888384:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.392723:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155572.392729:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 20 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.392732:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 30 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.392738:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 30 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.392738:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 20 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.392756:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093480600/0x844e5faceb5ec557 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1781759) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11654 expref: 30 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.392756:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ec4bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115d6 expref: 20 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.392767:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155572.392767:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.392769:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155572.392769:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.392772:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.392772:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.392779:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.392779:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.392796:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155572.392799:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155572.392822:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123888384:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 103us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.392826:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6240 00010000:00010000:3.0:1746155572.392843:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.392844:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.392851:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.392851:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.392866:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.392866:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.392872:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.392877:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.392878:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.392882:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.392884:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdd5000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155572.392886:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4c8000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155572.392887:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.392888:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.392894:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.392896:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.392902:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.392903:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.392907:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4c8000/0x844e5faceb5ec5dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.392908:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd5000/0x844e5faceb5ec5ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155572.392956:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976123888256:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 258us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155572.392961:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6239 00000100:00100000:2.0:1746155572.393027:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123885952:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 27924us (28350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.393034:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12364 00000100:00100000:3.0:1746155572.393093:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123885696:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 28060us (28444us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.393098:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12363 00000100:00100000:3.0:1746155572.394723:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976123887872:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10673us (10807us total) trans 17179873242 rc 0/0 00000100:00100000:3.0:1746155572.394732:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 762 00002000:00100000:3.0:1746155572.394740:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2629631) req@ffff88009a6da680 x1830976123887872/t17179873242(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/448 e 0 to 0 dl 1746155583 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.394749:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6da680 with x1830976123887872 ext(2097152->2629631) 00010000:00010000:3.0:1746155572.394755:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 14 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.394767:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 14 pid: 29728 timeout: 801 lvb_type: 0 00002000:00010000:3.0:1746155572.394774:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6da680 00000100:00100000:0.0:1746155572.396171:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.396229:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123888512 00000100:00100000:2.0:1746155572.396235:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123888512 00010000:00010000:2.0:1746155572.396254:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 14 pid: 29728 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.396898:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6241 00000100:00100000:2.0:1746155572.396906:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123888512:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.396916:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155572.396932:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 14 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.396942:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 14 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.396963:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5ec4cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2629631) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f115e4 expref: 14 pid: 29728 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.396974:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.396975:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.396979:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.396986:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.397014:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155572.397038:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123888512:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 132us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.397043:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6241 00010000:00010000:3.0:1746155572.397099:0:9235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.397107:0:9235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.397121:0:9235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.397128:0:9235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.397134:0:9235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.397140:0:9235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093481000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155572.397143:0:9235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.397149:0:9235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.397158:0:9235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.397163:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ec5ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155572.397200:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123886080:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 31771us (32258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.397207:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12367 00000100:00100000:0.0:1746155572.399568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.400048:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123888768 00000100:00100000:3.0:1746155572.400055:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123888768 00000100:00100000:3.0:1746155572.400098:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10077 00000100:00100000:3.0:1746155572.400104:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:29310:x1830976123888768:12345-192.168.202.51@tcp:36:mirror_io.0 00010000:00010000:3.0:1746155572.400177:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155572.400196:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd4a00/0x844e5faceb5ec5c7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11693 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.400281:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155572.400284:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155572.400305:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.400314:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11344 expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.400321:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.400327:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 304 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.400332:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5ec113 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113c9 expref: 26 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.400566:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58c00/0x844e5faceb5ec304 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11504 expref: 304 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.400572:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.400596:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58c00/0x844e5faceb5ec304 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11504 expref: 304 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.400605:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58c00/0x844e5faceb5ec304 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11504 expref: 304 pid: 27374 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.400615:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124630784:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.400680:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5ec113 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113c9 expref: 26 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.400687:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5ec113 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113c9 expref: 26 pid: 19870 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.400698:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124630912:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.400717:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 304 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.400722:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 304 pid: 19870 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.400728:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124631040:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.400741:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.400746:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 26 pid: 27374 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.400752:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124631168:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.400768:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11344 expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.400774:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11344 expref: 26 pid: 15474 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.400781:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124631296:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155572.400794:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155572.408684:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.408761:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124630784:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155572.408769:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124630912:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155572.408776:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124631040:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155572.408961:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.408986:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.409003:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123888896 00000100:00100000:0.0:1746155572.409008:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123888896 00010000:00010000:0.0:1746155572.409034:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5ec113 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113c9 expref: 27 pid: 19870 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.409053:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123889152 00000100:00100000:0.0:1746155572.409055:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123889152 00010000:00010000:0.0:1746155572.409064:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 28 pid: 27374 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.409075:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123889024 00000100:00100000:0.0:1746155572.409076:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123889024 00000100:00100000:2.0:1746155572.409102:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6242 00000100:00100000:2.0:1746155572.409111:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123888896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.409122:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155572.409191:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58c00/0x844e5faceb5ec304 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11504 expref: 305 pid: 27374 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.409207:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6243 00000100:00100000:0.0:1746155572.409213:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1963:x1830976123889152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155572.409219:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155572.409223:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 28 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.409232:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 28 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.409249:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155572.409253:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155572.409261:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155572.409293:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1963:x1830976123889152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155572.409299:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6243 00000100:00100000:0.0:1746155572.409313:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6244 00000100:00100000:0.0:1746155572.409318:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:1961:x1830976123889024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155572.409324:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155572.409327:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58c00/0x844e5faceb5ec304 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11504 expref: 305 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.409335:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58c00/0x844e5faceb5ec304 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11504 expref: 305 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.409345:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58c00/0x844e5faceb5ec304 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11504 expref: 305 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.409357:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155572.409360:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155572.409365:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155572.409377:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:1961:x1830976123889024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 59us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155572.409381:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6244 00000100:00100000:0.0:1746155572.409404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.409416:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123889280 00000100:00100000:0.0:1746155572.409418:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123889280 00010000:00010000:0.0:1746155572.409427:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11344 expref: 28 pid: 15474 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.409440:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6245 00000100:00100000:0.0:1746155572.409445:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123889280:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155572.409450:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155572.409452:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5ec113 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113c9 expref: 28 pid: 19870 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.409453:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11344 expref: 28 pid: 15474 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.409461:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5ec113 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113c9 expref: 28 pid: 19870 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.409471:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11344 expref: 28 pid: 15474 timeout: 801 lvb_type: 0 00010000:00010000:2.0:1746155572.409488:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5ec113 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f113c9 expref: 28 pid: 19870 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.409493:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155572.409496:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155572.409501:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155572.409517:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.409520:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155572.409525:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155572.409543:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123889280:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155572.409548:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6245 00000100:00100000:2.0:1746155572.409552:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123888896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 443us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.409558:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6242 00000100:00100000:0.0:1746155572.409604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.409935:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123889408 00000100:00100000:1.0:1746155572.409938:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123889408 00010000:00010000:1.0:1746155572.409949:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 304 pid: 19870 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.409962:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6246 00000100:00100000:1.0:1746155572.409966:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:1962:x1830976123889408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.409972:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.409975:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 304 pid: 19870 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.409982:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 304 pid: 19870 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.409992:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec079 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11359 expref: 304 pid: 19870 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.410002:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155572.410005:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155572.410010:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155572.410014:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155572.410029:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155572.410086:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fed8600/0x844e5faceb5ec06b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1134b expref: 25 pid: 27374 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.410095:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124631168:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.410103:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec064 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11344 expref: 24 pid: 15474 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.410110:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124631296:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.410130:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.410137:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.410141:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000040:00080000:3.0:1746155572.410911:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2926, 88 off244872 00000004:00080000:3.0:1746155572.410918:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701560414334ns, next at 645865692772ns, rc = 0 00000100:00100000:1.0:1746155572.411841:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:1962:x1830976123889408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1870us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.411848:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6246 00000040:00080000:3.0:1746155572.411925:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2866, 88 off239328 00000004:00080000:3.0:1746155572.411931:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701561428000ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155572.411943:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2867, 88 off239416 00000004:00080000:3.0:1746155572.411946:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701561442865ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155572.411954:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2927, 88 off244960 00000004:00080000:3.0:1746155572.411956:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701561453040ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155572.411973:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2928, 88 off245048 00000004:00080000:3.0:1746155572.411976:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701561472877ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155572.411983:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2868, 88 off239504 00000004:00080000:3.0:1746155572.411985:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701561482244ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155572.411991:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2869, 88 off239592 00000004:00080000:3.0:1746155572.411994:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701561490699ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155572.412000:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2870, 88 off239680 00000004:00080000:3.0:1746155572.412002:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701561498980ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155572.412008:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2929, 88 off245136 00000004:00080000:3.0:1746155572.412010:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701561507072ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155572.412016:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2871, 88 off239768 00000004:00080000:3.0:1746155572.412018:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701561515592ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155572.412025:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2930, 88 off245224 00000004:00080000:3.0:1746155572.412027:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701561524425ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155572.412034:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2872, 88 off239856 00000004:00080000:3.0:1746155572.412036:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701561532882ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155572.412042:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2931, 88 off245312 00000004:00080000:3.0:1746155572.412044:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701561541159ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155572.412050:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2932, 88 off245400 00000004:00080000:3.0:1746155572.412052:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701561548989ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155572.412058:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2933, 88 off245488 00000004:00080000:3.0:1746155572.412060:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701561557577ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155572.412066:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2934, 88 off245576 00000004:00080000:3.0:1746155572.412069:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701561565732ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155572.412074:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2873, 88 off239944 00000004:00080000:3.0:1746155572.412076:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701561573569ns, next at 645866785986ns, rc = 0 00000001:00080000:1.0:1746155572.449432:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944022 is committed 00000001:00080000:1.0:1746155572.449442:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944000 is committed 00000001:00080000:1.0:1746155572.449447:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944037 is committed 00000001:00080000:1.0:1746155572.449451:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944028 is committed 00000001:00080000:1.0:1746155572.449470:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944034 is committed 00000001:00080000:1.0:1746155572.449495:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944008 is committed 00000001:00080000:1.0:1746155572.449514:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944040 is committed 00000004:00080000:1.0:1746155572.449518:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2065 committed 00000004:00080000:1.0:1746155572.449524:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2133 committed 00000004:00080000:1.0:1746155572.449528:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2132 committed 00000004:00080000:1.0:1746155572.449530:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2131 committed 00000004:00080000:1.0:1746155572.449531:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2130 committed 00000004:00080000:1.0:1746155572.449540:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2064 committed 00000004:00080000:1.0:1746155572.449542:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2129 committed 00000004:00080000:1.0:1746155572.449543:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2063 committed 00000004:00080000:1.0:1746155572.449544:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2128 committed 00000004:00080000:1.0:1746155572.449545:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2062 committed 00000004:00080000:1.0:1746155572.449546:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2061 committed 00000004:00080000:1.0:1746155572.449548:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2060 committed 00000004:00080000:1.0:1746155572.449549:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2127 committed 00000004:00080000:1.0:1746155572.449550:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2126 committed 00000004:00080000:1.0:1746155572.449552:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2059 committed 00000004:00080000:1.0:1746155572.449553:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2058 committed 00000004:00080000:1.0:1746155572.449554:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2125 committed 00000100:00100000:0.0:1746155572.449740:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124631680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.449788:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155572.449930:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124631424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.449951:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155572.449968:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124631552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.449982:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155572.450026:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124631680 00000100:00100000:0.0:1746155572.450031:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124631680 00000100:00100000:0.0:1746155572.450063:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124631424 00000100:00100000:0.0:1746155572.450066:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124631424 00000100:00100000:0.0:1746155572.450076:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124631552 00000100:00100000:0.0:1746155572.450078:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124631552 00000100:00100000:0.0:1746155572.450089:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12369 00000100:00100000:0.0:1746155572.450096:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3295:x1830976124631680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.450242:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3295:x1830976124631680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (453us total) trans 17179873243 rc 0/0 00000100:00100000:0.0:1746155572.450247:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12369 00000100:00100000:0.0:1746155572.450260:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12370 00000100:00100000:0.0:1746155572.450264:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3297:x1830976124631424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.450341:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3297:x1830976124631424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (389us total) trans 17179873244 rc 0/0 00000100:00100000:0.0:1746155572.450346:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12370 00000100:00100000:0.0:1746155572.450355:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12371 00000100:00100000:0.0:1746155572.450360:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3298:x1830976124631552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.450434:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3298:x1830976124631552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (450us total) trans 17179873245 rc 0/0 00000100:00100000:0.0:1746155572.450439:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12371 00000100:00080000:1.0:1746155572.450484:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155572.451220:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124631808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155572.451244:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155572.451275:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124631808 00000100:00100000:2.0:1746155572.451278:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124631808 00000100:00100000:2.0:1746155572.451295:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12372 00000100:00100000:2.0:1746155572.451300:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3296:x1830976124631808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155572.451384:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3296:x1830976124631808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (139us total) trans 17179873246 rc 0/0 00000100:00100000:2.0:1746155572.451389:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12372 00000004:00080000:1.0:1746155572.452199:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdeea00/2, rc 0, transno 17179873244 00000100:00100000:1.0:1746155572.452204:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124631424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.452209:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124631936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.452227:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155572.452964:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124632448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155572.452984:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155572.452996:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124632960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155572.453007:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746155572.453032:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094087800/2, rc 0, transno 17179873245 00000100:00100000:1.0:1746155572.453036:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124631552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.453040:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124632064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.453052:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155572.453062:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124632576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155572.453073:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155572.453082:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124633088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155572.453092:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155572.453107:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124631936 00000100:00100000:1.0:1746155572.453110:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124631936 00000100:00100000:1.0:1746155572.453126:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124632448 00000100:00100000:1.0:1746155572.453127:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124632448 00000100:00100000:1.0:1746155572.453142:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124632960 00000100:00100000:1.0:1746155572.453145:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124632960 00000100:00100000:1.0:1746155572.453151:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124632064 00000100:00100000:1.0:1746155572.453153:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124632064 00000100:00100000:1.0:1746155572.453160:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124632576 00000100:00100000:1.0:1746155572.453162:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124632576 00000100:00100000:1.0:1746155572.453168:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124633088 00000100:00100000:1.0:1746155572.453169:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124633088 00000100:00100000:1.0:1746155572.453176:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12373 00000100:00100000:1.0:1746155572.453180:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3297:x1830976124631936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.453285:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976124631936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (1057us total) trans 17179873247 rc 0/0 00000100:00100000:1.0:1746155572.453290:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12373 00000100:00100000:1.0:1746155572.453300:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12374 00000100:00100000:1.0:1746155572.453304:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976124632448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155572.453393:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3297:x1830976124632448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (408us total) trans 21474840628 rc 0/0 00000100:00100000:1.0:1746155572.453398:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12374 00000100:00100000:1.0:1746155572.453411:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12375 00000100:00100000:1.0:1746155572.453415:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976124632960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155572.453480:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3297:x1830976124632960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (471us total) trans 21474840629 rc 0/0 00000100:00100000:1.0:1746155572.453484:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12375 00000100:00100000:1.0:1746155572.453493:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12376 00000100:00100000:1.0:1746155572.453497:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3298:x1830976124632064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.453590:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3298:x1830976124632064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (537us total) trans 17179873248 rc 0/0 00000100:00100000:1.0:1746155572.453595:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12376 00000100:00100000:1.0:1746155572.453604:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12377 00000100:00100000:1.0:1746155572.453608:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3298:x1830976124632576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155572.453675:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3298:x1830976124632576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (600us total) trans 21474840630 rc 0/0 00000100:00100000:1.0:1746155572.453680:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12377 00000100:00100000:1.0:1746155572.453688:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12378 00000100:00100000:1.0:1746155572.453692:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3298:x1830976124633088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155572.453752:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3298:x1830976124633088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (659us total) trans 21474840631 rc 0/0 00000100:00100000:1.0:1746155572.453757:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12378 00000004:00080000:1.0:1746155572.453781:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb69f80/2, rc 0, transno 17179873248 00000100:00100000:1.0:1746155572.453784:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124632064:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155572.453791:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a44380/2, rc 0, transno 21474840630 00000100:00100000:1.0:1746155572.453798:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124632576:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155572.453803:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a44700/2, rc 0, transno 21474840631 00000100:00100000:1.0:1746155572.453806:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124633088:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1746155572.453815:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746155572.453827:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dbb80/2, rc 0, transno 17179873247 00000100:00100000:1.0:1746155572.453830:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124631936:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155572.453834:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a46a00/2, rc 0, transno 21474840628 00000100:00100000:1.0:1746155572.453836:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124632448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155572.453841:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a45180/2, rc 0, transno 21474840629 00000100:00100000:1.0:1746155572.453843:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124632960:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155572.454336:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6db100/2, rc 0, transno 17179873246 00000100:00100000:2.0:1746155572.454340:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124631808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155572.454345:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124632320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155572.454364:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155572.454382:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124632832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155572.454396:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155572.454405:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124633344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155572.454418:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155572.454428:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746155572.454432:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124632704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155572.454445:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155572.454452:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124633216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155572.454462:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155572.454476:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124632320 00000100:00100000:2.0:1746155572.454479:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124632320 00000100:00100000:2.0:1746155572.454492:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124632832 00000100:00100000:2.0:1746155572.454494:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124632832 00000100:00100000:2.0:1746155572.454515:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124633344 00000100:00100000:2.0:1746155572.454518:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124633344 00000100:00100000:2.0:1746155572.454526:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124632704 00000100:00100000:2.0:1746155572.454527:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124632704 00000100:00100000:2.0:1746155572.454543:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124633216 00000100:00100000:2.0:1746155572.454545:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124633216 00000100:00100000:2.0:1746155572.454553:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12379 00000100:00100000:2.0:1746155572.454557:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3296:x1830976124632320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155572.454636:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3296:x1830976124632320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (270us total) trans 17179873249 rc 0/0 00000100:00100000:2.0:1746155572.454640:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12379 00000100:00100000:2.0:1746155572.454651:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12380 00000100:00100000:2.0:1746155572.454655:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3296:x1830976124632832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155572.454717:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:2.0:1746155572.454720:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155572.454722:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155572.454724:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155572.454726:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:2.0:1746155572.454743:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976124632832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (346us total) trans 21474840632 rc 0/0 00000100:00100000:2.0:1746155572.454747:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12380 00000100:00100000:2.0:1746155572.454755:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12381 00000100:00100000:2.0:1746155572.454759:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3296:x1830976124633344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155572.454821:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976124633344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (402us total) trans 21474840633 rc 0/0 00000100:00100000:2.0:1746155572.454826:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12381 00000100:00100000:2.0:1746155572.454834:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12382 00000100:00100000:2.0:1746155572.454837:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3296:x1830976124632704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155572.454903:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976124632704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (457us total) trans 21474840634 rc 0/0 00000100:00100000:2.0:1746155572.454908:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12382 00000100:00100000:2.0:1746155572.454916:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12383 00000100:00100000:2.0:1746155572.454920:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3296:x1830976124633216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155572.454985:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976124633216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (521us total) trans 21474840635 rc 0/0 00000100:00100000:2.0:1746155572.454989:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12383 00000004:00080000:2.0:1746155572.455007:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a46d80/2, rc 0, transno 21474840634 00000100:00100000:2.0:1746155572.455010:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124632704:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155572.455016:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a44a80/2, rc 0, transno 21474840635 00000100:00100000:2.0:1746155572.455018:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124633216:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155572.455023:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a45f80/2, rc 0, transno 17179873249 00000100:00100000:2.0:1746155572.455026:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124632320:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155572.455033:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a44000/2, rc 0, transno 21474840632 00000100:00100000:2.0:1746155572.455034:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124632832:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155572.455039:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093a47b80/2, rc 0, transno 21474840633 00000100:00100000:2.0:1746155572.455042:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124633344:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746155572.455171:0:15474:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012cdef480 reply state ffff8800946d5000 transno 8589944040 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155572.455183:0:15474:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746155572.455249:0:15474:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746155572.455918:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29310:x1830976123888768:12345-192.168.202.51@tcp:36:mirror_io.0 Request processed in 55811us (56353us total) trans 8589944040 rc 0/0 00000100:00100000:3.0:1746155572.455924:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10077 00010000:00010000:2.0:1746155572.455989:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155572.455996:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155572.456001:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155572.456006:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b9d200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155572.456010:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155572.456015:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155572.456026:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.456029:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155572.456031:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155572.456035:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec5f8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000004:00080000:0.0:1746155572.456197:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094084380/2, rc 0, transno 17179873243 00000100:00100000:0.0:1746155572.456201:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124631680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.456256:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124632192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.456282:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155572.456297:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124632192 00000100:00100000:0.0:1746155572.456300:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124632192 00000100:00100000:0.0:1746155572.456316:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12384 00000100:00100000:0.0:1746155572.456320:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830976124632192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.456411:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830976124632192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (128us total) trans 17179873250 rc 0/0 00000100:00100000:0.0:1746155572.456416:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12384 00000004:00080000:0.0:1746155572.456556:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136633100/2, rc 0, transno 17179873250 00000100:00100000:0.0:1746155572.456560:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124632192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155572.456897:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124633472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155572.456917:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155572.457823:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124633472 00000100:00100000:0.0:1746155572.457826:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124633472 00000100:00100000:0.0:1746155572.457844:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12385 00000100:00100000:0.0:1746155572.457849:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830976124633472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155572.458618:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3297:x1830976124633472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 769us (1699us total) trans 21474840636 rc 0/0 00000100:00100000:0.0:1746155572.458624:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12385 00000004:00080000:3.0:1746155572.458804:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fe8ca80/2, rc 0, transno 21474840636 00000100:00100000:3.0:1746155572.458808:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124633472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155572.459033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.459107:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123889536 00000100:00100000:3.0:1746155572.459111:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123889536 00000100:00100000:3.0:1746155572.459136:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10078 00000100:00100000:3.0:1746155572.459141:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29310:x1830976123889536:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155572.459152:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.459163:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a200/0x844e5faceb5ec5ff lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1169a expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.459201:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a200/0x844e5faceb5ec5ff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1169a expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.459211:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a200/0x844e5faceb5ec5ff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1169a expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.459225:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155572.459227:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155572.459229:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3a200, rc 0) 00000100:00100000:3.0:1746155572.459254:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29310:x1830976123889536:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 113us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.459262:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10078 00000100:00100000:0.0:1746155572.463795:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.464089:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123889664 00000100:00100000:1.0:1746155572.464096:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123889664 00000100:00100000:1.0:1746155572.464143:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 606 00000100:00100000:1.0:1746155572.464150:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29310:x1830976123889664:12345-192.168.202.51@tcp:103:mirror_io.0 00010000:00010000:1.0:1746155572.464161:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.464183:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9400/0x844e5faceb5ec5b9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1168c expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.464194:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155572.464197:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.464225:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29310:x1830976123889664:12345-192.168.202.51@tcp:103:mirror_io.0 Request processed in 77us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.464231:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 606 00000100:00100000:0.0:1746155572.467031:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.467228:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123889920 00000100:00100000:2.0:1746155572.467235:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123889920 00000100:00100000:2.0:1746155572.467271:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4084 00000100:00100000:2.0:1746155572.467276:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29310:x1830976123889920:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:2.0:1746155572.467469:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29310:x1830976123889920:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 191us (441us total) trans 8589944041 rc 0/0 00000100:00100000:2.0:1746155572.467474:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4084 00000100:00100000:0.0:1746155572.468680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.468720:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123890176 00000100:00100000:1.0:1746155572.468724:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123890176 00000100:00100000:1.0:1746155572.468749:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4085 00000100:00100000:1.0:1746155572.468754:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29310:x1830976123890176:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:1.0:1746155572.468847:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29310:x1830976123890176:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 91us (166us total) trans 8589944042 rc 0/0 00000100:00100000:1.0:1746155572.468852:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4085 00000100:00100000:0.0:1746155572.487677:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.487735:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123890432 00000100:00100000:2.0:1746155572.487743:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123890432 00000100:00100000:2.0:1746155572.487823:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10079 00000100:00100000:2.0:1746155572.487831:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+6:29321:x1830976123890432:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155572.487851:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.487870:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec606 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116a1 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.489893:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094faea00/0x844e5faceb5ec60d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.489906:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094faea00/0x844e5faceb5ec60d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.489916:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094faea00/0x844e5faceb5ec60d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.489930:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec614 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.489934:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec614 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.489938:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec614 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490044:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec61b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490051:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec61b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490056:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec61b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155572.490064:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155572.490136:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094faea00/0x844e5faceb5ec60d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490142:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094faea00/0x844e5faceb5ec60d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490147:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094faea00/0x844e5faceb5ec60d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490153:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094faea00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155572.490156:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094faea00/0x844e5faceb5ec60d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490161:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094faea00/0x844e5faceb5ec60d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490170:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155572.490173:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155572.490179:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094faea00/0x844e5faceb5ec60d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490184:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094faea00/0x844e5faceb5ec60d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490216:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec614 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490221:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec614 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490225:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec614 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490229:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094218200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155572.490232:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec614 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490235:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec614 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490240:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9c00) 00010000:00010000:2.0:1746155572.490242:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155572.490244:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec614 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490247:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5ec614 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.490283:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9c000/0x844e5faceb5ec606 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116a1 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.490293:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec61b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116a1 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.490298:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.490301:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155572.490303:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093481000, rc 0) 00000100:00100000:2.0:1746155572.490361:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29321:x1830976123890432:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2529us (2691us total) trans 8589944043 rc 0/0 00000100:00100000:2.0:1746155572.490368:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10079 00000100:00100000:0.0:1746155572.492601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.499186:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123890688 00000100:00100000:2.0:1746155572.499198:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123890688 00000100:00100000:2.0:1746155572.499258:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10080 00000100:00100000:2.0:1746155572.499266:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+285:29320:x1830976123890688:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155572.499286:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.499301:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec629 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116a8 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.499388:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec630 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499398:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec630 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499407:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec630 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499417:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0x844e5faceb5ec637 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499422:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0x844e5faceb5ec637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499427:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0x844e5faceb5ec637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499550:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7acc00/0x844e5faceb5ec63e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499559:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7acc00/0x844e5faceb5ec63e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499565:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7acc00/0x844e5faceb5ec63e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155572.499573:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155572.499646:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec630 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499652:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec630 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499657:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec630 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499662:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ad800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155572.499665:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec630 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499671:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec630 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499681:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155572.499684:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155572.499688:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec630 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499692:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499701:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0x844e5faceb5ec637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499709:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0x844e5faceb5ec637 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499713:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0x844e5faceb5ec637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499716:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ad400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155572.499717:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0x844e5faceb5ec637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499721:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0x844e5faceb5ec637 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499725:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9f00) 00010000:00010000:2.0:1746155572.499727:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155572.499728:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0x844e5faceb5ec637 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499732:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0x844e5faceb5ec637 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.499772:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116a8 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.499781:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7acc00/0x844e5faceb5ec63e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116a8 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.499786:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.499788:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155572.499789:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7acc00, rc 0) 00000100:00100000:2.0:1746155572.499862:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29320:x1830976123890688:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 595us (7264us total) trans 8589944044 rc 0/0 00000100:00100000:2.0:1746155572.499869:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10080 00000100:00100000:0.0:1746155572.509203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.509269:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123890944 00000100:00100000:2.0:1746155572.509277:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123890944 00000100:00100000:2.0:1746155572.509324:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10081 00000100:00100000:2.0:1746155572.509340:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29324:x1830976123890944:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155572.509360:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.509374:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec64c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116af expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.509446:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0x844e5faceb5ec653 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.509457:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0x844e5faceb5ec653 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.509464:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0x844e5faceb5ec653 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155572.509472:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155572.509596:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec64c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116af expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.509611:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0x844e5faceb5ec653 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116af expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.509618:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.509620:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746155572.509623:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad600, rc 0) 00000100:00100000:2.0:1746155572.509671:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29324:x1830976123890944:12345-192.168.202.51@tcp:101:cat.0 Request processed in 340us (474us total) trans 8589944045 rc 0/0 00000100:00100000:2.0:1746155572.509677:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10081 00000100:00100000:0.0:1746155572.513583:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.513660:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123891200 00000100:00100000:2.0:1746155572.513667:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123891200 00000100:00100000:2.0:1746155572.513715:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10082 00000100:00100000:2.0:1746155572.513723:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29322:x1830976123891200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155572.513743:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.513757:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac000/0x844e5faceb5ec661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116b6 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.513833:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ace00/0x844e5faceb5ec668 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.513843:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ace00/0x844e5faceb5ec668 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.513852:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ace00/0x844e5faceb5ec668 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155572.513861:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155572.513950:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac000/0x844e5faceb5ec661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116b6 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.513981:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ace00/0x844e5faceb5ec668 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116b6 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.513987:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.513990:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746155572.513993:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ace00, rc 0) 00000100:00100000:2.0:1746155572.514032:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29322:x1830976123891200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 310us (457us total) trans 8589944046 rc 0/0 00000100:00100000:2.0:1746155572.514039:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10082 00000100:00100000:1.0:1746155572.523597:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.523746:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.523893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.523920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.523936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.523938:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123891328 00000100:00100000:3.0:1746155572.523945:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123891328 00000100:00100000:1.0:1746155572.523947:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.523960:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123891584 00000100:00100000:1.0:1746155572.523964:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123891584 00000100:00100000:3.0:1746155572.523973:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123891840 00000100:00100000:3.0:1746155572.523975:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123891840 00000100:00100000:1.0:1746155572.523981:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123891456 00000100:00100000:1.0:1746155572.523983:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123891456 00000100:00100000:3.0:1746155572.523984:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123891712 00000100:00100000:3.0:1746155572.523985:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123891712 00000100:00100000:1.0:1746155572.524048:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123891968 00000100:00100000:1.0:1746155572.524051:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123891968 00000100:00100000:3.0:1746155572.524052:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12386 00000100:00100000:3.0:1746155572.524059:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123891328:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155572.524069:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12387 00010000:00010000:3.0:1746155572.524072:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155572.524075:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123891584:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.524083:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.524086:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec676 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116bd expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.524094:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b400/0x844e5faceb5ec67d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116cb expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155572.524104:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x68143832, atime: 0x68143832, ctime: 0x68143833, blocks: 0x767 00002000:00010000:1.0:1746155572.524108:0:10591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3db:0x0] initial LVB size: 2097152, mtime: 0x68143834, atime: 0x68143834, ctime: 0x68143834, blocks: 0x81d 00010000:00010000:3.0:1746155572.524117:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524117:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.524119:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524119:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.524126:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec676 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116bd expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524126:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b400/0x844e5faceb5ec67d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116cb expref: 16 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.524138:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec676 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116bd expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524138:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b400/0x844e5faceb5ec67d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116cb expref: 16 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.524145:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b200, rc 0) 00010000:00010000:1.0:1746155572.524146:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4b400, rc 0) 00000100:00100000:1.0:1746155572.524177:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123891584:12345-192.168.202.51@tcp:101:cat.0 Request processed in 103us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.524178:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123891328:12345-192.168.202.51@tcp:101:cat.0 Request processed in 119us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.524182:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12387 00000100:00100000:3.0:1746155572.524185:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12386 00000100:00100000:3.0:1746155572.524196:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12388 00000100:00100000:1.0:1746155572.524200:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12389 00000100:00100000:3.0:1746155572.524201:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123891840:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155572.524205:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155572.524205:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123891456:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155572.524210:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ec684 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116d9 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.524211:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746155572.524218:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d9:0x0] initial LVB size: 4954272, mtime: 0x68143834, atime: 0x68143834, ctime: 0x68143834, blocks: 0x1613 00010000:00010000:1.0:1746155572.524218:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe4be00/0x844e5faceb5ec68b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116c4 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.524222:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.524223:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.524227:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ec684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d9 expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746155572.524227:0:10591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3da:0x0] initial LVB size: 2097152, mtime: 0x68143834, atime: 0x68143833, ctime: 0x68143834, blocks: 0x821 00010000:00010000:1.0:1746155572.524233:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.524234:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ec684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d9 expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524235:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524238:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4be00/0x844e5faceb5ec68b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116c4 expref: 16 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.524239:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3a800, rc 0) 00010000:00010000:1.0:1746155572.524246:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4be00/0x844e5faceb5ec68b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116c4 expref: 16 pid: 10591 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155572.524248:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123891840:12345-192.168.202.51@tcp:101:cat.0 Request processed in 48us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.524253:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12388 00010000:00010000:1.0:1746155572.524253:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4be00, rc 0) 00000100:00100000:3.0:1746155572.524259:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12390 00000100:00100000:3.0:1746155572.524262:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123891712:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155572.524266:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155572.524268:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123891456:12345-192.168.202.51@tcp:101:cat.0 Request processed in 63us (347us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155572.524271:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ec692 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116d2 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.524273:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12389 00002000:00010000:3.0:1746155572.524279:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x68143833, atime: 0x68143833, ctime: 0x68143833, blocks: 0x821 00010000:00010000:3.0:1746155572.524283:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746155572.524284:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12391 00010000:00010000:3.0:1746155572.524285:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.524288:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ec692 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d2 expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155572.524288:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976123891968:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.524293:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.524294:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ec692 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d2 expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.524299:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3a600, rc 0) 00010000:00010000:1.0:1746155572.524299:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5ec699 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116e0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155572.524308:0:10591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3dc:0x0] initial LVB size: 4194304, mtime: 0x68143834, atime: 0x68143833, ctime: 0x68143834, blocks: 0x1029 00010000:00010000:1.0:1746155572.524314:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524315:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524319:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5ec699 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e0 expref: 16 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524331:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5ec699 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e0 expref: 16 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524338:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4bc00, rc 0) 00000100:00100000:1.0:1746155572.524350:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976123891968:12345-192.168.202.51@tcp:101:cat.0 Request processed in 62us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.524354:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12391 00000100:00100000:1.0:1746155572.524382:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.524395:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123892096 00000100:00100000:1.0:1746155572.524398:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123892096 00000100:00100000:1.0:1746155572.524409:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12392 00000100:00100000:1.0:1746155572.524414:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123892096:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.524420:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.524425:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116e7 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.524435:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524436:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524440:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 17 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524449:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 17 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524456:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4b000, rc 0) 00000100:00100000:1.0:1746155572.524468:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123892096:12345-192.168.202.51@tcp:101:cat.0 Request processed in 54us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.524474:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12392 00000100:00100000:1.0:1746155572.524553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.524566:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123892224 00000100:00100000:1.0:1746155572.524569:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123892224 00000100:00100000:1.0:1746155572.524581:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12393 00000100:00100000:1.0:1746155572.524586:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123892224:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.524592:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.524597:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ac00/0x844e5faceb5ec6a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116ee expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.524607:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524608:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524612:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ac00/0x844e5faceb5ec6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116ee expref: 30 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524620:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ac00/0x844e5faceb5ec6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116ee expref: 30 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524627:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4ac00, rc 0) 00000100:00100000:1.0:1746155572.524639:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123892224:12345-192.168.202.51@tcp:101:cat.0 Request processed in 53us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.524643:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12393 00000100:00100000:1.0:1746155572.524672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.524682:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123892352 00000100:00100000:1.0:1746155572.524684:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123892352 00000100:00100000:1.0:1746155572.524695:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12394 00000100:00100000:1.0:1746155572.524699:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123892352:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.524705:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.524710:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b800/0x844e5faceb5ec6ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116f5 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.524719:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524720:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524723:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b800/0x844e5faceb5ec6ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116f5 expref: 31 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524732:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b800/0x844e5faceb5ec6ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116f5 expref: 31 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524738:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4b800, rc 0) 00000100:00100000:1.0:1746155572.524750:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123892352:12345-192.168.202.51@tcp:101:cat.0 Request processed in 51us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.524755:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12394 00000100:00100000:1.0:1746155572.524783:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.524791:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123892480 00000100:00100000:1.0:1746155572.524794:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123892480 00000100:00100000:1.0:1746155572.524804:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12395 00000100:00100000:1.0:1746155572.524808:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976123892480:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.524813:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.524818:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a200/0x844e5faceb5ec6b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f116fc expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.524826:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524827:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524830:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a200/0x844e5faceb5ec6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116fc expref: 18 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524838:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a200/0x844e5faceb5ec6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116fc expref: 18 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524845:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4a200, rc 0) 00000100:00100000:1.0:1746155572.524859:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976123892480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 50us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.524863:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12395 00000100:00100000:1.0:1746155572.524892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.524900:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123892608 00000100:00100000:1.0:1746155572.524903:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123892608 00000100:00100000:1.0:1746155572.524912:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12396 00000100:00100000:1.0:1746155572.524916:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123892608:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.524921:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.524926:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5ec6bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11703 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.524934:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524935:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.524938:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5ec6bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11703 expref: 19 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524945:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5ec6bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11703 expref: 19 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.524951:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0db3400, rc 0) 00000100:00100000:1.0:1746155572.524964:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123892608:12345-192.168.202.51@tcp:101:cat.0 Request processed in 47us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.524968:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12396 00000100:00100000:1.0:1746155572.525007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.525020:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123892736 00000100:00100000:1.0:1746155572.525022:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123892736 00000100:00100000:1.0:1746155572.525033:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12397 00000100:00100000:1.0:1746155572.525037:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123892736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.525043:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.525050:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5ec6c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1170a expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.525057:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.525058:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.525061:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5ec6c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1170a expref: 32 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.525069:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5ec6c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1170a expref: 32 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155572.525074:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913f0c00, rc 0) 00000100:00100000:1.0:1746155572.525087:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123892736:12345-192.168.202.51@tcp:101:cat.0 Request processed in 50us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.525091:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12397 00000100:00100000:3.0:1746155572.525125:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123891712:12345-192.168.202.51@tcp:101:cat.0 Request processed in 860us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.525129:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12390 00000100:00100000:0.0:1746155572.527367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.527418:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123892992 00000100:00100000:2.0:1746155572.527424:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123892992 00000100:00100000:2.0:1746155572.527462:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10083 00000100:00100000:2.0:1746155572.527468:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29320:x1830976123892992:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155572.527484:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.527491:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746155572.527550:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ace00/0x844e5faceb5ec668 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116b6 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.527575:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7acc00/0x844e5faceb5ec63e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116a8 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.527584:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.527587:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155572.527595:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac000/0x844e5faceb5ec6ca lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11711 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.527635:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.527645:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a200/0x844e5faceb5ec5ff lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1169a expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.527651:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0x844e5faceb5ec653 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116af expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.527656:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec61b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116a1 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.527662:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.527694:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec61b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116a1 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.527707:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec61b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116a1 expref: 9 pid: 27374 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.527716:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124633600:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.527795:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0x844e5faceb5ec653 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116af expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.527802:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0x844e5faceb5ec653 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116af expref: 9 pid: 27374 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.527809:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124633728:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.527838:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a200/0x844e5faceb5ec5ff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1169a expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.527844:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a200/0x844e5faceb5ec5ff lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1169a expref: 8 pid: 15474 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.527851:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124633856:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.527867:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155572.531183:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.531194:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124633600:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.531204:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124633728:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155572.531212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.531249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.531263:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123893248 00000100:00100000:0.0:1746155572.531263:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123893120 00000100:00100000:1.0:1746155572.531268:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123893248 00000100:00100000:0.0:1746155572.531268:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123893120 00010000:00010000:1.0:1746155572.531291:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0x844e5faceb5ec653 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116af expref: 11 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.531291:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec61b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116a1 expref: 11 pid: 27374 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.531316:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123893376 00000100:00100000:0.0:1746155572.531318:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123893376 00000100:00100000:1.0:1746155572.531322:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6247 00000100:00100000:1.0:1746155572.531328:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123893120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155572.531328:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a200/0x844e5faceb5ec5ff lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1169a expref: 9 pid: 15474 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.531338:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155572.531341:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6248 00010000:00010000:1.0:1746155572.531343:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec61b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116a1 expref: 11 pid: 27374 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.531346:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123893248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.531351:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec61b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116a1 expref: 11 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.531353:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155572.531356:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0x844e5faceb5ec653 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116af expref: 11 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.531367:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5ec61b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116a1 expref: 11 pid: 27374 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.531412:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6249 00000100:00100000:2.0:1746155572.531418:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123893376:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.531431:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155572.531435:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a200/0x844e5faceb5ec5ff lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1169a expref: 9 pid: 15474 timeout: 801 lvb_type: 0 00000100:00100000:3.0:1746155572.531529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.531558:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123893504 00000100:00100000:3.0:1746155572.531561:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123893504 00000100:00100000:3.0:1746155572.531586:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10084 00000100:00100000:3.0:1746155572.531595:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29324:x1830976123893504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155572.531612:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.531622:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11718 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.531717:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0x844e5faceb5ec653 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116af expref: 12 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.531758:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155572.531764:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155572.531773:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155572.531778:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.531824:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123893120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 495us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.531830:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6247 00010000:00010000:2.0:1746155572.532103:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a200/0x844e5faceb5ec5ff lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1169a expref: 9 pid: 15474 timeout: 801 lvb_type: 0 00010000:00010000:3.0:1746155572.532123:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155572.532135:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.532148:0:15474:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155572.532166:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.532174:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155572.532179:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155572.532181:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155572.532185:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3a400, rc 0) 00000100:00100000:3.0:1746155572.532222:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29324:x1830976123893504:12345-192.168.202.51@tcp:101:cat.0 Request processed in 627us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.532228:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10084 00010000:00010000:0.0:1746155572.532273:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad600/0x844e5faceb5ec653 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116af expref: 10 pid: 27374 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746155572.532284:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155572.532286:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155572.532291:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155572.532295:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.532323:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976123893248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 975us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.532329:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6248 00010000:00010000:2.0:1746155572.532419:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.532423:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.532428:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.532433:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.532440:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.532449:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155572.532479:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123893376:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1061us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.532485:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6249 00010000:00010000:2.0:1746155572.532524:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a200/0x844e5faceb5ec5ff lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1169a expref: 8 pid: 15474 timeout: 801 lvb_type: 0 00000100:00100000:2.0:1746155572.532546:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124633856:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.532564:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.532571:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.532575:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00000040:00080000:2.0:1746155572.533130:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2935, 88 off245664 00000004:00080000:2.0:1746155572.533136:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701682632258ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155572.533188:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2874, 88 off240032 00000004:00080000:2.0:1746155572.533191:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701682688345ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155572.533216:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2875, 88 off240120 00000004:00080000:2.0:1746155572.533219:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701682715660ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155572.533644:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2937, 88 off245848 00000004:00080000:2.0:1746155572.533649:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701683145981ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155572.533661:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2938, 88 off245936 00000004:00080000:2.0:1746155572.533663:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701683160420ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155572.533677:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2876, 88 off240208 00000004:00080000:2.0:1746155572.533679:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701683176320ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155572.533695:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2877, 88 off240296 00000004:00080000:2.0:1746155572.533697:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701683194581ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155572.533703:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2878, 88 off240384 00000004:00080000:2.0:1746155572.533707:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701683204255ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155572.533713:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2939, 88 off246024 00000004:00080000:2.0:1746155572.533716:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701683212815ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155572.533734:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2879, 88 off240472 00000004:00080000:2.0:1746155572.533737:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701683233890ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155572.533743:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2940, 88 off246112 00000004:00080000:2.0:1746155572.533747:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701683243970ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155572.533813:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2880, 88 off240560 00000004:00080000:2.0:1746155572.533817:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701683314136ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155572.534175:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2941, 88 off246200 00000004:00080000:2.0:1746155572.534179:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701683676256ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155572.534201:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2942, 88 off246288 00000004:00080000:2.0:1746155572.534204:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701683700757ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155572.534210:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2943, 88 off246376 00000004:00080000:2.0:1746155572.534212:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701683709400ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155572.534220:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2944, 88 off246464 00000004:00080000:2.0:1746155572.534223:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701683719942ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155572.534231:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2881, 88 off240648 00000004:00080000:2.0:1746155572.534233:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 701683730396ns, next at 645866785986ns, rc = 0 00000100:00100000:0.0:1746155572.535186:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.536999:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123893632 00000100:00100000:3.0:1746155572.537008:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123893632 00000100:00100000:3.0:1746155572.537055:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10085 00000100:00100000:3.0:1746155572.537063:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29322:x1830976123893632:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155572.537078:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.537093:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1171f expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.537144:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.537155:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.537165:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155572.537168:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155572.537172:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.537178:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3bc00, rc 0) 00000100:00100000:3.0:1746155572.537222:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29322:x1830976123893632:12345-192.168.202.51@tcp:101:cat.0 Request processed in 160us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.537228:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10085 00000001:00080000:1.0:1746155572.577223:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944042 is committed 00000001:00080000:1.0:1746155572.577234:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944047 is committed 00000004:00080000:1.0:1746155572.577238:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2073 committed 00000100:00100000:0.0:1746155572.578417:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124634112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.578467:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155572.578497:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124634624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.578527:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155572.578554:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746155572.578559:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124634240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.578572:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155572.578582:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124634752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.578594:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155572.578613:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124634112 00000100:00100000:0.0:1746155572.578618:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124634112 00000100:00100000:0.0:1746155572.578644:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124634624 00000100:00100000:0.0:1746155572.578646:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124634624 00000100:00100000:0.0:1746155572.578654:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124634240 00000100:00100000:0.0:1746155572.578656:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124634240 00000100:00100000:0.0:1746155572.578664:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124634752 00000100:00100000:0.0:1746155572.578666:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124634752 00000100:00100000:0.0:1746155572.578677:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12398 00000100:00100000:0.0:1746155572.578682:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976124634112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155572.578824:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155572.578827:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155572 -> 1746155572 00002000:00010000:0.0:1746155572.578829:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155572 -> 1746155572 00002000:00010000:0.0:1746155572.578831:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155572 -> 1746155572 00002000:00010000:0.0:1746155572.578832:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746155572.578858:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3295:x1830976124634112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (391us total) trans 17179873251 rc 0/0 00000100:00100000:0.0:1746155572.578864:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12398 00000100:00100000:0.0:1746155572.578877:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12399 00000100:00100000:0.0:1746155572.578882:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976124634624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.578957:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3295:x1830976124634624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (429us total) trans 17179873252 rc 0/0 00000100:00100000:0.0:1746155572.578962:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12399 00000100:00100000:0.0:1746155572.578971:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12400 00000100:00100000:0.0:1746155572.578975:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976124634240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155572.579039:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155572.579041:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155572 -> 1746155572 00002000:00010000:0.0:1746155572.579042:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155571 -> 1746155571 00002000:00010000:0.0:1746155572.579044:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155572 -> 1746155572 00002000:00010000:0.0:1746155572.579045:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155572.579063:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3295:x1830976124634240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (490us total) trans 17179873253 rc 0/0 00000100:00100000:0.0:1746155572.579067:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12400 00000100:00100000:0.0:1746155572.579076:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12401 00000100:00100000:0.0:1746155572.579080:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976124634752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.579148:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3295:x1830976124634752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (553us total) trans 17179873254 rc 0/0 00000100:00100000:0.0:1746155572.579152:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12401 00000004:00080000:0.0:1746155572.579182:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f882300/2, rc 0, transno 17179873253 00000100:00100000:0.0:1746155572.579185:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124634240:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155572.579191:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3eea00/2, rc 0, transno 17179873254 00000100:00100000:0.0:1746155572.579194:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124634752:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155572.579199:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f881880/2, rc 0, transno 17179873251 00000100:00100000:0.0:1746155572.579202:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124634112:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155572.579206:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3efb80/2, rc 0, transno 17179873252 00000100:00100000:0.0:1746155572.579208:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124634624:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746155572.579306:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11711 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.579315:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.579318:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746155572.579322:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.579330:0:27374:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.579339:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.579344:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 290 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.579349:0:27374:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 290 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.579355:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 290 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.579375:0:27374:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 290 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.579383:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124635008:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155572.579436:0:27374:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.579443:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124635136:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155572.579459:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b3c0 going to sleep for 11 seconds 00000004:00080000:1.0:1746155572.579565:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2142 committed 00000004:00080000:1.0:1746155572.579571:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2141 committed 00000004:00080000:1.0:1746155572.579572:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2140 committed 00000004:00080000:1.0:1746155572.579574:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2139 committed 00000004:00080000:1.0:1746155572.579575:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2072 committed 00000004:00080000:1.0:1746155572.579577:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2138 committed 00000004:00080000:1.0:1746155572.579578:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2071 committed 00000004:00080000:1.0:1746155572.579580:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2137 committed 00000004:00080000:1.0:1746155572.579582:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2070 committed 00000004:00080000:1.0:1746155572.579583:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2069 committed 00000004:00080000:1.0:1746155572.579584:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2068 committed 00000004:00080000:1.0:1746155572.579586:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2136 committed 00000004:00080000:1.0:1746155572.579587:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2135 committed 00000004:00080000:1.0:1746155572.579588:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2067 committed 00000004:00080000:1.0:1746155572.579589:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2066 committed 00000004:00080000:1.0:1746155572.579593:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2134 committed 00000001:00080000:1.0:1746155572.579601:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944045 is committed 00000100:00100000:1.0:1746155572.579620:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124633984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.579641:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155572.579653:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124634496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.579665:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155572.579675:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746155572.579679:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124634368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.579688:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155572.579695:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124634880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.579704:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155572.579716:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124633984 00000100:00100000:1.0:1746155572.579719:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124633984 00000100:00100000:1.0:1746155572.579730:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124634496 00000100:00100000:1.0:1746155572.579731:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124634496 00000100:00100000:1.0:1746155572.579739:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124634368 00000100:00100000:1.0:1746155572.579740:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124634368 00000100:00100000:1.0:1746155572.579747:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124634880 00000100:00100000:1.0:1746155572.579749:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124634880 00000100:00100000:1.0:1746155572.579756:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12402 00000100:00100000:1.0:1746155572.579760:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3298:x1830976124633984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155572.579828:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155572.579830:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155572 -> 1746155572 00002000:00010000:1.0:1746155572.579832:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155571 -> 1746155571 00002000:00010000:1.0:1746155572.579833:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155572 -> 1746155572 00002000:00010000:1.0:1746155572.579835:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155572.579852:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3298:x1830976124633984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (211us total) trans 17179873255 rc 0/0 00000100:00100000:1.0:1746155572.579857:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12402 00000100:00100000:1.0:1746155572.579864:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12403 00000100:00100000:1.0:1746155572.579868:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3298:x1830976124634496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.579930:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3298:x1830976124634496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (264us total) trans 17179873256 rc 0/0 00000100:00100000:1.0:1746155572.579934:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12403 00000100:00100000:1.0:1746155572.579944:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12404 00000100:00100000:1.0:1746155572.579948:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3298:x1830976124634368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.580005:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3298:x1830976124634368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (316us total) trans 17179873257 rc 0/0 00000100:00100000:1.0:1746155572.580009:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12404 00000100:00100000:1.0:1746155572.580017:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12405 00000100:00100000:1.0:1746155572.580020:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3298:x1830976124634880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155572.580071:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3298:x1830976124634880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (366us total) trans 17179873258 rc 0/0 00000100:00100000:1.0:1746155572.580076:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12405 00000004:00080000:1.0:1746155572.580096:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f881f80/2, rc 0, transno 17179873257 00000100:00100000:1.0:1746155572.580098:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124634368:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155572.580103:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ec000/2, rc 0, transno 17179873258 00000100:00100000:1.0:1746155572.580105:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124634880:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155572.580109:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f880e00/2, rc 0, transno 17179873255 00000100:00100000:1.0:1746155572.580111:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124633984:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155572.580115:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f881180/2, rc 0, transno 17179873256 00000100:00100000:1.0:1746155572.580117:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124634496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155572.580614:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124635392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155572.580632:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155572.580642:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124635904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155572.580652:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155572.580659:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746155572.580662:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124635520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155572.580671:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155572.580678:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124636032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155572.580686:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155572.580697:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124635392 00000100:00100000:0.0:1746155572.580699:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124635392 00000100:00100000:0.0:1746155572.580710:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124635904 00000100:00100000:0.0:1746155572.580712:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124635904 00000100:00100000:0.0:1746155572.580717:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124635520 00000100:00100000:0.0:1746155572.580719:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124635520 00000100:00100000:0.0:1746155572.580724:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124636032 00000100:00100000:0.0:1746155572.580725:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124636032 00000100:00100000:0.0:1746155572.580733:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12406 00000100:00100000:0.0:1746155572.580736:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3295:x1830976124635392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155572.580818:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155572.580821:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155571 -> 1746155571 00002000:00010000:0.0:1746155572.580823:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155571 -> 1746155571 00002000:00010000:0.0:1746155572.580824:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:0.0:1746155572.580827:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155572.580848:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3295:x1830976124635392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (214us total) trans 21474840637 rc 0/0 00000100:00100000:0.0:1746155572.580853:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12406 00000100:00100000:0.0:1746155572.580861:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12407 00000100:00100000:0.0:1746155572.580865:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3295:x1830976124635904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155572.580925:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3295:x1830976124635904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (272us total) trans 21474840638 rc 0/0 00000100:00100000:0.0:1746155572.580930:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12407 00000100:00100000:0.0:1746155572.580937:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12408 00000100:00100000:0.0:1746155572.580940:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3295:x1830976124635520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155572.580989:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:0.0:1746155572.580991:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155572 -> 1746155572 00002000:00010000:0.0:1746155572.580993:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155572 -> 1746155572 00002000:00010000:0.0:1746155572.580994:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155572 -> 1746155572 00002000:00010000:0.0:1746155572.580996:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:0.0:1746155572.581008:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3295:x1830976124635520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (336us total) trans 21474840639 rc 0/0 00000100:00100000:0.0:1746155572.581012:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12408 00000100:00100000:0.0:1746155572.581019:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12409 00000100:00100000:0.0:1746155572.581022:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3295:x1830976124636032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155572.581081:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3295:x1830976124636032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (393us total) trans 21474840640 rc 0/0 00000100:00100000:0.0:1746155572.581084:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12409 00000004:00080000:0.0:1746155572.581103:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b6c0380/2, rc 0, transno 21474840639 00000100:00100000:0.0:1746155572.581108:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124635520:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155572.581113:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c7480/2, rc 0, transno 21474840640 00000100:00100000:0.0:1746155572.581115:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124636032:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155572.581119:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b6c0700/2, rc 0, transno 21474840637 00000100:00100000:0.0:1746155572.581121:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124635392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155572.581125:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b6c3b80/2, rc 0, transno 21474840638 00000100:00100000:0.0:1746155572.581127:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124635904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155572.581221:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124635648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155572.581238:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155572.581247:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124636160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155572.581255:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155572.581262:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1746155572.581265:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124635264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155572.581274:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155572.581280:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124635776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155572.581289:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155572.581294:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124636288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155572.581303:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155572.581313:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124635648 00000100:00100000:3.0:1746155572.581315:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124635648 00000100:00100000:3.0:1746155572.581326:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124636160 00000100:00100000:3.0:1746155572.581327:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124636160 00000100:00100000:3.0:1746155572.581335:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124635264 00000100:00100000:3.0:1746155572.581337:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124635264 00000100:00100000:3.0:1746155572.581342:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124635776 00000100:00100000:3.0:1746155572.581344:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124635776 00000100:00100000:3.0:1746155572.581349:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124636288 00000100:00100000:3.0:1746155572.581351:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124636288 00000100:00100000:3.0:1746155572.581358:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12410 00000100:00100000:3.0:1746155572.581362:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976124635648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155572.581433:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:3.0:1746155572.581436:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155572.581437:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746155572.581438:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155572.581440:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:3.0:1746155572.581461:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3297:x1830976124635648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (222us total) trans 21474840641 rc 0/0 00000100:00100000:3.0:1746155572.581466:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12410 00000100:00100000:3.0:1746155572.581476:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12411 00000100:00100000:3.0:1746155572.581480:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976124636160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155572.581709:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12412 00000100:00100000:2.0:1746155572.581716:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976124635264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155572.581789:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155572.581792:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155570 -> 1746155570 00002000:00010000:2.0:1746155572.581793:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155570 -> 1746155570 00002000:00010000:2.0:1746155572.581796:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155571 -> 1746155571 00002000:00010000:2.0:1746155572.581798:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:2.0:1746155572.581817:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3297:x1830976124635264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (541us total) trans 21474840642 rc 0/0 00000100:00100000:2.0:1746155572.581822:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12412 00000100:00100000:2.0:1746155572.581832:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12413 00000100:00100000:2.0:1746155572.581836:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976124635776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155572.581904:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3297:x1830976124635776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (614us total) trans 21474840643 rc 0/0 00000100:00100000:2.0:1746155572.581909:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12413 00000100:00100000:2.0:1746155572.581918:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12414 00000100:00100000:2.0:1746155572.581922:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976124636288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155572.581988:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3297:x1830976124636288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (683us total) trans 21474840644 rc 0/0 00000100:00100000:2.0:1746155572.581993:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12414 00000100:00100000:3.0:1746155572.582233:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3297:x1830976124636160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 751us (975us total) trans 21474840645 rc 0/0 00000100:00100000:3.0:1746155572.582239:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12411 00000004:00080000:3.0:1746155572.582267:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008ff19180/2, rc 0, transno 21474840642 00000100:00100000:3.0:1746155572.582270:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ff19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124635264:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155572.582276:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b6c1c00/2, rc 0, transno 21474840643 00000100:00100000:3.0:1746155572.582278:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124635776:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155572.582283:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094f09180/2, rc 0, transno 21474840644 00000100:00100000:3.0:1746155572.582285:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124636288:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155572.582290:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b6c2300/2, rc 0, transno 21474840641 00000100:00100000:3.0:1746155572.582292:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124635648:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155572.582296:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c5f80/2, rc 0, transno 21474840645 00000100:00100000:3.0:1746155572.582299:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124636160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155572.583526:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.583803:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123893760 00000100:00100000:3.0:1746155572.583808:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123893760 00000100:00100000:2.0:1746155572.584063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.584116:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124635008:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155572.584125:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124635136:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155572.584159:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac000/0x844e5faceb5ec6ca lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11711 expref: 289 pid: 27374 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746155572.584175:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11711 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.584202:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad800, rc 0) 00000100:00100000:0.0:1746155572.584581:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29320:x1830976123892992:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 57112us (57217us total) trans 8589944047 rc 0/0 00000100:00100000:0.0:1746155572.584588:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10083 00000100:00100000:3.0:1746155572.584869:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123893888 00000100:00100000:3.0:1746155572.584873:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123893888 00000100:00100000:1.0:1746155572.584915:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4086 00000100:00100000:1.0:1746155572.584923:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29322:x1830976123893760:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:1.0:1746155572.584982:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29322:x1830976123893760:12345-192.168.202.51@tcp:49:cat.0 Request processed in 60us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.584986:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4086 00000100:00100000:1.0:1746155572.584998:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4087 00000100:00100000:1.0:1746155572.585003:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+7:29324:x1830976123893888:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:1.0:1746155572.585028:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+7:29324:x1830976123893888:12345-192.168.202.51@tcp:49:cat.0 Request processed in 25us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.585032:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4087 00000100:00100000:0.0:1746155572.590646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.590957:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123894016 00000100:00100000:1.0:1746155572.590966:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123894016 00000100:00100000:1.0:1746155572.591007:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4088 00000100:00100000:1.0:1746155572.591014:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a652450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29320:x1830976123894016:12345-192.168.202.51@tcp:49:multiop.0 00000100:00100000:1.0:1746155572.591111:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a652450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29320:x1830976123894016:12345-192.168.202.51@tcp:49:multiop.0 Request processed in 98us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.591117:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4088 00000100:00100000:0.0:1746155572.601012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.601079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.601132:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123894400 00000100:00100000:3.0:1746155572.601140:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123894400 00002000:00100000:3.0:1746155572.601176:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880094f0a300 x1830976123894400/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.601184:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0a300 with x1830976123894400 ext(0->1048575) 00002000:00010000:3.0:1746155572.601195:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f0a300 00000100:00100000:3.0:1746155572.601214:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4789 00000100:00100000:2.0:1746155572.601217:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123894144 00000100:00100000:3.0:1746155572.601221:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123894400:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155572.601221:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123894144 00000100:00100000:2.0:1746155572.601254:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12415 00000100:00100000:2.0:1746155572.601258:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:29320:x1830976123894144:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155572.601267:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.601280:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11726 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.601298:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec676 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116bd expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.601306:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.601312:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.601313:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.601316:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [544768->786431] (req 544768->786431) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.601338:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.601348:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 20 pid: 18270 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746155572.601358:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124636416:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.601424:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec676 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116bd expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.601431:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec676 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116bd expref: 22 pid: 19959 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746155572.601438:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124636544:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.601454:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155572.601626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.601670:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.601718:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123894656 00000100:00100000:0.0:1746155572.601721:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123894656 00002000:00100000:0.0:1746155572.601738:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094f0b480 x1830976123894656/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.601745:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0b480 with x1830976123894656 ext(1048576->2097151) 00002000:00010000:0.0:1746155572.601748:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f0b480 00000100:00100000:0.0:1746155572.601757:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123894912 00000100:00100000:0.0:1746155572.601759:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123894912 00002000:00100000:0.0:1746155572.601767:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009a6daa00 x1830976123894912/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.601773:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6daa00 with x1830976123894912 ext(1048576->2097151) 00002000:00010000:0.0:1746155572.601775:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6daa00 00000100:00100000:0.0:1746155572.601785:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4790 00000100:00100000:0.0:1746155572.601789:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976123894656:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155572.602792:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4791 00000100:00100000:0.0:1746155572.602799:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123894912:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155572.611167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.614953:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124636416:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155572.614966:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124636544:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.614992:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [544768->786431] (req 544768->786431) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.615007:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0400, rc 0) 00000100:00100000:3.0:1746155572.615043:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29320:x1830976123894144:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 13783us (14037us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.615050:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12415 00000100:00100000:2.0:1746155572.615060:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123895168 00000100:00100000:2.0:1746155572.615067:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123895168 00002000:00100000:2.0:1746155572.615098:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009a6db800 x1830976123895168/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.615106:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6db800 with x1830976123895168 ext(1048576->2097151) 00002000:00010000:2.0:1746155572.615110:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6db800 00000100:00100000:2.0:1746155572.615135:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4792 00000100:00100000:2.0:1746155572.615142:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123895168:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155572.619765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.619805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.621730:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123895552 00000100:00100000:1.0:1746155572.621730:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123895680 00000100:00100000:3.0:1746155572.621738:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123895552 00000100:00100000:1.0:1746155572.621738:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123895680 00000100:00100000:0.0:1746155572.621759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:3.0:1746155572.621771:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009a6d8000 x1830976123895552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.621771:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009a6d9180 x1830976123895680/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.621780:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d9180 with x1830976123895680 ext(1048576->2097151) 00002000:00100000:3.0:1746155572.621784:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d8000 with x1830976123895552 ext(0->1048575) 00002000:00010000:1.0:1746155572.621784:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6d9180 00000100:00100000:0.0:1746155572.621784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155572.621790:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 21 pid: 18270 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746155572.621799:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123896064 00000100:00100000:1.0:1746155572.621800:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123896064 00010000:00010000:3.0:1746155572.621802:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 21 pid: 18270 timeout: 801 lvb_type: 1 00002000:00010000:3.0:1746155572.621807:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6d8000 00002000:00100000:1.0:1746155572.621810:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009a6d8700 x1830976123896064/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155572.621815:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123895936 00002000:00100000:1.0:1746155572.621816:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d8700 with x1830976123896064 ext(1048576->2097151) 00000100:00100000:3.0:1746155572.621817:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123895936 00002000:00010000:1.0:1746155572.621818:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6d8700 00002000:00100000:3.0:1746155572.621826:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800a5ae0700 x1830976123895936/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155572.621827:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 763 00002000:00100000:3.0:1746155572.621831:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0700 with x1830976123895936 ext(1048576->2097151) 00002000:00010000:3.0:1746155572.621833:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ae0700 00000100:00100000:1.0:1746155572.621833:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123895552:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155572.621841:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4793 00000100:00100000:3.0:1746155572.621844:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123895680:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155572.622091:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123894656:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20300us (20464us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155572.622098:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4790 00002000:00100000:0.0:1746155572.622104:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094f0b480 x1830976123894656/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.622116:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0b480 with x1830976123894656 ext(1048576->2097151) 00002000:00010000:0.0:1746155572.622119:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f0b480 00000100:00100000:0.0:1746155572.622134:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4794 00000100:00100000:0.0:1746155572.622139:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123896064:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155572.622877:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4795 00000100:00100000:3.0:1746155572.622884:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123895936:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155572.629859:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123894400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28631us (28771us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155572.629869:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4789 00002000:00100000:3.0:1746155572.629877:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880094f0a300 x1830976123894400/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.629891:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0a300 with x1830976123894400 ext(0->1048575) 00010000:00010000:3.0:1746155572.629899:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec676 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116bd expref: 24 pid: 19959 timeout: 801 lvb_type: 1 00010000:00010000:3.0:1746155572.629910:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec676 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116bd expref: 24 pid: 19959 timeout: 801 lvb_type: 1 00002000:00010000:3.0:1746155572.629916:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f0a300 00000100:00100000:2.0:1746155572.632560:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976123894912:12345-192.168.202.51@tcp:3:cat.0 Request processed in 29754us (30882us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155572.632568:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4791 00002000:00100000:2.0:1746155572.632576:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009a6daa00 x1830976123894912/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.632583:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6daa00 with x1830976123894912 ext(1048576->2097151) 00002000:00010000:2.0:1746155572.632587:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6daa00 00000100:00100000:2.0:1746155572.639885:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123895168:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24735us (28717us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155572.639895:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4792 00002000:00100000:2.0:1746155572.639904:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009a6db800 x1830976123895168/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.639912:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6db800 with x1830976123895168 ext(1048576->2097151) 00002000:00010000:2.0:1746155572.639917:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6db800 00000100:00100000:0.0:1746155572.644805:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.644872:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123896320 00000100:00100000:3.0:1746155572.644881:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123896320 00000100:00100000:3.0:1746155572.644930:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12416 00000100:00100000:3.0:1746155572.644938:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29321:x1830976123896320:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155572.644953:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.644968:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1172d expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.644991:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4be00/0x844e5faceb5ec68b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116c4 expref: 17 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.644998:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ac00/0x844e5faceb5ec6a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116ee expref: 35 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.645004:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.645005:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.645008:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1294336->1949695] (req 1294336->1949695) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.645038:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ac00/0x844e5faceb5ec6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116ee expref: 35 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.645047:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ac00/0x844e5faceb5ec6a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116ee expref: 35 pid: 20200 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746155572.645056:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124636672:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.645139:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe4be00/0x844e5faceb5ec68b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116c4 expref: 17 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.645147:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4be00/0x844e5faceb5ec68b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116c4 expref: 17 pid: 10591 timeout: 801 lvb_type: 1 00000100:00100000:3.0:1746155572.645154:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124636800:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155572.645172:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155572.645275:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123895680:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23427us (25467us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155572.645284:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4793 00002000:00100000:2.0:1746155572.645291:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009a6d9180 x1830976123895680/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.645299:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d9180 with x1830976123895680 ext(1048576->2097151) 00002000:00010000:2.0:1746155572.645303:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6d9180 00000100:00100000:2.0:1746155572.646854:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123895552:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25014us (27091us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155572.646864:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 763 00002000:00100000:2.0:1746155572.646872:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009a6d8000 x1830976123895552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.646880:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d8000 with x1830976123895552 ext(0->1048575) 00010000:00010000:2.0:1746155572.646888:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 20 pid: 18270 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.646900:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 20 pid: 18270 timeout: 801 lvb_type: 1 00002000:00010000:2.0:1746155572.646906:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6d8000 00000100:00100000:0.0:1746155572.651900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.652247:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123896448 00000100:00100000:2.0:1746155572.652255:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123896448 00010000:00010000:2.0:1746155572.652282:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec676 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116bd expref: 22 pid: 19959 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746155572.652303:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6250 00000100:00100000:2.0:1746155572.652309:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123896448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.652319:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155572.652334:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec676 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116bd expref: 22 pid: 19959 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.652344:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec676 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116bd expref: 22 pid: 19959 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.652362:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ec676 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116bd expref: 22 pid: 19959 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.652376:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155572.652418:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123896448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 109us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.652423:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6250 00000100:00100000:1.0:1746155572.652441:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123896064:12345-192.168.202.51@tcp:3:cat.0 Request processed in 30300us (30682us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155572.652449:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4794 00002000:00100000:1.0:1746155572.652456:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009a6d8700 x1830976123896064/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.652464:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6d8700 with x1830976123896064 ext(1048576->2097151) 00002000:00010000:1.0:1746155572.652467:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6d8700 00000100:00100000:3.0:1746155572.652925:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124636672:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155572.653481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.653495:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124636800:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155572.653555:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1294336->1949695] (req 1294336->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.653566:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1e00, rc 0) 00000100:00100000:3.0:1746155572.653590:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29321:x1830976123896320:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8654us (8793us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.653599:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12416 00000100:00100000:1.0:1746155572.653638:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123896576 00000100:00100000:1.0:1746155572.653642:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123896576 00010000:00010000:1.0:1746155572.653663:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4be00/0x844e5faceb5ec68b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116c4 expref: 17 pid: 10591 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746155572.653692:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6251 00000100:00100000:1.0:1746155572.653698:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123896576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.653705:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.653716:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe4be00/0x844e5faceb5ec68b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116c4 expref: 17 pid: 10591 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.653723:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe4be00/0x844e5faceb5ec68b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116c4 expref: 17 pid: 10591 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.653735:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4be00/0x844e5faceb5ec68b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116c4 expref: 17 pid: 10591 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.653749:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.653765:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123896576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.653770:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6251 00000100:00100000:2.0:1746155572.655105:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123895936:12345-192.168.202.51@tcp:3:cat.0 Request processed in 32219us (33317us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155572.655113:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4795 00002000:00100000:2.0:1746155572.655120:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800a5ae0700 x1830976123895936/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.655127:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0700 with x1830976123895936 ext(1048576->2097151) 00010000:00010000:2.0:1746155572.655133:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ac00/0x844e5faceb5ec6a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116ee expref: 32 pid: 20200 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.655142:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ac00/0x844e5faceb5ec6a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116ee expref: 32 pid: 20200 timeout: 801 lvb_type: 1 00002000:00010000:2.0:1746155572.655147:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ae0700 00000100:00100000:0.0:1746155572.663278:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.663321:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.666077:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.666179:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123896960 00000100:00100000:3.0:1746155572.666187:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123896960 00000100:00100000:3.0:1746155572.666223:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12417 00000100:00100000:3.0:1746155572.666230:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29322:x1830976123896960:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155572.666246:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.666260:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11734 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.666280:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155572.666286:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1294336->1949695] (req 1294336->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.666291:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155572.666294:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11734 expref: 33 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.666322:0:1625:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1294336->1949695] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.666332:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11734 expref: 33 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.666340:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd4200, rc 0) 00000100:00100000:3.0:1746155572.666374:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:29322:x1830976123896960:12345-192.168.202.51@tcp:101:cat.0 Request processed in 144us (3151us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.666380:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12417 00000100:00100000:2.0:1746155572.666453:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123896832 00000100:00100000:2.0:1746155572.666457:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123896832 00010000:00010000:2.0:1746155572.666474:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 20 pid: 18270 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746155572.667541:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123896704 00000100:00100000:2.0:1746155572.667545:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123896704 00010000:00010000:2.0:1746155572.667558:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ac00/0x844e5faceb5ec6a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116ee expref: 33 pid: 20200 timeout: 801 lvb_type: 1 00000100:00100000:1.0:1746155572.667605:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6252 00000100:00100000:1.0:1746155572.667612:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123896832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.667622:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.667639:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 20 pid: 18270 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.667648:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 20 pid: 18270 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.667662:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b000/0x844e5faceb5ec6a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e7 expref: 20 pid: 18270 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.667688:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.667690:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.667695:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.667702:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.667722:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.667732:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124637056:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155572.667790:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155572.667806:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6253 00000100:00100000:1.0:1746155572.667812:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123896704:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.667818:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.667832:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ac00/0x844e5faceb5ec6a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116ee expref: 33 pid: 20200 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.667840:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ac00/0x844e5faceb5ec6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116ee expref: 33 pid: 20200 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.667851:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ac00/0x844e5faceb5ec6a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116ee expref: 33 pid: 20200 timeout: 801 lvb_type: 1 00010000:00010000:1.0:1746155572.667858:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.667859:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.667863:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.667868:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.667883:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.667892:0:7064:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 15 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.667900:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124637184:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155572.667917:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155572.670804:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.670919:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123897216 00000100:00100000:2.0:1746155572.670925:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123897216 00002000:00100000:2.0:1746155572.670953:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a5ae2680 x1830976123897216/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.670962:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae2680 with x1830976123897216 ext(2097152->3145727) 00002000:00010000:2.0:1746155572.670966:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae2680 00000100:00100000:2.0:1746155572.670991:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4796 00000100:00100000:2.0:1746155572.670996:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123897216:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.679579:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124637056:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155572.679600:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.679656:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123896832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 12043us (16333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.679667:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6252 00000100:00100000:1.0:1746155572.679924:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124637184:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155572.679934:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.679950:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123896704:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 12138us (13880us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.679956:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6253 00000100:00100000:0.0:1746155572.680460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.680485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.680520:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123897600 00000100:00100000:0.0:1746155572.680525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.680526:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123897600 00000100:00100000:0.0:1746155572.680555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:1.0:1746155572.680565:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800a5ae0000 x1830976123897600/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155572.680567:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:1.0:1746155572.680574:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0000 with x1830976123897600 ext(3145728->4194303) 00002000:00010000:1.0:1746155572.680579:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae0000 00000100:00100000:0.0:1746155572.680580:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123897856 00000100:00100000:0.0:1746155572.680583:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123897856 00000100:00100000:1.0:1746155572.680591:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123898112 00000100:00100000:1.0:1746155572.680593:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123898112 00002000:00100000:0.0:1746155572.680598:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a5ae3480 x1830976123897856/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155572.680605:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae3480 with x1830976123897856 ext(2097152->3145727) 00002000:00100000:1.0:1746155572.680607:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3da:0x0] (1294336->1298431) req@ffff8800a5ae1c00 x1830976123898112/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746155572.680608:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ae3480 00002000:00100000:1.0:1746155572.680613:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1c00 with x1830976123898112 ext(1294336->1298431) 00000100:00100000:0.0:1746155572.680617:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123898240 00010000:00010000:1.0:1746155572.680619:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 17 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746155572.680619:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123898240 00002000:00100000:0.0:1746155572.680629:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880093a46300 x1830976123898240/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746155572.680634:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00002000:00100000:0.0:1746155572.680636:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a46300 with x1830976123898240 ext(3145728->4194303) 00002000:00010000:0.0:1746155572.680638:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093a46300 00002000:00010000:1.0:1746155572.680640:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ae1c00 00000100:00100000:0.0:1746155572.680646:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123898496 00000100:00100000:0.0:1746155572.680648:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123898496 00000100:00100000:1.0:1746155572.680657:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 764 00002000:00100000:0.0:1746155572.680657:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d6:0x0] (544768->548863) req@ffff880094868e00 x1830976123898496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155572.680663:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123898112:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:0.0:1746155572.680663:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094868e00 with x1830976123898496 ext(544768->548863) 00002000:00010000:0.0:1746155572.680665:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094868e00 00000100:00100000:0.0:1746155572.680675:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4797 00000100:00100000:0.0:1746155572.680680:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123897600:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.680724:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4798 00000100:00100000:1.0:1746155572.680729:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123897856:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.681837:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1963:x1830976123898112:12345-192.168.202.51@tcp:3:cat.0 Request processed in 1172us (1309us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155572.681844:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 764 00002000:00100000:1.0:1746155572.681849:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1294336->1298431) req@ffff8800a5ae1c00 x1830976123898112/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.681856:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1c00 with x1830976123898112 ext(1294336->1298431) 00010000:00010000:1.0:1746155572.681862:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 19 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.681872:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 19 pid: 1625 timeout: 801 lvb_type: 0 00002000:00010000:1.0:1746155572.681878:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5ae1c00 00000100:00100000:1.0:1746155572.681890:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4799 00000100:00100000:1.0:1746155572.681895:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123898240:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.682979:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4800 00000100:00100000:1.0:1746155572.682986:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123898496:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.683060:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123898496:12345-192.168.202.51@tcp:3:cat.0 Request processed in 74us (2491us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155572.683069:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4800 00002000:00100000:1.0:1746155572.683074:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3d6:0x0] (544768->548863) req@ffff880094868e00 x1830976123898496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.683081:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094868e00 with x1830976123898496 ext(544768->548863) 00002000:00010000:1.0:1746155572.683084:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094868e00 00000100:00100000:3.0:1746155572.683524:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976123897216:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12526us (12723us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155572.683543:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4796 00002000:00100000:3.0:1746155572.683548:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a5ae2680 x1830976123897216/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.683555:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae2680 with x1830976123897216 ext(2097152->3145727) 00002000:00010000:3.0:1746155572.683558:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae2680 00000100:00100000:1.0:1746155572.700561:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123897856:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19822us (20065us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155572.700571:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4798 00002000:00100000:1.0:1746155572.700581:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a5ae3480 x1830976123897856/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.700589:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae3480 with x1830976123897856 ext(2097152->3145727) 00002000:00010000:1.0:1746155572.700594:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ae3480 00000100:00100000:0.0:1746155572.701280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.701329:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123898752 00000100:00100000:1.0:1746155572.701334:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123898752 00002000:00100000:1.0:1746155572.702222:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3da:0x0] (1945600->1949695) req@ffff88009486b100 x1830976123898752/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.702230:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b100 with x1830976123898752 ext(1945600->1949695) 00010000:00010000:1.0:1746155572.702237:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.702250:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00002000:00010000:1.0:1746155572.702255:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009486b100 00000100:00100000:1.0:1746155572.702287:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 765 00000100:00100000:1.0:1746155572.702294:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123898752:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.702415:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123898752:12345-192.168.202.51@tcp:3:cat.0 Request processed in 121us (1135us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155572.702421:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 765 00002000:00100000:1.0:1746155572.702426:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3da:0x0] (1945600->1949695) req@ffff88009486b100 x1830976123898752/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.702432:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b100 with x1830976123898752 ext(1945600->1949695) 00010000:00010000:1.0:1746155572.702437:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.702446:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00002000:00010000:1.0:1746155572.702451:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009486b100 00000100:00100000:1.0:1746155572.705246:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123897600:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24559us (24780us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155572.705255:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4797 00002000:00100000:1.0:1746155572.705263:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800a5ae0000 x1830976123897600/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.705271:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0000 with x1830976123897600 ext(3145728->4194303) 00002000:00010000:1.0:1746155572.705275:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae0000 00000100:00100000:1.0:1746155572.707565:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976123898240:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25662us (27002us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155572.707577:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4799 00002000:00100000:1.0:1746155572.707585:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880093a46300 x1830976123898240/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.707593:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093a46300 with x1830976123898240 ext(3145728->4194303) 00002000:00010000:1.0:1746155572.707598:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093a46300 00000100:00100000:0.0:1746155572.708153:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.708193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.708196:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123899008 00000100:00100000:3.0:1746155572.708228:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123899264 00000100:00100000:3.0:1746155572.708234:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123899264 00000100:00100000:3.0:1746155572.708265:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4089 00000100:00100000:3.0:1746155572.708271:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+7:29321:x1830976123899264:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155572.708498:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29321:x1830976123899264:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 226us (304us total) trans 8589944048 rc 0/0 00000100:00100000:3.0:1746155572.708519:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4089 00000100:00100000:1.0:1746155572.708600:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123899008 00002000:00100000:1.0:1746155572.708621:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1294336->1949695) req@ffff880094869500 x1830976123899008/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.708628:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094869500 with x1830976123899008 ext(1294336->1949695) 00010000:00010000:1.0:1746155572.708635:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 16 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.708646:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 16 pid: 1625 timeout: 801 lvb_type: 0 00002000:00010000:1.0:1746155572.708652:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094869500 00000100:00100000:1.0:1746155572.708664:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 766 00000100:00100000:1.0:1746155572.708669:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123899008:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155572.710151:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.710298:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123899520 00000100:00100000:2.0:1746155572.710303:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123899520 00002000:00100000:2.0:1746155572.710325:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d6:0x0] (782336->786431) req@ffff88009486b800 x1830976123899520/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.710332:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b800 with x1830976123899520 ext(782336->786431) 00002000:00010000:2.0:1746155572.710335:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486b800 00000100:00100000:2.0:1746155572.710355:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4801 00000100:00100000:2.0:1746155572.710360:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123899520:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155572.710693:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123899520:12345-192.168.202.51@tcp:3:cat.0 Request processed in 331us (544us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155572.710706:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4801 00002000:00100000:2.0:1746155572.710711:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d6:0x0] (782336->786431) req@ffff88009486b800 x1830976123899520/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.710717:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b800 with x1830976123899520 ext(782336->786431) 00002000:00010000:2.0:1746155572.710720:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486b800 00000100:00100000:0.0:1746155572.715676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.715698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.716450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.716469:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123900032 00000100:00100000:0.0:1746155572.716474:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123900032 00000100:00100000:0.0:1746155572.716555:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4090 00000100:00100000:0.0:1746155572.716565:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29320:x1830976123900032:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155572.716732:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29320:x1830976123900032:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 168us (280us total) trans 8589944049 rc 0/0 00000100:00100000:0.0:1746155572.716737:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4090 00000100:00100000:1.0:1746155572.717393:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123899648 00000100:00100000:1.0:1746155572.717398:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123899648 00000100:00100000:1.0:1746155572.717428:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123899776 00000100:00100000:1.0:1746155572.717431:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123899776 00000100:00100000:1.0:1746155572.717445:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12418 00000100:00100000:1.0:1746155572.717450:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123899648:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155572.717460:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155572.717473:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a13c600/0x844e5faceb5ec6fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1173b expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.717528:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124637312:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155572.717592:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337300 going to sleep for 11 seconds 00000100:00100000:2.0:1746155572.717642:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12419 00000100:00100000:2.0:1746155572.717649:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123899776:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155572.717656:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.717665:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012de0ba00/0x844e5faceb5ec702 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11742 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.717687:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124637440:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155572.717707:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155572.720976:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976123899008:12345-192.168.202.51@tcp:4:cat.0 Request processed in 12300us (12817us total) trans 17179873259 rc 0/0 00000100:00100000:1.0:1746155572.720986:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 766 00002000:00100000:1.0:1746155572.720995:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3da:0x0] (1294336->1949695) req@ffff880094869500 x1830976123899008/t17179873259(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/448 e 0 to 0 dl 1746155583 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.721003:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094869500 with x1830976123899008 ext(1294336->1949695) 00010000:00010000:1.0:1746155572.721011:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.721024:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 20 pid: 1625 timeout: 801 lvb_type: 0 00002000:00010000:1.0:1746155572.721031:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094869500 00002000:00010000:3.0:1746155572.722146:0:4461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155572 -> 1746155573 00002000:00010000:3.0:1746155572.722150:0:4461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155571 -> 1746155573 00002000:00010000:3.0:1746155572.722151:0:4461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155572 -> 1746155573 00000100:00100000:3.0:1746155572.722164:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124637440:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155572.722186:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012de0ba00/0x844e5faceb5ec702 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11742 expref: 19 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.722197:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012de0ba00/0x844e5faceb5ec702 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11742 expref: 19 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.722209:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012de0ba00, rc 0) 00000100:00100000:3.0:1746155572.722232:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123899776:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4584us (6532us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155572.722238:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12419 00002000:00010000:3.0:1746155572.722336:0:20796:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime: 1746155570 -> 1746155573 00002000:00010000:3.0:1746155572.722338:0:20796:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime: 1746155570 -> 1746155573 00002000:00010000:3.0:1746155572.722340:0:20796:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime: 1746155571 -> 1746155573 00000100:00100000:3.0:1746155572.722351:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124637312:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155572.722367:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a13c600/0x844e5faceb5ec6fb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1173b expref: 22 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.722375:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a13c600/0x844e5faceb5ec6fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1173b expref: 22 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155572.722382:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a13c600, rc 0) 00000100:00100000:3.0:1746155572.722401:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123899648:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4951us (6731us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155572.722407:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12418 00000100:00100000:0.0:1746155572.724272:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.725651:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123900160 00000100:00100000:1.0:1746155572.725660:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123900160 00010000:00010000:1.0:1746155572.725691:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00000100:00100000:1.0:1746155572.725715:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6254 00000100:00100000:1.0:1746155572.725722:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123900160:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.725734:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.725752:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.725761:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.725781:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5ec6ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1949695) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1172d expref: 18 pid: 1625 timeout: 801 lvb_type: 0 00010000:00010000:1.0:1746155572.725808:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.725811:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.725816:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11734 expref: 31 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.725823:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11734 expref: 31 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.725850:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11734 expref: 31 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.725860:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124637568:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155572.725922:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155572.728327:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155572.728409:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123900544 00000100:00100000:1.0:1746155572.728416:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123900544 00002000:00100000:1.0:1746155572.728452:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009451f100 x1830976123900544/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.728464:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451f100 with x1830976123900544 ext(4194304->4956159) 00002000:00010000:1.0:1746155572.728469:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451f100 00000100:00100000:1.0:1746155572.728497:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4802 00000100:00100000:1.0:1746155572.728544:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123900544:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155572.729944:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124637568:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155572.729962:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155572.730423:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1963:x1830976123900160:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4700us (6154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.730430:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6254 00000100:00100000:0.0:1746155572.735070:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.735595:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123900800 00000100:00100000:2.0:1746155572.735603:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123900800 00002000:00100000:2.0:1746155572.735637:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88012cdced80 x1830976123900800/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.735645:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdced80 with x1830976123900800 ext(1048576->2097151) 00002000:00010000:2.0:1746155572.735650:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdced80 00000100:00100000:2.0:1746155572.736543:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4803 00000100:00100000:2.0:1746155572.736551:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123900800:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.740680:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123900544:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12168us (12350us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155572.740690:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4802 00002000:00100000:1.0:1746155572.740701:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009451f100 x1830976123900544/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.740709:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451f100 with x1830976123900544 ext(4194304->4956159) 00002000:00010000:1.0:1746155572.740714:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451f100 00000100:00100000:0.0:1746155572.748892:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.748935:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.749110:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123901056 00000100:00100000:2.0:1746155572.749118:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123901056 00000100:00100000:2.0:1746155572.749157:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123900928 00000100:00100000:2.0:1746155572.749159:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123900928 00000100:00100000:2.0:1746155572.749174:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12420 00000100:00100000:2.0:1746155572.749181:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976123901056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155572.749200:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.749214:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b000/0x844e5faceb5ec709 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11750 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.749233:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.749235:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.749242:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b000/0x844e5faceb5ec709 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11750 expref: 18 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.749256:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b000/0x844e5faceb5ec709 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11750 expref: 18 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.749265:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b000, rc 0) 00000100:00100000:2.0:1746155572.749317:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123901056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 136us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.749323:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12420 00000100:00100000:2.0:1746155572.749337:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12421 00000100:00100000:2.0:1746155572.749343:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123900928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155572.749349:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.749359:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec710 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11749 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.749392:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124637696:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155572.749441:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155572.751573:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123900800:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15017us (16503us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155572.751582:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4803 00002000:00100000:3.0:1746155572.751591:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88012cdced80 x1830976123900800/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.751598:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdced80 with x1830976123900800 ext(1048576->2097151) 00002000:00010000:3.0:1746155572.751603:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdced80 00000100:00100000:2.0:1746155572.752772:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124637696:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155572.752799:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec710 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11749 expref: 22 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.752810:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3ac00/0x844e5faceb5ec710 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11749 expref: 22 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.752825:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3ac00, rc 0) 00000100:00100000:2.0:1746155572.752971:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1961:x1830976123900928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3626us (4033us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155572.752977:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12421 00000100:00100000:0.0:1746155572.756103:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.756260:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123901184 00000100:00100000:2.0:1746155572.756268:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123901184 00000100:00100000:2.0:1746155572.756358:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12422 00000100:00100000:2.0:1746155572.756366:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123901184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155572.756383:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.756398:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec717 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11757 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.756442:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124637824:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155572.757275:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155572.771241:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.771277:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.771301:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.771325:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.771407:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123901440 00000100:00100000:3.0:1746155572.771415:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123901440 00002000:00100000:3.0:1746155572.771454:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009b881c00 x1830976123901440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.771463:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881c00 with x1830976123901440 ext(2097152->3145727) 00002000:00010000:3.0:1746155572.771468:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b881c00 00000100:00100000:3.0:1746155572.771495:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123901952 00000100:00100000:3.0:1746155572.771497:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123901952 00000100:00100000:1.0:1746155572.771522:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123901824 00000100:00100000:1.0:1746155572.771525:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123901824 00002000:00100000:3.0:1746155572.771541:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009b880a80 x1830976123901952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.771548:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880a80 with x1830976123901952 ext(3145728->4194303) 00002000:00100000:1.0:1746155572.771550:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009b881500 x1830976123901824/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746155572.771552:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880a80 00002000:00100000:1.0:1746155572.771556:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881500 with x1830976123901824 ext(2097152->3145727) 00002000:00010000:1.0:1746155572.771558:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881500 00000100:00100000:3.0:1746155572.771561:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123902208 00000100:00100000:3.0:1746155572.771563:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123902208 00000100:00100000:1.0:1746155572.771570:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4804 00002000:00100000:3.0:1746155572.771571:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009b883800 x1830976123902208/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155572.771576:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976123901440:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:3.0:1746155572.771577:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883800 with x1830976123902208 ext(3145728->4194303) 00002000:00010000:3.0:1746155572.771579:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b883800 00000100:00100000:3.0:1746155572.771587:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4805 00000100:00100000:3.0:1746155572.771591:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123901952:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155572.771594:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4806 00000100:00100000:0.0:1746155572.771601:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123901824:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155572.771926:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124637824:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155572.771951:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec717 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11757 expref: 22 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.771961:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ec717 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11757 expref: 22 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.771972:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6400, rc 0) 00000100:00100000:2.0:1746155572.772005:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123901184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 15640us (15908us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155572.772010:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12422 00000100:00100000:3.0:1746155572.772517:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4807 00000100:00100000:3.0:1746155572.772527:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123902208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155572.781104:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123901440:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9520us (9863us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155572.781115:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4804 00002000:00100000:1.0:1746155572.781127:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009b881c00 x1830976123901440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155572.781136:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881c00 with x1830976123901440 ext(2097152->3145727) 00002000:00010000:1.0:1746155572.781141:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b881c00 00000100:00100000:0.0:1746155572.784493:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.785016:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123902464 00000100:00100000:3.0:1746155572.785024:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123902464 00000100:00100000:3.0:1746155572.785064:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4091 00000100:00100000:3.0:1746155572.785072:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29324:x1830976123902464:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155572.785252:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29324:x1830976123902464:12345-192.168.202.51@tcp:35:cat.0 Request processed in 180us (765us total) trans 8589944050 rc 0/0 00000100:00100000:3.0:1746155572.785258:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4091 00000100:00100000:2.0:1746155572.785821:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123901824:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14220us (14518us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155572.785829:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4806 00002000:00100000:2.0:1746155572.785836:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009b881500 x1830976123901824/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.785844:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881500 with x1830976123901824 ext(2097152->3145727) 00002000:00010000:2.0:1746155572.785849:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881500 00000100:00100000:3.0:1746155572.788712:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123902208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16180us (17379us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155572.788721:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4807 00002000:00100000:3.0:1746155572.788728:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009b883800 x1830976123902208/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.788736:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883800 with x1830976123902208 ext(3145728->4194303) 00002000:00010000:3.0:1746155572.788741:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b883800 00000100:00100000:2.0:1746155572.789810:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123901952:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18215us (18529us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155572.789817:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4805 00002000:00100000:2.0:1746155572.789823:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009b880a80 x1830976123901952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.789829:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880a80 with x1830976123901952 ext(3145728->4194303) 00002000:00010000:2.0:1746155572.789832:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880a80 00000100:00100000:0.0:1746155572.801439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.801525:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123902720 00000100:00100000:2.0:1746155572.801540:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123902720 00002000:00100000:2.0:1746155572.801573:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800935bc000 x1830976123902720/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.801583:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bc000 with x1830976123902720 ext(4194304->4956159) 00002000:00010000:2.0:1746155572.801588:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bc000 00000100:00100000:2.0:1746155572.801614:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4808 00000100:00100000:2.0:1746155572.801620:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123902720:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155572.807604:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123902720:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5975us (6163us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155572.807615:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4808 00002000:00100000:2.0:1746155572.807624:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800935bc000 x1830976123902720/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/440 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.807633:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bc000 with x1830976123902720 ext(4194304->4956159) 00002000:00010000:2.0:1746155572.807637:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bc000 00000100:00100000:0.0:1746155572.813865:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.813943:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123902976 00000100:00100000:2.0:1746155572.813952:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123902976 00000100:00100000:2.0:1746155572.813996:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4092 00000100:00100000:2.0:1746155572.814003:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29322:x1830976123902976:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155572.814836:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29322:x1830976123902976:12345-192.168.202.51@tcp:35:cat.0 Request processed in 832us (977us total) trans 8589944051 rc 0/0 00000100:00100000:2.0:1746155572.814843:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4092 00000100:00100000:0.0:1746155572.835392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.835702:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123903232 00000100:00100000:2.0:1746155572.835710:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123903232 00000100:00100000:2.0:1746155572.835763:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10086 00000100:00100000:2.0:1746155572.835772:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29330:x1830976123903232:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155572.835792:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.835806:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec71e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1175e expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155572.835859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155572.835892:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5ec725 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.835902:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5ec725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.835911:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5ec725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155572.835920:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123903488 00010000:00010000:2.0:1746155572.835922:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ec72c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155572.835924:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123903488 00010000:00010000:2.0:1746155572.835927:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ec72c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.835932:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ec72c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155572.835955:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10087 00000100:00100000:3.0:1746155572.835960:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29332:x1830976123903488:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155572.835969:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155572.835976:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272200/0x844e5faceb5ec733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11765 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.836008:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec73a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.836014:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec73a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155572.836019:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5ec741 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155572.836020:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec73a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155572.836025:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5ec741 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155572.836026:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec748 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155572.836030:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5ec741 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155572.836031:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec748 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.836035:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec748 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155572.836037:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155572.836101:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5ec725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836107:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5ec725 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836112:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5ec725 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836117:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca18e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155572.836120:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5ec725 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836126:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5ec725 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836135:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155572.836137:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155572.836140:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5ec725 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836144:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5ec725 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836215:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ec72c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836220:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ec72c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836224:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ec72c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836228:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca18800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155572.836230:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ec72c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836237:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ec72c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836243:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9a00) 00010000:00010000:2.0:1746155572.836244:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155572.836246:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ec72c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836251:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18800/0x844e5faceb5ec72c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155572.836277:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec71e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1175e expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.836286:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5ec741 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1175e expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.836291:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155572.836293:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155572.836294:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19e00, rc 0) 00000100:00100000:2.0:1746155572.836341:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29330:x1830976123903232:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 571us (957us total) trans 8589944052 rc 0/0 00000100:00100000:2.0:1746155572.836350:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10086 00010000:00010000:3.0:1746155572.837100:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480600/0x844e5faceb5ec756 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837108:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093480600/0x844e5faceb5ec756 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837115:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093480600/0x844e5faceb5ec756 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155572.837121:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155572.837158:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec73a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837163:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec73a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837167:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec73a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837171:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a273000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155572.837173:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec73a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837177:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec73a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837184:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155572.837187:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155572.837189:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec73a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837193:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec73a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837219:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec748 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837223:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec748 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837228:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec748 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837232:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a273800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155572.837234:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec748 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837238:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec748 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837243:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9a00) 00010000:00010000:3.0:1746155572.837245:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155572.837247:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec748 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837250:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273800/0x844e5faceb5ec748 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155572.837275:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272200/0x844e5faceb5ec733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11765 expref: 292 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.837288:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480600/0x844e5faceb5ec756 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11765 expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155572.837294:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155572.837295:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155572.837297:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093480600, rc 0) 00000100:00100000:3.0:1746155572.837332:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29332:x1830976123903488:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1372us (1472us total) trans 8589944053 rc 0/0 00000100:00100000:3.0:1746155572.837338:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10087 00000100:00100000:2.0:1746155572.838735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155572.838800:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123903616 00000100:00100000:0.0:1746155572.838807:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123903616 00000100:00100000:0.0:1746155572.838845:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12423 00000100:00100000:0.0:1746155572.838852:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29330:x1830976123903616:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155572.838864:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155572.838877:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1176c expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.838897:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5ec699 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e0 expref: 19 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155572.838908:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5ec6c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1170a expref: 31 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155572.838914:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155572.838915:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155572.838918:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2363392->2453503] (req 2363392->2453503) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155572.838940:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5ec6c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1170a expref: 31 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155572.838950:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5ec6c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1170a expref: 31 pid: 20200 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746155572.838959:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124637952:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155572.839077:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5ec699 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e0 expref: 19 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155572.839085:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5ec699 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e0 expref: 19 pid: 10591 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746155572.839093:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124638080:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155572.839112:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155572.842454:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124637952:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.842462:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124638080:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.842486:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2363392->2453503] (req 2363392->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.842520:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b038e00, rc 0) 00000100:00100000:2.0:1746155572.842562:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29330:x1830976123903616:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3710us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.842569:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12423 00000100:00100000:0.0:1746155572.843152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.843216:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123903744 00000100:00100000:2.0:1746155572.843221:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123903744 00010000:00010000:2.0:1746155572.843242:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5ec699 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e0 expref: 19 pid: 10591 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746155572.843862:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6255 00000100:00100000:2.0:1746155572.843870:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976123903744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.843881:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155572.843898:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5ec699 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e0 expref: 19 pid: 10591 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.843907:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5ec699 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e0 expref: 19 pid: 10591 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.843926:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5ec699 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116e0 expref: 19 pid: 10591 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.843952:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155572.843973:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123903744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 104us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.843979:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6255 00000100:00100000:0.0:1746155572.846419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.846599:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123903872 00000100:00100000:2.0:1746155572.846606:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123903872 00010000:00010000:2.0:1746155572.846626:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5ec6c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1170a expref: 32 pid: 20200 timeout: 801 lvb_type: 1 00000100:00100000:2.0:1746155572.846658:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6256 00000100:00100000:2.0:1746155572.846664:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976123903872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155572.846673:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155572.848182:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5ec6c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1170a expref: 32 pid: 20200 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.848196:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5ec6c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1170a expref: 32 pid: 20200 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.848214:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913f0c00/0x844e5faceb5ec6c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1170a expref: 32 pid: 20200 timeout: 801 lvb_type: 1 00010000:00010000:2.0:1746155572.848226:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.848228:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.848233:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.848241:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.848268:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155572.848284:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124638208:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155572.848369:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155572.849419:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124638208:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155572.849431:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155572.849455:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976123903872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2791us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.849463:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6256 00000100:00100000:0.0:1746155572.850013:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.851180:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123904128 00000100:00100000:2.0:1746155572.851187:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123904128 00002000:00100000:2.0:1746155572.851220:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (2363392->2367487) req@ffff8800935bdc00 x1830976123904128/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.851229:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bdc00 with x1830976123904128 ext(2363392->2367487) 00002000:00010000:2.0:1746155572.851233:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935bdc00 00000100:00100000:2.0:1746155572.851313:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4809 00000100:00100000:2.0:1746155572.851320:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123904128:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155572.851464:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976123904128:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 143us (1451us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155572.851470:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4809 00002000:00100000:2.0:1746155572.851475:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (2363392->2367487) req@ffff8800935bdc00 x1830976123904128/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.851481:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bdc00 with x1830976123904128 ext(2363392->2367487) 00002000:00010000:2.0:1746155572.851484:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935bdc00 00000100:00100000:0.0:1746155572.853455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.853526:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123904384 00000100:00100000:3.0:1746155572.853540:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123904384 00002000:00100000:3.0:1746155572.853564:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2449408->2453503) req@ffff8800935bdf80 x1830976123904384/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.853571:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bdf80 with x1830976123904384 ext(2449408->2453503) 00002000:00010000:3.0:1746155572.853575:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935bdf80 00000100:00100000:3.0:1746155572.853598:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4810 00000100:00100000:3.0:1746155572.853604:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123904384:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155572.853724:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976123904384:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 119us (273us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155572.853730:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4810 00002000:00100000:3.0:1746155572.853735:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2449408->2453503) req@ffff8800935bdf80 x1830976123904384/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155572.853741:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bdf80 with x1830976123904384 ext(2449408->2453503) 00002000:00010000:3.0:1746155572.853744:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935bdf80 00000100:00100000:0.0:1746155572.866247:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.866551:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123904640 00000100:00100000:2.0:1746155572.866558:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123904640 00000100:00100000:2.0:1746155572.866601:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4093 00000100:00100000:2.0:1746155572.866607:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29330:x1830976123904640:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155572.868525:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29330:x1830976123904640:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 1793us (2161us total) trans 8589944054 rc 0/0 00000100:00100000:2.0:1746155572.868554:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4093 00000100:00100000:0.0:1746155572.986086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.986562:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123904768 00000100:00100000:2.0:1746155572.986571:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123904768 00000100:00100000:2.0:1746155572.987061:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12424 00000100:00100000:2.0:1746155572.987069:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:29332:x1830976123904768:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155572.987084:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155572.987097:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11773 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.987123:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ec692 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d2 expref: 20 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.987131:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a200/0x844e5faceb5ec6b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116fc expref: 20 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.987136:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.987138:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155572.987141:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1134592->2031615] (req 1134592->2031615) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.987166:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a200/0x844e5faceb5ec6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116fc expref: 20 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.987176:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a200/0x844e5faceb5ec6b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116fc expref: 20 pid: 20200 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746155572.987187:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124638336:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.987276:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ec692 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d2 expref: 20 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155572.987284:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ec692 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d2 expref: 20 pid: 19959 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746155572.987291:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124638464:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.987308:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155572.990614:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155572.990687:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123904896 00000100:00100000:3.0:1746155572.990695:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123904896 00010000:00010000:3.0:1746155572.990723:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a200/0x844e5faceb5ec6b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116fc expref: 21 pid: 20200 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746155572.990746:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6257 00000100:00100000:3.0:1746155572.990752:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123904896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155572.990762:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155572.990780:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a200/0x844e5faceb5ec6b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116fc expref: 21 pid: 20200 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746155572.990790:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a200/0x844e5faceb5ec6b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116fc expref: 21 pid: 20200 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746155572.990810:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155572.990849:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123904896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155572.990854:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6257 00010000:00010000:2.0:1746155572.990985:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a200/0x844e5faceb5ec6b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116fc expref: 20 pid: 20200 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746155572.991206:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124638336:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155572.991219:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124638464:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155572.991240:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1134592->2031615] (req 1134592->2031615) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155572.991250:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19a00, rc 0) 00000100:00100000:0.0:1746155572.991259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.991269:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:29332:x1830976123904768:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4201us (5189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155572.991283:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12424 00000100:00100000:1.0:1746155572.991412:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123905024 00000100:00100000:1.0:1746155572.991415:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123905024 00010000:00010000:1.0:1746155572.991435:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ec692 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d2 expref: 21 pid: 19959 timeout: 802 lvb_type: 1 00000100:00100000:1.0:1746155572.991457:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6258 00000100:00100000:1.0:1746155572.991463:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1960:x1830976123905024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155572.991469:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155572.991476:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ec692 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d2 expref: 21 pid: 19959 timeout: 802 lvb_type: 1 00010000:00010000:1.0:1746155572.991483:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ec692 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d2 expref: 21 pid: 19959 timeout: 802 lvb_type: 1 00010000:00010000:1.0:1746155572.991495:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a600/0x844e5faceb5ec692 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d2 expref: 21 pid: 19959 timeout: 802 lvb_type: 1 00010000:00010000:1.0:1746155572.991523:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.991525:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155572.991537:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.991549:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155572.991574:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155572.991583:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124638592:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155572.991625:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155572.996196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155572.997086:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123905280 00000100:00100000:2.0:1746155572.997096:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123905280 00002000:00100000:2.0:1746155572.997135:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1134592->1138687) req@ffff8800935bed80 x1830976123905280/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/0 e 0 to 0 dl 1746155583 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.997144:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bed80 with x1830976123905280 ext(1134592->1138687) 00002000:00010000:2.0:1746155572.997148:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bed80 00000100:00100000:2.0:1746155572.997181:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4811 00000100:00100000:2.0:1746155572.997189:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123905280:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155572.997742:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123905280:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 552us (1553us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155572.997748:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4811 00002000:00100000:2.0:1746155572.997753:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1134592->1138687) req@ffff8800935bed80 x1830976123905280/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:643/0 lens 488/4536 e 0 to 0 dl 1746155583 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155572.997758:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bed80 with x1830976123905280 ext(1134592->1138687) 00002000:00010000:2.0:1746155572.997761:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bed80 00000100:00100000:1.0:1746155572.998234:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124638592:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155572.998253:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155572.998281:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976123905024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6818us (7023us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155572.998289:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6258 00000100:00100000:0.0:1746155573.005387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.006927:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123905536 00000100:00100000:2.0:1746155573.006936:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123905536 00002000:00100000:2.0:1746155573.006973:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (2027520->2031615) req@ffff8800935bf100 x1830976123905536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.006981:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bf100 with x1830976123905536 ext(2027520->2031615) 00002000:00010000:2.0:1746155573.006986:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bf100 00000100:00100000:2.0:1746155573.007017:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4812 00000100:00100000:2.0:1746155573.007024:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123905536:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155573.007174:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123905536:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 149us (1794us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155573.007180:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4812 00002000:00100000:2.0:1746155573.007185:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (2027520->2031615) req@ffff8800935bf100 x1830976123905536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.007192:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bf100 with x1830976123905536 ext(2027520->2031615) 00002000:00010000:2.0:1746155573.007195:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bf100 00000100:00100000:0.0:1746155573.022180:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.022541:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123905792 00000100:00100000:3.0:1746155573.022551:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123905792 00000100:00100000:3.0:1746155573.022619:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10088 00000100:00100000:3.0:1746155573.022627:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29336:x1830976123905792:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.022648:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.022664:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec772 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1177a expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.022743:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272e00/0x844e5faceb5ec779 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.022754:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272e00/0x844e5faceb5ec779 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.022764:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272e00/0x844e5faceb5ec779 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155573.022773:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155573.022862:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a273000/0x844e5faceb5ec772 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1177a expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.022880:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272e00/0x844e5faceb5ec779 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1177a expref: 14 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.022886:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155573.022889:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746155573.022891:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a272e00, rc 0) 00000100:00100000:3.0:1746155573.022933:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29336:x1830976123905792:12345-192.168.202.51@tcp:101:cat.0 Request processed in 307us (762us total) trans 8589944055 rc 0/0 00000100:00100000:3.0:1746155573.022940:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10088 00000100:00080000:1.0:1746155573.023027:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155573.029309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.029378:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123906048 00000100:00100000:2.0:1746155573.029386:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123906048 00000100:00100000:2.0:1746155573.029434:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4094 00000100:00100000:2.0:1746155573.029442:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a651850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29332:x1830976123906048:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155573.029642:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a651850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:29332:x1830976123906048:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 200us (339us total) trans 8589944056 rc 0/0 00000100:00100000:2.0:1746155573.029648:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4094 00000100:00100000:0.0:1746155573.031719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.031757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.031822:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123906176 00000100:00100000:2.0:1746155573.031828:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123906176 00000100:00080000:1.0:1746155573.031979:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155573.032024:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123906304 00000100:00100000:2.0:1746155573.032027:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123906304 00000100:00100000:2.0:1746155573.032052:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12425 00000100:00100000:2.0:1746155573.032059:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123906176:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155573.032072:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.032085:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5ec787 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11781 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155573.032125:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124638720:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155573.032263:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12426 00000100:00100000:0.0:1746155573.032269:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123906304:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155573.032275:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155573.032281:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b038600/0x844e5faceb5ec78e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11788 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155573.032300:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124638848:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155573.033653:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.033700:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77300 going to sleep for 11 seconds 00000100:00100000:3.0:1746155573.035107:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124638720:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155573.035131:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5ec787 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11781 expref: 23 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.035142:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5ec787 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11781 expref: 23 pid: 1625 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746155573.035216:0:29728:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155571 -> 1746155573 00002000:00010000:2.0:1746155573.035219:0:29728:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155571 -> 1746155573 00002000:00010000:2.0:1746155573.035220:0:29728:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155571 -> 1746155573 00000100:00100000:2.0:1746155573.035228:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124638848:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155573.035243:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b038600/0x844e5faceb5ec78e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11788 expref: 22 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.035251:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b038600/0x844e5faceb5ec78e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11788 expref: 22 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.035258:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b038600, rc 0) 00010000:00010000:3.0:1746155573.036285:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca18000, rc 0) 00000100:00100000:2.0:1746155573.036435:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1962:x1830976123906304:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4164us (4674us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155573.036443:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12426 00000100:00100000:3.0:1746155573.036793:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123906176:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4733us (5078us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155573.036799:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12425 00000100:00100000:0.0:1746155573.039100:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.039266:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123906560 00000100:00100000:2.0:1746155573.039273:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123906560 00000100:00100000:2.0:1746155573.039315:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10089 00000100:00100000:2.0:1746155573.039322:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:29340:x1830976123906560:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155573.039340:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.039354:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5ec795 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1178f expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.039425:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5ec79c lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155573.039437:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5ec79c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155573.039447:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5ec79c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155573.039455:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155573.039573:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca18e00/0x844e5faceb5ec795 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1178f expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.039586:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5ec79c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1178f expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.039593:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155573.039595:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746155573.039598:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19400, rc 0) 00000100:00100000:2.0:1746155573.039637:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29340:x1830976123906560:12345-192.168.202.51@tcp:101:cat.0 Request processed in 315us (542us total) trans 8589944057 rc 0/0 00000100:00100000:2.0:1746155573.039643:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10089 00000100:00100000:0.0:1746155573.039932:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.040363:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123906688 00000100:00100000:3.0:1746155573.040367:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123906688 00000100:00100000:3.0:1746155573.040475:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12427 00000100:00100000:3.0:1746155573.040481:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29336:x1830976123906688:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.040489:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.040499:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11796 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.040663:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.040669:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.040671:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.040674:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11796 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.040697:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.040707:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 18 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.040722:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124638976:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155573.040833:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.041898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.042001:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123906816 00000100:00100000:3.0:1746155573.042006:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123906816 00000100:00100000:3.0:1746155573.042028:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12428 00000100:00100000:3.0:1746155573.042034:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123906816:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.042042:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.042052:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094faea00/0x844e5faceb5ec7b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1179d expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155573.042077:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124639104:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155573.042123:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.044066:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.044165:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124638976:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155573.044185:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11796 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.044197:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a273000, rc 0) 00000100:00100000:3.0:1746155573.044224:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29336:x1830976123906688:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3742us (4292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.044230:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12427 00002000:00010000:3.0:1746155573.044261:0:29728:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime: 1746155572 -> 1746155573 00002000:00010000:3.0:1746155573.044263:0:29728:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime: 1746155571 -> 1746155573 00002000:00010000:3.0:1746155573.044265:0:29728:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime: 1746155572 -> 1746155573 00000100:00100000:3.0:1746155573.044280:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124639104:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155573.044297:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094faea00/0x844e5faceb5ec7b1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1179d expref: 32 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.044307:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094faea00/0x844e5faceb5ec7b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1179d expref: 32 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.044318:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094faea00, rc 0) 00000100:00100000:3.0:1746155573.044332:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123906816:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2299us (2437us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155573.044338:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12428 00000100:00100000:2.0:1746155573.044379:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123906944 00000100:00100000:2.0:1746155573.044384:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123906944 00002000:00100000:2.0:1746155573.044409:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (544768->786431) req@ffff8800935be300 x1830976123906944/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.044417:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935be300 with x1830976123906944 ext(544768->786431) 00010000:00010000:2.0:1746155573.044423:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 19 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.044433:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 19 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.044443:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935be300 00000100:00100000:2.0:1746155573.044455:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 767 00000100:00100000:2.0:1746155573.044461:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123906944:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155573.048733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.048800:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123907072 00000100:00100000:3.0:1746155573.048806:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123907072 00000100:00100000:3.0:1746155573.048839:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12429 00000100:00100000:3.0:1746155573.048845:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29340:x1830976123907072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.048859:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.048872:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117a4 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.048892:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.048896:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117a4 expref: 22 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.048906:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117a4 expref: 22 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.048914:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fafc00, rc 0) 00000100:00100000:3.0:1746155573.049437:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29340:x1830976123907072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 590us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.049443:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12429 00000100:00100000:2.0:1746155573.049547:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123906944:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 5083us (5482us total) trans 21474840646 rc 0/0 00000100:00100000:2.0:1746155573.049555:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 767 00002000:00100000:2.0:1746155573.049561:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (544768->786431) req@ffff8800935be300 x1830976123906944/t21474840646(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/448 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.049570:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935be300 with x1830976123906944 ext(544768->786431) 00010000:00010000:2.0:1746155573.049575:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.049585:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.049590:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935be300 00000100:00100000:0.0:1746155573.051250:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.051314:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123907200 00000100:00100000:1.0:1746155573.051319:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123907200 00010000:00010000:1.0:1746155573.051340:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.051369:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6259 00000100:00100000:1.0:1746155573.051374:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123907200:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155573.051384:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155573.051398:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.051408:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.051424:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0400/0x844e5faceb5ec6e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 544768->786431) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11726 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.051447:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.051449:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.051454:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11796 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.051461:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11796 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.051468:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.051469:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.051473:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117a4 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.051479:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117a4 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.051579:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117a4 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155573.051589:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124639232:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155573.051854:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11796 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155573.051863:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124639360:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155573.051882:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155573.057173:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124639232:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155573.057185:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124639360:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155573.057205:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155573.057241:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976123907200:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5865us (5992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.057251:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6259 00000100:00100000:0.0:1746155573.058173:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.058203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.058224:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.058246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.058316:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123907456 00000100:00100000:2.0:1746155573.058323:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123907456 00002000:00100000:2.0:1746155573.058357:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009f3ef800 x1830976123907456/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.058365:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ef800 with x1830976123907456 ext(0->1048575) 00002000:00010000:2.0:1746155573.058369:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ef800 00000100:00100000:2.0:1746155573.058382:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123907712 00000100:00100000:2.0:1746155573.058385:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123907712 00002000:00100000:2.0:1746155573.058395:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009f3ed880 x1830976123907712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 504/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.058402:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ed880 with x1830976123907712 ext(1048576->2097151) 00002000:00010000:2.0:1746155573.058404:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ed880 00000100:00100000:2.0:1746155573.058413:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123908096 00000100:00100000:2.0:1746155573.058414:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123908096 00002000:00100000:2.0:1746155573.058431:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009f3ece00 x1830976123908096/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.058437:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ece00 with x1830976123908096 ext(1048576->2097151) 00002000:00010000:2.0:1746155573.058440:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3ece00 00000100:00100000:2.0:1746155573.058447:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123908224 00000100:00100000:2.0:1746155573.058449:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123908224 00002000:00100000:2.0:1746155573.058459:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009c213800 x1830976123908224/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.058465:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213800 with x1830976123908224 ext(0->1048575) 00002000:00010000:2.0:1746155573.058467:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c213800 00000100:00100000:2.0:1746155573.058476:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4813 00000100:00100000:2.0:1746155573.058482:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123907456:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155573.059952:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4814 00000100:00100000:3.0:1746155573.059961:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123907712:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155573.060211:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4815 00000100:00100000:3.0:1746155573.060217:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123908096:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155573.061279:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4816 00000100:00100000:0.0:1746155573.061288:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123908224:12345-192.168.202.51@tcp:3:cat.0 00000100:00080000:1.0:1746155573.062189:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746155573.072702:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123907712:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12734us (14489us total) trans 0 rc 151552/151552 00000100:00100000:3.0:1746155573.072713:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4814 00002000:00100000:3.0:1746155573.072722:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009f3ed880 x1830976123907712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 504/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 151552/151552 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.072732:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ed880 with x1830976123907712 ext(1048576->2097151) 00002000:00010000:3.0:1746155573.072737:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ed880 00000100:00100000:3.0:1746155573.078615:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976123908096:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18391us (20382us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155573.078626:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4815 00002000:00100000:3.0:1746155573.078635:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009f3ece00 x1830976123908096/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.078643:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ece00 with x1830976123908096 ext(1048576->2097151) 00002000:00010000:3.0:1746155573.078648:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3ece00 00000100:00100000:2.0:1746155573.081166:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123907456:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22675us (22987us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155573.081176:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4813 00002000:00100000:2.0:1746155573.081186:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009f3ef800 x1830976123907456/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.081194:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ef800 with x1830976123907456 ext(0->1048575) 00002000:00010000:2.0:1746155573.081199:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ef800 00000100:00100000:1.0:1746155573.084112:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:1963:x1830976123908224:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22819us (25858us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155573.084123:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4816 00002000:00100000:1.0:1746155573.084131:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009c213800 x1830976123908224/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.084139:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213800 with x1830976123908224 ext(0->1048575) 00002000:00010000:1.0:1746155573.084144:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c213800 00000100:00100000:0.0:1746155573.102763:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.102853:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123908352 00000100:00100000:3.0:1746155573.102861:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123908352 00000100:00100000:3.0:1746155573.102896:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12430 00000100:00100000:3.0:1746155573.102903:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29336:x1830976123908352:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.102919:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.102934:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117ab expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.102958:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.102965:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.102966:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.102969:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ab expref: 22 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.102992:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.103003:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 20 pid: 4461 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.103013:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124639488:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155573.103096:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.106585:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.106732:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123908480 00000100:00100000:2.0:1746155573.106739:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123908480 00000100:00100000:2.0:1746155573.106768:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12431 00000100:00100000:2.0:1746155573.106774:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29340:x1830976123908480:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155573.106790:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.106806:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117b2 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.106829:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.106837:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155573.106838:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155573.106841:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 32 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.106865:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.106874:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 17 pid: 4461 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.106885:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124639616:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.106956:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155573.107028:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124639488:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155573.107047:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ab expref: 22 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.107057:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094faea00, rc 0) 00000100:00100000:3.0:1746155573.107094:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29336:x1830976123908352:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4191us (4338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.107100:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12430 00000100:00100000:2.0:1746155573.108836:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124639616:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.108857:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 32 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.108869:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b9dc00, rc 0) 00000100:00100000:2.0:1746155573.108910:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29340:x1830976123908480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2135us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.108917:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12431 00000100:00100000:0.0:1746155573.112856:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.113261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.113797:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123908608 00000100:00100000:1.0:1746155573.113804:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123908608 00002000:00100000:1.0:1746155573.113839:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d8:0x0] (1134592->2031615) req@ffff8800910d8380 x1830976123908608/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.113847:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8380 with x1830976123908608 ext(1134592->2031615) 00010000:00010000:1.0:1746155573.113856:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 21 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.113866:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 21 pid: 4461 timeout: 802 lvb_type: 0 00002000:00010000:1.0:1746155573.113872:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800910d8380 00000100:00100000:2.0:1746155573.118176:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123908736 00000100:00100000:2.0:1746155573.118187:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123908736 00002000:00100000:2.0:1746155573.118228:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (2363392->2453503) req@ffff88008ff19f80 x1830976123908736/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.118237:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff19f80 with x1830976123908736 ext(2363392->2453503) 00010000:00010000:2.0:1746155573.118245:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 18 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.118256:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 18 pid: 4461 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.118263:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ff19f80 00000100:00100000:2.0:1746155573.118284:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 768 00000100:00100000:2.0:1746155573.118292:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123908608:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155573.118999:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 769 00000100:00100000:2.0:1746155573.119005:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976123908736:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155573.121347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.121417:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123908992 00000100:00100000:3.0:1746155573.121423:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123908992 00000100:00100000:3.0:1746155573.121464:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10090 00000100:00100000:3.0:1746155573.121470:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29342:x1830976123908992:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155573.121486:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.121514:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fae200/0x844e5faceb5ec7cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117b9 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.121596:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.121606:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5ec741 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1175e expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.121612:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093480600/0x844e5faceb5ec756 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11765 expref: 293 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.121618:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.121641:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093480600/0x844e5faceb5ec756 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11765 expref: 293 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.121649:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480600/0x844e5faceb5ec756 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11765 expref: 293 pid: 15474 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.121658:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124639744:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155573.121732:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5ec741 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1175e expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.121740:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5ec741 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1175e expref: 15 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.121747:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124639872:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155573.121764:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effc00 going to sleep for 11 seconds 00010000:00010000:3.0:1746155573.122719:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746155573.125641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.125682:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.125692:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123909248 00000100:00100000:1.0:1746155573.125699:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123909248 00010000:00010000:1.0:1746155573.125726:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5ec741 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1175e expref: 16 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.125729:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123909120 00000100:00100000:3.0:1746155573.125733:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123909120 00010000:00010000:3.0:1746155573.125749:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093480600/0x844e5faceb5ec756 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11765 expref: 294 pid: 15474 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.126112:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124639744:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.126122:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124639872:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.126142:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155573.126222:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6260 00000100:00100000:1.0:1746155573.126230:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123909248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155573.126240:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155573.126246:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5ec741 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1175e expref: 16 pid: 27374 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.126255:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5ec741 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1175e expref: 16 pid: 27374 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.126271:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19e00/0x844e5faceb5ec741 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1175e expref: 16 pid: 27374 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.126298:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155573.126303:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.126308:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.126317:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.126323:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6261 00000100:00100000:3.0:1746155573.126330:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1963:x1830976123909120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155573.126337:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155573.126342:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093480600/0x844e5faceb5ec756 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11765 expref: 294 pid: 15474 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.126350:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093480600/0x844e5faceb5ec756 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11765 expref: 294 pid: 15474 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.126355:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976123909248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 121us (716us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155573.126362:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093480600/0x844e5faceb5ec756 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11765 expref: 294 pid: 15474 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.126362:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6260 00010000:00010000:3.0:1746155573.126374:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155573.126377:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.126384:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.126389:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.126402:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.126420:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1963:x1830976123909120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 90us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.126425:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6261 00010000:00010000:2.0:1746155573.126572:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155573.126578:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155573.126593:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155573.128807:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fae200/0x844e5faceb5ec7cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b9 expref: 16 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.128848:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b9 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.128856:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155573.128858:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155573.128864:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c046600, rc 0) 00000100:00100000:2.0:1746155573.128910:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29342:x1830976123908992:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7439us (7568us total) trans 8589944058 rc 0/0 00000100:00100000:2.0:1746155573.128918:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10090 00000100:00100000:2.0:1746155573.137969:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123908608:12345-192.168.202.51@tcp:4:cat.0 Request processed in 19669us (25110us total) trans 21474840647 rc 0/0 00000100:00100000:2.0:1746155573.137980:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 768 00002000:00100000:2.0:1746155573.137991:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1134592->2031615) req@ffff8800910d8380 x1830976123908608/t21474840647(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/448 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.138006:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8380 with x1830976123908608 ext(1134592->2031615) 00010000:00010000:2.0:1746155573.138015:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 23 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.138467:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 23 pid: 4461 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.138474:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800910d8380 00000100:00100000:3.0:1746155573.138545:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123908736:12345-192.168.202.51@tcp:4:cat.0 Request processed in 19538us (25283us total) trans 17179873260 rc 0/0 00000100:00100000:3.0:1746155573.138553:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 769 00002000:00100000:3.0:1746155573.138562:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2363392->2453503) req@ffff88008ff19f80 x1830976123908736/t17179873260(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/448 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.138569:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ff19f80 with x1830976123908736 ext(2363392->2453503) 00010000:00010000:3.0:1746155573.138575:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 20 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.138584:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 20 pid: 4461 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746155573.138589:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ff19f80 00000100:00100000:0.0:1746155573.144376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.144450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.144524:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123909504 00000100:00100000:2.0:1746155573.144526:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123909376 00000100:00100000:2.0:1746155573.144540:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123909376 00000100:00100000:1.0:1746155573.144540:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123909504 00010000:00010000:1.0:1746155573.144569:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 23 pid: 4461 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.144572:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12432 00000100:00100000:2.0:1746155573.144578:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29342:x1830976123909376:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:1.0:1746155573.144589:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6262 00010000:00010000:2.0:1746155573.144591:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155573.144594:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976123909504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155573.144602:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117c0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.144604:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155573.144621:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 23 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.144622:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ec684 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d9 expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.144630:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5ec6bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11703 expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155573.144631:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 23 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.144635:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.144637:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.144640:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4014080->4194303] (req 4014080->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.144646:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec76b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->2031615) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11773 expref: 23 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.144660:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.144661:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.144666:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5ec6bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11703 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155573.144666:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ab expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.144675:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5ec6bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11703 expref: 22 pid: 18270 timeout: 802 lvb_type: 1 00010000:00010000:1.0:1746155573.144678:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ab expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155573.144686:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124640000:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155573.144697:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ab expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155573.144705:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124640128:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155573.144968:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ec684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d9 expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.144976:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ec684 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d9 expref: 23 pid: 19959 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746155573.144984:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124640256:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155573.145260:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:2.0:1746155573.148418:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155573.151821:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124640000:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155573.152231:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124640128:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155573.152249:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155573.152295:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123909504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7698us (7842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.152305:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6262 00000100:00100000:2.0:1746155573.154054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.155894:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123909888 00000100:00100000:1.0:1746155573.155903:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123909888 00010000:00010000:1.0:1746155573.155934:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5ec6bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11703 expref: 22 pid: 18270 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746155573.157066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.157077:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123909632 00000100:00100000:1.0:1746155573.157082:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123909632 00000100:00100000:3.0:1746155573.157089:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124640256:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155573.157096:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 20 pid: 4461 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.157106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.157113:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6263 00010000:00010000:3.0:1746155573.157114:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4014080->4194303] (req 4014080->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155573.157119:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123909888:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155573.157129:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155573.157132:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5424800, rc 0) 00010000:00010000:1.0:1746155573.157145:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5ec6bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11703 expref: 22 pid: 18270 timeout: 802 lvb_type: 1 00010000:00010000:1.0:1746155573.157153:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5ec6bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11703 expref: 22 pid: 18270 timeout: 802 lvb_type: 1 00010000:00010000:1.0:1746155573.157169:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0db3400/0x844e5faceb5ec6bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11703 expref: 22 pid: 18270 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746155573.157302:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6264 00000100:00100000:0.0:1746155573.157309:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123909632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155573.157323:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155573.157337:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 20 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.157347:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 20 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.157359:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ec764 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2363392->2453503) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1176c expref: 20 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.157370:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155573.157372:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155573.157380:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 31 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.157391:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 31 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.157414:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 31 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155573.157422:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124640384:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155573.157466:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.157468:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29342:x1830976123909376:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 12889us (13096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.157474:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12432 00000100:00100000:3.0:1746155573.157495:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123910016 00000100:00100000:3.0:1746155573.157498:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123910016 00000100:00100000:1.0:1746155573.157591:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976123909888:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 472us (3543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.157597:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6263 00000100:00100000:0.0:1746155573.157608:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77000 going to sleep for 11 seconds 00002000:00100000:3.0:1746155573.158087:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880095269500 x1830976123910016/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.158096:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269500 with x1830976123910016 ext(1048576->2097151) 00002000:00010000:3.0:1746155573.158100:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095269500 00000100:00100000:3.0:1746155573.158121:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4817 00000100:00100000:3.0:1746155573.158126:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123910016:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155573.158574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.158842:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123910144 00000100:00100000:1.0:1746155573.158846:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123910144 00010000:00010000:1.0:1746155573.158860:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ec684 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d9 expref: 25 pid: 19959 timeout: 802 lvb_type: 1 00000100:00100000:1.0:1746155573.158888:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6265 00000100:00100000:1.0:1746155573.158893:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123910144:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155573.158901:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155573.158912:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ec684 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d9 expref: 25 pid: 19959 timeout: 802 lvb_type: 1 00010000:00010000:1.0:1746155573.158921:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ec684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d9 expref: 25 pid: 19959 timeout: 802 lvb_type: 1 00010000:00010000:1.0:1746155573.158935:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3a800/0x844e5faceb5ec684 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116d9 expref: 25 pid: 19959 timeout: 802 lvb_type: 1 00010000:00010000:1.0:1746155573.158943:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.158945:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.158948:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.158955:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.158974:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155573.158982:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124640512:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155573.159035:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:2.0:1746155573.160760:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124640384:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155573.160777:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155573.160802:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976123909632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3494us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.160813:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6264 00000100:00100000:0.0:1746155573.163899:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.163947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.163989:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123910400 00000100:00100000:2.0:1746155573.163995:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123910400 00000100:00100000:3.0:1746155573.164024:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123910016:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 5897us (6916us total) trans 0 rc 1048576/1048576 00002000:00100000:2.0:1746155573.164028:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012bdf5f80 x1830976123910400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155573.164032:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4817 00002000:00100000:2.0:1746155573.164036:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5f80 with x1830976123910400 ext(2097152->3145727) 00002000:00100000:3.0:1746155573.164037:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880095269500 x1830976123910016/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00010000:2.0:1746155573.164040:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf5f80 00002000:00100000:3.0:1746155573.164043:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269500 with x1830976123910016 ext(1048576->2097151) 00002000:00010000:3.0:1746155573.164046:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095269500 00000100:00100000:2.0:1746155573.164056:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123910656 00000100:00100000:2.0:1746155573.164059:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123910656 00000100:00100000:3.0:1746155573.164060:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4818 00000100:00100000:3.0:1746155573.164066:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123910400:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:2.0:1746155573.164069:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4014080->4018175) req@ffff8800a5ae1180 x1830976123910656/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.164075:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1180 with x1830976123910656 ext(4014080->4018175) 00002000:00010000:2.0:1746155573.164077:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae1180 00000100:00100000:2.0:1746155573.164087:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4819 00000100:00100000:2.0:1746155573.164091:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123910656:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155573.164182:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123910656:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 90us (234us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155573.164188:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4819 00002000:00100000:2.0:1746155573.164192:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4014080->4018175) req@ffff8800a5ae1180 x1830976123910656/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.164197:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1180 with x1830976123910656 ext(4014080->4018175) 00002000:00010000:2.0:1746155573.164200:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae1180 00000100:00100000:1.0:1746155573.164247:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124640512:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155573.164265:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155573.164284:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123910144:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5391us (5711us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.164291:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6265 00000100:00100000:0.0:1746155573.173751:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.174340:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123910784 00000100:00100000:3.0:1746155573.174348:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123910784 00000100:00100000:3.0:1746155573.174394:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12433 00000100:00100000:3.0:1746155573.174400:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29342:x1830976123910784:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155573.174413:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.174427:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117c7 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.174448:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 33 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.174454:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.174455:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.174458:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->3190783] (req 3145728->3190783) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.174478:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 33 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.174487:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 33 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.174496:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124640640:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.174907:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123910400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10839us (11013us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155573.174918:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4818 00002000:00100000:2.0:1746155573.174926:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012bdf5f80 x1830976123910400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.174934:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5f80 with x1830976123910400 ext(2097152->3145727) 00010000:00010000:2.0:1746155573.174939:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 32 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.174942:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff600 going to sleep for 11 seconds 00010000:00010000:2.0:1746155573.174948:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 32 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.174953:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bdf5f80 00000100:00100000:3.0:1746155573.176481:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124640640:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155573.176500:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->3190783] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.176546:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e18c00, rc 0) 00000100:00100000:3.0:1746155573.176572:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29342:x1830976123910784:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2172us (2830us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.176577:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12433 00000100:00100000:0.0:1746155573.178595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.178666:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123910912 00000100:00100000:3.0:1746155573.178672:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123910912 00000100:00100000:3.0:1746155573.178701:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12434 00000100:00100000:3.0:1746155573.178707:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29340:x1830976123910912:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.178720:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.178733:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117ce expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.178753:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.178760:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.178761:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.178764:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ce expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.178785:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.178794:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 21 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.178809:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124640768:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155573.178882:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.179919:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.180062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.180107:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123911296 00000100:00100000:2.0:1746155573.180112:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123911296 00000100:00100000:1.0:1746155573.180116:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123911040 00000100:00100000:1.0:1746155573.180120:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123911040 00010000:00010000:1.0:1746155573.180137:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 32 pid: 1625 timeout: 802 lvb_type: 0 00002000:00100000:2.0:1746155573.180139:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880130c9c380 x1830976123911296/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.180146:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9c380 with x1830976123911296 ext(2097152->3145727) 00010000:00010000:2.0:1746155573.180152:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.180163:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.180168:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6266 00002000:00010000:2.0:1746155573.180169:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130c9c380 00000100:00100000:1.0:1746155573.180173:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123911040:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155573.180182:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155573.180187:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 770 00000100:00100000:2.0:1746155573.180193:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123911296:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:1.0:1746155573.180199:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 32 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.180208:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 32 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.180225:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec7c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b2 expref: 32 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.180238:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.180239:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.180245:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.180251:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.180271:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155573.180279:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124640896:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155573.180320:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155573.180417:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124640768:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155573.180435:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ce expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.180444:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e18000, rc 0) 00000100:00100000:3.0:1746155573.180468:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29340:x1830976123910912:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1761us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.180472:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12434 00000100:00100000:0.0:1746155573.181611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.182147:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123911424 00000100:00100000:3.0:1746155573.182153:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123911424 00002000:00100000:3.0:1746155573.182177:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4014080->4194303) req@ffff880130c9df80 x1830976123911424/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.182184:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9df80 with x1830976123911424 ext(4014080->4194303) 00010000:00010000:3.0:1746155573.182190:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.182200:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746155573.182205:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130c9df80 00000100:00100000:3.0:1746155573.182219:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 771 00000100:00100000:3.0:1746155573.182224:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123911424:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155573.182822:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124640896:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155573.182836:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155573.182855:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123911040:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2681us (2937us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.182861:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6266 00000100:00100000:2.0:1746155573.183959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.185071:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123911680 00000100:00100000:1.0:1746155573.185077:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123911680 00002000:00100000:1.0:1746155573.185106:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (3186688->3190783) req@ffff880095268380 x1830976123911680/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.185115:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268380 with x1830976123911680 ext(3186688->3190783) 00002000:00010000:1.0:1746155573.185119:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095268380 00000100:00100000:2.0:1746155573.185818:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4820 00000100:00100000:2.0:1746155573.185828:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123911680:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155573.185985:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123911680:12345-192.168.202.51@tcp:3:cat.0 Request processed in 159us (2027us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155573.185991:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4820 00002000:00100000:2.0:1746155573.185996:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3186688->3190783) req@ffff880095268380 x1830976123911680/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.186003:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268380 with x1830976123911680 ext(3186688->3190783) 00002000:00010000:2.0:1746155573.186006:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095268380 00000100:00100000:3.0:1746155573.189200:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123911296:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8998us (9129us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155573.189210:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 770 00002000:00100000:3.0:1746155573.189219:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880130c9c380 x1830976123911296/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.189226:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9c380 with x1830976123911296 ext(2097152->3145727) 00010000:00010000:3.0:1746155573.189233:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.189245:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746155573.189250:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130c9c380 00000100:00100000:3.0:1746155573.192989:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123911424:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10757us (11372us total) trans 21474840648 rc 0/0 00000100:00100000:3.0:1746155573.192999:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 771 00002000:00100000:3.0:1746155573.193008:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4014080->4194303) req@ffff880130c9df80 x1830976123911424/t21474840648(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/448 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.193016:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9df80 with x1830976123911424 ext(4014080->4194303) 00010000:00010000:3.0:1746155573.193024:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.193036:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746155573.193045:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130c9df80 00000100:00100000:1.0:1746155573.201624:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.201705:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123911936 00000100:00100000:3.0:1746155573.201712:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123911936 00002000:00100000:3.0:1746155573.201748:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009366d880 x1830976123911936/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.201757:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d880 with x1830976123911936 ext(2097152->3145727) 00002000:00010000:3.0:1746155573.201761:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366d880 00000100:00100000:3.0:1746155573.201787:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4821 00000100:00100000:3.0:1746155573.201794:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123911936:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155573.206299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.206378:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123912192 00000100:00100000:2.0:1746155573.206386:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123912192 00002000:00100000:2.0:1746155573.206421:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4014079) req@ffff880137123480 x1830976123912192/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.206430:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123480 with x1830976123912192 ext(3145728->4014079) 00010000:00010000:2.0:1746155573.206439:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.206458:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.206465:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880137123480 00000100:00100000:2.0:1746155573.206484:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 772 00000100:00100000:2.0:1746155573.206492:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123912192:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155573.219366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.221457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.221469:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123912320 00000100:00100000:2.0:1746155573.221478:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123912320 00000100:00100000:2.0:1746155573.221561:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10091 00000100:00100000:2.0:1746155573.221569:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:29344:x1830976123912320:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155573.221590:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.221605:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425a00/0x844e5faceb5ec7f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117d5 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746155573.221649:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746155573.221656:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425400/0x844e5faceb5ec7fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155573.221666:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425400/0x844e5faceb5ec7fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155573.221675:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425400/0x844e5faceb5ec7fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155573.221685:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425600/0x844e5faceb5ec805 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155573.221690:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425600/0x844e5faceb5ec805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155573.221695:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425600/0x844e5faceb5ec805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155573.221781:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155573.221790:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b9 expref: 14 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.221799:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155573.221821:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b9 expref: 14 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.221831:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b9 expref: 14 pid: 15474 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.221840:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124641024:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.221910:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.222042:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123912576 00000100:00100000:0.0:1746155573.222046:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123912576 00002000:00100000:0.0:1746155573.222066:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (3190784->4194303) req@ffff88009366df80 x1830976123912576/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155573.222074:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366df80 with x1830976123912576 ext(3190784->4194303) 00002000:00010000:0.0:1746155573.222078:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366df80 00000100:00100000:0.0:1746155573.222090:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4822 00000100:00100000:0.0:1746155573.222095:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123912576:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155573.226873:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976123911936:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25073us (25248us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155573.226884:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4821 00002000:00100000:3.0:1746155573.226893:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009366d880 x1830976123911936/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.226901:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d880 with x1830976123911936 ext(2097152->3145727) 00002000:00010000:3.0:1746155573.226906:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366d880 00000100:00100000:0.0:1746155573.235780:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.236304:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123912192:12345-192.168.202.51@tcp:3:cat.0 Request processed in 29812us (30012us total) trans 0 rc 868352/868352 00000100:00100000:0.0:1746155573.236313:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 772 00002000:00100000:0.0:1746155573.236322:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4014079) req@ffff880137123480 x1830976123912192/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 868352/868352 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155573.236330:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123480 with x1830976123912192 ext(3145728->4014079) 00010000:00010000:0.0:1746155573.236338:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.236348:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746155573.236354:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880137123480 00000100:00100000:1.0:1746155573.236387:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123912576:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14290us (14936us total) trans 0 rc 1003520/1003520 00000100:00100000:1.0:1746155573.236393:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4822 00002000:00100000:1.0:1746155573.236398:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (3190784->4194303) req@ffff88009366df80 x1830976123912576/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1003520/1003520 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.236403:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366df80 with x1830976123912576 ext(3190784->4194303) 00002000:00010000:1.0:1746155573.236407:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366df80 00000100:00100000:3.0:1746155573.236633:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123912832 00000100:00100000:3.0:1746155573.236640:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123912832 00000100:00100000:3.0:1746155573.236671:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4095 00000100:00100000:3.0:1746155573.236677:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:27126:x1830976123912832:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155573.236826:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:27126:x1830976123912832:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 148us (1054us total) trans 8589944059 rc 0/0 00000100:00100000:3.0:1746155573.236832:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4095 00000100:00100000:2.0:1746155573.237652:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124641024:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.237671:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155573.239196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.241633:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123912960 00000100:00100000:3.0:1746155573.241641:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123912960 00000100:00100000:3.0:1746155573.241691:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12435 00000100:00100000:3.0:1746155573.241698:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29336:x1830976123912960:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.241712:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.241725:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117dc expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.241745:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.241749:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.241759:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.241766:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19a00, rc 0) 00000100:00100000:3.0:1746155573.241818:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+25:29336:x1830976123912960:12345-192.168.202.51@tcp:101:cat.0 Request processed in 120us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.241823:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12435 00000100:00100000:0.0:1746155573.249655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.249703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.251893:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123913216 00000100:00100000:2.0:1746155573.251901:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123913216 00010000:00010000:2.0:1746155573.251931:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.251958:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123913088 00000100:00100000:2.0:1746155573.251961:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123913088 00010000:00010000:2.0:1746155573.251972:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b9 expref: 16 pid: 15474 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.252361:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6267 00000100:00100000:2.0:1746155573.252369:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123913216:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155573.252375:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6268 00000100:00100000:1.0:1746155573.252381:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976123913088:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155573.252385:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155573.252386:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155573.252390:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b9 expref: 16 pid: 15474 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.252400:0:7062:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155572 -> 1746155573 00002000:00010000:2.0:1746155573.252402:0:7062:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155572 -> 1746155573 00010000:00010000:1.0:1746155573.252402:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b9 expref: 16 pid: 15474 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.252407:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.252413:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.252419:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046600/0x844e5faceb5ec7d4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117b9 expref: 16 pid: 15474 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.252424:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5424800/0x844e5faceb5ec7e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4014080->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c0 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.252434:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155573.252438:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.252445:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.252451:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.252467:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155573.252514:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976123913088:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 121us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.252520:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6268 00010000:00010000:3.0:1746155573.252534:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252541:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155573.252573:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155573.252577:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155573.252590:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252601:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252608:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425400/0x844e5faceb5ec7fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252613:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425400/0x844e5faceb5ec7fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252618:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425400/0x844e5faceb5ec7fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252622:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5425400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155573.252625:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425400/0x844e5faceb5ec7fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252630:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425400/0x844e5faceb5ec7fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252638:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155573.252640:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155573.252643:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425400/0x844e5faceb5ec7fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252647:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425400/0x844e5faceb5ec7fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252658:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425600/0x844e5faceb5ec805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252663:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425600/0x844e5faceb5ec805 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252667:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425600/0x844e5faceb5ec805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252672:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5425600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155573.252674:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425600/0x844e5faceb5ec805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252682:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425600/0x844e5faceb5ec805 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252688:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9f00) 00010000:00010000:3.0:1746155573.252689:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155573.252691:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425600/0x844e5faceb5ec805 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252696:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425600/0x844e5faceb5ec805 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.252723:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425a00/0x844e5faceb5ec7f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117d5 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.252733:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117d5 expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.252739:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155573.252741:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155573.252743:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5425800, rc 0) 00000100:00100000:3.0:1746155573.252780:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29344:x1830976123912320:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 31212us (33421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.252786:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10091 00010000:00010000:2.0:1746155573.252967:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.252969:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.252974:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ce expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.252981:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ce expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.252987:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.252988:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.252991:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.252997:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.253021:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155573.253030:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124641152:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155573.253077:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ce expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155573.253083:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009486bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124641280:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155573.253095:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.262770:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.262805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.263038:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124641152:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155573.263047:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009486bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124641280:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155573.263065:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.263912:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123913472 00000100:00100000:3.0:1746155573.263919:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123913472 00000100:00100000:3.0:1746155573.263956:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10092 00000100:00100000:3.0:1746155573.263962:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:29347:x1830976123913472:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155573.263979:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.263995:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577a00/0x844e5faceb5ec81a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117e3 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.264077:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577200/0x844e5faceb5ec821 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264086:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577200/0x844e5faceb5ec821 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264095:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577200/0x844e5faceb5ec821 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264105:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577e00/0x844e5faceb5ec828 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264111:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577e00/0x844e5faceb5ec828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264115:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577e00/0x844e5faceb5ec828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264190:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577600/0x844e5faceb5ec82f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264197:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577600/0x844e5faceb5ec82f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264202:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577600/0x844e5faceb5ec82f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155573.264208:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155573.264267:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577200/0x844e5faceb5ec821 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264273:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577200/0x844e5faceb5ec821 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264278:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577200/0x844e5faceb5ec821 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264282:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a9577200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155573.264284:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577200/0x844e5faceb5ec821 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264289:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577200/0x844e5faceb5ec821 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264296:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155573.264299:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155573.264302:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577200/0x844e5faceb5ec821 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264307:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577200/0x844e5faceb5ec821 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264319:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577e00/0x844e5faceb5ec828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264323:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577e00/0x844e5faceb5ec828 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264327:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577e00/0x844e5faceb5ec828 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264330:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a9577e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155573.264332:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577e00/0x844e5faceb5ec828 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264336:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577e00/0x844e5faceb5ec828 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264340:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fd66d00) 00010000:00010000:3.0:1746155573.264342:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155573.264343:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577e00/0x844e5faceb5ec828 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264348:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577e00/0x844e5faceb5ec828 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.264375:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577a00/0x844e5faceb5ec81a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117e3 expref: 296 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.264384:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577600/0x844e5faceb5ec82f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117e3 expref: 295 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.264389:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155573.264391:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155573.264393:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9577600, rc 0) 00000100:00100000:2.0:1746155573.264456:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123913216:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 12086us (14806us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.264464:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6267 00000100:00100000:2.0:1746155573.264546:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123913600 00000100:00100000:2.0:1746155573.264550:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123913600 00000100:00100000:2.0:1746155573.264574:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12436 00000100:00100000:2.0:1746155573.264578:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123913600:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155573.264585:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.264593:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5424c00/0x844e5faceb5ec83d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117ea expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.264605:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.264607:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.264613:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5424c00/0x844e5faceb5ec83d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ea expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.264623:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5424c00/0x844e5faceb5ec83d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ea expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.264630:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5424c00, rc 0) 00000100:00100000:3.0:1746155573.265626:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:29347:x1830976123913472:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1661us (2861us total) trans 8589944060 rc 0/0 00000100:00100000:3.0:1746155573.265632:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10092 00000100:00100000:2.0:1746155573.265861:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123913600:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1281us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.265866:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12436 00000100:00100000:1.0:1746155573.265971:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.265990:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.266099:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.266129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.266261:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123913984 00000100:00100000:2.0:1746155573.266266:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123913984 00000100:00100000:2.0:1746155573.266273:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123914240 00000100:00100000:2.0:1746155573.266274:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123914240 00000100:00100000:2.0:1746155573.266296:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123914368 00000100:00100000:2.0:1746155573.266298:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123914368 00000100:00100000:2.0:1746155573.266309:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12437 00000100:00100000:2.0:1746155573.266315:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123914240:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155573.266323:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.266333:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5425000/0x844e5faceb5ec844 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117f1 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.266346:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.266347:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.266352:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5425000/0x844e5faceb5ec844 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f1 expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.266362:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5425000/0x844e5faceb5ec844 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f1 expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.266370:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5425000, rc 0) 00000100:00100000:3.0:1746155573.266478:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123914112 00000100:00100000:3.0:1746155573.266482:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123914112 00000100:00100000:3.0:1746155573.266493:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12438 00000100:00100000:3.0:1746155573.266498:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123914368:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155573.266533:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.266543:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec84b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117f8 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.266552:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.266553:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.266557:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec84b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f8 expref: 11 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.266565:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec84b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f8 expref: 11 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.266571:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b9dc00, rc 0) 00000100:00100000:2.0:1746155573.267363:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123914240:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1047us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.267368:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12437 00002000:00100000:1.0:1746155573.267369:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009366c000 x1830976123913984/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.267377:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366c000 with x1830976123913984 ext(3145728->4194303) 00002000:00010000:1.0:1746155573.267381:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366c000 00000100:00100000:1.0:1746155573.267393:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4823 00002000:00100000:2.0:1746155573.267397:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009366d180 x1830976123914112/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155573.267398:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123913984:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:2.0:1746155573.267403:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d180 with x1830976123914112 ext(3145728->4194303) 00002000:00010000:2.0:1746155573.267406:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366d180 00000100:00100000:2.0:1746155573.267415:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4824 00000100:00100000:2.0:1746155573.267418:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123914112:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155573.267518:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123914368:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1018us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.267523:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12438 00000100:00100000:0.0:1746155573.272611:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.272643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.272674:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.272697:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123914624 00000100:00100000:2.0:1746155573.272709:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123914624 00000100:00100000:2.0:1746155573.272754:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123914496 00000100:00100000:2.0:1746155573.272756:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123914496 00000100:00100000:2.0:1746155573.272767:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123914752 00000100:00100000:2.0:1746155573.272768:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123914752 00000100:00100000:0.0:1746155573.272772:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12439 00000100:00100000:2.0:1746155573.272780:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12440 00000100:00100000:0.0:1746155573.272780:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123914624:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:2.0:1746155573.272784:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123914496:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:3.0:1746155573.272837:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12441 00000100:00100000:3.0:1746155573.272845:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123914752:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155573.272855:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.272871:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec852 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1180d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155573.272916:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124641408:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155573.272996:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effd80 going to sleep for 11 seconds 00010000:00010000:2.0:1746155573.273104:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.273120:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946fa000/0x844e5faceb5ec859 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f117ff expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.273135:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.273136:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.273143:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fa000/0x844e5faceb5ec859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ff expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.273158:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946fa000/0x844e5faceb5ec859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ff expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.273168:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946fa000, rc 0) 00000100:00100000:2.0:1746155573.273193:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123914496:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 407us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.273199:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12440 00010000:00010000:0.0:1746155573.273218:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155573.273226:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ec860 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11806 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.273236:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155573.273237:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155573.273242:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ec860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11806 expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155573.273250:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ec860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11806 expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155573.273257:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131004400, rc 0) 00000100:00100000:0.0:1746155573.273273:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123914624:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 495us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155573.273278:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12439 00000100:00100000:2.0:1746155573.279199:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123914112:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11771us (13200us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155573.279210:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4824 00002000:00100000:2.0:1746155573.279220:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009366d180 x1830976123914112/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.279228:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d180 with x1830976123914112 ext(3145728->4194303) 00002000:00010000:2.0:1746155573.279233:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366d180 00000100:00100000:3.0:1746155573.280806:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124641408:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155573.280838:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec852 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1180d expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.280855:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9d200/0x844e5faceb5ec852 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1180d expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.280879:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b9d200, rc 0) 00000100:00100000:3.0:1746155573.280906:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123914752:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8062us (8230us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155573.280912:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12441 00000100:00100000:1.0:1746155573.281917:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123913984:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14516us (15944us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155573.281926:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4823 00002000:00100000:1.0:1746155573.281934:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009366c000 x1830976123913984/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.281941:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366c000 with x1830976123913984 ext(3145728->4194303) 00002000:00010000:1.0:1746155573.281945:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366c000 00000100:00100000:2.0:1746155573.291725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.291727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.291762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.291811:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123915008 00000100:00100000:1.0:1746155573.291818:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123915008 00002000:00100000:1.0:1746155573.291854:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800939ec000 x1830976123915008/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.291864:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939ec000 with x1830976123915008 ext(4194304->4956159) 00002000:00010000:1.0:1746155573.291869:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939ec000 00000100:00100000:1.0:1746155573.291886:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4825 00000100:00100000:1.0:1746155573.291893:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123915008:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155573.292005:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123915392 00000100:00100000:3.0:1746155573.292009:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123915392 00000100:00100000:3.0:1746155573.292031:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10093 00000100:00100000:3.0:1746155573.292036:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29344:x1830976123915392:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:0.0:1746155573.292036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155573.292045:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155573.292049:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123915136 00000100:00100000:0.0:1746155573.292053:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123915136 00010000:00010000:3.0:1746155573.292058:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec867 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1181b expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155573.292071:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123915520 00000100:00100000:0.0:1746155573.292073:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123915520 00000100:00100000:0.0:1746155573.292086:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12442 00000100:00100000:0.0:1746155573.292091:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29340:x1830976123915136:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155573.292099:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155573.292108:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11814 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.292121:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155573.292130:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.292131:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117d5 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.292137:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577600/0x844e5faceb5ec82f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117e3 expref: 294 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.292137:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155573.292139:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.292141:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155573.292142:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11814 expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.292163:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577600/0x844e5faceb5ec82f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117e3 expref: 294 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.292163:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.292171:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577600/0x844e5faceb5ec82f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117e3 expref: 294 pid: 15474 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.292172:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 19 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.292180:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124641664:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155573.292180:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124641536:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.292225:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12443 00000100:00100000:2.0:1746155573.292231:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29347:x1830976123915520:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:0.0:1746155573.292233:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746155573.292237:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.292245:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11822 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.292257:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ce expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.292267:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ec860 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11806 expref: 11 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.292273:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.292277:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.292278:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.292280:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2547712->2785279] (req 2547712->2785279) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.292293:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.292299:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.292306:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094869f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124641792:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.292333:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ec860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11806 expref: 11 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.292340:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ec860 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11806 expref: 11 pid: 4461 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746155573.292347:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124641920:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.292365:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ce expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.292371:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ce expref: 23 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.292378:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124642048:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.292388:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7000 going to sleep for 11 seconds 00010000:00010000:3.0:1746155573.292499:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117d5 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.292534:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117d5 expref: 8 pid: 15474 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.292541:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124642176:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155573.292575:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.297752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.297931:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124641536:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155573.297971:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123915648 00000100:00100000:3.0:1746155573.297977:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123915648 00002000:00100000:3.0:1746155573.298010:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->3190783) req@ffff8800939ece00 x1830976123915648/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.298019:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939ece00 with x1830976123915648 ext(3145728->3190783) 00010000:00010000:3.0:1746155573.298026:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 20 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.298039:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 20 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.298048:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11814 expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155573.298049:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800939ece00 00010000:00010000:2.0:1746155573.298063:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131004600, rc 0) 00000100:00100000:2.0:1746155573.298101:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29340:x1830976123915136:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6009us (6337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.298107:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12442 00000100:00100000:2.0:1746155573.298200:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094869f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124641792:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.298209:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124641920:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.298216:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124642048:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.298233:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2547712->2785279] (req 2547712->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.298242:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946fa400, rc 0) 00000100:00100000:2.0:1746155573.298257:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29347:x1830976123915520:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6027us (6222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.298264:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12443 00000100:00100000:3.0:1746155573.298360:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 773 00000100:00100000:3.0:1746155573.298368:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976123915648:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155573.298757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.298886:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123915776 00000100:00100000:3.0:1746155573.298889:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123915776 00010000:00010000:3.0:1746155573.298906:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ec860 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11806 expref: 12 pid: 4461 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746155573.298926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.299089:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123915904 00000100:00100000:3.0:1746155573.299092:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123915904 00000100:00100000:1.0:1746155573.299098:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6269 00010000:00010000:3.0:1746155573.299103:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ce expref: 23 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.299105:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123915776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155573.299113:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155573.299126:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ec860 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11806 expref: 12 pid: 4461 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746155573.299134:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6270 00010000:00010000:1.0:1746155573.299134:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ec860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11806 expref: 12 pid: 4461 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746155573.299138:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123915904:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155573.299144:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155573.299153:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ce expref: 23 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.299154:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131004400/0x844e5faceb5ec860 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11806 expref: 12 pid: 4461 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746155573.299160:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ce expref: 23 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.299167:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155573.299172:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e18000/0x844e5faceb5ec7f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ce expref: 23 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.299184:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155573.299185:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123915776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 81us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.299190:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6269 00000100:00100000:3.0:1746155573.299196:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123915904:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 58us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.299200:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6270 00000100:00100000:3.0:1746155573.299350:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124641664:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155573.299352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.299359:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124642176:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155573.299369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155573.299372:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155573.299384:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123916160 00000100:00100000:2.0:1746155573.299387:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123916160 00010000:00010000:2.0:1746155573.299405:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117d5 expref: 9 pid: 15474 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.299423:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123916032 00000100:00100000:2.0:1746155573.299425:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123916032 00000100:00100000:1.0:1746155573.299430:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6271 00010000:00010000:2.0:1746155573.299434:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577600/0x844e5faceb5ec82f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117e3 expref: 295 pid: 15474 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.299436:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123916160:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155573.299442:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155573.299446:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6272 00010000:00010000:1.0:1746155573.299447:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117d5 expref: 9 pid: 15474 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.299451:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1962:x1830976123916032:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155573.299454:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117d5 expref: 9 pid: 15474 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.299457:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155573.299461:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577600/0x844e5faceb5ec82f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117e3 expref: 295 pid: 15474 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.299465:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5425800/0x844e5faceb5ec80c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117d5 expref: 9 pid: 15474 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.299469:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577600/0x844e5faceb5ec82f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117e3 expref: 295 pid: 15474 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.299479:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155573.299482:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155573.299488:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155573.299493:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155573.299499:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a9577600/0x844e5faceb5ec82f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117e3 expref: 295 pid: 15474 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.299533:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155573.299536:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155573.299538:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976123916160:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 101us (185us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155573.299546:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155573.299551:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155573.299551:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6271 00010000:00010000:2.0:1746155573.299563:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155573.299578:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1962:x1830976123916032:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 127us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.299583:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6272 00010000:00010000:3.0:1746155573.301005:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.301013:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155573.301028:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155573.301132:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec867 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1181b expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.301143:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1181b expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.301149:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155573.301151:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155573.301153:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487200, rc 0) 00000100:00100000:3.0:1746155573.301192:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29344:x1830976123915392:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 9155us (9473us total) trans 8589944061 rc 0/0 00000100:00100000:3.0:1746155573.301201:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10093 00000100:00100000:3.0:1746155573.301409:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123915008:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9515us (9682us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155573.301415:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4825 00002000:00100000:3.0:1746155573.301422:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800939ec000 x1830976123915008/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.301429:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939ec000 with x1830976123915008 ext(4194304->4956159) 00010000:00010000:3.0:1746155573.301435:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.301443:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746155573.301448:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800939ec000 00000100:00100000:1.0:1746155573.301799:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123915648:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3430us (4054us total) trans 17179873261 rc 0/0 00000100:00100000:1.0:1746155573.301805:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 773 00002000:00100000:1.0:1746155573.301811:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->3190783) req@ffff8800939ece00 x1830976123915648/t17179873261(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/448 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.301817:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939ece00 with x1830976123915648 ext(3145728->3190783) 00010000:00010000:1.0:1746155573.301822:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.301830:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:1.0:1746155573.301836:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800939ece00 00000100:00100000:0.0:1746155573.304187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.304236:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123916288 00000100:00100000:3.0:1746155573.304243:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123916288 00000100:00100000:3.0:1746155573.304295:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10094 00000100:00100000:3.0:1746155573.304302:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29344:x1830976123916288:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155573.304320:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.304336:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0x844e5faceb5ec88a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11829 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.304405:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.304417:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1181b expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.304423:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.304447:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1181b expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.304456:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1181b expref: 9 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.304465:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124642304:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155573.305072:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155573.308851:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.308945:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123916416 00000100:00100000:0.0:1746155573.308960:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123916416 00010000:00010000:0.0:1746155573.308989:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746155573.309018:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6273 00000100:00100000:0.0:1746155573.309024:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123916416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155573.309034:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155573.309050:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.309059:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.309077:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e18c00/0x844e5faceb5ec7e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117c7 expref: 22 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.309091:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155573.309093:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155573.309099:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11814 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.309106:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11814 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.309131:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11814 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155573.309141:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124642432:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155573.309253:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.309347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.309429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.309523:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123916544 00000100:00100000:1.0:1746155573.309537:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123916544 00010000:00010000:1.0:1746155573.309559:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1181b expref: 10 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.309581:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6274 00000100:00100000:1.0:1746155573.309586:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123916544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155573.309592:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155573.309596:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1181b expref: 10 pid: 27374 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.309603:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1181b expref: 10 pid: 27374 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.309615:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155573.309619:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155573.309625:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155573.309629:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155573.309640:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155573.309657:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123916672 00000100:00100000:2.0:1746155573.309660:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123916672 00000100:00100000:1.0:1746155573.309664:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123916544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.309670:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6274 00000100:00100000:2.0:1746155573.309681:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12444 00000100:00100000:2.0:1746155573.309686:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123916672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155573.309697:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.309707:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec898 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11830 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.309729:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.309735:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec898 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11830 expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.309743:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec898 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11830 expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.309757:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb88200, rc 0) 00000100:00100000:2.0:1746155573.309774:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123916672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 88us (345us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155573.309780:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12444 00010000:00010000:3.0:1746155573.309993:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487200/0x844e5faceb5ec875 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1181b expref: 9 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.310003:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124642304:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155573.310015:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.310021:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.310026:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155573.310057:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155573.310060:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155573.310072:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.310097:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487800/0x844e5faceb5ec88a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11829 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.310116:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11829 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.310122:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155573.310124:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155573.310126:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487a00, rc 0) 00000100:00100000:3.0:1746155573.310156:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29344:x1830976123916288:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5855us (5973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.310162:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10094 00000100:00100000:0.0:1746155573.313296:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.313373:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.313552:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123916928 00000100:00100000:3.0:1746155573.313558:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123916928 00000100:00100000:3.0:1746155573.313587:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12445 00000100:00100000:3.0:1746155573.313593:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123916928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.313608:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.313621:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f487400/0x844e5faceb5ec89f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11837 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.313638:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.313640:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.313647:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487400/0x844e5faceb5ec89f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11837 expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.313660:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f487400/0x844e5faceb5ec89f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11837 expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.313673:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487400, rc 0) 00000100:00100000:3.0:1746155573.313705:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123916928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 112us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.313710:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12445 00000100:00100000:2.0:1746155573.313763:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123916800 00000100:00100000:2.0:1746155573.313768:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123916800 00010000:00010000:2.0:1746155573.313784:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.313815:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6275 00000100:00100000:2.0:1746155573.313821:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123916800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155573.313830:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155573.313848:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.313858:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.313872:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ec813 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117dc expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.313883:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.313884:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.313888:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.313895:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.313927:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155573.313938:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124642560:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155573.314006:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155573.314538:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124642432:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155573.314554:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155573.314638:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123916416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5613us (5792us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.314644:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6273 00000100:00100000:0.0:1746155573.315708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.315739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.318421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.318472:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123917440 00000100:00100000:1.0:1746155573.318479:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123917440 00002000:00100000:1.0:1746155573.318598:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2547712->2551807) req@ffff8800939eed80 x1830976123917440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.318606:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939eed80 with x1830976123917440 ext(2547712->2551807) 00002000:00010000:1.0:1746155573.318611:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939eed80 00000100:00100000:2.0:1746155573.318917:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123917184 00000100:00100000:2.0:1746155573.318922:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123917184 00000100:00100000:2.0:1746155573.318955:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123917056 00000100:00100000:2.0:1746155573.318958:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123917056 00000100:00100000:2.0:1746155573.318975:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12446 00000100:00100000:2.0:1746155573.318981:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123917184:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155573.318994:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.319008:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb88800/0x844e5faceb5ec8a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11845 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.319026:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.319028:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.319035:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb88800/0x844e5faceb5ec8a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11845 expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155573.319163:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4826 00000100:00100000:3.0:1746155573.319168:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12447 00000100:00100000:1.0:1746155573.319169:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123917440:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155573.319176:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123917056:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155573.319184:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.319193:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486800/0x844e5faceb5ec8ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1183e expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155573.319199:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124642560:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155573.319213:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.319228:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124642688:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155573.319245:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123916800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5424us (5956us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155573.319252:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6275 00000100:00100000:3.0:1746155573.319266:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155573.319290:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123917440:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 121us (876us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155573.319297:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4826 00002000:00100000:1.0:1746155573.319301:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2547712->2551807) req@ffff8800939eed80 x1830976123917440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.319308:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939eed80 with x1830976123917440 ext(2547712->2551807) 00002000:00010000:1.0:1746155573.319311:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939eed80 00010000:00010000:2.0:1746155573.319382:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb88800/0x844e5faceb5ec8a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11845 expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.319395:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb88800, rc 0) 00000100:00100000:2.0:1746155573.319414:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123917184:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 434us (3708us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.319419:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12446 00000100:00100000:0.0:1746155573.321478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.321563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.322155:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123917824 00000100:00100000:3.0:1746155573.322166:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123917824 00000100:00100000:3.0:1746155573.322202:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12448 00000100:00100000:3.0:1746155573.322209:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29336:x1830976123917824:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.322221:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.322233:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1184c expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.322257:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.322264:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.322266:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.322269:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4952064->5242879] (req 4952064->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.322291:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.322300:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 21 pid: 20796 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.322310:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124642816:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155573.322322:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123917696 00000100:00100000:1.0:1746155573.322326:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123917696 00002000:00100000:1.0:1746155573.322348:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800939ef100 x1830976123917696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.322357:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939ef100 with x1830976123917696 ext(3145728->4194303) 00002000:00010000:1.0:1746155573.322361:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939ef100 00000100:00100000:1.0:1746155573.322372:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4827 00000100:00100000:3.0:1746155573.322374:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155573.322377:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123917696:12345-192.168.202.51@tcp:3:multiop.0 00002000:00010000:3.0:1746155573.327106:0:4461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155572 -> 1746155573 00000100:00100000:3.0:1746155573.327130:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124642688:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155573.327154:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486800/0x844e5faceb5ec8ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1183e expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.327166:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486800/0x844e5faceb5ec8ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1183e expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.327585:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486800, rc 0) 00000100:00100000:3.0:1746155573.327784:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123917056:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8608us (12042us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155573.327792:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12447 00000100:00100000:2.0:1746155573.327979:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124642816:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.327993:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [4952064->5242879] (req 4952064->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.328004:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486000, rc 0) 00000100:00100000:2.0:1746155573.328166:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29336:x1830976123917824:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5956us (6601us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.328172:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12448 00000100:00100000:0.0:1746155573.328400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.328437:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123918080 00000100:00100000:2.0:1746155573.328443:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123918080 00002000:00100000:2.0:1746155573.328470:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2781184->2785279) req@ffff8800939ef800 x1830976123918080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.328479:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939ef800 with x1830976123918080 ext(2781184->2785279) 00010000:00010000:2.0:1746155573.328485:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 22 pid: 20796 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.328496:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 22 pid: 20796 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.328538:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800939ef800 00000100:00100000:2.0:1746155573.328555:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 774 00000100:00100000:2.0:1746155573.328562:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123918080:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155573.328676:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976123918080:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 114us (275us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155573.328682:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 774 00002000:00100000:2.0:1746155573.328687:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2781184->2785279) req@ffff8800939ef800 x1830976123918080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.328693:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939ef800 with x1830976123918080 ext(2781184->2785279) 00010000:00010000:2.0:1746155573.328697:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 22 pid: 20796 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.328706:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 22 pid: 20796 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.328711:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800939ef800 00000100:00100000:1.0:1746155573.328965:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123917696:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 6587us (7493us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155573.328972:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4827 00002000:00100000:1.0:1746155573.328977:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800939ef100 x1830976123917696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.328983:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939ef100 with x1830976123917696 ext(3145728->4194303) 00002000:00010000:1.0:1746155573.328986:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939ef100 00000100:00100000:2.0:1746155573.332728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.332788:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123918592 00000100:00100000:0.0:1746155573.332794:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123918592 00002000:00100000:0.0:1746155573.332828:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2547712->2785279) req@ffff880094869f80 x1830976123918592/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155573.332836:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094869f80 with x1830976123918592 ext(2547712->2785279) 00010000:00010000:0.0:1746155573.332843:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 22 pid: 20796 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.332854:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 22 pid: 20796 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746155573.332861:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094869f80 00000100:00100000:0.0:1746155573.332888:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 775 00000100:00100000:0.0:1746155573.332894:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123918592:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155573.332938:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.333052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.333888:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123918336 00000100:00100000:3.0:1746155573.333893:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123918336 00000100:00100000:3.0:1746155573.333923:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10095 00000100:00100000:3.0:1746155573.333930:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29344:x1830976123918336:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155573.333940:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.333953:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0x844e5faceb5ec8bb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11853 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.334020:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec8c2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.334031:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.334040:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.334049:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.334055:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec8c2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.334060:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec8c2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.334065:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155573.334068:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec8c2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.334073:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec8c2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.334092:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155573.334094:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155573.334097:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec8c2 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.334102:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec8c2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.334125:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0x844e5faceb5ec8bb lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11853 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.334132:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486400/0x844e5faceb5ec8bb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11853 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.334138:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486400, rc 0) 00000100:00100000:1.0:1746155573.334569:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.334588:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123918976 00000100:00100000:2.0:1746155573.334591:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123918976 00000100:00100000:2.0:1746155573.334611:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12449 00000100:00100000:2.0:1746155573.334616:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123918976:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155573.334624:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.334632:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb88e00/0x844e5faceb5ec8c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1185a expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.334645:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.334647:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.334653:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb88e00/0x844e5faceb5ec8c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1185a expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.334663:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb88e00/0x844e5faceb5ec8c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1185a expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.334670:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb88e00, rc 0) 00000100:00100000:2.0:1746155573.334687:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123918976:12345-192.168.202.51@tcp:101:cat.0 Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.334692:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12449 00000100:00100000:3.0:1746155573.334965:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29344:x1830976123918336:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1034us (2026us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155573.334970:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10095 00000100:00100000:3.0:1746155573.334987:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123918848 00000100:00100000:3.0:1746155573.334990:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123918848 00000100:00100000:3.0:1746155573.335006:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4096 00000100:00100000:3.0:1746155573.335011:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29347:x1830976123918848:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155573.335659:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:29347:x1830976123918848:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 563us (2523us total) trans 8589944062 rc 0/0 00000100:00100000:3.0:1746155573.335667:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4096 00000100:00100000:2.0:1746155573.335982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.336178:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123919104 00000100:00100000:0.0:1746155573.336182:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123919104 00000100:00100000:0.0:1746155573.336213:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12450 00000100:00100000:0.0:1746155573.336218:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123919104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155573.336226:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155573.336233:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095144400/0x844e5faceb5ec8d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11861 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155573.336687:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124642944:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155573.336745:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.338565:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.338611:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123919360 00000100:00100000:3.0:1746155573.338617:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123919360 00000100:00100000:3.0:1746155573.338642:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4097 00000100:00100000:3.0:1746155573.338648:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29344:x1830976123919360:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155573.338784:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29344:x1830976123919360:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 129us (215us total) trans 8589944063 rc 0/0 00000100:00100000:3.0:1746155573.338793:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4097 00000100:00100000:2.0:1746155573.340997:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123918592:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 8097us (8270us total) trans 21474840649 rc 0/0 00000100:00100000:2.0:1746155573.341007:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 775 00002000:00100000:2.0:1746155573.341015:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2547712->2785279) req@ffff880094869f80 x1830976123918592/t21474840649(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/448 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.341024:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094869f80 with x1830976123918592 ext(2547712->2785279) 00010000:00010000:2.0:1746155573.341032:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 27 pid: 20796 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.341044:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 27 pid: 20796 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.341049:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094869f80 00000100:00100000:2.0:1746155573.342046:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124642944:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155573.342072:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095144400/0x844e5faceb5ec8d0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11861 expref: 26 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.342083:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095144400/0x844e5faceb5ec8d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11861 expref: 26 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.342106:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095144400, rc 0) 00000100:00100000:2.0:1746155573.342137:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123919104:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5918us (6155us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155573.342143:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12450 00000100:00100000:0.0:1746155573.344683:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.344803:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123919488 00000100:00100000:2.0:1746155573.344810:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123919488 00010000:00010000:2.0:1746155573.344838:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 25 pid: 20796 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.344870:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6276 00000100:00100000:2.0:1746155573.344876:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123919488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155573.344888:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155573.344903:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 25 pid: 20796 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.344913:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 25 pid: 20796 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.344931:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa400/0x844e5faceb5ec87c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2547712->2785279) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11822 expref: 25 pid: 20796 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.344947:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.344949:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.344955:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.344961:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.344985:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155573.344996:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124643072:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155573.345066:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.348035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.348109:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123919744 00000100:00100000:2.0:1746155573.348115:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123919744 00000100:00100000:2.0:1746155573.348157:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12451 00000100:00100000:2.0:1746155573.348164:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:29340:x1830976123919744:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155573.348179:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.348192:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0x844e5faceb5ec8d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11868 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.348211:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.348213:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.348217:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0x844e5faceb5ec8d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11868 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.348234:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0x844e5faceb5ec8d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11868 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.348242:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb89200, rc 0) 00000100:00100000:2.0:1746155573.348270:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:29340:x1830976123919744:12345-192.168.202.51@tcp:101:cat.0 Request processed in 108us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.348275:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12451 00000100:00100000:2.0:1746155573.348684:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124643072:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155573.348697:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155573.348990:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123919488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4113us (4311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.348998:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6276 00000100:00100000:0.0:1746155573.352117:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.352337:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123920000 00000100:00100000:2.0:1746155573.352345:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123920000 00002000:00100000:2.0:1746155573.352379:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4952064->4956159) req@ffff8800939efb80 x1830976123920000/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.352388:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939efb80 with x1830976123920000 ext(4952064->4956159) 00002000:00010000:2.0:1746155573.352393:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939efb80 00000100:00100000:2.0:1746155573.352422:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4828 00000100:00100000:2.0:1746155573.352428:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123920000:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155573.352592:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123920000:12345-192.168.202.51@tcp:3:cat.0 Request processed in 164us (482us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155573.352598:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4828 00002000:00100000:2.0:1746155573.352604:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4952064->4956159) req@ffff8800939efb80 x1830976123920000/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.352610:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939efb80 with x1830976123920000 ext(4952064->4956159) 00002000:00010000:2.0:1746155573.352613:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939efb80 00000100:00100000:0.0:1746155573.352798:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.352838:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123920256 00000100:00100000:3.0:1746155573.352842:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123920256 00002000:00100000:3.0:1746155573.352858:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880090d84000 x1830976123920256/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.352864:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d84000 with x1830976123920256 ext(4194304->4956159) 00002000:00010000:3.0:1746155573.352867:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090d84000 00000100:00100000:3.0:1746155573.352876:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4829 00000100:00100000:3.0:1746155573.352881:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123920256:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155573.363320:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123920256:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10429us (10513us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155573.363331:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4829 00002000:00100000:3.0:1746155573.363339:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880090d84000 x1830976123920256/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.363347:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d84000 with x1830976123920256 ext(4194304->4956159) 00002000:00010000:3.0:1746155573.363352:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090d84000 00000100:00100000:0.0:1746155573.412550:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.412615:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123920512 00000100:00100000:3.0:1746155573.412622:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123920512 00000100:00100000:3.0:1746155573.412675:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10096 00000100:00100000:3.0:1746155573.412683:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29353:x1830976123920512:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155573.413999:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.414018:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0x844e5faceb5ec8de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1186f expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.414119:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0x844e5faceb5ec8e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414129:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0x844e5faceb5ec8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414138:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0x844e5faceb5ec8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414146:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487c00/0x844e5faceb5ec8ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414151:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487c00/0x844e5faceb5ec8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414155:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487c00/0x844e5faceb5ec8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414229:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0x844e5faceb5ec8f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414235:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0x844e5faceb5ec8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414239:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0x844e5faceb5ec8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155573.414246:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155573.414301:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0x844e5faceb5ec8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414306:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0x844e5faceb5ec8e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414314:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0x844e5faceb5ec8e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414318:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f486c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155573.414321:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0x844e5faceb5ec8e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414325:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0x844e5faceb5ec8e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414334:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155573.414336:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155573.414338:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0x844e5faceb5ec8e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414342:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486c00/0x844e5faceb5ec8e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414356:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487c00/0x844e5faceb5ec8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414360:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487c00/0x844e5faceb5ec8ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414364:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487c00/0x844e5faceb5ec8ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414367:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155573.414369:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487c00/0x844e5faceb5ec8ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414372:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487c00/0x844e5faceb5ec8ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414379:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fd66d00) 00010000:00010000:3.0:1746155573.414381:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155573.414383:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487c00/0x844e5faceb5ec8ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414386:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487c00/0x844e5faceb5ec8ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.414414:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486a00/0x844e5faceb5ec8de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1186f expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.414429:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0x844e5faceb5ec8f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1186f expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.414434:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155573.414435:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155573.414437:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486600, rc 0) 00000100:00100000:3.0:1746155573.414479:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29353:x1830976123920512:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1796us (1977us total) trans 8589944064 rc 0/0 00000100:00100000:3.0:1746155573.414486:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10096 00000100:00100000:0.0:1746155573.456140:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.456247:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123920640 00000100:00100000:3.0:1746155573.456256:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123920640 00000100:00100000:3.0:1746155573.456476:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12452 00000100:00100000:3.0:1746155573.456484:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29353:x1830976123920640:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155573.456628:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.456643:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11876 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.456673:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11796 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.456681:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5424c00/0x844e5faceb5ec83d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ea expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.456688:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117a4 expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.456694:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.456695:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.456699:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [503808->974847] (req 503808->974847) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.456723:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117a4 expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.456734:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117a4 expref: 24 pid: 29728 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.456746:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124643200:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155573.457009:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5424c00/0x844e5faceb5ec83d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ea expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.457018:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5424c00/0x844e5faceb5ec83d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ea expref: 10 pid: 4461 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746155573.457030:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124643328:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155573.457055:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11796 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.457062:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11796 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.457070:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124643456:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155573.457085:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155573.458699:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124643200:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155573.458709:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124643328:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155573.458715:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124643456:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155573.459098:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [503808->974847] (req 503808->974847) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.459111:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486400, rc 0) 00000100:00100000:3.0:1746155573.459156:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+25:29353:x1830976123920640:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2671us (3022us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.459162:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12452 00000100:00100000:0.0:1746155573.461585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.461626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.464123:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.465018:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123920896 00000100:00100000:2.0:1746155573.465026:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123920896 00010000:00010000:2.0:1746155573.465058:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117a4 expref: 25 pid: 29728 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.465081:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123920768 00000100:00100000:2.0:1746155573.465083:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123920768 00010000:00010000:2.0:1746155573.465092:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5424c00/0x844e5faceb5ec83d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ea expref: 11 pid: 4461 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746155573.465111:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123921024 00000100:00100000:2.0:1746155573.465114:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123921024 00010000:00010000:2.0:1746155573.465124:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11796 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.465138:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6277 00000100:00100000:2.0:1746155573.465145:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123920896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155573.465155:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155573.465174:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117a4 expref: 25 pid: 29728 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.465183:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117a4 expref: 25 pid: 29728 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.465206:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fafc00/0x844e5faceb5ec7b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117a4 expref: 25 pid: 29728 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.465223:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155573.465260:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123920896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 115us (3681us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.465266:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6277 00000100:00100000:2.0:1746155573.465280:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6278 00000100:00100000:2.0:1746155573.465285:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123920768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155573.465292:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155573.465300:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5424c00/0x844e5faceb5ec83d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ea expref: 11 pid: 4461 timeout: 802 lvb_type: 1 00010000:00010000:2.0:1746155573.465307:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5424c00/0x844e5faceb5ec83d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ea expref: 11 pid: 4461 timeout: 802 lvb_type: 1 00010000:00010000:2.0:1746155573.465317:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5424c00/0x844e5faceb5ec83d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ea expref: 11 pid: 4461 timeout: 802 lvb_type: 1 00010000:00010000:2.0:1746155573.465327:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155573.465341:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123920768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 56us (3714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.465346:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6278 00000100:00100000:2.0:1746155573.465354:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6279 00000100:00100000:2.0:1746155573.465359:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123921024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155573.465365:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155573.465371:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11796 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.465379:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11796 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.465389:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a273000/0x844e5faceb5ec7aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11796 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.465397:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.465399:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.465404:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.465410:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.465436:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155573.465446:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124643584:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155573.465490:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155573.467463:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124643584:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155573.467477:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155573.467786:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.470374:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123921024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5006us (6248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.470389:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6279 00000100:00100000:3.0:1746155573.471465:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123921280 00000100:00100000:3.0:1746155573.471474:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123921280 00002000:00100000:3.0:1746155573.471539:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (503808->507903) req@ffff880090d85500 x1830976123921280/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.471553:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d85500 with x1830976123921280 ext(503808->507903) 00002000:00010000:3.0:1746155573.471558:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090d85500 00000100:00100000:3.0:1746155573.471576:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4830 00000100:00100000:3.0:1746155573.471582:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123921280:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155573.472882:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123921280:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1297us (5094us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155573.472888:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4830 00002000:00100000:3.0:1746155573.472893:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (503808->507903) req@ffff880090d85500 x1830976123921280/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.472900:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d85500 with x1830976123921280 ext(503808->507903) 00002000:00010000:3.0:1746155573.472903:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090d85500 00000100:00100000:0.0:1746155573.480375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.480774:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123921536 00000100:00100000:3.0:1746155573.480782:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123921536 00002000:00100000:3.0:1746155573.480817:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (970752->974847) req@ffff880090d85880 x1830976123921536/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.480826:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d85880 with x1830976123921536 ext(970752->974847) 00002000:00010000:3.0:1746155573.480830:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090d85880 00000100:00100000:3.0:1746155573.480857:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4831 00000100:00100000:3.0:1746155573.480864:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123921536:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155573.481009:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123921536:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 145us (642us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155573.481015:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4831 00002000:00100000:3.0:1746155573.481021:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (970752->974847) req@ffff880090d85880 x1830976123921536/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.481028:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d85880 with x1830976123921536 ext(970752->974847) 00002000:00010000:3.0:1746155573.481030:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090d85880 00000100:00100000:0.0:1746155573.484086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.485026:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123921792 00000100:00100000:2.0:1746155573.485034:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123921792 00000100:00100000:2.0:1746155573.485080:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4098 00000100:00100000:2.0:1746155573.485087:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29353:x1830976123921792:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155573.485655:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29353:x1830976123921792:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 566us (1575us total) trans 8589944065 rc 0/0 00000100:00100000:2.0:1746155573.485661:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4098 00000100:00100000:0.0:1746155573.571643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.571706:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123922048 00000100:00100000:3.0:1746155573.571714:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123922048 00000100:00100000:3.0:1746155573.571763:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10097 00000100:00100000:3.0:1746155573.571770:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:29356:x1830976123922048:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155573.571789:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.571802:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0x844e5faceb5ec908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1187d expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.571883:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487600/0x844e5faceb5ec90f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.571893:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487600/0x844e5faceb5ec90f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.571901:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487600/0x844e5faceb5ec90f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.571910:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec916 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.571915:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec916 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.571919:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec916 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.571993:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0x844e5faceb5ec91d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.571999:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0x844e5faceb5ec91d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572004:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0x844e5faceb5ec91d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155573.572011:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155573.572070:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487600/0x844e5faceb5ec90f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572075:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487600/0x844e5faceb5ec90f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572080:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487600/0x844e5faceb5ec90f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572084:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155573.572087:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487600/0x844e5faceb5ec90f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572092:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487600/0x844e5faceb5ec90f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572100:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155573.572103:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155573.572106:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487600/0x844e5faceb5ec90f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572109:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487600/0x844e5faceb5ec90f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572133:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec916 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572140:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec916 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572145:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec916 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572148:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f487000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155573.572149:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec916 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572153:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec916 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572157:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fd66500) 00010000:00010000:3.0:1746155573.572159:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155573.572160:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec916 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572164:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487000/0x844e5faceb5ec916 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155573.572190:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486200/0x844e5faceb5ec908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1187d expref: 298 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.572198:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0x844e5faceb5ec91d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1187d expref: 297 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.572203:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155573.572204:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155573.572206:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486800, rc 0) 00000100:00100000:3.0:1746155573.572253:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29356:x1830976123922048:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 483us (616us total) trans 8589944066 rc 0/0 00000100:00100000:3.0:1746155573.572258:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10097 00000100:00100000:0.0:1746155573.593641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.593677:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123922304 00000100:00100000:2.0:1746155573.593684:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123922304 00002000:00100000:2.0:1746155573.593726:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880090d86300 x1830976123922304/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 504/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.593734:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d86300 with x1830976123922304 ext(0->1048575) 00002000:00010000:2.0:1746155573.593739:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090d86300 00000100:00100000:2.0:1746155573.593754:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4832 00000100:00100000:2.0:1746155573.593761:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123922304:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155573.619458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.619539:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123922432 00000100:00100000:3.0:1746155573.619547:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123922432 00000100:00100000:3.0:1746155573.619590:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12453 00000100:00100000:3.0:1746155573.619598:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123922432:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.619614:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.619631:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0x844e5faceb5ec92b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11884 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155573.619672:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124643712:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155573.619754:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155573.620977:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123922304:12345-192.168.202.51@tcp:3:cat.0 Request processed in 27213us (27338us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746155573.620986:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4832 00002000:00100000:2.0:1746155573.620995:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880090d86300 x1830976123922304/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 504/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.621002:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d86300 with x1830976123922304 ext(0->1048575) 00002000:00010000:2.0:1746155573.621006:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090d86300 00002000:00010000:3.0:1746155573.622180:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime: 1746155573 -> 1746155574 00000100:00100000:3.0:1746155573.622202:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124643712:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155573.622229:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0x844e5faceb5ec92b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11884 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.622242:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f487200/0x844e5faceb5ec92b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11884 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155573.622277:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f487200, rc 0) 00000100:00100000:3.0:1746155573.622318:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123922432:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2720us (2866us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155573.622324:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12453 00000100:00100000:0.0:1746155573.634084:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.634147:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123922560 00000100:00100000:3.0:1746155573.634155:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123922560 00000100:00100000:3.0:1746155573.634207:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12454 00000100:00100000:3.0:1746155573.634215:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:29363:x1830976123922560:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.634231:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.634245:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1188b expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.634268:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.634275:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.634277:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.634280:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1188b expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.634304:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.634315:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 23 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.634325:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124643840:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155573.634393:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.634433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.634458:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123922816 00000100:00100000:0.0:1746155573.634461:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123922816 00000100:00100000:0.0:1746155573.634483:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10098 00000100:00100000:0.0:1746155573.634488:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29364:x1830976123922816:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155573.634501:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155573.634544:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbc00/0x844e5faceb5ec939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11892 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.634616:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155573.634627:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11829 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.636594:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0x844e5faceb5ec8f3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1186f expref: 19 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.636600:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0x844e5faceb5ec91d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1187d expref: 296 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.636606:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.636754:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0x844e5faceb5ec91d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1187d expref: 296 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.636764:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0x844e5faceb5ec91d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1187d expref: 296 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.636775:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124643968:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155573.636850:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0x844e5faceb5ec8f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1186f expref: 19 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.636857:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0x844e5faceb5ec8f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1186f expref: 19 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.636864:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124644096:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155573.636886:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11829 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.636893:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11829 expref: 8 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.636900:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124644224:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155573.636915:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155573.637062:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.637373:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124643840:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155573.637389:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1188b expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.637401:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f486200, rc 0) 00000100:00100000:0.0:1746155573.637421:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:29363:x1830976123922560:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3208us (3345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155573.637428:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12454 00000100:00100000:3.0:1746155573.637764:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123922944 00000100:00100000:3.0:1746155573.637769:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123922944 00002000:00100000:3.0:1746155573.637795:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (503808->974847) req@ffff880094c31500 x1830976123922944/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.637808:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c31500 with x1830976123922944 ext(503808->974847) 00010000:00010000:3.0:1746155573.637814:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.637823:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 24 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746155573.637829:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c31500 00000100:00100000:3.0:1746155573.637854:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 776 00000100:00100000:3.0:1746155573.637860:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123922944:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155573.647621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.647645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.647669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.647697:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123923072 00000100:00100000:3.0:1746155573.647702:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123923072 00010000:00010000:3.0:1746155573.647726:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0x844e5faceb5ec91d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1187d expref: 297 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.647743:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123923328 00000100:00100000:3.0:1746155573.647744:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123923328 00010000:00010000:3.0:1746155573.647750:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11829 expref: 9 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.647758:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123923200 00000100:00100000:3.0:1746155573.647760:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123923200 00010000:00010000:3.0:1746155573.647766:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0x844e5faceb5ec8f3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1186f expref: 20 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.647780:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6280 00000100:00100000:3.0:1746155573.647786:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1962:x1830976123923072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155573.647795:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155573.647800:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0x844e5faceb5ec91d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1187d expref: 297 pid: 27374 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.647808:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0x844e5faceb5ec91d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1187d expref: 297 pid: 27374 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.647831:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155573.647835:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.647841:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.647845:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.647875:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1962:x1830976123923072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.647880:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6280 00000100:00100000:3.0:1746155573.647893:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6281 00000100:00100000:3.0:1746155573.647897:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123923328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155573.647903:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155573.647906:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11829 expref: 9 pid: 27374 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.647917:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11829 expref: 9 pid: 27374 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.647925:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155573.647928:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.647933:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.647936:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.647949:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123923328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.647953:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6281 00000100:00100000:3.0:1746155573.647982:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6282 00000100:00100000:3.0:1746155573.647987:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123923200:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155573.647992:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155573.647995:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0x844e5faceb5ec8f3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1186f expref: 20 pid: 27374 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.648002:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0x844e5faceb5ec8f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1186f expref: 20 pid: 27374 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.648010:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155573.648013:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.648018:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.648024:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155573.648036:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.648050:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976123923200:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 62us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.648054:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6282 00010000:00010000:1.0:1746155573.648248:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486800/0x844e5faceb5ec91d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1187d expref: 296 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.648263:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124643968:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155573.648271:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f486600/0x844e5faceb5ec8f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1186f expref: 19 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.648280:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124644096:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155573.648286:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f487a00/0x844e5faceb5ec891 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11829 expref: 8 pid: 27374 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.648292:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124644224:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155573.648312:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.648318:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.648322:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155573.648337:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155573.648448:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbc00/0x844e5faceb5ec939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11892 expref: 20 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.648459:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11892 expref: 19 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.648465:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155573.648467:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155573.648469:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946fbe00, rc 0) 00000100:00100000:1.0:1746155573.648500:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29364:x1830976123922816:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 14011us (14067us total) trans 8589944067 rc 0/0 00000100:00100000:1.0:1746155573.648552:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10098 00000100:00100000:0.0:1746155573.653804:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.654871:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.654890:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123923584 00000100:00100000:0.0:1746155573.654896:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123923584 00002000:00100000:0.0:1746155573.654928:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880090d87100 x1830976123923584/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155573.654936:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d87100 with x1830976123923584 ext(2097152->3145727) 00002000:00010000:0.0:1746155573.654940:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090d87100 00000100:00100000:0.0:1746155573.655364:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123923840 00000100:00100000:0.0:1746155573.655367:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123923840 00002000:00100000:0.0:1746155573.655382:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880090d87480 x1830976123923840/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155573.655388:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d87480 with x1830976123923840 ext(3145728->4194303) 00002000:00010000:0.0:1746155573.655391:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090d87480 00000100:00100000:1.0:1746155573.655611:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4833 00000100:00100000:1.0:1746155573.655621:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123923584:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155573.657778:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4834 00000100:00100000:0.0:1746155573.657787:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123923840:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155573.658397:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.658424:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.658434:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123924096 00000100:00100000:2.0:1746155573.658438:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123924096 00002000:00100000:2.0:1746155573.658459:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800944af480 x1830976123924096/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.658466:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944af480 with x1830976123924096 ext(2097152->3145727) 00002000:00010000:2.0:1746155573.658470:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944af480 00000100:00100000:2.0:1746155573.658490:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4835 00000100:00100000:2.0:1746155573.658495:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123924096:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155573.658553:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123924224 00000100:00100000:1.0:1746155573.658557:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123924224 00000100:00100000:1.0:1746155573.658576:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12455 00000100:00100000:1.0:1746155573.658580:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:29356:x1830976123924224:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155573.658588:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155573.658603:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11899 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.658623:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.658630:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0x844e5faceb5ec8d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11868 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.658635:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.658637:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.658639:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3366912->3817471] (req 3366912->3817471) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 26 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.658661:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0x844e5faceb5ec8d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11868 expref: 26 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.658670:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0x844e5faceb5ec8d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11868 expref: 26 pid: 4461 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.658683:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124644352:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155573.658726:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.658733:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.658739:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124644480:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155573.658751:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155573.658785:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.658798:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123924352 00000100:00100000:1.0:1746155573.658800:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123924352 00002000:00100000:1.0:1746155573.658812:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800910c9180 x1830976123924352/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.658818:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c9180 with x1830976123924352 ext(3145728->4194303) 00002000:00010000:1.0:1746155573.658820:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910c9180 00000100:00100000:1.0:1746155573.658829:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4836 00000100:00100000:1.0:1746155573.658833:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123924352:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155573.663167:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123922944:12345-192.168.202.51@tcp:4:cat.0 Request processed in 25297us (26095us total) trans 21474840650 rc 0/0 00000100:00100000:3.0:1746155573.663180:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 776 00002000:00100000:3.0:1746155573.663190:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (503808->974847) req@ffff880094c31500 x1830976123922944/t21474840650(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/448 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.663198:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c31500 with x1830976123922944 ext(503808->974847) 00010000:00010000:3.0:1746155573.663207:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 30 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.663218:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 30 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746155573.663225:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c31500 00000100:00100000:0.0:1746155573.679484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.679804:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123924608 00000100:00100000:3.0:1746155573.679812:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123924608 00010000:00010000:3.0:1746155573.679839:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0x844e5faceb5ec8d7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11868 expref: 27 pid: 4461 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.679861:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6283 00000100:00100000:3.0:1746155573.679868:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123924608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155573.679869:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123923584:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24246us (26067us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155573.679878:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4833 00010000:00010000:3.0:1746155573.679879:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1746155573.679888:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff880090d87100 x1830976123923584/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746155573.679894:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0x844e5faceb5ec8d7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11868 expref: 27 pid: 4461 timeout: 802 lvb_type: 0 00002000:00100000:0.0:1746155573.679896:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d87100 with x1830976123923584 ext(2097152->3145727) 00010000:00010000:3.0:1746155573.679903:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0x844e5faceb5ec8d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11868 expref: 27 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.679904:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.679914:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746155573.679920:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090d87100 00010000:00010000:3.0:1746155573.679922:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.679940:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123924608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.679946:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6283 00010000:00010000:1.0:1746155573.681240:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb89200/0x844e5faceb5ec8d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4956159) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11868 expref: 26 pid: 4461 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.681267:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124644352:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155573.681277:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124644480:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155573.681298:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3366912->3817471] (req 3366912->3817471) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.681308:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0107a00, rc 0) 00000100:00100000:1.0:1746155573.681328:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:29356:x1830976123924224:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 22747us (22933us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.681334:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12455 00000100:00100000:0.0:1746155573.687952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.688064:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123924736 00000100:00100000:3.0:1746155573.688072:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123924736 00010000:00010000:3.0:1746155573.688102:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.688141:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6284 00000100:00100000:3.0:1746155573.688148:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123924736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155573.688158:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155573.688175:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.688185:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.688202:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486400/0x844e5faceb5ec901 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->974847) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11876 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.690155:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123923840:12345-192.168.202.51@tcp:3:cat.0 Request processed in 32365us (35280us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155573.690165:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4834 00002000:00100000:1.0:1746155573.690174:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880090d87480 x1830976123923840/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.690183:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d87480 with x1830976123923840 ext(3145728->4194303) 00010000:00010000:1.0:1746155573.690191:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 26 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.690204:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 26 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:1.0:1746155573.690210:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090d87480 00010000:00010000:3.0:1746155573.691746:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.691751:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.691762:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1188b expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.691772:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1188b expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.691816:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1188b expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155573.691829:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124644608:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155573.691920:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155573.695317:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123924096:12345-192.168.202.51@tcp:3:cat.0 Request processed in 36813us (36883us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155573.695327:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4835 00002000:00100000:3.0:1746155573.695336:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800944af480 x1830976123924096/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.695344:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944af480 with x1830976123924096 ext(2097152->3145727) 00002000:00010000:3.0:1746155573.695349:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944af480 00000100:00100000:0.0:1746155573.698956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.701447:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123924864 00000100:00100000:2.0:1746155573.701457:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123924864 00010000:00010000:2.0:1746155573.701487:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 26 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.703135:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123924352:12345-192.168.202.51@tcp:3:cat.0 Request processed in 44295us (44344us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155573.703145:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4836 00002000:00100000:1.0:1746155573.703154:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800910c9180 x1830976123924352/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.703167:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c9180 with x1830976123924352 ext(3145728->4194303) 00002000:00010000:1.0:1746155573.703171:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910c9180 00000100:00100000:2.0:1746155573.704662:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6285 00000100:00100000:2.0:1746155573.704673:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123924864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155573.704685:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155573.704703:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 26 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.704715:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 26 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.704738:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486000/0x844e5faceb5ec8b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1184c expref: 26 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.704763:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.704765:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.704770:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.704777:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.704807:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155573.704818:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124644736:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155573.704884:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155573.705583:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.705622:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.705648:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123925248 00000100:00100000:1.0:1746155573.705654:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123925248 00002000:00100000:1.0:1746155573.705682:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800910cbb80 x1830976123925248/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.705689:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cbb80 with x1830976123925248 ext(1048576->2097151) 00002000:00010000:1.0:1746155573.705692:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910cbb80 00000100:00100000:1.0:1746155573.705704:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4837 00000100:00100000:1.0:1746155573.705709:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123925248:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155573.706724:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123925120 00000100:00100000:1.0:1746155573.706728:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123925120 00002000:00100000:1.0:1746155573.706744:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800910c9f80 x1830976123925120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.706751:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c9f80 with x1830976123925120 ext(0->1048575) 00002000:00010000:1.0:1746155573.706755:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c9f80 00000100:00100000:1.0:1746155573.706782:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4838 00000100:00100000:1.0:1746155573.706789:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123925120:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155573.708288:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124644608:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155573.708304:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155573.708329:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123924736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 20182us (20383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.708337:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6284 00000100:00100000:0.0:1746155573.711794:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.714105:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123925504 00000100:00100000:1.0:1746155573.714116:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123925504 00000100:00100000:0.0:1746155573.714449:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.714465:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123925760 00000100:00100000:0.0:1746155573.714468:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123925760 00002000:00100000:0.0:1746155573.714494:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3366912->3371007) req@ffff880090d85180 x1830976123925760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746155573.714967:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124644736:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155573.714985:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746155573.715388:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d85180 with x1830976123925760 ext(3366912->3371007) 00002000:00010000:0.0:1746155573.715394:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090d85180 00000100:00100000:3.0:1746155573.715402:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123924864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10731us (16452us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.715414:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6285 00000100:00100000:0.0:1746155573.715414:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4839 00000100:00100000:0.0:1746155573.715421:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123925760:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155573.715575:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123925760:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 154us (1128us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155573.715581:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4839 00002000:00100000:0.0:1746155573.715586:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3366912->3371007) req@ffff880090d85180 x1830976123925760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155573.715593:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d85180 with x1830976123925760 ext(3366912->3371007) 00002000:00010000:0.0:1746155573.715597:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090d85180 00000100:00100000:0.0:1746155573.715699:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12456 00000100:00100000:0.0:1746155573.715706:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29364:x1830976123925504:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155573.715714:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155573.715726:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118a0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.715744:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.715751:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155573.715752:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155573.715755:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3121152->3145727] (req 3121152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.715792:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.715802:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746155573.715812:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aca8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124644864:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155573.715847:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.717400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.717444:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123925888 00000100:00100000:2.0:1746155573.717449:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123925888 00000100:00100000:2.0:1746155573.717483:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12457 00000100:00100000:2.0:1746155573.717489:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29359:x1830976123925888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155573.717497:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.717540:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118a7 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.717558:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155573.717560:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155573.717563:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a7 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.717571:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a7 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.717578:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb88200, rc 0) 00000100:00100000:2.0:1746155573.717605:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:29359:x1830976123925888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 117us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.717611:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12457 00000100:00100000:0.0:1746155573.718539:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123925120:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11748us (12915us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155573.718547:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4838 00002000:00100000:0.0:1746155573.718554:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800910c9f80 x1830976123925120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155573.718562:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c9f80 with x1830976123925120 ext(0->1048575) 00002000:00010000:0.0:1746155573.718566:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c9f80 00000100:00100000:1.0:1746155573.718718:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123925248:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13008us (13135us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155573.718727:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4837 00002000:00100000:1.0:1746155573.718732:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800910cbb80 x1830976123925248/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155573.718738:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cbb80 with x1830976123925248 ext(1048576->2097151) 00002000:00010000:1.0:1746155573.718741:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910cbb80 00000100:00100000:0.0:1746155573.723065:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aca8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124644864:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155573.723091:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3121152->3145727] (req 3121152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 26 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.723107:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946fa800, rc 0) 00000100:00100000:0.0:1746155573.723157:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29364:x1830976123925504:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7450us (11370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155573.723165:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12456 00000100:00100000:1.0:1746155573.723275:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.723479:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123926144 00000100:00100000:0.0:1746155573.723485:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123926144 00002000:00100000:0.0:1746155573.723543:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3813376->3817471) req@ffff8800935bd880 x1830976123926144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155573.723551:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bd880 with x1830976123926144 ext(3813376->3817471) 00010000:00010000:0.0:1746155573.723558:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.723568:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746155573.723573:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935bd880 00000100:00100000:0.0:1746155573.723587:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 777 00000100:00100000:0.0:1746155573.723593:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123926144:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155573.724800:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123926144:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1202us (1520us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155573.724807:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 777 00002000:00100000:0.0:1746155573.724814:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3813376->3817471) req@ffff8800935bd880 x1830976123926144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155573.724822:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bd880 with x1830976123926144 ext(3813376->3817471) 00010000:00010000:0.0:1746155573.724828:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.724839:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746155573.724846:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935bd880 00000100:00100000:0.0:1746155573.727950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.728100:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.728141:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123926400 00000100:00100000:0.0:1746155573.728144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.728150:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123926400 00000100:00100000:3.0:1746155573.728153:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123926656 00000100:00100000:3.0:1746155573.728157:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123926656 00002000:00100000:2.0:1746155573.728183:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3366912->3817471) req@ffff88009aca8000 x1830976123926400/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746155573.728187:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4099 00002000:00100000:2.0:1746155573.728192:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aca8000 with x1830976123926400 ext(3366912->3817471) 00000100:00100000:3.0:1746155573.728199:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:29356:x1830976123926656:12345-192.168.202.51@tcp:35:multiop.0 00010000:00010000:2.0:1746155573.728200:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.728212:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.728218:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aca8000 00000100:00100000:1.0:1746155573.728224:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123926784 00000100:00100000:1.0:1746155573.728227:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123926784 00000100:00100000:2.0:1746155573.728230:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 778 00000100:00100000:2.0:1746155573.728235:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976123926400:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155573.728246:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12458 00000100:00100000:1.0:1746155573.728250:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:29363:x1830976123926784:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155573.728256:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155573.728267:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118ae expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.728282:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155573.728287:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3121152->3145727] (req 3121152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.728292:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746155573.728295:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ae expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.728320:0:1625:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3121152->3145727] (req 3121152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.728331:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ae expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.728340:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68aa00, rc 0) 00000100:00100000:1.0:1746155573.728372:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29363:x1830976123926784:12345-192.168.202.51@tcp:101:cat.0 Request processed in 121us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.728377:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12458 00000100:00100000:3.0:1746155573.728721:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29356:x1830976123926656:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 527us (619us total) trans 8589944068 rc 0/0 00000100:00100000:3.0:1746155573.728727:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4099 00000100:00100000:2.0:1746155573.738023:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123926400:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 9779us (10072us total) trans 21474840651 rc 0/0 00000100:00100000:2.0:1746155573.738034:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 778 00002000:00100000:2.0:1746155573.738044:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3366912->3817471) req@ffff88009aca8000 x1830976123926400/t21474840651(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/448 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.738052:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aca8000 with x1830976123926400 ext(3366912->3817471) 00010000:00010000:2.0:1746155573.738062:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.738075:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.738081:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aca8000 00000100:00100000:0.0:1746155573.741172:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.741292:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123926912 00000100:00100000:3.0:1746155573.741300:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123926912 00010000:00010000:3.0:1746155573.741550:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.741587:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6286 00000100:00100000:3.0:1746155573.741594:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123926912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155573.741607:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155573.741623:0:7063:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155573 -> 1746155574 00002000:00010000:3.0:1746155573.741626:0:7063:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155573 -> 1746155574 00010000:00010000:3.0:1746155573.741630:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.741641:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.741661:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107a00/0x844e5faceb5ec94e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3366912->3817471) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11899 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.741679:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.741680:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.741687:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.741694:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.741701:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.741702:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.741705:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a7 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.741711:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a7 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.741736:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a7 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155573.741787:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124645120:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155573.741871:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.741882:0:7063:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 25 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.741894:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124645248:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155573.741914:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155573.742915:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124645120:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155573.744134:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124645248:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155573.744150:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.744193:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123926912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2598us (3027us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.744202:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6286 00000100:00100000:0.0:1746155573.745055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.745098:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123927168 00000100:00100000:2.0:1746155573.745104:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123927168 00002000:00100000:2.0:1746155573.745130:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3121152->3125247) req@ffff88009aca9180 x1830976123927168/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.745139:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aca9180 with x1830976123927168 ext(3121152->3125247) 00010000:00010000:2.0:1746155573.745146:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 26 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.745157:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 26 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.745163:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aca9180 00000100:00100000:2.0:1746155573.745184:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 779 00000100:00100000:2.0:1746155573.745190:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123927168:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155573.745316:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123927168:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 125us (263us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155573.745322:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 779 00002000:00100000:2.0:1746155573.745327:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3121152->3125247) req@ffff88009aca9180 x1830976123927168/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.745333:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aca9180 with x1830976123927168 ext(3121152->3125247) 00010000:00010000:2.0:1746155573.745337:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 26 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.745345:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 26 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.745349:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aca9180 00000100:00100000:0.0:1746155573.748615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.748696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.748733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.748743:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123927552 00000100:00100000:0.0:1746155573.748749:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123927424 00000100:00100000:1.0:1746155573.748751:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123927552 00000100:00100000:0.0:1746155573.748752:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123927424 00002000:00100000:0.0:1746155573.748782:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3121152->3145727) req@ffff88009aca9500 x1830976123927424/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746155573.748783:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12459 00000100:00100000:1.0:1746155573.748790:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29364:x1830976123927552:12345-192.168.202.51@tcp:101:multiop.0 00002000:00100000:0.0:1746155573.748790:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aca9500 with x1830976123927424 ext(3121152->3145727) 00010000:00010000:0.0:1746155573.748797:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 26 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.748801:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155573.748809:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 26 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:1.0:1746155573.748814:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118b5 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155573.748815:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aca9500 00000100:00100000:0.0:1746155573.748828:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123927808 00000100:00100000:0.0:1746155573.748831:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123927808 00010000:00010000:1.0:1746155573.748836:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11814 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.748844:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb88800/0x844e5faceb5ec8a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11845 expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155573.748851:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f487400/0x844e5faceb5ec89f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11837 expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746155573.748856:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009aca9c00 x1830976123927808/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746155573.748857:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.748858:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.748861:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->2551807] (req 2097152->2551807) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746155573.748863:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aca9c00 with x1830976123927808 ext(3145728->4194303) 00002000:00010000:0.0:1746155573.748865:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aca9c00 00000100:00100000:0.0:1746155573.748887:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 780 00010000:00010000:1.0:1746155573.748889:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f487400/0x844e5faceb5ec89f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11837 expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155573.748893:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123927424:12345-192.168.202.51@tcp:4:multiop.0 00010000:00010000:1.0:1746155573.748898:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f487400/0x844e5faceb5ec89f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11837 expref: 23 pid: 4461 timeout: 802 lvb_type: 1 00000100:00100000:1.0:1746155573.748909:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124645376:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155573.748979:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb88800/0x844e5faceb5ec8a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11845 expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155573.748979:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4840 00000100:00100000:0.0:1746155573.748984:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1963:x1830976123927808:12345-192.168.202.51@tcp:3:multiop.0 00010000:00010000:1.0:1746155573.748987:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb88800/0x844e5faceb5ec8a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11845 expref: 10 pid: 20796 timeout: 802 lvb_type: 1 00000100:00100000:1.0:1746155573.748996:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124645504:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155573.749022:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11814 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.749030:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11814 expref: 31 pid: 4461 timeout: 802 lvb_type: 0 00000100:00100000:1.0:1746155573.749037:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124645632:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155573.749053:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.752819:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124645376:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.753018:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123927424:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 4124us (4407us total) trans 21474840652 rc 0/0 00000100:00100000:2.0:1746155573.753027:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 780 00002000:00100000:2.0:1746155573.753035:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3121152->3145727) req@ffff88009aca9500 x1830976123927424/t21474840652(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/448 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.753044:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aca9500 with x1830976123927424 ext(3121152->3145727) 00010000:00010000:2.0:1746155573.753052:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 30 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.753062:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 30 pid: 1625 timeout: 802 lvb_type: 0 00002000:00010000:2.0:1746155573.753068:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aca9500 00000100:00100000:0.0:1746155573.753414:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.753467:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123927936 00000100:00100000:3.0:1746155573.753473:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123927936 00010000:00010000:3.0:1746155573.753496:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb88800/0x844e5faceb5ec8a6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11845 expref: 11 pid: 20796 timeout: 802 lvb_type: 1 00000100:00100000:3.0:1746155573.753549:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6287 00000100:00100000:3.0:1746155573.753555:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123927936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155573.753567:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155573.753582:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb88800/0x844e5faceb5ec8a6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11845 expref: 11 pid: 20796 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746155573.753591:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb88800/0x844e5faceb5ec8a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11845 expref: 11 pid: 20796 timeout: 802 lvb_type: 1 00010000:00010000:3.0:1746155573.753610:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.753640:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123927936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.753646:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6287 00010000:00010000:2.0:1746155573.753733:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb88800/0x844e5faceb5ec8a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11845 expref: 10 pid: 20796 timeout: 802 lvb_type: 1 00000100:00100000:2.0:1746155573.753753:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124645504:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.756889:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094087480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124645632:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.756920:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->2551807] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.756934:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68b200, rc 0) 00000100:00100000:2.0:1746155573.756968:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29364:x1830976123927552:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8178us (8271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.756975:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12459 00000100:00100000:0.0:1746155573.758031:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.758049:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123928064 00000100:00100000:0.0:1746155573.758055:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123928064 00010000:00010000:0.0:1746155573.758078:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f487400/0x844e5faceb5ec89f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11837 expref: 23 pid: 4461 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746155573.758114:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6288 00000100:00100000:0.0:1746155573.758121:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123928064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155573.758133:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155573.758149:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f487400/0x844e5faceb5ec89f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11837 expref: 23 pid: 4461 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746155573.758159:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f487400/0x844e5faceb5ec89f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11837 expref: 23 pid: 4461 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746155573.758177:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f487400/0x844e5faceb5ec89f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11837 expref: 23 pid: 4461 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746155573.758200:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155573.758219:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1960:x1830976123928064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 98us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155573.758224:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6288 00000100:00100000:2.0:1746155573.758426:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1963:x1830976123927808:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9440us (9691us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155573.758434:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4840 00002000:00100000:2.0:1746155573.758441:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009aca9c00 x1830976123927808/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.758449:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aca9c00 with x1830976123927808 ext(3145728->4194303) 00002000:00010000:2.0:1746155573.758453:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aca9c00 00000100:00100000:2.0:1746155573.759458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.759691:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123928192 00000100:00100000:0.0:1746155573.759695:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123928192 00010000:00010000:0.0:1746155573.759708:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746155573.759737:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6289 00000100:00100000:0.0:1746155573.759742:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123928192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155573.759750:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155573.759761:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.759770:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.759785:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa800/0x844e5faceb5ec955 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3121152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a0 expref: 28 pid: 1625 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746155573.759794:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155573.759795:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155573.759801:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ae expref: 26 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.759807:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ae expref: 26 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.759832:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ae expref: 26 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155573.759842:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aca8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124645760:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155573.760647:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.764062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.764140:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.764641:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123928448 00000100:00100000:2.0:1746155573.764648:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123928448 00000100:00100000:2.0:1746155573.764685:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12460 00000100:00100000:2.0:1746155573.764692:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29359:x1830976123928448:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155573.764706:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.764720:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb88600/0x844e5faceb5ec971 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118bc expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.764739:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.764741:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.764748:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb88600/0x844e5faceb5ec971 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118bc expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.764760:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb88600/0x844e5faceb5ec971 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118bc expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.764769:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb88600, rc 0) 00000100:00100000:2.0:1746155573.764807:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29359:x1830976123928448:12345-192.168.202.51@tcp:101:cat.0 Request processed in 116us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.764813:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12460 00000100:00100000:2.0:1746155573.764834:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123928320 00000100:00100000:2.0:1746155573.764837:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123928320 00010000:00010000:2.0:1746155573.764848:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11814 expref: 32 pid: 4461 timeout: 802 lvb_type: 0 00000100:00100000:2.0:1746155573.764865:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6290 00000100:00100000:2.0:1746155573.764869:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123928320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155573.764877:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155573.764894:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11814 expref: 32 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.764903:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11814 expref: 32 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.764917:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131004600/0x844e5faceb5ec86e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11814 expref: 32 pid: 4461 timeout: 802 lvb_type: 0 00010000:00010000:2.0:1746155573.764929:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.764930:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.764934:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.764941:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.764964:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155573.764978:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124645888:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155573.765017:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155573.765098:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aca8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124645760:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155573.765114:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155573.765140:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123928192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5398us (5683us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.765145:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6289 00000100:00100000:0.0:1746155573.768046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.768166:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124645888:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155573.768176:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123928704 00000100:00100000:2.0:1746155573.768182:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123928704 00010000:00010000:3.0:1746155573.768184:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746155573.768216:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009acaa680 x1830976123928704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155573.768219:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123928320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3347us (4163us total) trans 0 rc 0/0 00002000:00100000:2.0:1746155573.768224:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acaa680 with x1830976123928704 ext(2097152->3145727) 00000100:00100000:3.0:1746155573.768227:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6290 00002000:00010000:2.0:1746155573.768229:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acaa680 00000100:00100000:2.0:1746155573.768244:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4841 00000100:00100000:2.0:1746155573.768251:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123928704:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155573.771167:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.771217:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123928960 00000100:00100000:3.0:1746155573.771224:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123928960 00002000:00100000:3.0:1746155573.771256:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009acaaa00 x1830976123928960/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.771265:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acaaa00 with x1830976123928960 ext(3145728->4194303) 00002000:00010000:3.0:1746155573.771269:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009acaaa00 00000100:00100000:3.0:1746155573.771791:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4842 00000100:00100000:3.0:1746155573.771800:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123928960:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155573.774712:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.777158:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123929216 00000100:00100000:3.0:1746155573.777169:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123929216 00002000:00100000:3.0:1746155573.777212:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2547712->2551807) req@ffff880095269c00 x1830976123929216/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.777222:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269c00 with x1830976123929216 ext(2547712->2551807) 00002000:00010000:3.0:1746155573.777227:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095269c00 00000100:00100000:3.0:1746155573.777259:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4843 00000100:00100000:3.0:1746155573.777267:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123929216:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155573.777573:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123928704:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9321us (9530us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155573.777579:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4841 00002000:00100000:2.0:1746155573.777584:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009acaa680 x1830976123928704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.777591:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acaa680 with x1830976123928704 ext(2097152->3145727) 00002000:00010000:2.0:1746155573.777594:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acaa680 00000100:00100000:3.0:1746155573.777893:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123929216:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 626us (3188us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155573.777900:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4843 00002000:00100000:3.0:1746155573.777904:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2547712->2551807) req@ffff880095269c00 x1830976123929216/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.777911:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269c00 with x1830976123929216 ext(2547712->2551807) 00002000:00010000:3.0:1746155573.777913:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095269c00 00000100:00100000:3.0:1746155573.780827:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123928960:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9021us (9659us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155573.780838:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4842 00002000:00100000:3.0:1746155573.780846:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009acaaa00 x1830976123928960/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.780855:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acaaa00 with x1830976123928960 ext(3145728->4194303) 00002000:00010000:3.0:1746155573.780859:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009acaaa00 00000100:00100000:0.0:1746155573.791724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.791996:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123929344 00000100:00100000:0.0:1746155573.792000:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.792004:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123929344 00000100:00100000:0.0:1746155573.792031:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.792220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.792248:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123929472 00000100:00100000:2.0:1746155573.792251:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123929472 00000100:00100000:3.0:1746155573.792256:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123929600 00000100:00100000:3.0:1746155573.792261:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123929600 00000100:00100000:2.0:1746155573.792268:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123929728 00000100:00100000:2.0:1746155573.792270:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123929728 00000100:00100000:3.0:1746155573.792291:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12461 00000100:00100000:3.0:1746155573.792301:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29363:x1830976123929344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.792317:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155573.792334:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118c3 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.792357:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.792364:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.792366:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155573.792368:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118c3 expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155573.792375:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12462 00000100:00100000:0.0:1746155573.792380:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12463 00000100:00100000:2.0:1746155573.792382:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1963:x1830976123929472:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155573.792385:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1962:x1830976123929600:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155573.792390:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.792390:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155573.792391:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.792398:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e2b800/0x844e5faceb5ec97f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118ca expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.792398:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5ec986 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118d1 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.792399:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 23 pid: 20796 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.792408:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124646016:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.792410:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155573.792410:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.792411:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155573.792411:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.792417:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e2b800/0x844e5faceb5ec97f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ca expref: 30 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155573.792417:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5ec986 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118d1 expref: 30 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.792429:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e2b800/0x844e5faceb5ec97f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ca expref: 30 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155573.792429:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5ec986 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118d1 expref: 30 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.792437:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e2b800, rc 0) 00010000:00010000:0.0:1746155573.792437:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9577a00, rc 0) 00000100:00100000:0.0:1746155573.792458:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1962:x1830976123929600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 72us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155573.792463:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12463 00000100:00100000:3.0:1746155573.792467:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.792477:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12464 00000100:00100000:0.0:1746155573.792482:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123929728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155573.792488:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155573.792493:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9577600/0x844e5faceb5ec98d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118d8 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155573.792542:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9577600/0x844e5faceb5ec98d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118d8 expref: 24 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155573.792550:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9577600/0x844e5faceb5ec98d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118d8 expref: 24 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155573.792565:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9577600, rc 0) 00000100:00100000:2.0:1746155573.792676:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1963:x1830976123929472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 294us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.792681:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12462 00000100:00100000:0.0:1746155573.792708:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976123929728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 226us (489us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155573.792713:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12464 00000100:00100000:3.0:1746155573.796482:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124646016:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155573.796540:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118c3 expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.796556:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6021200, rc 0) 00000100:00100000:3.0:1746155573.796593:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29363:x1830976123929344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4295us (4878us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.796601:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12461 00000100:00100000:0.0:1746155573.798909:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.798951:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.799081:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123929856 00000100:00100000:3.0:1746155573.799089:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123929856 00002000:00100000:3.0:1746155573.799120:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2551807) req@ffff88009acabb80 x1830976123929856/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746155573.799122:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123930112 00000100:00100000:2.0:1746155573.799126:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123930112 00002000:00100000:3.0:1746155573.799128:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acabb80 with x1830976123929856 ext(2097152->2551807) 00010000:00010000:3.0:1746155573.799134:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 23 pid: 20796 timeout: 802 lvb_type: 0 00002000:00100000:2.0:1746155573.799143:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009aca8e00 x1830976123930112/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746155573.799146:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 23 pid: 20796 timeout: 802 lvb_type: 0 00002000:00100000:2.0:1746155573.799149:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aca8e00 with x1830976123930112 ext(4194304->4956159) 00002000:00010000:3.0:1746155573.799152:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009acabb80 00002000:00010000:2.0:1746155573.799152:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aca8e00 00000100:00100000:3.0:1746155573.799195:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 781 00000100:00100000:3.0:1746155573.799202:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123929856:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155573.799203:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4844 00000100:00100000:2.0:1746155573.799206:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1962:x1830976123930112:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155573.807099:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1962:x1830976123930112:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7883us (8139us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155573.807108:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4844 00002000:00100000:2.0:1746155573.807118:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009aca8e00 x1830976123930112/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.807127:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aca8e00 with x1830976123930112 ext(4194304->4956159) 00002000:00010000:2.0:1746155573.807133:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aca8e00 00000100:00100000:3.0:1746155573.807675:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123929856:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8472us (8771us total) trans 17179873262 rc 0/0 00000100:00100000:3.0:1746155573.807682:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 781 00002000:00100000:3.0:1746155573.807687:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->2551807) req@ffff88009acabb80 x1830976123929856/t17179873262(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:644/0 lens 488/448 e 0 to 0 dl 1746155584 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.807694:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acabb80 with x1830976123929856 ext(2097152->2551807) 00010000:00010000:3.0:1746155573.807701:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 25 pid: 20796 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.807712:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 25 pid: 20796 timeout: 802 lvb_type: 0 00002000:00010000:3.0:1746155573.807718:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009acabb80 00000100:00100000:0.0:1746155573.809956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.810056:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123930240 00000100:00100000:3.0:1746155573.810063:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123930240 00010000:00010000:3.0:1746155573.810089:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 25 pid: 20796 timeout: 802 lvb_type: 0 00000100:00100000:3.0:1746155573.810127:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6291 00000100:00100000:3.0:1746155573.810135:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123930240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155573.810146:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155573.810160:0:7063:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155573 -> 1746155574 00010000:00010000:3.0:1746155573.810166:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 25 pid: 20796 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.810175:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 25 pid: 20796 timeout: 802 lvb_type: 0 00010000:00010000:3.0:1746155573.810195:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b200/0x844e5faceb5ec96a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2551807) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118b5 expref: 25 pid: 20796 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746155573.810200:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155573.810217:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.810219:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155573.810225:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118c3 expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.810232:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118c3 expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155573.810263:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118c3 expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155573.810273:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124646144:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155573.810291:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123930368 00000100:00100000:2.0:1746155573.810295:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123930368 00000100:00100000:2.0:1746155573.810323:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12465 00000100:00100000:2.0:1746155573.810329:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123930368:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155573.810342:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.810351:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e2b600/0x844e5faceb5ec994 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118df expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.810363:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.810364:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.810369:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e2b600/0x844e5faceb5ec994 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118df expref: 26 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.810379:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e2b600/0x844e5faceb5ec994 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118df expref: 26 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.810392:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e2b600, rc 0) 00000100:00100000:2.0:1746155573.810645:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123930368:12345-192.168.202.51@tcp:101:cat.0 Request processed in 314us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.810650:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12465 00000100:00100000:3.0:1746155573.810701:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effa80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155573.817306:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976124646144:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155573.817331:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.817367:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123930240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7232us (7417us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.817377:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6291 00000100:00100000:0.0:1746155573.820387:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.820434:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.820471:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.820546:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123930624 00000100:00100000:2.0:1746155573.820546:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123930880 00000100:00100000:3.0:1746155573.820553:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123930624 00000100:00100000:2.0:1746155573.820553:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123930880 00002000:00100000:3.0:1746155573.820591:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880090d84a80 x1830976123930624/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.820599:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d84a80 with x1830976123930624 ext(2097152->3145727) 00002000:00010000:3.0:1746155573.820603:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090d84a80 00000100:00100000:3.0:1746155573.820617:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123931136 00000100:00100000:3.0:1746155573.820619:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123931136 00000100:00100000:0.0:1746155573.820654:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4845 00000100:00100000:0.0:1746155573.820662:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123930624:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:2.0:1746155573.821259:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009fb78000 x1830976123930880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.821267:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb78000 with x1830976123930880 ext(3145728->4194303) 00002000:00010000:2.0:1746155573.821269:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb78000 00000100:00100000:2.0:1746155573.821290:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4846 00000100:00100000:2.0:1746155573.821296:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123930880:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:3.0:1746155573.822540:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009fb78380 x1830976123931136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.822548:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb78380 with x1830976123931136 ext(3145728->4194303) 00002000:00010000:3.0:1746155573.822551:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb78380 00000100:00100000:3.0:1746155573.822564:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4847 00000100:00100000:3.0:1746155573.822571:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123931136:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155573.832445:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123930624:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11776us (12056us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155573.832454:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4845 00002000:00100000:2.0:1746155573.832464:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880090d84a80 x1830976123930624/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.832471:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090d84a80 with x1830976123930624 ext(2097152->3145727) 00002000:00010000:2.0:1746155573.832476:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090d84a80 00000100:00100000:2.0:1746155573.834400:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123930880:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13096us (13957us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155573.834409:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4846 00002000:00100000:2.0:1746155573.834416:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009fb78000 x1830976123930880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155573.834424:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb78000 with x1830976123930880 ext(3145728->4194303) 00002000:00010000:2.0:1746155573.834428:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb78000 00000100:00100000:3.0:1746155573.837948:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123931136:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15369us (17467us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155573.837958:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4847 00002000:00100000:3.0:1746155573.837967:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009fb78380 x1830976123931136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.837975:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb78380 with x1830976123931136 ext(3145728->4194303) 00002000:00010000:3.0:1746155573.837980:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb78380 00000100:00100000:1.0:1746155573.844690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.844801:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123931392 00000100:00100000:3.0:1746155573.844810:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123931392 00002000:00100000:3.0:1746155573.844846:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880094087480 x1830976123931392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.844856:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087480 with x1830976123931392 ext(4194304->4956159) 00002000:00010000:3.0:1746155573.844860:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094087480 00000100:00100000:3.0:1746155573.845292:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4848 00000100:00100000:3.0:1746155573.845299:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123931392:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155573.854990:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976123931392:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9683us (10301us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155573.854999:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4848 00002000:00100000:3.0:1746155573.855008:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880094087480 x1830976123931392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/440 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.855017:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087480 with x1830976123931392 ext(4194304->4956159) 00002000:00010000:3.0:1746155573.855021:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094087480 00000100:00100000:0.0:1746155573.859143:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.859355:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123931648 00000100:00100000:1.0:1746155573.859363:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123931648 00000100:00100000:1.0:1746155573.859420:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10099 00000100:00100000:1.0:1746155573.859428:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:29370:x1830976123931648:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155573.859450:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155573.859470:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cec00/0x844e5faceb5ec99b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118e6 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.859626:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ec9a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.859638:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ec9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.859650:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ec9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.859663:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf400/0x844e5faceb5ec9a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.859668:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf400/0x844e5faceb5ec9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.859673:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf400/0x844e5faceb5ec9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.860491:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ec9b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.860499:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ec9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.860530:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ec9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155573.860538:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155573.860605:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ec9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.860610:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ec9a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.860615:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ec9a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.860619:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1cf200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155573.860622:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ec9a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.860626:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ec9a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.860634:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155573.860636:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155573.860639:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ec9a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.860643:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ec9a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.861788:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf400/0x844e5faceb5ec9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.861797:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf400/0x844e5faceb5ec9a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.861802:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf400/0x844e5faceb5ec9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.861806:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1cf400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155573.861809:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf400/0x844e5faceb5ec9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.861813:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf400/0x844e5faceb5ec9a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.861822:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51000) 00010000:00010000:1.0:1746155573.861824:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155573.861827:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf400/0x844e5faceb5ec9a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.861831:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf400/0x844e5faceb5ec9a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.861879:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cec00/0x844e5faceb5ec99b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118e6 expref: 300 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.861890:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ec9b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118e6 expref: 299 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.861895:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155573.861898:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155573.861900:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1cf600, rc 0) 00000100:00100000:1.0:1746155573.861960:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:29370:x1830976123931648:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2531us (2822us total) trans 8589944069 rc 0/0 00000100:00100000:1.0:1746155573.861967:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10099 00000100:00100000:0.0:1746155573.875036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.875211:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123931776 00000100:00100000:2.0:1746155573.875218:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123931776 00000100:00100000:2.0:1746155573.875261:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12466 00000100:00100000:2.0:1746155573.875267:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29370:x1830976123931776:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155573.875282:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.875295:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118ed expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.875320:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118c3 expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.875331:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e2b600/0x844e5faceb5ec994 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118df expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.875337:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.875338:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.875341:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 33 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.875366:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e2b600/0x844e5faceb5ec994 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118df expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.875376:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e2b600/0x844e5faceb5ec994 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118df expref: 24 pid: 20796 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155573.875387:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124646272:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.875486:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118c3 expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.875494:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118c3 expref: 33 pid: 20796 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155573.875536:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124646400:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.875906:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155573.877451:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124646272:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.877462:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124646400:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.877484:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 33 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.877497:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e2b400, rc 0) 00000100:00100000:2.0:1746155573.877564:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:29370:x1830976123931776:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2296us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.877571:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12466 00000100:00100000:0.0:1746155573.878813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.878883:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123931904 00000100:00100000:3.0:1746155573.878890:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123931904 00010000:00010000:3.0:1746155573.878913:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e2b600/0x844e5faceb5ec994 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118df expref: 25 pid: 20796 timeout: 803 lvb_type: 1 00000100:00100000:3.0:1746155573.878945:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6292 00000100:00100000:3.0:1746155573.878952:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123931904:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155573.878962:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155573.878980:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e2b600/0x844e5faceb5ec994 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118df expref: 25 pid: 20796 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155573.878990:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e2b600/0x844e5faceb5ec994 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118df expref: 25 pid: 20796 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155573.879013:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e2b600/0x844e5faceb5ec994 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118df expref: 25 pid: 20796 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155573.879027:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.879048:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123931904:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.879053:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6292 00000100:00100000:0.0:1746155573.882253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.882341:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123932032 00000100:00100000:1.0:1746155573.882350:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123932032 00010000:00010000:1.0:1746155573.882377:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118c3 expref: 33 pid: 20796 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155573.882413:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6293 00000100:00100000:1.0:1746155573.882421:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123932032:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155573.882431:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155573.882449:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118c3 expref: 33 pid: 20796 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155573.882459:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118c3 expref: 33 pid: 20796 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155573.882476:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6021200/0x844e5faceb5ec978 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118c3 expref: 33 pid: 20796 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155573.882530:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.882532:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155573.882538:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 32 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.882544:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 32 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.882571:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 32 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155573.882581:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124646528:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155573.882652:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155573.884379:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124646528:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155573.884392:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155573.884416:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123932032:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1997us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.884423:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6293 00000100:00100000:0.0:1746155573.884723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.884760:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123932288 00000100:00100000:3.0:1746155573.884765:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123932288 00002000:00100000:3.0:1746155573.885141:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3018752->3022847) req@ffff88009fb79500 x1830976123932288/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.885149:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb79500 with x1830976123932288 ext(3018752->3022847) 00002000:00010000:3.0:1746155573.885152:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb79500 00000100:00100000:3.0:1746155573.885177:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4849 00000100:00100000:3.0:1746155573.885184:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123932288:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155573.886736:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123932288:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1548us (2009us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155573.886744:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4849 00002000:00100000:3.0:1746155573.886751:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3018752->3022847) req@ffff88009fb79500 x1830976123932288/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.886764:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb79500 with x1830976123932288 ext(3018752->3022847) 00002000:00010000:3.0:1746155573.886768:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb79500 00000100:00100000:0.0:1746155573.892773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.892856:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123932416 00000100:00100000:2.0:1746155573.892863:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123932416 00000100:00100000:2.0:1746155573.892894:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12467 00000100:00100000:2.0:1746155573.892899:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29370:x1830976123932416:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155573.892913:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155573.892926:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118f4 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.892951:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ae expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.892959:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5ec986 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118d1 expref: 28 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.892964:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a7 expref: 28 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.892969:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155573.892971:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155573.892974:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->3256319] (req 3145728->3256319) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.892995:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a7 expref: 28 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.893004:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a7 expref: 28 pid: 4461 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155573.893013:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124646656:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.893098:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5ec986 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118d1 expref: 28 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155573.893105:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5ec986 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118d1 expref: 28 pid: 29728 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155573.893112:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124646784:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.893132:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ae expref: 28 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.893139:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ae expref: 28 pid: 1625 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155573.893145:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124646912:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.893156:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155573.896206:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.896307:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123932544 00000100:00100000:1.0:1746155573.896313:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123932544 00010000:00010000:1.0:1746155573.896340:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a7 expref: 29 pid: 4461 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155573.896373:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6294 00000100:00100000:1.0:1746155573.896379:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123932544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155573.896389:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155573.896405:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a7 expref: 29 pid: 4461 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155573.896415:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a7 expref: 29 pid: 4461 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155573.896439:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155573.896475:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123932544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 97us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155573.896480:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6294 00010000:00010000:2.0:1746155573.896568:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb88200/0x844e5faceb5ec95c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118a7 expref: 28 pid: 4461 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155573.896596:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124646656:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.896610:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124646784:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155573.896617:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124646912:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155573.896640:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->3256319] (req 3145728->3256319) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.896649:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e2ac00, rc 0) 00000100:00100000:2.0:1746155573.896667:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:29370:x1830976123932416:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3768us (3902us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155573.896673:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12467 00000100:00100000:0.0:1746155573.897952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155573.897994:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155573.898204:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123932672 00000100:00100000:2.0:1746155573.898209:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123932672 00010000:00010000:2.0:1746155573.898224:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5ec986 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118d1 expref: 28 pid: 29728 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155573.898339:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123932800 00000100:00100000:2.0:1746155573.898342:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123932800 00010000:00010000:2.0:1746155573.898352:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ae expref: 28 pid: 1625 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746155573.898384:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6295 00000100:00100000:3.0:1746155573.898392:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1960:x1830976123932672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155573.898402:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155573.898416:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5ec986 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118d1 expref: 28 pid: 29728 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155573.898425:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5ec986 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118d1 expref: 28 pid: 29728 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155573.898439:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a9577a00/0x844e5faceb5ec986 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118d1 expref: 28 pid: 29728 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155573.898542:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6296 00000100:00100000:2.0:1746155573.898549:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976123932800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155573.898557:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155573.898566:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ae expref: 28 pid: 1625 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155573.898575:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ae expref: 28 pid: 1625 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155573.898586:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e68aa00/0x844e5faceb5ec963 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ae expref: 28 pid: 1625 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155573.898596:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.898597:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155573.898603:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 27 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.898611:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 27 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155573.898636:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 27 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155573.898647:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124647040:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155573.898941:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155573.899112:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155573.899193:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1960:x1830976123932672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 801us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.899199:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6295 00000100:00100000:3.0:1746155573.900800:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124647040:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155573.900815:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155573.900842:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123932800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2292us (2846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155573.900848:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6296 00000100:00100000:0.0:1746155573.902437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.902534:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123933056 00000100:00100000:3.0:1746155573.902541:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123933056 00002000:00100000:3.0:1746155573.902571:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3252224->3256319) req@ffff88009fb7a300 x1830976123933056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/0 e 0 to 0 dl 1746155584 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.902581:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb7a300 with x1830976123933056 ext(3252224->3256319) 00002000:00010000:3.0:1746155573.902585:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb7a300 00000100:00100000:3.0:1746155573.902737:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4850 00000100:00100000:3.0:1746155573.902745:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123933056:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155573.902883:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976123933056:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 138us (448us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155573.902888:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4850 00002000:00100000:3.0:1746155573.902894:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3252224->3256319) req@ffff88009fb7a300 x1830976123933056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:644/0 lens 488/4536 e 0 to 0 dl 1746155584 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155573.902901:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb7a300 with x1830976123933056 ext(3252224->3256319) 00002000:00010000:3.0:1746155573.902903:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb7a300 00000100:00100000:0.0:1746155573.905037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155573.905190:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123933312 00000100:00100000:3.0:1746155573.905196:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123933312 00000100:00100000:3.0:1746155573.905235:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4100 00000100:00100000:3.0:1746155573.905242:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a651c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:29370:x1830976123933312:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155573.905394:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a651c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:29370:x1830976123933312:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 151us (359us total) trans 8589944070 rc 0/0 00000100:00100000:3.0:1746155573.905400:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4100 00000100:00100000:0.0:1746155573.995017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155573.997667:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123933568 00000100:00100000:1.0:1746155573.997677:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123933568 00000100:00100000:1.0:1746155573.997728:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10100 00000100:00100000:1.0:1746155573.997736:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:29375:x1830976123933568:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155573.997758:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155573.997772:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfa00/0x844e5faceb5ec9cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f118fb expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.997857:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ec9d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.997868:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ec9d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.997877:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ec9d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.997889:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ec9da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.997893:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ec9da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.997898:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ec9da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.997984:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ec9e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.997991:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ec9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.997996:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ec9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155573.998003:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155573.998064:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ec9d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998070:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ec9d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998075:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ec9d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998079:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1cfc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155573.998083:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ec9d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998088:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ec9d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998097:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155573.998100:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155573.998103:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ec9d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998108:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ec9d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998132:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ec9da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998136:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ec9da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998140:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ec9da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998144:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1cfe00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155573.998146:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ec9da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998150:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ec9da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998156:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51d00) 00010000:00010000:1.0:1746155573.998158:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155573.998160:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ec9da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998164:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ec9da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155573.998194:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfa00/0x844e5faceb5ec9cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118fb expref: 303 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.998204:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ec9e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118fb expref: 302 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155573.998209:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155573.998212:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155573.998214:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1cea00, rc 0) 00000100:00100000:1.0:1746155573.998259:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:29375:x1830976123933568:12345-192.168.202.51@tcp:101:cat.0 Request processed in 524us (3250us total) trans 8589944071 rc 0/0 00000100:00100000:1.0:1746155573.998265:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10100 00000100:00100000:0.0:1746155574.002147:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.006570:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.006831:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123933824 00000100:00100000:1.0:1746155574.006840:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123933824 00000100:00100000:1.0:1746155574.006900:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4101 00000100:00100000:1.0:1746155574.006908:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:29375:x1830976123933824:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155574.007080:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:29375:x1830976123933824:12345-192.168.202.51@tcp:35:cat.0 Request processed in 173us (4939us total) trans 8589944072 rc 0/0 00000100:00100000:1.0:1746155574.007087:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4101 00000100:00100000:3.0:1746155574.007266:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123933952 00000100:00100000:3.0:1746155574.007270:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123933952 00000100:00100000:3.0:1746155574.007310:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 607 00000100:00100000:3.0:1746155574.007316:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:1963:x1830976123933952:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.007326:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155574.007344:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ec9e1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118fb expref: 303 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.007360:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155574.007364:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.007383:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:1963:x1830976123933952:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 67us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.007388:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 607 00000100:00080000:0.0:1746155574.007649:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155574.019315:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.019369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.019844:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123934336 00000100:00100000:3.0:1746155574.019852:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123934336 00000100:00080000:0.0:1746155574.019930:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155574.019974:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123934208 00000100:00100000:2.0:1746155574.019978:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123934208 00000100:00100000:2.0:1746155574.020004:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10101 00000100:00100000:2.0:1746155574.020011:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29377:x1830976123934208:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155574.020030:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.020045:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b200/0x844e5faceb5ec9ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11902 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.020128:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b000/0x844e5faceb5ec9f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020139:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b000/0x844e5faceb5ec9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020147:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b000/0x844e5faceb5ec9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020157:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a200/0x844e5faceb5ec9fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020161:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a200/0x844e5faceb5ec9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020165:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a200/0x844e5faceb5ec9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020244:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a000/0x844e5faceb5eca04 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020251:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a000/0x844e5faceb5eca04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020256:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a000/0x844e5faceb5eca04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155574.020263:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155574.020325:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b000/0x844e5faceb5ec9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020331:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b000/0x844e5faceb5ec9f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020336:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b000/0x844e5faceb5ec9f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020340:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e2b000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155574.020343:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b000/0x844e5faceb5ec9f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020348:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b000/0x844e5faceb5ec9f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020355:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155574.020357:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155574.020360:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b000/0x844e5faceb5ec9f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020364:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b000/0x844e5faceb5ec9f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020379:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a200/0x844e5faceb5ec9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020384:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a200/0x844e5faceb5ec9fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020387:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a200/0x844e5faceb5ec9fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020391:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e2a200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155574.020393:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a200/0x844e5faceb5ec9fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020398:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a200/0x844e5faceb5ec9fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020407:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9200) 00010000:00010000:2.0:1746155574.020409:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155574.020411:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a200/0x844e5faceb5ec9fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020415:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a200/0x844e5faceb5ec9fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.020445:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b200/0x844e5faceb5ec9ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11902 expref: 22 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.020454:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a000/0x844e5faceb5eca04 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11902 expref: 21 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.020459:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155574.020461:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155574.020462:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e2a000, rc 0) 00000100:00100000:2.0:1746155574.020497:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29377:x1830976123934208:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 487us (1190us total) trans 8589944073 rc 0/0 00000100:00100000:2.0:1746155574.020541:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10101 00000100:00100000:3.0:1746155574.020773:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12468 00000100:00100000:3.0:1746155574.020780:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976123934336:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155574.020787:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.020796:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6020800/0x844e5faceb5eca12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11909 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.020811:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6020800/0x844e5faceb5eca12 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11909 expref: 33 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.020818:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6020800/0x844e5faceb5eca12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11909 expref: 33 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.020932:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6020800, rc 0) 00000100:00100000:3.0:1746155574.020953:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976123934336:12345-192.168.202.51@tcp:101:cat.0 Request processed in 174us (1584us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155574.020961:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12468 00000100:00100000:0.0:1746155574.026345:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.026425:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123934592 00000100:00100000:2.0:1746155574.026432:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123934592 00000100:00100000:2.0:1746155574.027356:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4102 00000100:00100000:2.0:1746155574.027369:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+21:29377:x1830976123934592:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155574.027731:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29377:x1830976123934592:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 366us (1390us total) trans 8589944074 rc 0/0 00000100:00100000:2.0:1746155574.027736:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4102 00000100:00100000:0.0:1746155574.041740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.041822:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123934848 00000100:00100000:1.0:1746155574.041831:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123934848 00000100:00100000:1.0:1746155574.041877:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10102 00000100:00100000:1.0:1746155574.041885:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:29379:x1830976123934848:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155574.041907:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.041922:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce000/0x844e5faceb5eca19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11910 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.042004:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042014:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042022:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042036:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5eca27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042041:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5eca27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042046:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5eca27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042130:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce600/0x844e5faceb5eca2e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042138:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce600/0x844e5faceb5eca2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042144:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce600/0x844e5faceb5eca2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155574.042151:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155574.042209:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042215:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042220:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042224:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1ce200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155574.042227:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042231:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042239:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155574.042242:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155574.042244:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.042248:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.043769:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5eca27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.043779:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5eca27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.043784:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5eca27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.043789:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1ce400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155574.043792:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5eca27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.043797:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5eca27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.043807:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51400) 00010000:00010000:1.0:1746155574.043809:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155574.043812:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5eca27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.043816:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5eca27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.043866:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce000/0x844e5faceb5eca19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11910 expref: 305 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.043881:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce600/0x844e5faceb5eca2e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11910 expref: 304 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.043887:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155574.043889:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155574.043891:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1ce600, rc 0) 00000100:00100000:1.0:1746155574.048575:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:29379:x1830976123934848:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6678us (6828us total) trans 8589944075 rc 0/0 00000100:00100000:1.0:1746155574.048586:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10102 00000100:00100000:0.0:1746155574.050353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.050483:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.050709:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123935104 00000100:00100000:3.0:1746155574.050717:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123935104 00002000:00100000:3.0:1746155574.050756:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009fb78e00 x1830976123935104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.050764:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb78e00 with x1830976123935104 ext(2097152->3145727) 00002000:00010000:3.0:1746155574.050769:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb78e00 00000100:00100000:3.0:1746155574.050792:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4851 00000100:00100000:3.0:1746155574.050799:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123935104:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155574.051630:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123935360 00000100:00100000:1.0:1746155574.051634:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123935360 00000100:00100000:1.0:1746155574.051665:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10103 00000100:00100000:1.0:1746155574.051671:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29382:x1830976123935360:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155574.051683:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.051698:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce800/0x844e5faceb5eca3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11917 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.051774:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.051785:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.051795:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.051805:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf800/0x844e5faceb5eca4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.051814:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf800/0x844e5faceb5eca4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.051818:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf800/0x844e5faceb5eca4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.051897:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfa00/0x844e5faceb5eca51 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.051905:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfa00/0x844e5faceb5eca51 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.051910:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfa00/0x844e5faceb5eca51 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155574.051918:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155574.051982:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.051988:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca43 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.051993:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.051997:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1ce200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155574.052000:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.052005:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca43 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.052014:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155574.052017:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155574.052020:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.052024:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce200/0x844e5faceb5eca43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.052032:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf800/0x844e5faceb5eca4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.052036:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf800/0x844e5faceb5eca4a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.052040:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf800/0x844e5faceb5eca4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.052043:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1cf800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155574.052045:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf800/0x844e5faceb5eca4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.052048:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf800/0x844e5faceb5eca4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.052052:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51a00) 00010000:00010000:1.0:1746155574.052054:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155574.052055:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf800/0x844e5faceb5eca4a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.052059:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf800/0x844e5faceb5eca4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.052085:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce800/0x844e5faceb5eca3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11917 expref: 25 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.052098:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfa00/0x844e5faceb5eca51 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11917 expref: 24 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.052103:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155574.052104:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155574.052106:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1cfa00, rc 0) 00000100:00100000:1.0:1746155574.052140:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29382:x1830976123935360:12345-192.168.202.51@tcp:101:cat.0 Request processed in 469us (1657us total) trans 8589944076 rc 0/0 00000100:00100000:1.0:1746155574.052145:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10103 00000100:00080000:0.0:1746155574.053000:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155574.053481:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.053631:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123935488 00000100:00100000:2.0:1746155574.053637:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123935488 00000100:00100000:2.0:1746155574.053679:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 608 00000100:00100000:2.0:1746155574.053688:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:1963:x1830976123935488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155574.053699:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.053716:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce600/0x844e5faceb5eca2e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11910 expref: 304 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.053735:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155574.053738:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155574.053770:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:1963:x1830976123935488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 82us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.053776:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 608 00000100:00100000:0.0:1746155574.057602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.057710:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123935616 00000100:00100000:2.0:1746155574.057717:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123935616 00000100:00100000:2.0:1746155574.057815:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10104 00000100:00100000:2.0:1746155574.057822:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29383:x1830976123935616:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155574.057841:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.057855:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b000/0x844e5faceb5eca5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1191e expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.057909:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a600/0x844e5faceb5eca66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.057919:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a600/0x844e5faceb5eca66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.057927:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a600/0x844e5faceb5eca66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.057942:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a400/0x844e5faceb5eca6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.057948:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a400/0x844e5faceb5eca6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.057953:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a400/0x844e5faceb5eca6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.058038:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.058048:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11892 expref: 23 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.058054:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.058078:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11892 expref: 23 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.058088:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11892 expref: 23 pid: 15474 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.058100:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124647168:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.060367:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.066483:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124647168:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.066612:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155574.069125:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.069409:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123935104:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18608us (19056us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155574.069419:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4851 00002000:00100000:3.0:1746155574.069428:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009fb78e00 x1830976123935104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.069436:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb78e00 with x1830976123935104 ext(2097152->3145727) 00002000:00010000:3.0:1746155574.069440:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb78e00 00000100:00100000:1.0:1746155574.069536:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123935744 00000100:00100000:1.0:1746155574.069542:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123935744 00010000:00010000:1.0:1746155574.069565:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11892 expref: 24 pid: 15474 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155574.069584:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6297 00000100:00100000:1.0:1746155574.069590:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123935744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155574.069600:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155574.069605:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11892 expref: 24 pid: 15474 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.069614:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11892 expref: 24 pid: 15474 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.069633:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946fbe00/0x844e5faceb5ec940 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11892 expref: 24 pid: 15474 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.069650:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155574.069655:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069662:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069668:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069684:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155574.069701:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123935744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 112us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.069707:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6297 00010000:00010000:1.0:1746155574.069732:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069738:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155574.069770:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:1.0:1746155574.069774:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155574.069785:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069793:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069800:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a600/0x844e5faceb5eca66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069805:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a600/0x844e5faceb5eca66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069810:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a600/0x844e5faceb5eca66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069815:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e2a600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155574.069818:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a600/0x844e5faceb5eca66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069823:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a600/0x844e5faceb5eca66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069830:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155574.069832:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155574.069835:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a600/0x844e5faceb5eca66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069839:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a600/0x844e5faceb5eca66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069848:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a400/0x844e5faceb5eca6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069852:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a400/0x844e5faceb5eca6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069856:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a400/0x844e5faceb5eca6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069860:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e2a400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155574.069861:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a400/0x844e5faceb5eca6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069866:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a400/0x844e5faceb5eca6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069874:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9900) 00010000:00010000:1.0:1746155574.069875:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155574.069877:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a400/0x844e5faceb5eca6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069881:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a400/0x844e5faceb5eca6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155574.069907:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2b000/0x844e5faceb5eca5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1191e expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.069917:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1191e expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.069922:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155574.069924:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155574.069926:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e2aa00, rc 0) 00000100:00100000:1.0:1746155574.069947:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29383:x1830976123935616:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 12125us (12352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.069952:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10104 00000100:00100000:0.0:1746155574.073732:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.073794:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123935872 00000100:00100000:3.0:1746155574.073801:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123935872 00000100:00100000:3.0:1746155574.073853:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 609 00000100:00100000:3.0:1746155574.073860:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976123935872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.073871:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155574.073883:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155574.073890:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cfa00/0x844e5faceb5eca51 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11917 expref: 23 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.073912:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155574.073916:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.073967:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976123935872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 107us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.073976:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 609 00000100:00100000:2.0:1746155574.074023:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123936000 00000100:00100000:2.0:1746155574.074027:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123936000 00000100:00080000:0.0:1746155574.074050:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155574.074062:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12469 00000100:00100000:2.0:1746155574.074068:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123936000:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155574.074081:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.074093:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2d9a00/0x844e5faceb5eca7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11925 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.074108:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.074110:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.074117:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2d9a00/0x844e5faceb5eca7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11925 expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.074128:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f2d9a00/0x844e5faceb5eca7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11925 expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.074137:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2d9a00, rc 0) 00000100:00100000:2.0:1746155574.074159:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123936000:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.074165:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12469 00000100:00100000:0.0:1746155574.075644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.075698:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123936256 00000100:00100000:1.0:1746155574.075703:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123936256 00000100:00100000:1.0:1746155574.075740:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4103 00000100:00100000:1.0:1746155574.075747:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+22:29382:x1830976123936256:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155574.075897:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29382:x1830976123936256:12345-192.168.202.51@tcp:35:cat.0 Request processed in 150us (258us total) trans 8589944077 rc 0/0 00000100:00100000:1.0:1746155574.075903:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4103 00000100:00100000:3.0:1746155574.078308:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.078345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.078668:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.078871:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123936384 00000100:00100000:1.0:1746155574.078877:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123936384 00000100:00100000:1.0:1746155574.078904:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123936512 00000100:00100000:1.0:1746155574.078906:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123936512 00000100:00100000:1.0:1746155574.078922:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123936640 00000100:00100000:1.0:1746155574.078923:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123936640 00000100:00100000:0.0:1746155574.078932:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12470 00000100:00100000:0.0:1746155574.078940:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123936384:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155574.078952:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155574.078966:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e68b600/0x844e5faceb5eca82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1192c expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155574.078973:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12471 00000100:00100000:1.0:1746155574.078978:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123936512:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155574.078989:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.078996:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5eca89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11933 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155574.079005:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124647296:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155574.079012:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5eca89 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11933 expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155574.079019:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5eca89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11933 expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155574.079026:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1cec00, rc 0) 00000100:00100000:1.0:1746155574.079042:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123936512:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 63us (697us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155574.079047:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12471 00000100:00100000:0.0:1746155574.079050:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155574.079058:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12472 00000100:00080000:0.0:1746155574.079061:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746155574.079062:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29375:x1830976123936640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155574.079067:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.079072:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1193a expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.079089:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 33 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.079095:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155574.079096:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155574.079099:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1193a expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.079114:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 33 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.079123:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 33 pid: 10591 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155574.079320:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124647424:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155574.079341:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00002000:00010000:0.0:1746155574.083410:0:29728:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155573 -> 1746155574 00000100:00100000:2.0:1746155574.083418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.083436:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124647296:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155574.083467:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e68b600/0x844e5faceb5eca82 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1192c expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.083481:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e68b600/0x844e5faceb5eca82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1192c expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.083542:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68b600, rc 0) 00000100:00100000:2.0:1746155574.083587:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.083590:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123936384:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4648us (5286us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155574.083597:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12470 00000100:00100000:0.0:1746155574.083619:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123936768 00000100:00100000:0.0:1746155574.083624:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123936768 00000100:00100000:0.0:1746155574.083663:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123936896 00000100:00100000:0.0:1746155574.083676:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123936896 00000100:00100000:0.0:1746155574.083697:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12473 00000100:00100000:0.0:1746155574.083705:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1963:x1830976123936768:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155574.083717:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155574.083729:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e68be00/0x844e5faceb5eca97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11941 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155574.083768:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124647552:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155574.083833:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155574.083965:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12474 00000100:00100000:3.0:1746155574.083974:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123936896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155574.083983:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.083994:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6021000/0x844e5faceb5eca9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11948 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.084012:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6021000/0x844e5faceb5eca9e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11948 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.084021:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6021000/0x844e5faceb5eca9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11948 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.084033:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6021000, rc 0) 00000100:00100000:3.0:1746155574.084055:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123936896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 83us (470us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155574.084060:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12474 00000100:00100000:0.0:1746155574.087934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.088012:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123937024 00000100:00100000:3.0:1746155574.088019:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123937024 00002000:00100000:3.0:1746155574.088053:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3018752->3145727) req@ffff8800a0ac5500 x1830976123937024/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.088061:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac5500 with x1830976123937024 ext(3018752->3145727) 00010000:00010000:3.0:1746155574.088069:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 34 pid: 10591 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.088081:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 34 pid: 10591 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746155574.088088:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0ac5500 00000100:00100000:3.0:1746155574.088104:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 782 00000100:00100000:3.0:1746155574.088110:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123937024:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155574.088656:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124647424:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155574.088678:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1193a expref: 35 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.088691:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1cee00, rc 0) 00000100:00100000:1.0:1746155574.089270:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:29375:x1830976123936640:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10205us (10599us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.089276:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12472 00000100:00100000:0.0:1746155574.090867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.090924:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124647552:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155574.090948:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e68be00/0x844e5faceb5eca97 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11941 expref: 28 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.090958:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e68be00/0x844e5faceb5eca97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11941 expref: 28 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.090966:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68be00, rc 0) 00000100:00100000:0.0:1746155574.091003:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1963:x1830976123936768:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7298us (7592us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155574.091009:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12473 00000100:00100000:2.0:1746155574.091109:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123937280 00000100:00100000:2.0:1746155574.091114:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123937280 00000100:00100000:2.0:1746155574.091143:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10105 00000100:00100000:2.0:1746155574.091150:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29383:x1830976123937280:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155574.091164:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.091176:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9800/0x844e5faceb5ecaa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1194f expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.091244:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.091254:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1191e expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.091260:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.091281:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1191e expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.091289:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1191e expref: 10 pid: 15474 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.091298:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124647680:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.091340:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c240 going to sleep for 11 seconds 00000100:00100000:3.0:1746155574.099711:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123937024:12345-192.168.202.51@tcp:4:cat.0 Request processed in 11592us (11777us total) trans 17179873263 rc 0/0 00000100:00100000:3.0:1746155574.099723:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 782 00002000:00100000:3.0:1746155574.099733:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3018752->3145727) req@ffff8800a0ac5500 x1830976123937024/t17179873263(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/448 e 0 to 0 dl 1746155585 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.099743:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac5500 with x1830976123937024 ext(3018752->3145727) 00010000:00010000:3.0:1746155574.099751:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 35 pid: 10591 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.099763:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 35 pid: 10591 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746155574.099769:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0ac5500 00000100:00100000:2.0:1746155574.102122:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124647680:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.102142:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155574.102437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.102553:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123937408 00000100:00100000:1.0:1746155574.102560:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123937408 00010000:00010000:1.0:1746155574.102586:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 35 pid: 10591 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155574.102636:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6298 00000100:00100000:1.0:1746155574.102646:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976123937408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155574.102659:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155574.102680:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 35 pid: 10591 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.102690:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 35 pid: 10591 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.102710:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e2b400/0x844e5faceb5ec9be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ed expref: 35 pid: 10591 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.102747:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.102750:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.102758:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1193a expref: 34 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.102766:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1193a expref: 34 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.102800:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1193a expref: 34 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155574.102812:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124647808:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155574.102890:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155574.104309:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124647808:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155574.104319:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155574.104338:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123937408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1695us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.104345:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6298 00000100:00100000:0.0:1746155574.104373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.104381:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123937536 00000100:00100000:0.0:1746155574.104384:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123937536 00010000:00010000:0.0:1746155574.104395:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1191e expref: 11 pid: 15474 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155574.104485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.104679:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6299 00000100:00100000:3.0:1746155574.104688:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123937536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.104696:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155574.104702:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1191e expref: 11 pid: 15474 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.104711:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1191e expref: 11 pid: 15474 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.104724:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2aa00/0x844e5faceb5eca74 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1191e expref: 11 pid: 15474 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.104739:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155574.104743:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.104750:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.104755:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.105035:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.105056:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123937536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 370us (682us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155574.105058:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155574.105062:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6299 00010000:00010000:2.0:1746155574.105066:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155574.105085:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000100:00100000:3.0:1746155574.105100:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123937792 00000100:00100000:3.0:1746155574.105103:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123937792 00002000:00100000:3.0:1746155574.105125:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012f1f3800 x1830976123937792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.105137:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3800 with x1830976123937792 ext(0->1048575) 00002000:00010000:3.0:1746155574.105141:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3800 00000100:00100000:3.0:1746155574.105152:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4852 00000100:00100000:3.0:1746155574.105157:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1962:x1830976123937792:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:2.0:1746155574.105223:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9800/0x844e5faceb5ecaa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1194f expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.105246:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1194f expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.105253:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155574.105255:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155574.105258:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2d9600, rc 0) 00000100:00100000:2.0:1746155574.105291:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29383:x1830976123937280:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 14139us (14424us total) trans 8589944078 rc 0/0 00000100:00100000:2.0:1746155574.105297:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10105 00000100:00100000:2.0:1746155574.116155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.116191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.116207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.116215:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123938048 00000100:00100000:2.0:1746155574.116219:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123938432 00000100:00100000:3.0:1746155574.116224:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123938048 00000100:00100000:2.0:1746155574.116224:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123938432 00002000:00100000:3.0:1746155574.116260:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880095269880 x1830976123938048/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.116260:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800935bf800 x1830976123938432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.116269:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269880 with x1830976123938048 ext(2097152->3145727) 00002000:00100000:2.0:1746155574.116269:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bf800 with x1830976123938432 ext(3145728->4194303) 00002000:00010000:3.0:1746155574.116274:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095269880 00002000:00010000:2.0:1746155574.116274:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935bf800 00000100:00100000:2.0:1746155574.116290:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4853 00000100:00100000:2.0:1746155574.116297:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1963:x1830976123938432:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155574.116307:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4854 00000100:00100000:3.0:1746155574.116312:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1963:x1830976123938048:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155574.116560:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123938176 00000100:00100000:0.0:1746155574.116563:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123938176 00000100:00100000:0.0:1746155574.116594:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10106 00000100:00100000:0.0:1746155574.116599:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29383:x1830976123938176:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155574.116612:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155574.116627:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b800/0x844e5faceb5ecaba lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11956 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.116683:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155574.116695:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1194f expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.116702:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155574.116722:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1194f expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.116732:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1194f expref: 11 pid: 15474 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746155574.116740:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124647936:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155574.116795:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.120622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.121472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.121984:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123938688 00000100:00100000:0.0:1746155574.121991:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123938688 00002000:00100000:0.0:1746155574.122025:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3256320->4194303) req@ffff8800935bfb80 x1830976123938688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155574.122035:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123938944 00002000:00100000:0.0:1746155574.122035:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bfb80 with x1830976123938688 ext(3256320->4194303) 00002000:00010000:0.0:1746155574.122039:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bfb80 00000100:00100000:3.0:1746155574.122040:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123938944 00000100:00100000:0.0:1746155574.122070:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4855 00000100:00100000:0.0:1746155574.122077:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123938688:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155574.122205:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4104 00000100:00100000:3.0:1746155574.122212:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:29379:x1830976123938944:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155574.122943:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:29379:x1830976123938944:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 730us (1471us total) trans 8589944079 rc 0/0 00000100:00100000:1.0:1746155574.122949:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.122950:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4104 00000100:00100000:3.0:1746155574.122971:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123939072 00000100:00100000:3.0:1746155574.122973:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123939072 00010000:00010000:3.0:1746155574.122987:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1194f expref: 12 pid: 15474 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746155574.123007:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6300 00000100:00100000:3.0:1746155574.123011:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123939072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.123019:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155574.123023:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1194f expref: 12 pid: 15474 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.123032:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1194f expref: 12 pid: 15474 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746155574.123044:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124647936:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155574.123047:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2d9600/0x844e5faceb5ecaac lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1194f expref: 12 pid: 15474 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.123058:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155574.123058:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.123062:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.123069:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.123075:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155574.124559:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.124560:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155574.124568:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155574.124593:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123939072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1579us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.124600:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6300 00010000:00010000:0.0:1746155574.124612:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:0.0:1746155574.124929:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:0.0:1746155574.124933:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155574.124944:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155574.124968:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b800/0x844e5faceb5ecaba lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11956 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.124985:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11956 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.124992:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155574.124995:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155574.124997:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68b600, rc 0) 00000100:00100000:0.0:1746155574.125017:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29383:x1830976123938176:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8418us (8825us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.125023:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10106 00000100:00100000:3.0:1746155574.125040:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1962:x1830976123937792:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19882us (20554us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155574.125051:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4852 00002000:00100000:3.0:1746155574.125058:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012f1f3800 x1830976123937792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.125067:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3800 with x1830976123937792 ext(0->1048575) 00002000:00010000:3.0:1746155574.125071:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3800 00000100:00100000:3.0:1746155574.129882:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1963:x1830976123938048:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13560us (13725us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155574.129893:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4854 00002000:00100000:3.0:1746155574.129902:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880095269880 x1830976123938048/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.129910:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269880 with x1830976123938048 ext(2097152->3145727) 00002000:00010000:3.0:1746155574.129919:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095269880 00000100:00100000:2.0:1746155574.130751:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123938432:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14453us (14541us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.130757:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4853 00002000:00100000:2.0:1746155574.130763:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800935bf800 x1830976123938432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.130770:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bf800 with x1830976123938432 ext(3145728->4194303) 00002000:00010000:2.0:1746155574.130773:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935bf800 00000100:00100000:0.0:1746155574.134076:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976123938688:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11991us (13453us total) trans 0 rc 937984/937984 00000100:00100000:0.0:1746155574.134085:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4855 00002000:00100000:0.0:1746155574.134094:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3256320->4194303) req@ffff8800935bfb80 x1830976123938688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 937984/937984 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155574.134103:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bfb80 with x1830976123938688 ext(3256320->4194303) 00002000:00010000:0.0:1746155574.134108:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bfb80 00000100:00100000:0.0:1746155574.137624:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.137663:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.137684:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123939328 00000100:00100000:2.0:1746155574.137692:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123939328 00002000:00100000:2.0:1746155574.137730:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800a0ac5c00 x1830976123939328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.137738:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac5c00 with x1830976123939328 ext(4194304->4956159) 00002000:00010000:2.0:1746155574.137743:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac5c00 00000100:00100000:2.0:1746155574.137774:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4856 00000100:00100000:2.0:1746155574.137781:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123939328:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155574.138365:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.138537:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123939456 00000100:00100000:1.0:1746155574.138541:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123939456 00000100:00100000:1.0:1746155574.138569:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123939584 00000100:00100000:1.0:1746155574.138572:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123939584 00000100:00100000:1.0:1746155574.138597:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12475 00000100:00100000:3.0:1746155574.138603:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12476 00000100:00100000:1.0:1746155574.138603:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123939456:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:3.0:1746155574.138611:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123939584:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155574.138612:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.138618:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.138625:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ebbde00/0x844e5faceb5ecac8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1195d expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.138626:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092835200/0x844e5faceb5ecacf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11964 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.138641:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155574.138643:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155574.138649:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092835200/0x844e5faceb5ecacf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11964 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.138662:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092835200/0x844e5faceb5ecacf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11964 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155574.138664:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124648064:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155574.138671:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092835200, rc 0) 00000100:00100000:3.0:1746155574.138762:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123939584:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 151us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.138767:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12476 00000100:00100000:1.0:1746155574.138901:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155574.141137:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124648064:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155574.141165:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ebbde00/0x844e5faceb5ecac8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1195d expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155574.141178:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ebbde00/0x844e5faceb5ecac8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1195d expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155574.141204:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebbde00, rc 0) 00000100:00100000:1.0:1746155574.141238:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123939456:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2634us (3573us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155574.141245:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12475 00000100:00100000:0.0:1746155574.141300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.141841:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123939712 00000100:00100000:1.0:1746155574.141847:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123939712 00000100:00100000:1.0:1746155574.141882:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12477 00000100:00100000:1.0:1746155574.141888:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+27:29382:x1830976123939712:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155574.141899:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.141909:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1196b expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.141927:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.141934:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155574.141935:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155574.141939:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1196b expref: 28 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.141959:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.141969:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 28 pid: 10591 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155574.141980:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124648192:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155574.142047:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.143655:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123939328:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 5870us (6034us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155574.143663:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4856 00002000:00100000:2.0:1746155574.143670:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800a0ac5c00 x1830976123939328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 761856/761856 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.143678:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac5c00 with x1830976123939328 ext(4194304->4956159) 00010000:00010000:2.0:1746155574.143684:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 27 pid: 10591 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.143699:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 27 pid: 10591 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746155574.143705:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0ac5c00 00000100:00100000:1.0:1746155574.143777:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124648192:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155574.143791:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1196b expref: 28 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.143805:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebbd800, rc 0) 00000100:00100000:1.0:1746155574.143828:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+28:29382:x1830976123939712:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1940us (2528us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.143834:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12477 00000100:00100000:0.0:1746155574.145952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.145997:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123939968 00000100:00100000:2.0:1746155574.146003:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123939968 00000100:00100000:2.0:1746155574.146043:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10107 00000100:00100000:2.0:1746155574.146049:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29383:x1830976123939968:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155574.146062:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.146076:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766800/0x844e5faceb5ecadd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11972 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.146143:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766a00/0x844e5faceb5ecae4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.146154:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766a00/0x844e5faceb5ecae4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.146162:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766a00/0x844e5faceb5ecae4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.146172:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766a00/0x844e5faceb5ecae4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.146177:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766a00/0x844e5faceb5ecae4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.146182:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766a00/0x844e5faceb5ecae4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.146191:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f766a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155574.146194:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766a00/0x844e5faceb5ecae4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.146199:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766a00/0x844e5faceb5ecae4 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.146206:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155574.146208:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155574.146211:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766a00/0x844e5faceb5ecae4 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.146215:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766a00/0x844e5faceb5ecae4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.146250:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766800/0x844e5faceb5ecadd lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11972 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.146256:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f766800/0x844e5faceb5ecadd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11972 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.146263:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f766800, rc 0) 00000100:00100000:2.0:1746155574.146293:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29383:x1830976123939968:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 244us (346us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155574.146299:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10107 00000100:00100000:1.0:1746155574.146768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.146868:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123940096 00000100:00100000:2.0:1746155574.146872:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123940096 00002000:00100000:2.0:1746155574.146893:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2236416->3256319) req@ffff88012f1f0700 x1830976123940096/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 504/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.146904:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0700 with x1830976123940096 ext(2236416->3256319) 00010000:00010000:2.0:1746155574.146910:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 27 pid: 10591 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.146919:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 27 pid: 10591 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746155574.146925:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1f0700 00000100:00100000:3.0:1746155574.147696:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 783 00000100:00100000:3.0:1746155574.147705:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123940096:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155574.152370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.152698:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.152789:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123940480 00000100:00100000:3.0:1746155574.152797:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123940480 00000100:00100000:3.0:1746155574.152833:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4105 00000100:00100000:3.0:1746155574.152839:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29383:x1830976123940480:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:1.0:1746155574.153303:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123940224 00000100:00100000:1.0:1746155574.153306:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123940224 00000100:00100000:1.0:1746155574.153337:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12478 00000100:00100000:1.0:1746155574.153342:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123940224:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155574.153351:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.153364:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd000/0x844e5faceb5ecaeb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11979 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155574.153406:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124648320:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155574.153467:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155574.153638:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29383:x1830976123940480:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 796us (1273us total) trans 8589944080 rc 0/0 00000100:00100000:3.0:1746155574.153644:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4105 00000100:00100000:2.0:1746155574.155133:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123940096:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 7428us (8363us total) trans 21474840653 rc 0/0 00000100:00100000:2.0:1746155574.155142:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 783 00002000:00100000:2.0:1746155574.155149:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2236416->3256319) req@ffff88012f1f0700 x1830976123940096/t21474840653(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 504/448 e 0 to 0 dl 1746155585 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.155156:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0700 with x1830976123940096 ext(2236416->3256319) 00010000:00010000:2.0:1746155574.155163:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 31 pid: 10591 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.155174:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 31 pid: 10591 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746155574.155179:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1f0700 00000100:00100000:2.0:1746155574.155423:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124648320:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155574.155592:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd000/0x844e5faceb5ecaeb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11979 expref: 30 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.155608:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd000/0x844e5faceb5ecaeb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11979 expref: 30 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.155628:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ebbd000, rc 0) 00000100:00100000:2.0:1746155574.155660:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123940224:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2316us (2962us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155574.155665:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12478 00000100:00100000:0.0:1746155574.160723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.160763:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123940608 00000100:00100000:3.0:1746155574.160771:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123940608 00010000:00010000:3.0:1746155574.160806:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 29 pid: 10591 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746155574.160865:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6301 00000100:00100000:3.0:1746155574.160875:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123940608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.160902:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155574.160926:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 29 pid: 10591 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.160944:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 29 pid: 10591 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.160965:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e2ac00/0x844e5faceb5ec9c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118f4 expref: 29 pid: 10591 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.161004:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155574.161007:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155574.161016:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1196b expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.161024:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1196b expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.161062:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1196b expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155574.161074:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124648448:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155574.161184:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155574.162079:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.162161:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123940736 00000100:00100000:3.0:1746155574.162162:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124648448:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155574.162164:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123940736 00010000:00010000:3.0:1746155574.162174:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155574.162186:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12479 00000100:00100000:2.0:1746155574.162191:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:29375:x1830976123940736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155574.162204:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155574.162207:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123940608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1335us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.162213:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6301 00010000:00010000:2.0:1746155574.162213:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944aba00/0x844e5faceb5ecaf2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11980 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.162226:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.162227:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.162231:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944aba00/0x844e5faceb5ecaf2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11980 expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.162241:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944aba00/0x844e5faceb5ecaf2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11980 expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.162248:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944aba00, rc 0) 00000100:00100000:2.0:1746155574.162265:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:29375:x1830976123940736:12345-192.168.202.51@tcp:101:cat.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.162270:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12479 00000100:00100000:0.0:1746155574.163988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.164046:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123940992 00000100:00100000:2.0:1746155574.164051:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123940992 00002000:00100000:2.0:1746155574.164074:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a0ac7800 x1830976123940992/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.164082:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac7800 with x1830976123940992 ext(2097152->3145727) 00002000:00010000:2.0:1746155574.164085:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac7800 00000100:00100000:2.0:1746155574.164096:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4857 00000100:00100000:2.0:1746155574.164100:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123940992:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155574.164965:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.165048:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123941248 00000100:00100000:0.0:1746155574.165052:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123941248 00002000:00100000:0.0:1746155574.165068:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4952064->4956159) req@ffff88009c211500 x1830976123941248/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155574.165074:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211500 with x1830976123941248 ext(4952064->4956159) 00002000:00010000:0.0:1746155574.165077:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c211500 00000100:00100000:0.0:1746155574.165097:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4858 00000100:00100000:0.0:1746155574.165102:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123941248:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155574.165210:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123941248:12345-192.168.202.51@tcp:3:cat.0 Request processed in 106us (245us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155574.165216:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4858 00002000:00100000:0.0:1746155574.165221:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4952064->4956159) req@ffff88009c211500 x1830976123941248/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/4536 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155574.165233:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211500 with x1830976123941248 ext(4952064->4956159) 00002000:00010000:0.0:1746155574.165236:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c211500 00000100:00100000:2.0:1746155574.178051:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123940992:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13942us (14058us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.178063:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4857 00002000:00100000:2.0:1746155574.178073:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a0ac7800 x1830976123940992/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.178082:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac7800 with x1830976123940992 ext(2097152->3145727) 00002000:00010000:2.0:1746155574.178088:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac7800 00000100:00100000:0.0:1746155574.182572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.182755:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123941376 00000100:00100000:2.0:1746155574.182764:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123941376 00000100:00100000:2.0:1746155574.183190:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12480 00000100:00100000:2.0:1746155574.183200:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29382:x1830976123941376:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155574.183218:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.183235:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800944abc00/0x844e5faceb5ecaf9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11987 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.183263:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.183265:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.183273:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800944abc00/0x844e5faceb5ecaf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11987 expref: 25 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.183287:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800944abc00/0x844e5faceb5ecaf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11987 expref: 25 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.183297:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944abc00, rc 0) 00000100:00100000:2.0:1746155574.183363:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+25:29382:x1830976123941376:12345-192.168.202.51@tcp:101:cat.0 Request processed in 163us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.183369:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12480 00000100:00100000:0.0:1746155574.188464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.188556:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.188630:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123941760 00000100:00100000:2.0:1746155574.188637:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123941760 00002000:00100000:2.0:1746155574.188674:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a0ac4380 x1830976123941760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.188683:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac4380 with x1830976123941760 ext(2097152->3145727) 00002000:00010000:2.0:1746155574.188688:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac4380 00000100:00100000:2.0:1746155574.188714:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123941888 00000100:00100000:2.0:1746155574.188716:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123941888 00002000:00100000:2.0:1746155574.188729:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800a0ac4700 x1830976123941888/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.188735:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac4700 with x1830976123941888 ext(3145728->4194303) 00002000:00010000:2.0:1746155574.188738:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac4700 00000100:00100000:2.0:1746155574.188746:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4859 00000100:00100000:2.0:1746155574.188903:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123941760:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155574.188968:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4860 00000100:00100000:3.0:1746155574.188975:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123941888:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155574.197910:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1961:x1830976123941760:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9150us (9448us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.197920:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4859 00002000:00100000:2.0:1746155574.197929:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a0ac4380 x1830976123941760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.197938:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac4380 with x1830976123941760 ext(2097152->3145727) 00002000:00010000:2.0:1746155574.197943:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac4380 00000100:00100000:3.0:1746155574.200078:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123941888:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11097us (11515us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155574.200114:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4860 00002000:00100000:3.0:1746155574.200122:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800a0ac4700 x1830976123941888/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.200130:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac4700 with x1830976123941888 ext(3145728->4194303) 00002000:00010000:3.0:1746155574.200134:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac4700 00000100:00100000:0.0:1746155574.207100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.207295:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123942016 00000100:00100000:2.0:1746155574.207303:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123942016 00000100:00100000:2.0:1746155574.207350:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12481 00000100:00100000:2.0:1746155574.207358:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+28:29377:x1830976123942016:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155574.207374:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.207390:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1198e expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.207415:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ab expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.207423:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb88e00/0x844e5faceb5ec8c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1185a expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.207430:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa000/0x844e5faceb5ec859 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ff expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.207440:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.207442:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.207445:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1236992->2097151] (req 1236992->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.207472:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800946fa000/0x844e5faceb5ec859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ff expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.207482:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800946fa000/0x844e5faceb5ec859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ff expref: 10 pid: 20796 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155574.207493:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124648576:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.208219:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb88e00/0x844e5faceb5ec8c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1185a expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.208230:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb88e00/0x844e5faceb5ec8c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1185a expref: 28 pid: 1625 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155574.208239:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124648704:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.208327:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ab expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.208334:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ab expref: 29 pid: 29728 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.208345:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124648832:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.208360:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155574.208381:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.208423:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123942272 00000100:00100000:3.0:1746155574.208427:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123942272 00002000:00100000:3.0:1746155574.208450:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009c213480 x1830976123942272/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.208459:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213480 with x1830976123942272 ext(4194304->4956159) 00002000:00010000:3.0:1746155574.208463:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c213480 00000100:00100000:3.0:1746155574.208477:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4861 00000100:00100000:3.0:1746155574.208482:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123942272:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155574.210374:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124648576:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.210385:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124648704:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.210397:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124648832:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.210419:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1236992->2097151] (req 1236992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 31 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.210437:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800944abe00, rc 0) 00000100:00100000:2.0:1746155574.210468:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+31:29377:x1830976123942016:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3111us (3376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.210481:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12481 00000100:00100000:0.0:1746155574.212210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.212273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.212333:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123942400 00000100:00100000:3.0:1746155574.212338:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123942400 00010000:00010000:3.0:1746155574.212359:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fa000/0x844e5faceb5ec859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ff expref: 11 pid: 20796 timeout: 803 lvb_type: 1 00000100:00100000:3.0:1746155574.212377:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123942528 00000100:00100000:3.0:1746155574.212378:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123942528 00010000:00010000:3.0:1746155574.212385:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb88e00/0x844e5faceb5ec8c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1185a expref: 29 pid: 1625 timeout: 803 lvb_type: 1 00000100:00100000:3.0:1746155574.212401:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6302 00000100:00100000:3.0:1746155574.212406:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123942400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.212415:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155574.212430:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800946fa000/0x844e5faceb5ec859 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ff expref: 11 pid: 20796 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.212438:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800946fa000/0x844e5faceb5ec859 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ff expref: 11 pid: 20796 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.212455:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946fa000/0x844e5faceb5ec859 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ff expref: 11 pid: 20796 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.212476:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.212497:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123942400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.212528:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6302 00000100:00100000:3.0:1746155574.212540:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6303 00000100:00100000:3.0:1746155574.212544:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123942528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.212550:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155574.212556:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb88e00/0x844e5faceb5ec8c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1185a expref: 29 pid: 1625 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.212563:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb88e00/0x844e5faceb5ec8c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1185a expref: 29 pid: 1625 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.212576:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb88e00/0x844e5faceb5ec8c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1185a expref: 29 pid: 1625 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.212583:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.212594:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976123942528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.212598:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6303 00000100:00100000:0.0:1746155574.213796:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.214286:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123942656 00000100:00100000:2.0:1746155574.214292:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123942656 00010000:00010000:2.0:1746155574.214314:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ab expref: 31 pid: 29728 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.214340:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6304 00000100:00100000:2.0:1746155574.214346:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1961:x1830976123942656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155574.214355:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.214367:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ab expref: 31 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.214382:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ab expref: 31 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.214396:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094faea00/0x844e5faceb5ec7bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117ab expref: 31 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.214422:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.214424:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.214434:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 30 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.214441:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 30 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.214471:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 30 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155574.214481:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124648960:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155574.214565:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155574.215609:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123942272:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7125us (7227us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155574.215616:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4861 00002000:00100000:3.0:1746155574.215624:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009c213480 x1830976123942272/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 761856/761856 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.215631:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213480 with x1830976123942272 ext(4194304->4956159) 00002000:00010000:3.0:1746155574.215635:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c213480 00000100:00100000:0.0:1746155574.216943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.217153:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124648960:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155574.217168:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.217366:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123942912 00000100:00100000:3.0:1746155574.217370:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123942912 00002000:00100000:3.0:1746155574.217392:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1236992->1241087) req@ffff88012bde8700 x1830976123942912/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.217399:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bde8700 with x1830976123942912 ext(1236992->1241087) 00002000:00010000:3.0:1746155574.217402:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bde8700 00000100:00100000:3.0:1746155574.217415:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4862 00000100:00100000:3.0:1746155574.217420:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123942912:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155574.218393:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1960:x1830976123942912:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 970us (1450us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155574.218401:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4862 00002000:00100000:3.0:1746155574.218407:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1236992->1241087) req@ffff88012bde8700 x1830976123942912/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/4536 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.218415:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bde8700 with x1830976123942912 ext(1236992->1241087) 00002000:00010000:3.0:1746155574.218418:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bde8700 00000100:00100000:2.0:1746155574.218471:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123942656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4124us (4675us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.218478:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6304 00000100:00100000:0.0:1746155574.225871:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.225926:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123943040 00000100:00100000:2.0:1746155574.225934:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123943040 00000100:00100000:2.0:1746155574.225967:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12482 00000100:00100000:2.0:1746155574.225972:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+28:29377:x1830976123943040:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155574.225985:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.225997:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11995 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.226016:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1196b expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.226022:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944aba00/0x844e5faceb5ecaf2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11980 expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.226025:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.226026:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.226028:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.226046:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800944aba00/0x844e5faceb5ecaf2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11980 expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.226053:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800944aba00/0x844e5faceb5ecaf2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11980 expref: 27 pid: 29728 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.226061:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124649088:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.226197:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1196b expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.226210:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1196b expref: 29 pid: 29728 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.226218:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124649216:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.226243:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.232068:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124649088:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.232197:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124649216:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.232221:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.232234:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68a600, rc 0) 00000100:00100000:2.0:1746155574.232269:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+29:29377:x1830976123943040:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6296us (6404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.232276:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12482 00000100:00100000:1.0:1746155574.233674:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.233734:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123943168 00000100:00100000:2.0:1746155574.233740:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123943168 00010000:00010000:2.0:1746155574.233768:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800944aba00/0x844e5faceb5ecaf2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11980 expref: 28 pid: 29728 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.233789:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6305 00000100:00100000:2.0:1746155574.233794:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123943168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155574.233806:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.234281:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800944aba00/0x844e5faceb5ecaf2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11980 expref: 28 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.234293:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800944aba00/0x844e5faceb5ecaf2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11980 expref: 28 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.234319:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944aba00/0x844e5faceb5ecaf2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4952064->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11980 expref: 28 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.234342:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155574.234380:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976123943168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 585us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.234386:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6305 00000100:00100000:0.0:1746155574.234865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.234994:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123943296 00000100:00100000:2.0:1746155574.234998:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123943296 00010000:00010000:2.0:1746155574.235012:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1196b expref: 29 pid: 29728 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.235049:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6306 00000100:00100000:2.0:1746155574.235055:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123943296:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155574.235062:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.235070:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1196b expref: 29 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.235078:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1196b expref: 29 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.235089:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ebbd800/0x844e5faceb5ecad6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1196b expref: 29 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.235097:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.235099:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.235105:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 28 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.235111:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 28 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.235136:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 28 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155574.235145:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124649344:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155574.235192:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.240055:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124649344:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155574.240076:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155574.240129:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123943296:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5073us (5263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.240139:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6306 00000100:00100000:0.0:1746155574.243111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.243204:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123943552 00000100:00100000:2.0:1746155574.243213:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123943552 00002000:00100000:2.0:1746155574.243250:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2170880->2174975) req@ffff88012bde8e00 x1830976123943552/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.243258:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bde8e00 with x1830976123943552 ext(2170880->2174975) 00002000:00010000:2.0:1746155574.243263:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bde8e00 00000100:00100000:2.0:1746155574.243286:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4863 00000100:00100000:2.0:1746155574.243293:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123943552:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155574.243426:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123943552:12345-192.168.202.51@tcp:3:cat.0 Request processed in 133us (321us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155574.243432:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4863 00002000:00100000:2.0:1746155574.243437:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2170880->2174975) req@ffff88012bde8e00 x1830976123943552/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/4536 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.243443:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bde8e00 with x1830976123943552 ext(2170880->2174975) 00002000:00010000:2.0:1746155574.243446:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bde8e00 00000100:00100000:0.0:1746155574.248886:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.248946:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123943808 00000100:00100000:3.0:1746155574.248954:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123943808 00000100:00100000:3.0:1746155574.248999:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4106 00000100:00100000:3.0:1746155574.249006:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a652850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29377:x1830976123943808:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155574.249186:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a652850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29377:x1830976123943808:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 180us (307us total) trans 8589944081 rc 0/0 00000100:00100000:3.0:1746155574.249192:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4106 00000100:00100000:0.0:1746155574.256118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.256313:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123944064 00000100:00100000:1.0:1746155574.256321:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123944064 00000100:00100000:1.0:1746155574.256373:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10108 00000100:00100000:1.0:1746155574.256380:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:29390:x1830976123944064:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155574.256401:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.256416:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6200/0x844e5faceb5ecb0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1199c expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.257335:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6400/0x844e5faceb5ecb15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257346:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6400/0x844e5faceb5ecb15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257355:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6400/0x844e5faceb5ecb15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257365:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6600/0x844e5faceb5ecb1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257369:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6600/0x844e5faceb5ecb1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257373:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6600/0x844e5faceb5ecb1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257461:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6800/0x844e5faceb5ecb23 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257468:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6800/0x844e5faceb5ecb23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257473:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6800/0x844e5faceb5ecb23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155574.257480:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155574.257573:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6400/0x844e5faceb5ecb15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257579:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6400/0x844e5faceb5ecb15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257585:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6400/0x844e5faceb5ecb15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257590:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f1d6400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155574.257593:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6400/0x844e5faceb5ecb15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257598:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6400/0x844e5faceb5ecb15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257608:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155574.257610:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155574.257613:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6400/0x844e5faceb5ecb15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257617:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6400/0x844e5faceb5ecb15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257642:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6600/0x844e5faceb5ecb1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257646:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6600/0x844e5faceb5ecb1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257650:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6600/0x844e5faceb5ecb1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257653:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f1d6600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155574.257655:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6600/0x844e5faceb5ecb1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257659:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6600/0x844e5faceb5ecb1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257667:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51800) 00010000:00010000:1.0:1746155574.257669:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155574.257670:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6600/0x844e5faceb5ecb1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257674:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6600/0x844e5faceb5ecb1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.257705:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6200/0x844e5faceb5ecb0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1199c expref: 307 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.257715:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6800/0x844e5faceb5ecb23 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1199c expref: 306 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.257720:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155574.257722:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155574.257724:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f1d6800, rc 0) 00000100:00100000:1.0:1746155574.257775:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:29390:x1830976123944064:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1395us (1664us total) trans 8589944082 rc 0/0 00000100:00100000:1.0:1746155574.257781:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10108 00000100:00100000:0.0:1746155574.268181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.268249:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123944192 00000100:00100000:2.0:1746155574.268258:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123944192 00000100:00100000:2.0:1746155574.268306:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12483 00000100:00100000:2.0:1746155574.268313:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:29390:x1830976123944192:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155574.268329:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.268343:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119a3 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.268368:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b400/0x844e5faceb5ec67d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116cb expref: 24 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.268376:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec84b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f8 expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.268383:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b800/0x844e5faceb5ec6ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116f5 expref: 35 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.268390:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.268392:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.268395:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [1703936->1961983] (req 1703936->1961983) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 35 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.268419:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b800/0x844e5faceb5ec6ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116f5 expref: 35 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.268429:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b800/0x844e5faceb5ec6ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116f5 expref: 35 pid: 18270 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155574.268440:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124649472:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.269576:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec84b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f8 expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.269587:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec84b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f8 expref: 10 pid: 29728 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155574.269596:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124649600:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.269642:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b400/0x844e5faceb5ec67d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116cb expref: 24 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.269650:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b400/0x844e5faceb5ec67d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116cb expref: 24 pid: 10591 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155574.269658:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124649728:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.269672:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155574.271178:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124649472:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155574.273863:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.273884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.273915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.273945:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123944448 00000100:00100000:0.0:1746155574.273951:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123944448 00010000:00010000:0.0:1746155574.273976:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b800/0x844e5faceb5ec6ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116f5 expref: 36 pid: 18270 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746155574.273995:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123944320 00000100:00100000:0.0:1746155574.273996:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123944320 00010000:00010000:0.0:1746155574.274004:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec84b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f8 expref: 11 pid: 29728 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746155574.274016:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123944576 00000100:00100000:0.0:1746155574.274018:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123944576 00010000:00010000:0.0:1746155574.274026:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b400/0x844e5faceb5ec67d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116cb expref: 25 pid: 10591 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746155574.274039:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6307 00000100:00100000:0.0:1746155574.274044:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976123944448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155574.274054:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155574.274071:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b800/0x844e5faceb5ec6ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116f5 expref: 36 pid: 18270 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746155574.274081:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b800/0x844e5faceb5ec6ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116f5 expref: 36 pid: 18270 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746155574.274101:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b800/0x844e5faceb5ec6ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116f5 expref: 36 pid: 18270 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746155574.274121:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155574.274153:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123944448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 109us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.274159:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6307 00000100:00100000:0.0:1746155574.274172:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6308 00000100:00100000:0.0:1746155574.274176:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123944320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155574.274181:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155574.274189:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec84b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f8 expref: 11 pid: 29728 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746155574.274197:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec84b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f8 expref: 11 pid: 29728 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746155574.274206:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155574.274219:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976123944320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 43us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.274224:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6308 00000100:00100000:0.0:1746155574.274232:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6309 00000100:00100000:0.0:1746155574.274237:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123944576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155574.274242:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155574.274248:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b400/0x844e5faceb5ec67d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116cb expref: 25 pid: 10591 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746155574.274256:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b400/0x844e5faceb5ec67d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116cb expref: 25 pid: 10591 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746155574.274266:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.274268:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.274273:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.274280:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.274312:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155574.274322:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124649856:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155574.274369:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746155574.274643:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9dc00/0x844e5faceb5ec84b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f8 expref: 10 pid: 29728 timeout: 803 lvb_type: 1 00000100:00100000:3.0:1746155574.274658:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124649600:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155574.274667:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b400/0x844e5faceb5ec67d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f116cb expref: 25 pid: 10591 timeout: 803 lvb_type: 1 00000100:00100000:3.0:1746155574.274675:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976124649728:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155574.274695:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.274708:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68aa00, rc 0) 00000100:00100000:3.0:1746155574.274731:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:29390:x1830976123944192:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6418us (6560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.274736:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12483 00000100:00100000:2.0:1746155574.279653:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124649856:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155574.279672:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155574.279710:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123944576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5472us (5793us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.279718:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6309 00000100:00100000:0.0:1746155574.280256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.281021:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123944832 00000100:00100000:3.0:1746155574.281028:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123944832 00002000:00100000:3.0:1746155574.281063:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1703936->1708031) req@ffff88012bdea680 x1830976123944832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.281072:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdea680 with x1830976123944832 ext(1703936->1708031) 00002000:00010000:3.0:1746155574.281077:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdea680 00000100:00100000:3.0:1746155574.281102:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4864 00000100:00100000:3.0:1746155574.281110:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123944832:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155574.281500:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123944832:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 389us (1242us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155574.281530:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4864 00002000:00100000:3.0:1746155574.281535:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1703936->1708031) req@ffff88012bdea680 x1830976123944832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/4536 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.281542:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdea680 with x1830976123944832 ext(1703936->1708031) 00002000:00010000:3.0:1746155574.281544:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdea680 00000100:00100000:0.0:1746155574.284654:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.284823:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123945088 00000100:00100000:3.0:1746155574.284831:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123945088 00002000:00100000:3.0:1746155574.284870:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1957888->1961983) req@ffff88012bdeaa00 x1830976123945088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.284884:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdeaa00 with x1830976123945088 ext(1957888->1961983) 00002000:00010000:3.0:1746155574.284889:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdeaa00 00000100:00100000:3.0:1746155574.284917:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4865 00000100:00100000:3.0:1746155574.284924:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123945088:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155574.285046:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123945088:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 122us (399us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155574.285052:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4865 00002000:00100000:3.0:1746155574.285056:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1957888->1961983) req@ffff88012bdeaa00 x1830976123945088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/4536 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.285063:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdeaa00 with x1830976123945088 ext(1957888->1961983) 00002000:00010000:3.0:1746155574.285065:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdeaa00 00000100:00100000:0.0:1746155574.288136:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.288365:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123945344 00000100:00100000:2.0:1746155574.288372:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123945344 00000100:00100000:2.0:1746155574.288422:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4107 00000100:00100000:2.0:1746155574.288430:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:29390:x1830976123945344:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155574.288655:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+307:29390:x1830976123945344:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 225us (524us total) trans 8589944083 rc 0/0 00000100:00100000:2.0:1746155574.288661:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4107 00000100:00100000:0.0:1746155574.289203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.289372:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.289677:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123945472 00000100:00100000:3.0:1746155574.289681:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123945472 00000100:00100000:3.0:1746155574.289706:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123945600 00000100:00100000:3.0:1746155574.289708:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123945600 00000100:00100000:3.0:1746155574.289723:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12484 00000100:00100000:3.0:1746155574.289729:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123945472:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155574.289738:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.289751:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092834600/0x844e5faceb5ecb38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119aa expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155574.289786:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124649984:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155574.289835:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43ce6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155574.289847:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12485 00000100:00100000:3.0:1746155574.289852:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123945600:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155574.289857:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.289862:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092834000/0x844e5faceb5ecb3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119b1 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155574.289878:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124650112:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155574.289894:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155574.291887:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124650112:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155574.291909:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092834000/0x844e5faceb5ecb3f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b1 expref: 30 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.291920:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092834000/0x844e5faceb5ecb3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b1 expref: 30 pid: 29728 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746155574.291986:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155573 -> 1746155574 00002000:00010000:2.0:1746155574.291990:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155573 -> 1746155574 00002000:00010000:2.0:1746155574.291991:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155573 -> 1746155574 00000100:00100000:2.0:1746155574.292000:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124649984:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155574.292013:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092834600/0x844e5faceb5ecb38 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119aa expref: 29 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.292021:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092834600/0x844e5faceb5ecb38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119aa expref: 29 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.292028:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092834600, rc 0) 00010000:00010000:3.0:1746155574.292271:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092834000, rc 0) 00000100:00100000:2.0:1746155574.292274:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123945472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2543us (3070us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155574.292281:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12484 00000100:00100000:3.0:1746155574.292288:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976123945600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2435us (2915us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155574.292292:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12485 00000100:00100000:0.0:1746155574.298121:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.298195:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123945856 00000100:00100000:2.0:1746155574.298203:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123945856 00002000:00100000:2.0:1746155574.298238:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88012bdeb800 x1830976123945856/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 504/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.298246:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdeb800 with x1830976123945856 ext(1048576->2097151) 00002000:00010000:2.0:1746155574.298250:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdeb800 00000100:00100000:2.0:1746155574.298564:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4866 00000100:00100000:2.0:1746155574.298571:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123945856:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155574.304780:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123945856:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6202us (6659us total) trans 0 rc 790528/790528 00000100:00100000:2.0:1746155574.304791:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4866 00002000:00100000:2.0:1746155574.304801:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88012bdeb800 x1830976123945856/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 504/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 790528/790528 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.304809:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdeb800 with x1830976123945856 ext(1048576->2097151) 00002000:00010000:2.0:1746155574.304814:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdeb800 00000100:00100000:0.0:1746155574.308580:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.308718:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123945984 00000100:00100000:2.0:1746155574.308726:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123945984 00000100:00100000:2.0:1746155574.308840:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12486 00000100:00100000:2.0:1746155574.308848:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29394:x1830976123945984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155574.308862:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.308876:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119b8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.308902:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.308913:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155574.308915:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155574.308918:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b8 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.308944:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.308954:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 27 pid: 29728 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.308963:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124650240:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.309348:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.310990:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124650240:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.311014:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b8 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.311026:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68a800, rc 0) 00000100:00100000:2.0:1746155574.311053:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:29394:x1830976123945984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2206us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.311060:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12486 00000100:00100000:0.0:1746155574.312043:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.312135:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123946112 00000100:00100000:2.0:1746155574.312140:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123946112 00002000:00100000:2.0:1746155574.312166:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1236992->2097151) req@ffff88012bdea300 x1830976123946112/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.312179:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdea300 with x1830976123946112 ext(1236992->2097151) 00010000:00010000:2.0:1746155574.312185:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 28 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.312195:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 28 pid: 29728 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746155574.312201:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bdea300 00000100:00100000:2.0:1746155574.312449:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 784 00000100:00100000:2.0:1746155574.312456:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123946112:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155574.320776:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123946112:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8312us (8725us total) trans 21474840654 rc 0/0 00000100:00100000:2.0:1746155574.320787:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 784 00002000:00100000:2.0:1746155574.320797:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1236992->2097151) req@ffff88012bdea300 x1830976123946112/t21474840654(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/448 e 0 to 0 dl 1746155585 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.320805:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdea300 with x1830976123946112 ext(1236992->2097151) 00010000:00010000:2.0:1746155574.320813:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 30 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.320827:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 30 pid: 29728 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746155574.320833:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bdea300 00000100:00100000:0.0:1746155574.322935:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.324444:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123946240 00000100:00100000:2.0:1746155574.324454:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123946240 00010000:00010000:2.0:1746155574.324485:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 30 pid: 29728 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.324543:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6310 00000100:00100000:2.0:1746155574.324551:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123946240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155574.324562:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.324580:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 30 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.324591:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 30 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.324609:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800944abe00/0x844e5faceb5ecb00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1198e expref: 30 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.324637:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.324639:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.324645:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b8 expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.324652:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b8 expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.324679:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b8 expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155574.324689:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124650368:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155574.324758:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.326807:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124650368:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155574.326823:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155574.326850:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123946240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2300us (3919us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.326858:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6310 00000100:00100000:0.0:1746155574.329349:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.329649:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123946496 00000100:00100000:2.0:1746155574.329656:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123946496 00002000:00100000:2.0:1746155574.329688:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012bde8380 x1830976123946496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.329697:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bde8380 with x1830976123946496 ext(1048576->2097151) 00002000:00010000:2.0:1746155574.329701:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bde8380 00000100:00100000:2.0:1746155574.329814:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4867 00000100:00100000:2.0:1746155574.329821:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123946496:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155574.336723:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976123946496:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6895us (7371us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.336733:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4867 00002000:00100000:2.0:1746155574.336743:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88012bde8380 x1830976123946496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.336751:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bde8380 with x1830976123946496 ext(1048576->2097151) 00002000:00010000:2.0:1746155574.336755:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bde8380 00000100:00100000:0.0:1746155574.340902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.340960:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123946624 00000100:00100000:2.0:1746155574.340968:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123946624 00000100:00100000:2.0:1746155574.341013:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12487 00000100:00100000:2.0:1746155574.341022:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:29394:x1830976123946624:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155574.341038:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.341053:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119bf expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.341078:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 28 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.341085:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155574.341086:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155574.341089:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119bf expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.341113:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 28 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.341123:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 28 pid: 29728 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.341134:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124650496:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.341216:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155574.343690:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.343706:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124650496:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.343727:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119bf expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.343739:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68ae00, rc 0) 00000100:00100000:2.0:1746155574.343776:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:29394:x1830976123946624:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2752us (2875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.343784:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12487 00000100:00100000:3.0:1746155574.343912:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123946752 00000100:00100000:3.0:1746155574.343918:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123946752 00002000:00100000:3.0:1746155574.343945:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2174975) req@ffff88009fefc380 x1830976123946752/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.343953:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fefc380 with x1830976123946752 ext(2097152->2174975) 00010000:00010000:3.0:1746155574.343959:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 29 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.343975:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 29 pid: 29728 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746155574.343981:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fefc380 00000100:00100000:3.0:1746155574.344004:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 785 00000100:00100000:3.0:1746155574.344011:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123946752:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155574.346851:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1961:x1830976123946752:12345-192.168.202.51@tcp:4:cat.0 Request processed in 2833us (3158us total) trans 21474840655 rc 0/0 00000100:00100000:3.0:1746155574.346859:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 785 00002000:00100000:3.0:1746155574.346867:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2174975) req@ffff88009fefc380 x1830976123946752/t21474840655(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/448 e 0 to 0 dl 1746155585 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.346875:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fefc380 with x1830976123946752 ext(2097152->2174975) 00010000:00010000:3.0:1746155574.346893:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 31 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.346904:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 31 pid: 29728 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746155574.346909:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fefc380 00000100:00100000:0.0:1746155574.348533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.348641:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123946880 00000100:00100000:2.0:1746155574.348648:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123946880 00010000:00010000:2.0:1746155574.348673:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 31 pid: 29728 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.348693:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6311 00000100:00100000:2.0:1746155574.348698:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1962:x1830976123946880:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155574.348710:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.348724:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 31 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.348733:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 31 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.348751:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecb07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11995 expref: 31 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.348892:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.348894:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.348901:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119bf expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.348908:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119bf expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.348933:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119bf expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155574.348943:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124650624:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155574.349355:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.350773:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124650624:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155574.350786:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155574.350812:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1962:x1830976123946880:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2112us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.350819:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6311 00000100:00100000:0.0:1746155574.355739:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.355782:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.355869:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123947264 00000100:00100000:3.0:1746155574.355876:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123947264 00002000:00100000:3.0:1746155574.355911:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009fefca80 x1830976123947264/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.355920:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fefca80 with x1830976123947264 ext(3145728->4194303) 00002000:00010000:3.0:1746155574.355926:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fefca80 00000100:00100000:3.0:1746155574.355952:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123947136 00000100:00100000:3.0:1746155574.355954:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123947136 00002000:00100000:3.0:1746155574.355965:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009fefce00 x1830976123947136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.355971:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fefce00 with x1830976123947136 ext(2097152->3145727) 00002000:00010000:3.0:1746155574.355974:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fefce00 00000100:00100000:3.0:1746155574.355990:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4868 00000100:00100000:3.0:1746155574.355997:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123947264:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155574.356030:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4869 00000100:00100000:2.0:1746155574.356038:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123947136:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155574.365468:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123947136:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9422us (9676us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.365479:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4869 00002000:00100000:2.0:1746155574.365489:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009fefce00 x1830976123947136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.365498:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fefce00 with x1830976123947136 ext(2097152->3145727) 00002000:00010000:2.0:1746155574.365540:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fefce00 00000100:00100000:3.0:1746155574.367639:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976123947264:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11636us (11902us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155574.367648:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4868 00002000:00100000:3.0:1746155574.367656:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009fefca80 x1830976123947264/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.367663:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fefca80 with x1830976123947264 ext(3145728->4194303) 00002000:00010000:3.0:1746155574.367667:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fefca80 00000100:00100000:0.0:1746155574.373187:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.373279:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123947648 00000100:00100000:3.0:1746155574.373286:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123947648 00002000:00100000:3.0:1746155574.373321:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009fefd180 x1830976123947648/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.373329:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fefd180 with x1830976123947648 ext(4194304->4956159) 00002000:00010000:3.0:1746155574.373333:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fefd180 00000100:00100000:3.0:1746155574.373364:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4870 00000100:00100000:3.0:1746155574.373371:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123947648:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155574.381233:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123947648:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7855us (8045us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155574.381243:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4870 00002000:00100000:3.0:1746155574.381254:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009fefd180 x1830976123947648/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.381263:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fefd180 with x1830976123947648 ext(4194304->4956159) 00002000:00010000:3.0:1746155574.381269:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fefd180 00000100:00100000:0.0:1746155574.415585:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.416080:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123947904 00000100:00100000:1.0:1746155574.416088:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123947904 00000100:00100000:1.0:1746155574.416136:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10109 00000100:00100000:1.0:1746155574.416144:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+307:29398:x1830976123947904:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155574.416171:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.416186:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6c00/0x844e5faceb5ecb54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119c6 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.416284:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.416297:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11956 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.416303:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6800/0x844e5faceb5ecb23 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1199c expref: 308 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.416309:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.416465:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6800/0x844e5faceb5ecb23 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1199c expref: 308 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.416477:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6800/0x844e5faceb5ecb23 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1199c expref: 308 pid: 27374 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155574.416487:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae1500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124650752:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155574.418279:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11956 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.418290:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11956 expref: 10 pid: 15474 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155574.418299:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f0bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124650880:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155574.418333:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155574.421324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.421546:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae1500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124650752:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155574.422465:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123948032 00000100:00100000:3.0:1746155574.422471:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123948032 00010000:00010000:3.0:1746155574.422499:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6800/0x844e5faceb5ecb23 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1199c expref: 309 pid: 27374 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746155574.422553:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6312 00000100:00100000:3.0:1746155574.422560:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:1960:x1830976123948032:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.422570:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155574.422575:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6800/0x844e5faceb5ecb23 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1199c expref: 309 pid: 27374 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.422584:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6800/0x844e5faceb5ecb23 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1199c expref: 309 pid: 27374 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.422601:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6800/0x844e5faceb5ecb23 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1199c expref: 309 pid: 27374 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.422624:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155574.422629:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155574.422637:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155574.422641:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.422670:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+308:1960:x1830976123948032:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 111us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.422676:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6312 00000100:00100000:0.0:1746155574.423194:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f0bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124650880:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155574.423215:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155574.423301:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.423644:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123948160 00000100:00100000:0.0:1746155574.423648:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123948160 00010000:00010000:0.0:1746155574.423662:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11956 expref: 11 pid: 15474 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746155574.423686:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6313 00000100:00100000:0.0:1746155574.423692:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123948160:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155574.423699:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155574.423703:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11956 expref: 11 pid: 15474 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746155574.423711:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11956 expref: 11 pid: 15474 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746155574.423723:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68b600/0x844e5faceb5ecac1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11956 expref: 11 pid: 15474 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746155574.424102:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155574.424106:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155574.424113:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155574.424118:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155574.424142:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155574.424163:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.424168:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155574.424171:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123948160:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 479us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.424176:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6313 00000004:00200000:1.0:1746155574.424183:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155574.424287:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6c00/0x844e5faceb5ecb54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119c6 expref: 309 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.424312:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119c6 expref: 308 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.424318:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155574.424320:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155574.424322:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f1d6e00, rc 0) 00000100:00100000:1.0:1746155574.424341:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+308:29398:x1830976123947904:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8198us (8763us total) trans 8589944084 rc 0/0 00000100:00100000:1.0:1746155574.424346:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10109 00000100:00100000:0.0:1746155574.439433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.439683:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123948288 00000100:00100000:2.0:1746155574.439690:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123948288 00000100:00100000:2.0:1746155574.440188:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12488 00000100:00100000:2.0:1746155574.440196:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:29398:x1830976123948288:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155574.440217:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.440233:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119cd expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.440258:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1188b expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.440266:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2d9a00/0x844e5faceb5eca7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11925 expref: 9 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.440272:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e2b800/0x844e5faceb5ec97f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ca expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.440277:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.440278:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.440281:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [966656->1048575] (req 966656->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.440303:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e2b800/0x844e5faceb5ec97f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ca expref: 29 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.440313:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e2b800/0x844e5faceb5ec97f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ca expref: 29 pid: 1625 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155574.440322:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124651008:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.440941:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f2d9a00/0x844e5faceb5eca7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11925 expref: 9 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.440950:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f2d9a00/0x844e5faceb5eca7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11925 expref: 9 pid: 10591 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155574.440957:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124651136:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.440983:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1188b expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.440989:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1188b expref: 30 pid: 1625 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.440997:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124651264:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.441012:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.445730:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124651008:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.445740:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124651136:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.445747:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124651264:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.445772:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [966656->1048575] (req 966656->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.445787:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68a200, rc 0) 00000100:00100000:2.0:1746155574.445821:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29398:x1830976123948288:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5626us (6394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.445829:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12488 00000100:00100000:0.0:1746155574.452338:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.452474:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123948416 00000100:00100000:2.0:1746155574.452483:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123948416 00010000:00010000:2.0:1746155574.452543:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e2b800/0x844e5faceb5ec97f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ca expref: 30 pid: 1625 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155574.452587:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6314 00000100:00100000:2.0:1746155574.452595:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1961:x1830976123948416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155574.452607:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.452627:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e2b800/0x844e5faceb5ec97f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ca expref: 30 pid: 1625 timeout: 803 lvb_type: 1 00010000:00010000:2.0:1746155574.452749:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e2b800/0x844e5faceb5ec97f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ca expref: 30 pid: 1625 timeout: 803 lvb_type: 1 00000100:00100000:1.0:1746155574.452760:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155574.452767:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e2b800/0x844e5faceb5ec97f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118ca expref: 30 pid: 1625 timeout: 803 lvb_type: 1 00010000:00010000:2.0:1746155574.452792:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.452828:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123948672 00000100:00100000:2.0:1746155574.452828:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1961:x1830976123948416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 234us (2335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.452831:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123948672 00000100:00100000:2.0:1746155574.452834:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6314 00010000:00010000:3.0:1746155574.452843:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2d9a00/0x844e5faceb5eca7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11925 expref: 10 pid: 10591 timeout: 803 lvb_type: 1 00000100:00100000:3.0:1746155574.452871:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6315 00000100:00100000:3.0:1746155574.452877:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976123948672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.452883:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155574.452890:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f2d9a00/0x844e5faceb5eca7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11925 expref: 10 pid: 10591 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.452898:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f2d9a00/0x844e5faceb5eca7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11925 expref: 10 pid: 10591 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.452909:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2d9a00/0x844e5faceb5eca7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11925 expref: 10 pid: 10591 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.452921:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.452937:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976123948672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 60us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.452946:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6315 00000100:00100000:1.0:1746155574.453036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.453629:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123948544 00000100:00100000:2.0:1746155574.453632:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123948544 00010000:00010000:2.0:1746155574.453644:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1188b expref: 30 pid: 1625 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.453670:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6316 00000100:00100000:2.0:1746155574.453675:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123948544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155574.453682:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.453691:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1188b expref: 30 pid: 1625 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.453698:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1188b expref: 30 pid: 1625 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.453708:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f486200/0x844e5faceb5ec932 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1188b expref: 30 pid: 1625 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.453716:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.453717:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.453723:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.453729:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.453753:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155574.453763:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124651392:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155574.453816:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155574.456685:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.456840:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123948928 00000100:00100000:1.0:1746155574.456845:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123948928 00000100:00100000:1.0:1746155574.456898:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10110 00000100:00100000:1.0:1746155574.456904:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29401:x1830976123948928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155574.456922:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.456939:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7c00/0x844e5faceb5ecb70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119d4 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.457019:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7a00/0x844e5faceb5ecb77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457029:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7a00/0x844e5faceb5ecb77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457037:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7a00/0x844e5faceb5ecb77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457046:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7800/0x844e5faceb5ecb7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457051:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7800/0x844e5faceb5ecb7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457055:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7800/0x844e5faceb5ecb7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457138:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7600/0x844e5faceb5ecb85 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457146:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7600/0x844e5faceb5ecb85 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457152:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7600/0x844e5faceb5ecb85 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155574.457159:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155574.457223:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7a00/0x844e5faceb5ecb77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457229:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7a00/0x844e5faceb5ecb77 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457238:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7a00/0x844e5faceb5ecb77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457243:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f1d7a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155574.457246:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7a00/0x844e5faceb5ecb77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457251:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7a00/0x844e5faceb5ecb77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457259:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155574.457262:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155574.457265:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7a00/0x844e5faceb5ecb77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457269:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7a00/0x844e5faceb5ecb77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457280:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7800/0x844e5faceb5ecb7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457284:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7800/0x844e5faceb5ecb7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457289:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7800/0x844e5faceb5ecb7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457292:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f1d7800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155574.457293:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7800/0x844e5faceb5ecb7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457297:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7800/0x844e5faceb5ecb7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457305:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51400) 00010000:00010000:1.0:1746155574.457307:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155574.457308:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7800/0x844e5faceb5ecb7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457312:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7800/0x844e5faceb5ecb7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.457337:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7c00/0x844e5faceb5ecb70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119d4 expref: 27 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.457345:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7600/0x844e5faceb5ecb85 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119d4 expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.457355:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155574.457356:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155574.457358:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f1d7600, rc 0) 00000100:00100000:1.0:1746155574.457393:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29401:x1830976123948928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 488us (713us total) trans 8589944085 rc 0/0 00000100:00100000:1.0:1746155574.457398:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10110 00000100:00100000:0.0:1746155574.458084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.458161:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124651392:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155574.458180:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155574.458202:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123948544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4527us (5166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.458209:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6316 00000100:00100000:3.0:1746155574.458273:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123949184 00000100:00100000:3.0:1746155574.458277:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123949184 00002000:00100000:3.0:1746155574.458300:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (966656->970751) req@ffff88009fefdf80 x1830976123949184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.458308:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fefdf80 with x1830976123949184 ext(966656->970751) 00002000:00010000:3.0:1746155574.458312:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fefdf80 00000100:00100000:3.0:1746155574.458324:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4871 00000100:00100000:3.0:1746155574.458329:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123949184:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155574.458425:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976123949184:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 95us (341us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155574.458430:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4871 00002000:00100000:3.0:1746155574.458434:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (966656->970751) req@ffff88009fefdf80 x1830976123949184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/4536 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.458440:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fefdf80 with x1830976123949184 ext(966656->970751) 00002000:00010000:3.0:1746155574.458443:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fefdf80 00000100:00100000:0.0:1746155574.459153:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.459445:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123949440 00000100:00100000:3.0:1746155574.459449:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123949440 00000100:00100000:3.0:1746155574.459474:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4108 00000100:00100000:3.0:1746155574.459480:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29401:x1830976123949440:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155574.459627:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+27:29401:x1830976123949440:12345-192.168.202.51@tcp:35:cat.0 Request processed in 146us (473us total) trans 8589944086 rc 0/0 00000100:00100000:3.0:1746155574.459872:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4108 00000100:00100000:1.0:1746155574.459995:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.460141:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123949568 00000100:00100000:2.0:1746155574.460146:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123949568 00000100:00100000:2.0:1746155574.460294:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 610 00000100:00100000:2.0:1746155574.460300:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1963:x1830976123949568:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155574.460308:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.460324:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d7600/0x844e5faceb5ecb85 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119d4 expref: 27 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.460336:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155574.460340:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155574.460422:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123949568:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 121us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.460427:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 610 00000100:00100000:0.0:1746155574.462093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.462120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.462145:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.462168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.462188:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.462241:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123949696 00000100:00100000:2.0:1746155574.462246:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123949696 00000100:00100000:2.0:1746155574.462264:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123949824 00000100:00100000:2.0:1746155574.462266:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123949824 00000100:00100000:2.0:1746155574.462277:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123949952 00000100:00100000:2.0:1746155574.462278:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123949952 00000100:00100000:2.0:1746155574.462286:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123950080 00000100:00100000:2.0:1746155574.462288:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123950080 00000100:00100000:2.0:1746155574.462296:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123950208 00000100:00100000:2.0:1746155574.462297:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123950208 00000100:00100000:2.0:1746155574.462309:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12489 00000100:00100000:2.0:1746155574.462314:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1961:x1830976123949696:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155574.462324:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155574.462337:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12490 00010000:00010000:2.0:1746155574.462337:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e68be00/0x844e5faceb5ecb93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119db expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155574.462345:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123949824:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155574.462353:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.462362:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092835400/0x844e5faceb5ecb9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119e2 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155574.462375:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124651520:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155574.462388:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124651648:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155574.462421:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12491 00000100:00100000:2.0:1746155574.462427:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123949952:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155574.462431:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746155574.462432:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.462438:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e68b000/0x844e5faceb5ecba1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119e9 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155574.462445:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12492 00010000:00010000:2.0:1746155574.462446:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.462448:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155574.462451:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1961:x1830976123950080:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155574.462454:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68b000/0x844e5faceb5ecba1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119e9 expref: 33 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.462457:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.462463:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092834c00/0x844e5faceb5ecba8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119f0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.462464:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e68b000/0x844e5faceb5ecba1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119e9 expref: 33 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.462472:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.462472:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68b000, rc 0) 00010000:00010000:3.0:1746155574.462474:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155574.462479:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092834c00/0x844e5faceb5ecba8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f0 expref: 34 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.462488:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092834c00/0x844e5faceb5ecba8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f0 expref: 34 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155574.462488:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1961:x1830976123949952:12345-192.168.202.51@tcp:101:cat.0 Request processed in 61us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.462494:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12491 00010000:00010000:3.0:1746155574.462495:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092834c00, rc 0) 00000100:00100000:2.0:1746155574.462532:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12493 00000100:00100000:2.0:1746155574.462537:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:29398:x1830976123950208:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:3.0:1746155574.462540:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1961:x1830976123950080:12345-192.168.202.51@tcp:101:cat.0 Request processed in 88us (370us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155574.462544:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155574.462545:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12492 00010000:00010000:2.0:1746155574.462550:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119f7 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.462567:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11734 expref: 35 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.462574:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5425000/0x844e5faceb5ec844 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f1 expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.462581:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b000/0x844e5faceb5ec709 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11750 expref: 25 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.462640:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.462642:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.462646:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->1249279] (req 1048576->1249279) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 35 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.462664:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b000/0x844e5faceb5ec709 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11750 expref: 25 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.462673:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b000/0x844e5faceb5ec709 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11750 expref: 25 pid: 4461 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155574.462681:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124651776:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.462723:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5425000/0x844e5faceb5ec844 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f1 expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.462731:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5425000/0x844e5faceb5ec844 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f1 expref: 9 pid: 4461 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155574.462739:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124651904:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.462763:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11734 expref: 35 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.462770:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11734 expref: 35 pid: 1625 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.462777:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124652032:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.462794:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.462803:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.465689:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124651776:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.465701:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124652032:192.168.202.51@tcp:104: 00002000:00010000:2.0:1746155574.465721:0:10591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime: 1746155573 -> 1746155574 00002000:00010000:2.0:1746155574.465724:0:10591:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime: 1746155573 -> 1746155574 00000100:00100000:2.0:1746155574.465738:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124651520:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155574.465762:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e68be00/0x844e5faceb5ecb93 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119db expref: 32 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.465773:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e68be00/0x844e5faceb5ecb93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119db expref: 32 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.465781:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68be00, rc 0) 00000100:00100000:2.0:1746155574.465822:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1961:x1830976123949696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3507us (3730us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155574.465830:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12489 00002000:00010000:3.0:1746155574.466130:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime: 1746155572 -> 1746155574 00002000:00010000:3.0:1746155574.466133:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime: 1746155572 -> 1746155574 00002000:00010000:3.0:1746155574.466135:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime: 1746155572 -> 1746155574 00000100:00100000:3.0:1746155574.466146:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124651648:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155574.466160:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092835400/0x844e5faceb5ecb9a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119e2 expref: 25 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.466169:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092835400/0x844e5faceb5ecb9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119e2 expref: 25 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.466180:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092835400, rc 0) 00000100:00100000:3.0:1746155574.466196:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123949824:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3853us (4075us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155574.466201:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12490 00000100:00100000:2.0:1746155574.470050:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124651904:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155574.470114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155574.470545:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->1249279] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 35 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.470560:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68b800, rc 0) 00000100:00100000:2.0:1746155574.470606:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:29398:x1830976123950208:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8068us (8416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.470613:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12493 00000100:00100000:3.0:1746155574.470711:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123950336 00000100:00100000:3.0:1746155574.470717:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123950336 00010000:00010000:3.0:1746155574.470851:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b000/0x844e5faceb5ec709 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11750 expref: 24 pid: 4461 timeout: 803 lvb_type: 1 00000100:00100000:3.0:1746155574.470877:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6317 00000100:00100000:3.0:1746155574.470883:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123950336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.470893:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155574.471428:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155574.471615:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b000/0x844e5faceb5ec709 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11750 expref: 24 pid: 4461 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.471625:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b000/0x844e5faceb5ec709 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11750 expref: 24 pid: 4461 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.471643:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b000/0x844e5faceb5ec709 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11750 expref: 24 pid: 4461 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.471652:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.472135:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1960:x1830976123950336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1249us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.472143:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6317 00000100:00100000:3.0:1746155574.472162:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123950464 00000100:00100000:3.0:1746155574.472166:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123950464 00010000:00010000:3.0:1746155574.472185:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5425000/0x844e5faceb5ec844 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f1 expref: 10 pid: 4461 timeout: 803 lvb_type: 1 00000100:00100000:3.0:1746155574.472211:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6318 00000100:00100000:3.0:1746155574.472217:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123950464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.472224:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155574.472232:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5425000/0x844e5faceb5ec844 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f1 expref: 10 pid: 4461 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.472239:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5425000/0x844e5faceb5ec844 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f1 expref: 10 pid: 4461 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.472250:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5425000/0x844e5faceb5ec844 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f117f1 expref: 10 pid: 4461 timeout: 803 lvb_type: 1 00010000:00010000:3.0:1746155574.472257:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155574.472771:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.472784:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123950592 00000100:00100000:0.0:1746155574.472787:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123950592 00010000:00010000:0.0:1746155574.472800:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11734 expref: 35 pid: 1625 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746155574.472815:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6319 00000100:00100000:0.0:1746155574.472820:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1963:x1830976123950592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155574.472826:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155574.472834:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11734 expref: 35 pid: 1625 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746155574.472841:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11734 expref: 35 pid: 1625 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746155574.472853:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd4200/0x844e5faceb5ec6f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11734 expref: 35 pid: 1625 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746155574.472865:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.472867:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.472873:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 34 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.472879:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 34 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.472904:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 34 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155574.472913:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bde9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124652160:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155574.473214:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123950464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 996us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.473220:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6318 00000100:00100000:1.0:1746155574.473297:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.474209:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123950720 00000100:00100000:2.0:1746155574.474214:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123950720 00000100:00100000:2.0:1746155574.474249:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12494 00000100:00100000:2.0:1746155574.474255:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+31:29401:x1830976123950720:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155574.474267:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.474280:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f119fe expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.474298:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.474305:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155574.474306:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155574.474310:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119fe expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.474333:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.474342:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 28 pid: 8437 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.474351:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124652288:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155574.475083:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.475128:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155574.475432:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bde9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124652160:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155574.475445:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155574.475465:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123950592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2644us (2694us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.475472:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6319 00000100:00100000:2.0:1746155574.477617:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124652288:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.477639:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119fe expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.477653:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4b800, rc 0) 00000100:00100000:0.0:1746155574.477679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.477771:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123950848 00000100:00100000:3.0:1746155574.477776:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123950848 00002000:00100000:3.0:1746155574.477804:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (966656->1048575) req@ffff88012bde9880 x1830976123950848/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.477979:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bde9880 with x1830976123950848 ext(966656->1048575) 00010000:00010000:3.0:1746155574.477986:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 29 pid: 8437 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.477997:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 29 pid: 8437 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746155574.478004:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bde9880 00000100:00100000:3.0:1746155574.478019:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 786 00000100:00100000:3.0:1746155574.478025:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123950848:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155574.478333:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:29401:x1830976123950720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4076us (5034us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.478340:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12494 00000100:00100000:0.0:1746155574.478409:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.478699:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123951104 00000100:00100000:1.0:1746155574.478703:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123951104 00002000:00100000:1.0:1746155574.478721:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1245184->1249279) req@ffff88012bde9c00 x1830976123951104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155574.478729:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bde9c00 with x1830976123951104 ext(1245184->1249279) 00002000:00010000:1.0:1746155574.478732:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bde9c00 00000100:00100000:1.0:1746155574.478746:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4872 00000100:00100000:1.0:1746155574.478888:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976123951104:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155574.479010:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976123951104:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 124us (601us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155574.479016:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4872 00002000:00100000:1.0:1746155574.479021:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1245184->1249279) req@ffff88012bde9c00 x1830976123951104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/4536 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155574.479027:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bde9c00 with x1830976123951104 ext(1245184->1249279) 00002000:00010000:1.0:1746155574.479030:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bde9c00 00000100:00100000:3.0:1746155574.481713:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123950848:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 3683us (4031us total) trans 21474840656 rc 0/0 00000100:00100000:3.0:1746155574.481721:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 786 00002000:00100000:3.0:1746155574.481728:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (966656->1048575) req@ffff88012bde9880 x1830976123950848/t21474840656(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/448 e 0 to 0 dl 1746155585 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.481735:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bde9880 with x1830976123950848 ext(966656->1048575) 00010000:00010000:3.0:1746155574.481742:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 31 pid: 8437 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.481758:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 31 pid: 8437 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746155574.481764:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bde9880 00000100:00100000:0.0:1746155574.483800:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.483857:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123951360 00000100:00100000:2.0:1746155574.483863:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123951360 00000100:00100000:2.0:1746155574.483907:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10111 00000100:00100000:2.0:1746155574.483914:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29403:x1830976123951360:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155574.483935:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.483950:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bc00/0x844e5faceb5ecbbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a05 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.484032:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a400/0x844e5faceb5ecbc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.484042:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a400/0x844e5faceb5ecbc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.484052:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a400/0x844e5faceb5ecbc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.484063:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecbcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.484068:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecbcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.484074:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecbcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485273:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba00/0x844e5faceb5ecbd2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485282:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba00/0x844e5faceb5ecbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485289:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba00/0x844e5faceb5ecbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155574.485296:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155574.485361:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a400/0x844e5faceb5ecbc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485367:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a400/0x844e5faceb5ecbc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485371:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a400/0x844e5faceb5ecbc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485376:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e68a400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155574.485379:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a400/0x844e5faceb5ecbc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485385:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a400/0x844e5faceb5ecbc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485393:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155574.485396:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155574.485399:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a400/0x844e5faceb5ecbc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485403:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a400/0x844e5faceb5ecbc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485425:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecbcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485430:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecbcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485434:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecbcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485438:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e68a600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155574.485440:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecbcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485444:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecbcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485449:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9a00) 00010000:00010000:2.0:1746155574.485451:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155574.485453:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecbcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485457:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68a600/0x844e5faceb5ecbcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.485489:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68bc00/0x844e5faceb5ecbbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a05 expref: 29 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.485499:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba00/0x844e5faceb5ecbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a05 expref: 28 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155574.487079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155574.487638:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155574.487641:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155574.487643:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68ba00, rc 0) 00000100:00100000:2.0:1746155574.487685:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+28:29403:x1830976123951360:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3770us (3890us total) trans 8589944087 rc 0/0 00000100:00100000:2.0:1746155574.487692:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10111 00000100:00100000:1.0:1746155574.487767:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123951488 00000100:00100000:1.0:1746155574.487773:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123951488 00010000:00010000:1.0:1746155574.487795:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 31 pid: 8437 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155574.487824:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6320 00000100:00100000:1.0:1746155574.487830:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bde8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123951488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155574.487840:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155574.487855:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 31 pid: 8437 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.487864:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 31 pid: 8437 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.487880:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a200/0x844e5faceb5ecb69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 966656->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119cd expref: 31 pid: 8437 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.487900:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.487901:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.487907:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119fe expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.487913:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119fe expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.487936:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119fe expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155574.487945:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124652416:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155574.488184:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155574.495838:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.495951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.496036:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123951616 00000100:00100000:3.0:1746155574.496043:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123951616 00000100:00100000:3.0:1746155574.496085:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 611 00000100:00100000:3.0:1746155574.496092:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1963:x1830976123951616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.496103:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155574.496122:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e68ba00/0x844e5faceb5ecbd2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a05 expref: 28 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.496141:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155574.496145:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.496179:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1963:x1830976123951616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.496185:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 611 00000100:00100000:1.0:1746155574.496474:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124652416:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155574.496490:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155574.496591:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123951872 00000100:00100000:2.0:1746155574.496595:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123951872 00002000:00100000:2.0:1746155574.496620:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009366fb80 x1830976123951872/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.496627:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366fb80 with x1830976123951872 ext(0->1048575) 00002000:00010000:2.0:1746155574.496630:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366fb80 00000100:00100000:2.0:1746155574.496643:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4873 00000100:00100000:2.0:1746155574.496648:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123951872:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155574.497612:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bde8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976123951488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9779us (10533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.497619:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6320 00000100:00100000:2.0:1746155574.511791:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123951872:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15135us (15832us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.511801:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4873 00002000:00100000:2.0:1746155574.511811:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009366fb80 x1830976123951872/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.511826:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366fb80 with x1830976123951872 ext(0->1048575) 00002000:00010000:2.0:1746155574.511830:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366fb80 00000100:00100000:0.0:1746155574.516431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.518726:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123952000 00000100:00100000:2.0:1746155574.518736:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123952000 00000100:00100000:2.0:1746155574.519003:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12495 00000100:00100000:2.0:1746155574.519010:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fefd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29401:x1830976123952000:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155574.519025:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.519040:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a0c expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.519064:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.519071:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155574.519072:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155574.519075:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a0c expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.519098:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.519108:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 33 pid: 4461 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.519119:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124652544:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.519193:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.522773:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124652544:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.522798:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a0c expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.522812:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e68b600, rc 0) 00000100:00100000:2.0:1746155574.522857:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fefd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29401:x1830976123952000:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3846us (6431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.522864:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12495 00000100:00100000:0.0:1746155574.524586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.525003:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123952128 00000100:00100000:2.0:1746155574.525009:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123952128 00002000:00100000:2.0:1746155574.525046:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1249279) req@ffff88009feff800 x1830976123952128/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.525053:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009feff800 with x1830976123952128 ext(1048576->1249279) 00010000:00010000:2.0:1746155574.525060:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 34 pid: 4461 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.525072:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 34 pid: 4461 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746155574.525078:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009feff800 00000100:00100000:2.0:1746155574.525100:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 787 00000100:00100000:2.0:1746155574.525106:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123952128:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155574.538624:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976123952128:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 13506us (14030us total) trans 17179873264 rc 0/0 00000100:00100000:2.0:1746155574.538636:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 787 00002000:00100000:2.0:1746155574.538650:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1249279) req@ffff88009feff800 x1830976123952128/t17179873264(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/448 e 0 to 0 dl 1746155585 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.538658:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009feff800 with x1830976123952128 ext(1048576->1249279) 00010000:00010000:2.0:1746155574.538667:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 36 pid: 4461 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.538679:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 36 pid: 4461 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746155574.538684:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009feff800 00000100:00100000:0.0:1746155574.540774:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.540820:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.540827:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123952256 00000100:00100000:2.0:1746155574.540834:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123952256 00000100:00100000:2.0:1746155574.540874:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12496 00000100:00100000:2.0:1746155574.540881:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:29403:x1830976123952256:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:1.0:1746155574.540883:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123952384 00000100:00100000:1.0:1746155574.540885:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123952384 00010000:00010000:2.0:1746155574.540895:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.540902:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 36 pid: 4461 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.540907:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a13 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155574.540920:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6321 00000100:00100000:1.0:1746155574.540924:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976123952384:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155574.540926:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119bf expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.540933:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092834c00/0x844e5faceb5ecba8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f0 expref: 33 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155574.540933:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.540938:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.540940:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.540942:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3878912->4194303] (req 3878912->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155574.540946:0:22680:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155573 -> 1746155574 00002000:00010000:1.0:1746155574.540948:0:22680:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155573 -> 1746155574 00010000:00010000:1.0:1746155574.540952:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 36 pid: 4461 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.540960:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 36 pid: 4461 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.540963:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092834c00/0x844e5faceb5ecba8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f0 expref: 33 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.540971:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092834c00/0x844e5faceb5ecba8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f0 expref: 33 pid: 1625 timeout: 803 lvb_type: 1 00010000:00010000:1.0:1746155574.540974:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b800/0x844e5faceb5ecbaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f7 expref: 36 pid: 4461 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.540980:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124652672:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155574.540988:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.540989:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.540994:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a0c expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.541000:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a0c expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.541015:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a0c expref: 23 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155574.541022:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124652800:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155574.541038:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00010000:00010000:2.0:1746155574.541040:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119bf expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.541046:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119bf expref: 29 pid: 8437 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.541054:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124652928:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.541069:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.542649:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124652672:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155574.542676:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124652800:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155574.542692:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155574.542715:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976123952384:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1790us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.542722:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6321 00000100:00100000:0.0:1746155574.544286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.544324:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123952640 00000100:00100000:2.0:1746155574.544329:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123952640 00002000:00100000:2.0:1746155574.544356:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800a5ae1500 x1830976123952640/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.544365:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1500 with x1830976123952640 ext(1048576->2097151) 00002000:00010000:2.0:1746155574.544369:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ae1500 00000100:00100000:2.0:1746155574.544391:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4874 00000100:00100000:2.0:1746155574.544396:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123952640:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155574.546487:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124652928:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155574.546538:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3878912->4194303] (req 3878912->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.546552:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cec400, rc 0) 00000100:00100000:3.0:1746155574.546591:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:29403:x1830976123952256:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5709us (5820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.546601:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12496 00000100:00100000:2.0:1746155574.549651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.549899:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123952768 00000100:00100000:0.0:1746155574.549911:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123952768 00010000:00010000:0.0:1746155574.549943:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092834c00/0x844e5faceb5ecba8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f0 expref: 33 pid: 1625 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746155574.549979:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6322 00000100:00100000:0.0:1746155574.549986:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1961:x1830976123952768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155574.549998:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155574.550015:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092834c00/0x844e5faceb5ecba8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f0 expref: 33 pid: 1625 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746155574.550025:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092834c00/0x844e5faceb5ecba8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f0 expref: 33 pid: 1625 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746155574.550043:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092834c00/0x844e5faceb5ecba8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119f0 expref: 33 pid: 1625 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746155574.554280:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155574.554354:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123952768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4361us (4702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.554368:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6322 00000100:00100000:2.0:1746155574.554455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.554496:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123952896 00000100:00100000:0.0:1746155574.554523:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123952896 00010000:00010000:0.0:1746155574.554544:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119bf expref: 30 pid: 8437 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746155574.554572:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6323 00000100:00100000:0.0:1746155574.554578:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123952896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155574.554589:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155574.554606:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119bf expref: 30 pid: 8437 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746155574.554616:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119bf expref: 30 pid: 8437 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746155574.554634:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e68ae00/0x844e5faceb5ecb4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119bf expref: 30 pid: 8437 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746155574.554644:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.554646:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.554651:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.554657:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.554691:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155574.554702:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f808000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124653056:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155574.554749:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77300 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.555597:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123952640:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11199us (11311us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.555604:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4874 00002000:00100000:2.0:1746155574.555611:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800a5ae1500 x1830976123952640/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.555618:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1500 with x1830976123952640 ext(1048576->2097151) 00002000:00010000:2.0:1746155574.555622:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ae1500 00000100:00100000:1.0:1746155574.558170:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f808000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124653056:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155574.558189:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155574.558230:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976123952896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3652us (3775us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.558239:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6323 00000100:00100000:0.0:1746155574.561654:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.562309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.562358:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123953024 00000100:00100000:2.0:1746155574.562366:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123953024 00000100:00100000:3.0:1746155574.562387:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123953152 00000100:00100000:3.0:1746155574.562390:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123953152 00000100:00100000:2.0:1746155574.562413:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12497 00000100:00100000:2.0:1746155574.562419:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:29403:x1830976123953024:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155574.562436:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.562449:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a1a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.562475:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1193a expref: 34 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.562483:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800944abc00/0x844e5faceb5ecaf9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11987 expref: 26 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.562490:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092835200/0x844e5faceb5ecacf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11964 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.562500:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb88600/0x844e5faceb5ec971 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118bc expref: 26 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.562540:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155574.562542:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155574.562545:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 7/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3145728->3325951] (req 3145728->3325951) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.562572:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb88600/0x844e5faceb5ec971 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118bc expref: 26 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.562583:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb88600/0x844e5faceb5ec971 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118bc expref: 26 pid: 20796 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.562594:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124653184:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155574.562817:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12498 00000100:00100000:3.0:1746155574.562822:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29401:x1830976123953152:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155574.562828:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.562834:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a21 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.562845:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.562850:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155574.562851:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155574.562853:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a21 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.562865:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.562872:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 34 pid: 29728 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746155574.562878:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124653312:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.565860:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092835200/0x844e5faceb5ecacf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11964 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.565874:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092835200/0x844e5faceb5ecacf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11964 expref: 8 pid: 8437 timeout: 803 lvb_type: 1 00000100:00100000:2.0:1746155574.565886:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124653440:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155574.565894:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746155574.565941:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800944abc00/0x844e5faceb5ecaf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11987 expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.565953:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800944abc00/0x844e5faceb5ecaf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11987 expref: 27 pid: 20796 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.565960:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124653568:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.565981:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1193a expref: 34 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.565988:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1193a expref: 34 pid: 20796 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.565995:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124653696:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.566008:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.568297:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124653184:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155574.568322:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124653312:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155574.568344:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a21 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.568359:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1cec00, rc 0) 00000100:00100000:3.0:1746155574.568406:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+27:29401:x1830976123953152:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5582us (6096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.568414:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12498 00000100:00100000:2.0:1746155574.568637:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124653440:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.568644:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124653696:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.572153:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.572213:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124653568:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155574.572244:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3145728->3325951] (req 3145728->3325951) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.572260:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ced400, rc 0) 00000100:00100000:0.0:1746155574.572302:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29403:x1830976123953024:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 9882us (10654us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.572309:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12497 00000100:00100000:3.0:1746155574.572318:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123953280 00000100:00100000:3.0:1746155574.572324:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123953280 00002000:00100000:3.0:1746155574.572353:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1703936->1961983) req@ffff8800a0ac4e00 x1830976123953280/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.572361:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac4e00 with x1830976123953280 ext(1703936->1961983) 00010000:00010000:3.0:1746155574.572369:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 35 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.572379:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 35 pid: 29728 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746155574.572384:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0ac4e00 00000100:00100000:3.0:1746155574.572397:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 788 00000100:00100000:3.0:1746155574.572403:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976123953280:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155574.572702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.572750:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.572766:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123953536 00000100:00100000:2.0:1746155574.572769:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123953536 00010000:00010000:2.0:1746155574.572783:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb88600/0x844e5faceb5ec971 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118bc expref: 26 pid: 20796 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.572808:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123953408 00000100:00100000:2.0:1746155574.572811:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123953408 00010000:00010000:2.0:1746155574.572820:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092835200/0x844e5faceb5ecacf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11964 expref: 9 pid: 8437 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746155574.572820:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6324 00000100:00100000:0.0:1746155574.572826:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1960:x1830976123953536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155574.572839:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6325 00000100:00100000:2.0:1746155574.572843:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123953408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155574.572847:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.572848:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.572859:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092835200/0x844e5faceb5ecacf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11964 expref: 9 pid: 8437 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746155574.572859:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb88600/0x844e5faceb5ec971 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 9 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118bc expref: 26 pid: 20796 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.572868:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092835200/0x844e5faceb5ecacf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11964 expref: 9 pid: 8437 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746155574.572876:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb88600/0x844e5faceb5ec971 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118bc expref: 26 pid: 20796 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746155574.574108:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb88600/0x844e5faceb5ec971 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118bc expref: 26 pid: 20796 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.575100:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092835200/0x844e5faceb5ecacf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11964 expref: 9 pid: 8437 timeout: 803 lvb_type: 1 00010000:00010000:2.0:1746155574.575254:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155574.575254:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155574.575306:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976123953408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2461us (2554us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.575346:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1960:x1830976123953536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2519us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.575355:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6324 00000100:00100000:2.0:1746155574.576024:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6325 00000100:00100000:0.0:1746155574.576484:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.576524:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123953664 00000100:00100000:2.0:1746155574.576531:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123953664 00010000:00010000:2.0:1746155574.576551:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1193a expref: 37 pid: 20796 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.576589:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6326 00000100:00100000:2.0:1746155574.576595:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976123953664:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155574.576604:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.576626:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1193a expref: 37 pid: 20796 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.576634:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1193a expref: 37 pid: 20796 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.576650:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1cee00/0x844e5faceb5eca90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1193a expref: 37 pid: 20796 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.576659:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155574.576678:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976123953664:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.576682:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6326 00000100:00100000:0.0:1746155574.578324:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.578391:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123953792 00000100:00100000:1.0:1746155574.578396:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123953792 00010000:00010000:1.0:1746155574.578414:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800944abc00/0x844e5faceb5ecaf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11987 expref: 25 pid: 20796 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155574.578445:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6327 00000100:00100000:1.0:1746155574.578451:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f808e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976123953792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155574.578460:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155574.578471:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800944abc00/0x844e5faceb5ecaf9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11987 expref: 25 pid: 20796 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.578480:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800944abc00/0x844e5faceb5ecaf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11987 expref: 25 pid: 20796 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.578499:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800944abc00/0x844e5faceb5ecaf9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11987 expref: 25 pid: 20796 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.578540:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.578542:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.578547:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.578555:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.578579:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155574.578590:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124653824:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155574.579193:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976123953280:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 6788us (7047us total) trans 17179873265 rc 0/0 00000100:00100000:2.0:1746155574.579201:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 788 00002000:00100000:2.0:1746155574.579209:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1703936->1961983) req@ffff8800a0ac4e00 x1830976123953280/t17179873265(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/448 e 0 to 0 dl 1746155585 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.579218:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac4e00 with x1830976123953280 ext(1703936->1961983) 00010000:00010000:2.0:1746155574.579224:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 36 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.579234:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 36 pid: 29728 timeout: 803 lvb_type: 0 00002000:00010000:2.0:1746155574.579240:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0ac4e00 00000100:00100000:1.0:1746155574.579632:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155574.583041:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124653824:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155574.583061:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155574.583103:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f808e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976123953792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4651us (4783us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.583112:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6327 00000100:00100000:0.0:1746155574.583861:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.583955:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123953920 00000100:00100000:1.0:1746155574.583960:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123953920 00010000:00010000:1.0:1746155574.583983:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 36 pid: 29728 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746155574.585218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.585264:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123954176 00000100:00100000:3.0:1746155574.585268:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123954176 00002000:00100000:3.0:1746155574.585294:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3321856->3325951) req@ffff88009f809500 x1830976123954176/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.585306:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f809500 with x1830976123954176 ext(3321856->3325951) 00002000:00010000:3.0:1746155574.585309:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f809500 00000100:00100000:1.0:1746155574.585312:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6328 00000100:00100000:1.0:1746155574.585320:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f809180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976123953920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155574.585330:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4875 00010000:00010000:1.0:1746155574.585332:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155574.585334:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f809500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123954176:12345-192.168.202.51@tcp:3:multiop.0 00010000:00010000:1.0:1746155574.585351:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 36 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.585366:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 36 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.585383:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e68aa00/0x844e5faceb5ecb31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1703936->1961983) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119a3 expref: 36 pid: 29728 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.585393:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.585395:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.585399:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a21 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.585406:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a21 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.585432:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a21 expref: 24 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155574.585442:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124653952:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155574.585456:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f809500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123954176:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 120us (246us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155574.585461:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4875 00002000:00100000:3.0:1746155574.585465:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3321856->3325951) req@ffff88009f809500 x1830976123954176/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/4536 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.585471:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f809500 with x1830976123954176 ext(3321856->3325951) 00002000:00010000:3.0:1746155574.585474:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f809500 00000100:00100000:1.0:1746155574.585496:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155574.588018:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124653952:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155574.588036:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155574.588080:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f809180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976123953920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2759us (4218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.588088:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6328 00000100:00100000:0.0:1746155574.589729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.589840:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123954432 00000100:00100000:3.0:1746155574.589846:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123954432 00000100:00100000:3.0:1746155574.589977:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4109 00000100:00100000:3.0:1746155574.589984:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+27:29403:x1830976123954432:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155574.590800:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+28:29403:x1830976123954432:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 815us (1071us total) trans 8589944088 rc 0/0 00000100:00100000:3.0:1746155574.590807:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4109 00000100:00100000:0.0:1746155574.592383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.592418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.592470:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123954816 00000100:00100000:1.0:1746155574.592476:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123954816 00000100:00100000:3.0:1746155574.592531:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123954944 00000100:00100000:3.0:1746155574.592534:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123954944 00002000:00100000:3.0:1746155574.592554:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009f809f80 x1830976123954944/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.592563:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f809f80 with x1830976123954944 ext(1048576->2097151) 00002000:00010000:3.0:1746155574.592567:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f809f80 00000100:00100000:3.0:1746155574.592580:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4876 00000100:00100000:3.0:1746155574.592586:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123954944:12345-192.168.202.51@tcp:3:multiop.0 00002000:00100000:1.0:1746155574.592626:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009f809c00 x1830976123954816/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155574.592632:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f809c00 with x1830976123954816 ext(1048576->2097151) 00002000:00010000:1.0:1746155574.592635:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f809c00 00000100:00100000:1.0:1746155574.592778:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4877 00000100:00100000:1.0:1746155574.592783:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f809c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1960:x1830976123954816:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155574.607667:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f809c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1960:x1830976123954816:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14876us (15278us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155574.607677:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4877 00002000:00100000:1.0:1746155574.607687:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009f809c00 x1830976123954816/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155574.607696:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f809c00 with x1830976123954816 ext(1048576->2097151) 00002000:00010000:1.0:1746155574.607701:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f809c00 00000100:00100000:0.0:1746155574.609093:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.609158:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123955072 00000100:00100000:2.0:1746155574.609164:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123955072 00000100:00100000:0.0:1746155574.609856:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.610089:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123955200 00000100:00100000:2.0:1746155574.610093:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123955200 00000100:00100000:0.0:1746155574.610117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.610118:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12499 00000100:00100000:2.0:1746155574.610125:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f80a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976123955072:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155574.610129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155574.610139:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155574.610149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155574.610154:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ceca00/0x844e5faceb5ecbfc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a28 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.610171:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155574.610172:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123955328 00010000:00010000:2.0:1746155574.610173:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155574.610174:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123955328 00010000:00010000:2.0:1746155574.610180:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ceca00/0x844e5faceb5ecbfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a28 expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155574.610187:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123955456 00000100:00100000:0.0:1746155574.610189:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123955456 00010000:00010000:2.0:1746155574.610193:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ceca00/0x844e5faceb5ecbfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a28 expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155574.610196:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123955584 00000100:00100000:0.0:1746155574.610198:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123955584 00010000:00010000:2.0:1746155574.610201:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ceca00, rc 0) 00000100:00100000:0.0:1746155574.610207:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12500 00000100:00100000:0.0:1746155574.610211:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f80a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1962:x1830976123955200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155574.610218:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155574.610226:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d5b000/0x844e5faceb5ecc03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a2f expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155574.610230:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f80a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123955072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 107us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.610235:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12499 00010000:00010000:0.0:1746155574.610236:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.610237:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.610241:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d5b000/0x844e5faceb5ecc03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a2f expref: 38 pid: 18270 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155574.610247:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12501 00010000:00010000:0.0:1746155574.610250:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d5b000/0x844e5faceb5ecc03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a2f expref: 38 pid: 18270 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155574.610251:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f80aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976123955328:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155574.610256:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155574.610256:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d5b000, rc 0) 00010000:00010000:2.0:1746155574.610261:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5cec600/0x844e5faceb5ecc0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a36 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.610268:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155574.610268:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f80a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1962:x1830976123955200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 56us (416us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155574.610269:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.610273:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cec600/0x844e5faceb5ecc0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a36 expref: 39 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155574.610273:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12500 00000100:00100000:0.0:1746155574.610280:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12502 00010000:00010000:2.0:1746155574.610281:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cec600/0x844e5faceb5ecc0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a36 expref: 38 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155574.610284:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f80ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123955456:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155574.610287:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cec600, rc 0) 00010000:00010000:0.0:1746155574.610289:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155574.610294:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d5b200/0x844e5faceb5ecc11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a3d expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155574.610297:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f80aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976123955328:12345-192.168.202.51@tcp:101:cat.0 Request processed in 46us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.610301:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12501 00000100:00100000:2.0:1746155574.610311:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12503 00000100:00100000:2.0:1746155574.610314:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f80b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1962:x1830976123955584:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155574.610318:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155574.610322:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f80b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124654080:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155574.610323:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5cecc00/0x844e5faceb5ecc18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a44 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155574.610339:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124654208:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155574.610361:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.610604:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155574.610715:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1960:x1830976123954944:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 18127us (18294us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155574.610722:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4876 00002000:00100000:3.0:1746155574.610729:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009f809f80 x1830976123954944/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.610737:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f809f80 with x1830976123954944 ext(1048576->2097151) 00002000:00010000:3.0:1746155574.610741:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f809f80 00002000:00010000:3.0:1746155574.612090:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime: 1746155574 -> 1746155575 00002000:00010000:3.0:1746155574.612094:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime: 1746155573 -> 1746155575 00002000:00010000:3.0:1746155574.612095:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime: 1746155573 -> 1746155575 00000100:00100000:3.0:1746155574.612109:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124654208:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155574.612127:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cecc00/0x844e5faceb5ecc18 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a44 expref: 38 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.612137:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cecc00/0x844e5faceb5ecc18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a44 expref: 38 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.612148:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cecc00, rc 0) 00000100:00100000:3.0:1746155574.612177:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f80b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1962:x1830976123955584:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1861us (2026us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155574.612183:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12503 00002000:00010000:2.0:1746155574.612537:0:18270:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime: 1746155574 -> 1746155575 00002000:00010000:2.0:1746155574.612540:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime: 1746155574 -> 1746155575 00002000:00010000:2.0:1746155574.612541:0:18270:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime: 1746155574 -> 1746155575 00000100:00100000:2.0:1746155574.612552:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f80b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124654080:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155574.612567:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d5b200/0x844e5faceb5ecc11 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a3d expref: 31 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.612575:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d5b200/0x844e5faceb5ecc11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a3d expref: 31 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.612854:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d5b200, rc 0) 00000100:00100000:2.0:1746155574.613460:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f80ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123955456:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3173us (3327us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155574.613467:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12502 00000100:00100000:0.0:1746155574.621764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.622000:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.622222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.622652:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123955840 00000100:00100000:3.0:1746155574.622660:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123955840 00002000:00100000:3.0:1746155574.622694:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009f80b800 x1830976123955840/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.622702:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f80b800 with x1830976123955840 ext(0->1048575) 00002000:00010000:3.0:1746155574.622707:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f80b800 00000100:00100000:3.0:1746155574.622721:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123956096 00000100:00100000:3.0:1746155574.622723:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123956096 00002000:00100000:3.0:1746155574.622732:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009f80bb80 x1830976123956096/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.622739:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f80bb80 with x1830976123956096 ext(1048576->2097151) 00002000:00010000:3.0:1746155574.622742:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f80bb80 00000100:00100000:3.0:1746155574.622749:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123956352 00000100:00100000:3.0:1746155574.622750:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123956352 00002000:00100000:3.0:1746155574.622757:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009f80b480 x1830976123956352/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.622763:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f80b480 with x1830976123956352 ext(1048576->2097151) 00002000:00010000:3.0:1746155574.622765:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f80b480 00000100:00100000:3.0:1746155574.622779:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4878 00000100:00100000:3.0:1746155574.622785:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f80b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123955840:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155574.623935:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4879 00000100:00100000:3.0:1746155574.623941:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f80bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976123956096:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155574.624795:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4880 00000100:00100000:3.0:1746155574.624801:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f80b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1962:x1830976123956352:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155574.639109:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f80b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976123955840:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16317us (17344us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155574.639119:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4878 00002000:00100000:3.0:1746155574.639128:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009f80b800 x1830976123955840/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.639137:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f80b800 with x1830976123955840 ext(0->1048575) 00002000:00010000:3.0:1746155574.639142:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f80b800 00000100:00100000:0.0:1746155574.640250:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.640280:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.640306:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.640320:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123956736 00000100:00100000:0.0:1746155574.640326:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123956736 00000100:00100000:1.0:1746155574.640328:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123956864 00000100:00100000:1.0:1746155574.640333:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123956864 00002000:00100000:1.0:1746155574.640351:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3878911) req@ffff88012f1f3100 x1830976123956864/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155574.640351:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009f808000 x1830976123956736/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155574.640359:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f808000 with x1830976123956736 ext(2097152->3145727) 00002000:00100000:1.0:1746155574.640360:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3100 with x1830976123956864 ext(3145728->3878911) 00002000:00010000:0.0:1746155574.640362:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f808000 00002000:00010000:1.0:1746155574.640363:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3100 00000100:00100000:0.0:1746155574.640382:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123957248 00000100:00100000:0.0:1746155574.640384:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123957248 00000100:00100000:1.0:1746155574.640389:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4881 00000100:00100000:1.0:1746155574.640395:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1961:x1830976123956736:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:0.0:1746155574.640395:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3325952->4194303) req@ffff880099ef6c50 x1830976123957248/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155574.640402:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ef6c50 with x1830976123957248 ext(3325952->4194303) 00002000:00010000:0.0:1746155574.640405:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ef6c50 00000100:00100000:0.0:1746155574.640420:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4882 00000100:00100000:0.0:1746155574.640425:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1961:x1830976123956864:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155574.640429:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4883 00000100:00100000:1.0:1746155574.640434:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123957248:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155574.642853:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.642913:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123957120 00000100:00100000:3.0:1746155574.642921:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123957120 00002000:00100000:3.0:1746155574.642949:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a0ac4a80 x1830976123957120/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.642958:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac4a80 with x1830976123957120 ext(2097152->3145727) 00002000:00010000:3.0:1746155574.642962:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac4a80 00000100:00100000:3.0:1746155574.642980:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4884 00000100:00100000:3.0:1746155574.642986:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1961:x1830976123957120:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155574.643224:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f80bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1962:x1830976123956096:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19282us (21223us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.643230:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4879 00002000:00100000:2.0:1746155574.643236:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009f80bb80 x1830976123956096/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.643243:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f80bb80 with x1830976123956096 ext(1048576->2097151) 00002000:00010000:2.0:1746155574.643247:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f80bb80 00000100:00100000:3.0:1746155574.649980:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f80b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1962:x1830976123956352:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25171us (27750us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155574.649990:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4880 00002000:00100000:3.0:1746155574.649999:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009f80b480 x1830976123956352/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.650008:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f80b480 with x1830976123956352 ext(1048576->2097151) 00002000:00010000:3.0:1746155574.650012:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f80b480 00000100:00100000:1.0:1746155574.657030:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1961:x1830976123957248:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16587us (16715us total) trans 0 rc 868352/868352 00000100:00100000:1.0:1746155574.657040:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4883 00002000:00100000:1.0:1746155574.657048:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (3325952->4194303) req@ffff880099ef6c50 x1830976123957248/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 868352/868352 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155574.657057:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ef6c50 with x1830976123957248 ext(3325952->4194303) 00002000:00010000:1.0:1746155574.657062:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ef6c50 00000100:00100000:2.0:1746155574.659725:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1961:x1830976123956736:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19321us (19467us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.659736:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4881 00002000:00100000:2.0:1746155574.659746:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009f808000 x1830976123956736/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.659754:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f808000 with x1830976123956736 ext(2097152->3145727) 00002000:00010000:2.0:1746155574.659759:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f808000 00000100:00100000:2.0:1746155574.660849:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123956864:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20422us (20565us total) trans 0 rc 733184/733184 00000100:00100000:2.0:1746155574.660855:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4882 00002000:00100000:2.0:1746155574.660860:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3878911) req@ffff88012f1f3100 x1830976123956864/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.660868:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3100 with x1830976123956864 ext(3145728->3878911) 00002000:00010000:2.0:1746155574.660870:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3100 00000100:00100000:0.0:1746155574.665774:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976123957120:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22780us (22921us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155574.665784:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4884 00002000:00100000:0.0:1746155574.665793:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a0ac4a80 x1830976123957120/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155574.665801:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac4a80 with x1830976123957120 ext(2097152->3145727) 00002000:00010000:0.0:1746155574.665805:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac4a80 00000100:00100000:0.0:1746155574.675299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.676381:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123957632 00000100:00100000:2.0:1746155574.676389:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123957632 00000100:00100000:2.0:1746155574.676425:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12504 00000100:00100000:2.0:1746155574.676431:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976123957632:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155574.676447:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.676461:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f200/0x844e5faceb5ecc1f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a52 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155574.676522:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124654336:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155574.676623:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.676685:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123957504 00000100:00100000:3.0:1746155574.676688:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123957504 00000100:00100000:3.0:1746155574.676705:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12505 00000100:00100000:3.0:1746155574.676710:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123957504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155574.676716:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.676724:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ecc26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a4b expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155574.676746:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124654464:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155574.676964:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155574.676993:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155574.677144:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.677233:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123957888 00000100:00100000:2.0:1746155574.677235:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123957888 00002000:00100000:2.0:1746155574.677257:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880094c32a00 x1830976123957888/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.677271:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c32a00 with x1830976123957888 ext(4194304->4956159) 00002000:00010000:2.0:1746155574.677275:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c32a00 00000100:00100000:2.0:1746155574.677487:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4885 00000100:00100000:2.0:1746155574.677493:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1962:x1830976123957888:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155574.680538:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124654336:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155574.680565:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f200/0x844e5faceb5ecc1f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a52 expref: 38 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.680577:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f200/0x844e5faceb5ecc1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a52 expref: 38 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.680598:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc8f200, rc 0) 00000100:00100000:2.0:1746155574.680628:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976123957632:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4196us (5335us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155574.680635:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12504 00000100:00100000:3.0:1746155574.680805:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124654464:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155574.680819:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ecc26 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a4b expref: 31 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.680828:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cf200/0x844e5faceb5ecc26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a4b expref: 31 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.681702:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1cf200, rc 0) 00000100:00100000:3.0:1746155574.681737:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976123957504:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5025us (5113us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155574.681742:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12505 00000100:00100000:0.0:1746155574.682613:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1962:x1830976123957888:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5119us (5467us total) trans 0 rc 761856/761856 00000100:00100000:0.0:1746155574.682621:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4885 00002000:00100000:0.0:1746155574.682627:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880094c32a00 x1830976123957888/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155574.682641:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c32a00 with x1830976123957888 ext(4194304->4956159) 00002000:00010000:0.0:1746155574.682646:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c32a00 00000100:00100000:0.0:1746155574.684625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.684832:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123958016 00000100:00100000:3.0:1746155574.684838:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123958016 00000100:00100000:3.0:1746155574.684960:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12506 00000100:00100000:3.0:1746155574.684967:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29408:x1830976123958016:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155574.684979:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.684992:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a59 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.685014:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.685021:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155574.685023:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155574.685026:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a59 expref: 31 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.685047:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.685062:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 31 pid: 4461 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746155574.685071:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124654592:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155574.685132:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155574.694113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.694673:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124654592:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155574.694696:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a59 expref: 31 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.694712:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1cfe00, rc 0) 00000100:00100000:3.0:1746155574.694747:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29408:x1830976123958016:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9780us (10126us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.694755:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12506 00000100:00100000:1.0:1746155574.694834:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123958144 00000100:00100000:1.0:1746155574.694840:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123958144 00002000:00100000:1.0:1746155574.694867:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3878912->4194303) req@ffff88012f1f2680 x1830976123958144/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155574.694877:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2680 with x1830976123958144 ext(3878912->4194303) 00010000:00010000:1.0:1746155574.694882:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 32 pid: 4461 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.694893:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 32 pid: 4461 timeout: 803 lvb_type: 0 00002000:00010000:1.0:1746155574.694899:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1f2680 00000100:00100000:1.0:1746155574.694927:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 789 00000100:00100000:1.0:1746155574.694933:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1960:x1830976123958144:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155574.700128:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1960:x1830976123958144:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5186us (6014us total) trans 21474840657 rc 0/0 00000100:00100000:1.0:1746155574.700138:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 789 00002000:00100000:1.0:1746155574.700148:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3878912->4194303) req@ffff88012f1f2680 x1830976123958144/t21474840657(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/448 e 0 to 0 dl 1746155585 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155574.700156:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2680 with x1830976123958144 ext(3878912->4194303) 00010000:00010000:1.0:1746155574.700164:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 34 pid: 4461 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.700177:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 34 pid: 4461 timeout: 803 lvb_type: 0 00002000:00010000:1.0:1746155574.700183:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1f2680 00000100:00100000:0.0:1746155574.703974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.712822:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123958272 00000100:00100000:1.0:1746155574.712832:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123958272 00010000:00010000:1.0:1746155574.712867:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 34 pid: 4461 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155574.712910:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6329 00000100:00100000:1.0:1746155574.712917:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1962:x1830976123958272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155574.712928:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155574.712945:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 34 pid: 4461 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.712960:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 34 pid: 4461 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.712978:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cec400/0x844e5faceb5ecbe7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3878912->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a13 expref: 34 pid: 4461 timeout: 803 lvb_type: 0 00010000:00010000:1.0:1746155574.713001:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.713003:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.713008:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a59 expref: 30 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.713016:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a59 expref: 30 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.713041:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a59 expref: 30 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155574.713051:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124654720:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155574.713130:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155574.713681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.713728:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123958400 00000100:00100000:3.0:1746155574.713732:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123958400 00000100:00100000:3.0:1746155574.713762:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12507 00000100:00100000:3.0:1746155574.713768:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29411:x1830976123958400:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155574.713781:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.713791:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a60 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.713809:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b8 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.713817:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e68b000/0x844e5faceb5ecba1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119e9 expref: 33 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.713823:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155574.713824:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155574.713827:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1380352->1519615] (req 1380352->1519615) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.713842:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e68b000/0x844e5faceb5ecba1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119e9 expref: 33 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.713851:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e68b000/0x844e5faceb5ecba1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119e9 expref: 33 pid: 4461 timeout: 803 lvb_type: 1 00000100:00100000:3.0:1746155574.713859:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124654848:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155574.713916:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b8 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.713924:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b8 expref: 32 pid: 8437 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746155574.714328:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124654976:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155574.715371:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155574.721218:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124654720:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155574.721236:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155574.721285:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1962:x1830976123958272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8367us (17316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.721293:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6329 00000100:00100000:0.0:1746155574.721340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.721471:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123958656 00000100:00100000:1.0:1746155574.721477:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123958656 00002000:00100000:1.0:1746155574.721542:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012f1f0e00 x1830976123958656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155574.721551:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0e00 with x1830976123958656 ext(2097152->3145727) 00002000:00010000:1.0:1746155574.721555:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f0e00 00000100:00100000:1.0:1746155574.721568:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4886 00000100:00100000:1.0:1746155574.721574:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123958656:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155574.729710:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124654848:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155574.731722:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.731910:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123958784 00000100:00100000:1.0:1746155574.731917:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123958784 00010000:00010000:1.0:1746155574.731945:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68b000/0x844e5faceb5ecba1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119e9 expref: 33 pid: 4461 timeout: 803 lvb_type: 1 00000100:00100000:1.0:1746155574.731980:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6330 00000100:00100000:1.0:1746155574.731987:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1961:x1830976123958784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155574.731998:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155574.732014:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e68b000/0x844e5faceb5ecba1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119e9 expref: 33 pid: 4461 timeout: 803 lvb_type: 1 00010000:00010000:1.0:1746155574.732024:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e68b000/0x844e5faceb5ecba1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119e9 expref: 33 pid: 4461 timeout: 803 lvb_type: 1 00010000:00010000:1.0:1746155574.732041:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e68b000/0x844e5faceb5ecba1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119e9 expref: 33 pid: 4461 timeout: 803 lvb_type: 1 00010000:00010000:1.0:1746155574.732065:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155574.732103:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1961:x1830976123958784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 116us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.732110:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6330 00000100:00100000:0.0:1746155574.732871:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124654976:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155574.732890:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1380352->1519615] (req 1380352->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 34 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.732899:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1cfc00, rc 0) 00000100:00100000:0.0:1746155574.732918:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:29411:x1830976123958400:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 19150us (19239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.732923:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12507 00000100:00100000:0.0:1746155574.734722:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.734873:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123958912 00000100:00100000:2.0:1746155574.734878:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123958912 00010000:00010000:2.0:1746155574.734896:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b8 expref: 34 pid: 8437 timeout: 803 lvb_type: 0 00000100:00100000:2.0:1746155574.734925:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6331 00000100:00100000:2.0:1746155574.734930:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123958912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155574.734939:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155574.734951:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b8 expref: 34 pid: 8437 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.734962:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b8 expref: 34 pid: 8437 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.734976:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e68a800/0x844e5faceb5ecb46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119b8 expref: 34 pid: 8437 timeout: 803 lvb_type: 0 00010000:00010000:2.0:1746155574.734992:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.734993:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.734999:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.735005:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.735026:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155574.735034:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124655104:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155574.735084:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.736792:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976123958656:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 15214us (15449us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.736800:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4886 00002000:00100000:2.0:1746155574.736806:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012f1f0e00 x1830976123958656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.736814:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0e00 with x1830976123958656 ext(2097152->3145727) 00002000:00010000:2.0:1746155574.736819:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f0e00 00000100:00100000:3.0:1746155574.736907:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124655104:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155574.736918:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.736939:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123958912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2009us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.736944:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6331 00000100:00100000:0.0:1746155574.738665:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.738790:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123959168 00000100:00100000:3.0:1746155574.738795:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123959168 00002000:00100000:3.0:1746155574.738824:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1380352->1384447) req@ffff88012f1f3800 x1830976123959168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.738831:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3800 with x1830976123959168 ext(1380352->1384447) 00002000:00010000:3.0:1746155574.738835:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3800 00000100:00100000:3.0:1746155574.738848:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4887 00000100:00100000:3.0:1746155574.738855:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123959168:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155574.740013:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123959168:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1155us (1348us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155574.740019:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4887 00002000:00100000:3.0:1746155574.740026:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1380352->1384447) req@ffff88012f1f3800 x1830976123959168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/4536 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.740033:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3800 with x1830976123959168 ext(1380352->1384447) 00002000:00010000:3.0:1746155574.740035:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3800 00000100:00100000:0.0:1746155574.740571:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.740591:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123959296 00000100:00100000:1.0:1746155574.740595:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123959296 00000100:00100000:1.0:1746155574.741684:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12508 00000100:00100000:1.0:1746155574.741693:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:29408:x1830976123959296:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155574.741705:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.741724:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a67 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.741748:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.741756:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155574.741757:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155574.741760:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a67 expref: 38 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.741794:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.741805:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 23 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:1.0:1746155574.741818:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124655232:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155574.741985:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155574.742969:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.743009:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123959552 00000100:00100000:3.0:1746155574.743015:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123959552 00002000:00100000:3.0:1746155574.743040:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1515520->1519615) req@ffff88012f1f3100 x1830976123959552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.743048:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3100 with x1830976123959552 ext(1515520->1519615) 00002000:00010000:3.0:1746155574.743051:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3100 00000100:00100000:3.0:1746155574.743076:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4888 00000100:00100000:3.0:1746155574.743083:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123959552:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155574.743446:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976123959552:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 362us (476us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155574.743453:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4888 00002000:00100000:3.0:1746155574.743458:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1515520->1519615) req@ffff88012f1f3100 x1830976123959552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/4536 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.743465:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3100 with x1830976123959552 ext(1515520->1519615) 00002000:00010000:3.0:1746155574.743468:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3100 00000100:00100000:0.0:1746155574.746050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.746226:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124655232:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155574.746250:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a67 expref: 38 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.746264:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df8d400, rc 0) 00000100:00100000:1.0:1746155574.746292:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:29408:x1830976123959296:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4600us (5721us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.746299:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12508 00000100:00100000:3.0:1746155574.746357:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123959680 00000100:00100000:3.0:1746155574.746361:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123959680 00002000:00100000:3.0:1746155574.746384:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->3325951) req@ffff8800935bc000 x1830976123959680/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.746391:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bc000 with x1830976123959680 ext(3145728->3325951) 00010000:00010000:3.0:1746155574.746397:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 24 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.746408:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 24 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746155574.746414:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800935bc000 00000100:00100000:3.0:1746155574.746427:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 790 00000100:00100000:3.0:1746155574.746433:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976123959680:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155574.751012:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123959680:12345-192.168.202.51@tcp:4:cat.0 Request processed in 4571us (4959us total) trans 17179873266 rc 0/0 00000100:00100000:3.0:1746155574.751023:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 790 00002000:00100000:3.0:1746155574.751032:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->3325951) req@ffff8800935bc000 x1830976123959680/t17179873266(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/448 e 0 to 0 dl 1746155585 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.751041:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bc000 with x1830976123959680 ext(3145728->3325951) 00010000:00010000:3.0:1746155574.751050:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.751063:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00002000:00010000:3.0:1746155574.751070:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800935bc000 00000100:00100000:0.0:1746155574.758806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.758895:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123959808 00000100:00100000:3.0:1746155574.758903:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123959808 00010000:00010000:3.0:1746155574.758933:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00000100:00100000:3.0:1746155574.761179:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6332 00000100:00100000:3.0:1746155574.761191:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123959808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155574.761204:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155574.761224:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.761236:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.761253:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ced400/0x844e5faceb5ecbee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3325951) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a1a expref: 26 pid: 8436 timeout: 803 lvb_type: 0 00010000:00010000:3.0:1746155574.761272:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155574.761274:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155574.761280:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a67 expref: 37 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.761287:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a67 expref: 37 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.761311:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a67 expref: 37 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155574.761320:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124655360:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155574.761384:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155574.769339:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124655360:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155574.769356:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155574.769390:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123959808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8202us (10591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.769399:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6332 00000100:00100000:0.0:1746155574.771415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.771443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.771479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.772341:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123960064 00000100:00100000:1.0:1746155574.772342:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123960320 00000100:00100000:2.0:1746155574.772348:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123960064 00000100:00100000:1.0:1746155574.772348:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123960320 00002000:00100000:1.0:1746155574.772381:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800935bdf80 x1830976123960320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.772385:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800935bdc00 x1830976123960064/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155574.772390:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bdf80 with x1830976123960320 ext(3145728->4194303) 00002000:00100000:2.0:1746155574.772392:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bdc00 with x1830976123960064 ext(2097152->3145727) 00002000:00010000:1.0:1746155574.772394:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935bdf80 00002000:00010000:2.0:1746155574.772395:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935bdc00 00000100:00100000:1.0:1746155574.772420:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123960576 00000100:00100000:1.0:1746155574.772422:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123960576 00000100:00100000:2.0:1746155574.772426:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4889 00000100:00100000:2.0:1746155574.772433:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976123960320:12345-192.168.202.51@tcp:3:multiop.0 00002000:00100000:1.0:1746155574.772433:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800935bed80 x1830976123960576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155574.772439:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bed80 with x1830976123960576 ext(3145728->4194303) 00002000:00010000:1.0:1746155574.772442:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bed80 00000100:00100000:1.0:1746155574.772453:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4890 00000100:00100000:1.0:1746155574.772459:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976123960064:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155574.772489:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4891 00000100:00100000:1.0:1746155574.772493:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123960576:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155574.786498:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976123960320:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14058us (15047us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.786530:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4889 00002000:00100000:2.0:1746155574.786539:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800935bdf80 x1830976123960320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.786547:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bdf80 with x1830976123960320 ext(3145728->4194303) 00002000:00010000:2.0:1746155574.786552:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935bdf80 00000100:00100000:1.0:1746155574.795643:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123960576:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 23141us (24155us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155574.795654:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4891 00002000:00100000:1.0:1746155574.795664:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800935bed80 x1830976123960576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155574.795673:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bed80 with x1830976123960576 ext(3145728->4194303) 00002000:00010000:1.0:1746155574.795677:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bed80 00000100:00100000:2.0:1746155574.796853:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976123960064:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 24392us (25439us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.796860:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4890 00002000:00100000:2.0:1746155574.796865:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800935bdc00 x1830976123960064/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.796872:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bdc00 with x1830976123960064 ext(2097152->3145727) 00002000:00010000:2.0:1746155574.796876:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935bdc00 00000100:00100000:0.0:1746155574.809388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.811083:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123960832 00000100:00100000:2.0:1746155574.811092:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123960832 00002000:00100000:2.0:1746155574.811136:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800935bf100 x1830976123960832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.811145:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bf100 with x1830976123960832 ext(4194304->4956159) 00002000:00010000:2.0:1746155574.811150:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bf100 00000100:00100000:2.0:1746155574.811176:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4892 00000100:00100000:2.0:1746155574.811183:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123960832:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155574.819285:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976123960832:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8094us (9896us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155574.819296:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4892 00002000:00100000:2.0:1746155574.819306:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800935bf100 x1830976123960832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.819314:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bf100 with x1830976123960832 ext(4194304->4956159) 00002000:00010000:2.0:1746155574.819319:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bf100 00000100:00100000:0.0:1746155574.824367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.824536:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123961088 00000100:00100000:2.0:1746155574.824544:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123961088 00000100:00100000:2.0:1746155574.825144:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10112 00000100:00100000:2.0:1746155574.825152:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+28:29415:x1830976123961088:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155574.825173:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.825189:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7e00/0x844e5faceb5ecc42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a6e expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.825273:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7c00/0x844e5faceb5ecc49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825283:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7c00/0x844e5faceb5ecc49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825293:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7c00/0x844e5faceb5ecc49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825304:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7a00/0x844e5faceb5ecc50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825309:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7a00/0x844e5faceb5ecc50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825313:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7a00/0x844e5faceb5ecc50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825393:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7800/0x844e5faceb5ecc57 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825401:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7800/0x844e5faceb5ecc57 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825406:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7800/0x844e5faceb5ecc57 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155574.825467:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155574.825581:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7c00/0x844e5faceb5ecc49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825588:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7c00/0x844e5faceb5ecc49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825592:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7c00/0x844e5faceb5ecc49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825597:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938e7c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155574.825600:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7c00/0x844e5faceb5ecc49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825606:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7c00/0x844e5faceb5ecc49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825614:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155574.825616:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155574.825619:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7c00/0x844e5faceb5ecc49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.825624:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7c00/0x844e5faceb5ecc49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.826842:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7a00/0x844e5faceb5ecc50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.826850:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7a00/0x844e5faceb5ecc50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.826855:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7a00/0x844e5faceb5ecc50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.826858:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938e7a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155574.826861:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7a00/0x844e5faceb5ecc50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.826865:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7a00/0x844e5faceb5ecc50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.826872:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9f00) 00010000:00010000:2.0:1746155574.826874:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155574.826877:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7a00/0x844e5faceb5ecc50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.826881:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7a00/0x844e5faceb5ecc50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155574.826920:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7e00/0x844e5faceb5ecc42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a6e expref: 31 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.826930:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7800/0x844e5faceb5ecc57 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a6e expref: 30 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.826936:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155574.826937:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155574.826939:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e7800, rc 0) 00000100:00100000:2.0:1746155574.829160:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+30:29415:x1830976123961088:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4000us (4792us total) trans 8589944089 rc 0/0 00000100:00100000:2.0:1746155574.829169:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10112 00000100:00100000:0.0:1746155574.839142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.839181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.839219:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123961472 00000100:00100000:0.0:1746155574.839226:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123961472 00000100:00100000:0.0:1746155574.839273:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 612 00000100:00100000:0.0:1746155574.839280:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1963:x1830976123961472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155574.839291:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155574.839308:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7800/0x844e5faceb5ecc57 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a6e expref: 30 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.839324:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155574.839327:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155574.839357:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+29:1963:x1830976123961472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.839362:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 612 00000100:00100000:3.0:1746155574.839492:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123961344 00000100:00100000:3.0:1746155574.839495:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123961344 00000100:00100000:3.0:1746155574.839543:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10113 00000100:00100000:3.0:1746155574.839547:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f38bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+29:29417:x1830976123961344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155574.839562:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.839571:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecc65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a75 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.839644:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7400/0x844e5faceb5ecc6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839652:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7400/0x844e5faceb5ecc6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839659:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7400/0x844e5faceb5ecc6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839667:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839672:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839676:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839745:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7a00/0x844e5faceb5ecc7a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839753:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7a00/0x844e5faceb5ecc7a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839758:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7a00/0x844e5faceb5ecc7a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155574.839765:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155574.839826:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7400/0x844e5faceb5ecc6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839832:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7400/0x844e5faceb5ecc6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839836:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7400/0x844e5faceb5ecc6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839840:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2f7400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155574.839843:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7400/0x844e5faceb5ecc6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839848:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7400/0x844e5faceb5ecc6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839853:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155574.839855:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155574.839857:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7400/0x844e5faceb5ecc6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839861:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7400/0x844e5faceb5ecc6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839869:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839877:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839881:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839884:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e2f7800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155574.839885:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839889:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839893:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fd66500) 00010000:00010000:3.0:1746155574.839894:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155574.839896:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839899:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.839921:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecc65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a75 expref: 32 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.839929:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7a00/0x844e5faceb5ecc7a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a75 expref: 31 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.839933:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155574.839934:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155574.839936:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2f7a00, rc 0) 00000100:00100000:3.0:1746155574.839955:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f38bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+31:29417:x1830976123961344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 407us (825us total) trans 8589944090 rc 0/0 00000100:00100000:3.0:1746155574.839960:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10113 00000100:00100000:0.0:1746155574.845704:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.845746:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.845817:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123961600 00000100:00100000:1.0:1746155574.845825:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123961600 00000100:00100000:1.0:1746155574.845862:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 613 00000100:00100000:1.0:1746155574.845868:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+31:1960:x1830976123961600:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155574.845878:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155574.845899:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7a00/0x844e5faceb5ecc7a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a75 expref: 31 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.845914:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155574.845917:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155574.845950:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+30:1960:x1830976123961600:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 83us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.845956:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 613 00000100:00100000:2.0:1746155574.846201:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123961856 00000100:00100000:2.0:1746155574.846205:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123961856 00000100:00100000:2.0:1746155574.846225:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4110 00000100:00100000:2.0:1746155574.846229:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+30:29417:x1830976123961856:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155574.846372:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+31:29417:x1830976123961856:12345-192.168.202.51@tcp:35:cat.0 Request processed in 141us (624us total) trans 8589944091 rc 0/0 00000100:00100000:2.0:1746155574.846377:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4110 00000100:00100000:0.0:1746155574.856478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.856539:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123961984 00000100:00100000:1.0:1746155574.856548:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123961984 00000100:00100000:1.0:1746155574.856595:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12509 00000100:00100000:1.0:1746155574.856602:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+32:1962:x1830976123961984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155574.856616:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.856630:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df8da00/0x844e5faceb5ecc88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a7c expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155574.856679:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124655488:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155574.856760:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155574.857881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.857979:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123962112 00000100:00100000:3.0:1746155574.857983:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123962112 00000100:00100000:3.0:1746155574.858007:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12510 00000100:00100000:3.0:1746155574.858012:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1963:x1830976123962112:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155574.858029:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.858038:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a83 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.858053:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155574.858055:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155574.858062:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a83 expref: 35 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.858076:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a83 expref: 35 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155574.858084:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2f7800, rc 0) 00000100:00100000:3.0:1746155574.858112:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1963:x1830976123962112:12345-192.168.202.51@tcp:101:cat.0 Request processed in 100us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155574.858118:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12510 00000100:00100000:0.0:1746155574.858731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.858777:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123962240 00000100:00100000:1.0:1746155574.858780:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123962240 00000100:00100000:1.0:1746155574.858809:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12511 00000100:00100000:1.0:1746155574.858814:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976123962240:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155574.858822:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.858831:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df8d000/0x844e5faceb5ecc96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a8a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.858842:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.858843:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.858847:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df8d000/0x844e5faceb5ecc96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a8a expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155574.858857:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df8d000/0x844e5faceb5ecc96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a8a expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155574.858863:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df8d000, rc 0) 00000100:00100000:1.0:1746155574.858879:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123962240:12345-192.168.202.51@tcp:101:cat.0 Request processed in 65us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.858884:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12511 00002000:00010000:1.0:1746155574.864765:0:9235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155574 -> 1746155575 00002000:00010000:1.0:1746155574.864773:0:9235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155574 -> 1746155575 00002000:00010000:1.0:1746155574.864775:0:9235:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155574 -> 1746155575 00000100:00100000:1.0:1746155574.864797:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124655488:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155574.864826:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df8da00/0x844e5faceb5ecc88 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a7c expref: 34 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155574.864839:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df8da00/0x844e5faceb5ecc88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a7c expref: 34 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155574.864862:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df8da00, rc 0) 00000100:00100000:1.0:1746155574.864904:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1962:x1830976123961984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8301us (8435us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155574.864916:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12509 00000100:00100000:0.0:1746155574.882954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.883040:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123962368 00000100:00100000:1.0:1746155574.883048:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123962368 00000100:00100000:1.0:1746155574.883095:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12512 00000100:00100000:1.0:1746155574.883103:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+33:29417:x1830976123962368:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155574.883121:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155574.883136:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a91 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.883160:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 30 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.883166:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155574.883168:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155574.883171:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a91 expref: 34 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.883198:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 30 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.883208:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 30 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746155574.883218:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124655616:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155574.883989:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155574.886354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.886812:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123962496 00000100:00100000:2.0:1746155574.886819:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123962496 00000100:00100000:2.0:1746155574.886869:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10114 00000100:00100000:2.0:1746155574.886876:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29419:x1830976123962496:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155574.886896:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.886910:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7600/0x844e5faceb5ecca4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a98 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.886958:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7400/0x844e5faceb5eccab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.886969:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7400/0x844e5faceb5eccab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.886980:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7400/0x844e5faceb5eccab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.886990:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7200/0x844e5faceb5eccb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.886994:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7200/0x844e5faceb5eccb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.886999:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7200/0x844e5faceb5eccb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.887083:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.887093:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119c6 expref: 307 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.887099:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.887123:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119c6 expref: 307 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.887132:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119c6 expref: 307 pid: 27374 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155574.887147:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124655744:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155574.887220:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155574.890942:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124655616:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155574.890976:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a91 expref: 34 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.890993:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df8dc00, rc 0) 00000100:00100000:1.0:1746155574.891047:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+34:29417:x1830976123962368:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7944us (8099us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.891055:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12512 00000100:00100000:2.0:1746155574.892140:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124655744:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155574.892154:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155574.892957:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.893024:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123962752 00000100:00100000:2.0:1746155574.893029:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123962752 00000100:00100000:2.0:1746155574.893071:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4111 00000100:00100000:2.0:1746155574.893079:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+308:27126:x1830976123962752:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746155574.893247:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:27126:x1830976123962752:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 168us (292us total) trans 8589944092 rc 0/0 00000100:00100000:2.0:1746155574.893253:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4111 00000100:00100000:0.0:1746155574.893899:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.893945:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123962880 00000100:00100000:2.0:1746155574.893948:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123962880 00002000:00100000:2.0:1746155574.893969:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1380352->1519615) req@ffff8800935bc700 x1830976123962880/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.893977:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bc700 with x1830976123962880 ext(1380352->1519615) 00010000:00010000:2.0:1746155574.893985:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 31 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155574.893995:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 31 pid: 9235 timeout: 804 lvb_type: 0 00002000:00010000:2.0:1746155574.894002:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935bc700 00000100:00100000:2.0:1746155574.894101:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 791 00000100:00100000:2.0:1746155574.894107:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976123962880:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155574.904476:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123962880:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10355us (10564us total) trans 21474840658 rc 0/0 00000100:00100000:2.0:1746155574.904488:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 791 00002000:00100000:2.0:1746155574.904548:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1380352->1519615) req@ffff8800935bc700 x1830976123962880/t21474840658(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:645/0 lens 488/448 e 0 to 0 dl 1746155585 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.904560:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bc700 with x1830976123962880 ext(1380352->1519615) 00010000:00010000:2.0:1746155574.904571:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 33 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155574.904582:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 33 pid: 9235 timeout: 804 lvb_type: 0 00002000:00010000:2.0:1746155574.904589:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935bc700 00000100:00100000:0.0:1746155574.905291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.905640:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123963008 00000100:00100000:1.0:1746155574.905646:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123963008 00010000:00010000:1.0:1746155574.905667:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119c6 expref: 309 pid: 27374 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746155574.905687:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6333 00000100:00100000:1.0:1746155574.905692:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:1960:x1830976123963008:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155574.905704:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155574.905709:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119c6 expref: 309 pid: 27374 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155574.905717:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119c6 expref: 309 pid: 27374 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155574.905733:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f1d6e00/0x844e5faceb5ecb5b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119c6 expref: 309 pid: 27374 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155574.905758:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155574.905762:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.905769:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.905774:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.906691:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155574.906721:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+308:1960:x1830976123963008:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1028us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.906728:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6333 00010000:00010000:2.0:1746155574.906829:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.906836:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155574.906866:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155574.906869:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155574.906880:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.906888:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.906898:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7400/0x844e5faceb5eccab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.906903:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7400/0x844e5faceb5eccab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.906907:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7400/0x844e5faceb5eccab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.906911:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938e7400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155574.908573:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7400/0x844e5faceb5eccab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.908586:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7400/0x844e5faceb5eccab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155574.908588:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155574.908598:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155574.908600:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155574.908603:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7400/0x844e5faceb5eccab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.908607:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7400/0x844e5faceb5eccab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.908625:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7200/0x844e5faceb5eccb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.908629:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7200/0x844e5faceb5eccb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.908633:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7200/0x844e5faceb5eccb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.908637:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938e7200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155574.908640:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7200/0x844e5faceb5eccb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.908646:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7200/0x844e5faceb5eccb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.908651:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9900) 00010000:00010000:2.0:1746155574.908653:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155574.908654:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7200/0x844e5faceb5eccb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.908658:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7200/0x844e5faceb5eccb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.908687:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7600/0x844e5faceb5ecca4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a98 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.908695:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a98 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.908700:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155574.908702:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155574.908704:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e7000, rc 0) 00000100:00100000:2.0:1746155574.908741:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29419:x1830976123962496:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 21866us (22393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.908747:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10114 00000100:00100000:1.0:1746155574.909536:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123963136 00000100:00100000:1.0:1746155574.909541:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123963136 00010000:00010000:1.0:1746155574.909562:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 33 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746155574.909588:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6334 00000100:00100000:1.0:1746155574.909594:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1962:x1830976123963136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155574.909602:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155574.909622:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 33 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155574.909631:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 33 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155574.909644:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfc00/0x844e5faceb5ecc34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1380352->1519615) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a60 expref: 33 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155574.909654:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.909655:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155574.909661:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a91 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.909667:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a91 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155574.909690:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a91 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155574.909700:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124655872:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155574.909756:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.923767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.923783:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.923840:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123963520 00000100:00100000:0.0:1746155574.923848:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123963520 00000100:00100000:2.0:1746155574.923849:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.923872:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123963648 00000100:00100000:2.0:1746155574.923876:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123963648 00000100:00100000:0.0:1746155574.923887:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12513 00000100:00100000:0.0:1746155574.923893:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123963520:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155574.923909:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155574.923922:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946fb200/0x844e5faceb5eccc0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11a9f expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155574.923938:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124655872:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155574.923942:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.923944:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.923951:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fb200/0x844e5faceb5eccc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a9f expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155574.923953:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155574.923964:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946fb200/0x844e5faceb5eccc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a9f expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.923972:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946fb200, rc 0) 00000100:00100000:1.0:1746155574.923984:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976123963136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 14389us (15399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.923991:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6334 00000100:00100000:0.0:1746155574.923993:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123963520:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 100us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.924105:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12514 00000100:00100000:2.0:1746155574.924111:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976123963648:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155574.924118:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.924126:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938e6a00/0x844e5faceb5eccc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11aa6 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.924137:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.924139:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155574.924143:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e6a00/0x844e5faceb5eccc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aa6 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.924153:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938e6a00/0x844e5faceb5eccc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aa6 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155574.924159:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938e6a00, rc 0) 00000100:00100000:2.0:1746155574.924175:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1963:x1830976123963648:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 65us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155574.924180:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12514 00000100:00100000:3.0:1746155574.924194:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123963392 00000100:00100000:3.0:1746155574.924198:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123963392 00002000:00100000:3.0:1746155574.924304:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800a0ac5c00 x1830976123963392/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.924312:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac5c00 with x1830976123963392 ext(1048576->2097151) 00002000:00010000:3.0:1746155574.924317:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac5c00 00000100:00100000:3.0:1746155574.924329:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4893 00000100:00100000:3.0:1746155574.924335:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1963:x1830976123963392:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155574.926323:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12513 00000100:00100000:0.0:1746155574.926537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.926571:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.926597:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.926631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.926662:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123963776 00000100:00100000:0.0:1746155574.926669:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123963776 00000100:00100000:0.0:1746155574.926696:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123963904 00000100:00100000:0.0:1746155574.926699:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123963904 00000100:00100000:0.0:1746155574.926715:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123964032 00000100:00100000:0.0:1746155574.926718:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123964032 00000100:00100000:0.0:1746155574.926733:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123964160 00000100:00100000:0.0:1746155574.926736:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123964160 00000100:00100000:0.0:1746155574.926755:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12515 00000100:00100000:0.0:1746155574.926764:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123963776:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155574.926778:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155574.926792:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946faa00/0x844e5faceb5eccce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11aad expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.926810:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.926811:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.926819:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946faa00/0x844e5faceb5eccce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aad expref: 11 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.926832:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946faa00/0x844e5faceb5eccce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aad expref: 11 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.926842:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946faa00, rc 0) 00000100:00100000:0.0:1746155574.926882:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123963776:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 118us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.926888:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12515 00000100:00100000:0.0:1746155574.926902:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12516 00000100:00100000:0.0:1746155574.926909:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123963904:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155574.926917:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155574.926926:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946fbe00/0x844e5faceb5eccd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ab4 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.926938:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.926940:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.926945:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fbe00/0x844e5faceb5eccd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ab4 expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.926955:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946fbe00/0x844e5faceb5eccd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ab4 expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.926963:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946fbe00, rc 0) 00000100:00100000:0.0:1746155574.926986:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123963904:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 76us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.926991:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12516 00000100:00100000:0.0:1746155574.927004:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12517 00000100:00100000:0.0:1746155574.927010:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123964032:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155574.927017:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155574.927025:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946fb000/0x844e5faceb5eccdc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11abb expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.927034:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.927036:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.927040:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fb000/0x844e5faceb5eccdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11abb expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.927048:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946fb000/0x844e5faceb5eccdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11abb expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.927054:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946fb000, rc 0) 00000100:00100000:0.0:1746155574.927074:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123964032:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 64us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.927082:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12517 00000100:00100000:0.0:1746155574.927096:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12518 00000100:00100000:0.0:1746155574.927102:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976123964160:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155574.927109:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155574.927118:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946fae00/0x844e5faceb5ecce3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ac2 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155574.927128:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.927129:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155574.927134:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946fae00/0x844e5faceb5ecce3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ac2 expref: 11 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.927143:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800946fae00/0x844e5faceb5ecce3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ac2 expref: 11 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155574.927150:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946fae00, rc 0) 00000100:00100000:0.0:1746155574.927172:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123964160:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 69us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155574.927177:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12518 00000100:00100000:0.0:1746155574.933850:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.934581:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123964416 00000100:00100000:3.0:1746155574.934589:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123964416 00000100:00100000:3.0:1746155574.934631:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10115 00000100:00100000:3.0:1746155574.934638:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29419:x1830976123964416:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155574.934655:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.934670:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7e00/0x844e5faceb5eccea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ac9 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.934745:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7000/0x844e5faceb5eccf1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155574.934755:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a98 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.934761:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7000/0x844e5faceb5eccf1 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155574.934783:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a98 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.934792:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a98 expref: 12 pid: 27374 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155574.934800:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124656000:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155574.934871:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155574.934968:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1963:x1830976123963392:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10632us (11206us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.934976:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4893 00002000:00100000:2.0:1746155574.934984:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800a0ac5c00 x1830976123963392/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.934992:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac5c00 with x1830976123963392 ext(1048576->2097151) 00002000:00010000:2.0:1746155574.934996:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac5c00 00000100:00100000:0.0:1746155574.937095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.937170:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124656000:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155574.937186:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7000/0x844e5faceb5eccf1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155574.937853:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123964544 00000100:00100000:1.0:1746155574.937859:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123964544 00010000:00010000:1.0:1746155574.937884:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a98 expref: 13 pid: 27374 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746155574.937913:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6335 00000100:00100000:1.0:1746155574.937919:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976123964544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155574.937928:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155574.937932:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a98 expref: 13 pid: 27374 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155574.937941:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a98 expref: 13 pid: 27374 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155574.937956:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938e7000/0x844e5faceb5eccb9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a98 expref: 13 pid: 27374 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155574.937979:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155574.937983:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7000/0x844e5faceb5eccf1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.937990:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7000/0x844e5faceb5eccf1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.937995:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7000/0x844e5faceb5eccf1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155574.938019:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155574.938047:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123964544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 128us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155574.938053:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6335 00010000:00010000:2.0:1746155574.938688:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7000/0x844e5faceb5eccf1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.938696:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7000/0x844e5faceb5eccf1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155574.938714:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155574.938847:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7e00/0x844e5faceb5eccea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ac9 expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.938870:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7000/0x844e5faceb5eccf1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ac9 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.938877:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155574.938879:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155574.938882:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2f7000, rc 0) 00000100:00100000:2.0:1746155574.938916:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:29419:x1830976123964416:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 4276us (5075us total) trans 8589944093 rc 0/0 00000100:00100000:2.0:1746155574.938922:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10115 00000100:00100000:0.0:1746155574.953427:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155574.954294:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123964800 00000100:00100000:2.0:1746155574.954302:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123964800 00000100:00100000:2.0:1746155574.954351:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10116 00000100:00100000:2.0:1746155574.954359:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:29419:x1830976123964800:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155574.954381:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155574.954384:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746155574.954406:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7000/0x844e5faceb5eccf1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ac9 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.954435:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155574.954439:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155574.954451:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8a00/0x844e5faceb5eccff lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ad0 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155574.954542:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155574.954552:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8c00/0x844e5faceb5ecd06 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.954562:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8c00/0x844e5faceb5ecd06 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.954570:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8c00/0x844e5faceb5ecd06 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.954578:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8c00/0x844e5faceb5ecd06 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.954583:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8c00/0x844e5faceb5ecd06 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.954588:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8c00/0x844e5faceb5ecd06 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.954593:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801315f8c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155574.954596:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8c00/0x844e5faceb5ecd06 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.954601:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8c00/0x844e5faceb5ecd06 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.954606:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155574.954608:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155574.954610:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8c00/0x844e5faceb5ecd06 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.954614:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8c00/0x844e5faceb5ecd06 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155574.954637:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8a00/0x844e5faceb5eccff lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ad0 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.954643:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801315f8a00/0x844e5faceb5eccff lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ad0 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155574.954648:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801315f8a00, rc 0) 00000100:00100000:2.0:1746155574.954681:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29419:x1830976123964800:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 324us (1265us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155574.954686:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10116 00000100:00100000:0.0:1746155574.956401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.957249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.957432:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123965056 00000100:00100000:3.0:1746155574.957441:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123965056 00002000:00100000:3.0:1746155574.957483:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a5ae1880 x1830976123965056/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.957492:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1880 with x1830976123965056 ext(2097152->3145727) 00002000:00010000:3.0:1746155574.957497:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae1880 00000100:00100000:3.0:1746155574.957537:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123965568 00000100:00100000:3.0:1746155574.957540:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123965568 00002000:00100000:3.0:1746155574.957553:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a5ae1f80 x1830976123965568/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.957559:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1f80 with x1830976123965568 ext(2097152->3145727) 00002000:00010000:3.0:1746155574.957562:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ae1f80 00000100:00100000:2.0:1746155574.957566:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4894 00000100:00100000:2.0:1746155574.957574:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1962:x1830976123965056:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155574.957619:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4895 00000100:00100000:3.0:1746155574.957625:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123965568:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155574.959524:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123965184 00000100:00100000:0.0:1746155574.959532:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123965184 00002000:00100000:0.0:1746155574.959562:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800a5ae3b80 x1830976123965184/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155574.959569:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae3b80 with x1830976123965184 ext(3145728->4194303) 00002000:00010000:0.0:1746155574.959573:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae3b80 00000100:00100000:0.0:1746155574.959587:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4896 00000100:00100000:0.0:1746155574.959593:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1963:x1830976123965184:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155574.960219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155574.960481:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123965952 00000100:00100000:0.0:1746155574.960484:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123965952 00000100:00100000:0.0:1746155574.960535:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4112 00000100:00100000:0.0:1746155574.960540:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a653050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29419:x1830976123965952:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:0.0:1746155574.960679:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a653050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:29419:x1830976123965952:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 138us (460us total) trans 8589944094 rc 0/0 00000100:00100000:0.0:1746155574.960685:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4112 00000100:00100000:0.0:1746155574.965362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155574.965954:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123966080 00000100:00100000:1.0:1746155574.965962:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123966080 00002000:00100000:1.0:1746155574.965997:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800a5ae0a80 x1830976123966080/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/0 e 0 to 0 dl 1746155585 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155574.966007:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0a80 with x1830976123966080 ext(3145728->4194303) 00002000:00010000:1.0:1746155574.966012:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ae0a80 00000100:00100000:1.0:1746155574.967711:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4897 00000100:00100000:1.0:1746155574.967721:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1963:x1830976123966080:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155574.974471:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1962:x1830976123965056:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16888us (19921us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.974481:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4894 00002000:00100000:2.0:1746155574.974491:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a5ae1880 x1830976123965056/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.974499:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1880 with x1830976123965056 ext(2097152->3145727) 00002000:00010000:2.0:1746155574.974532:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae1880 00000100:00100000:2.0:1746155574.982428:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1963:x1830976123965184:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22826us (25174us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155574.982439:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4896 00002000:00100000:2.0:1746155574.982449:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800a5ae3b80 x1830976123965184/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155574.982459:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae3b80 with x1830976123965184 ext(3145728->4194303) 00002000:00010000:2.0:1746155574.982464:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae3b80 00000100:00100000:3.0:1746155574.992114:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1962:x1830976123965568:12345-192.168.202.51@tcp:3:cat.0 Request processed in 34480us (35708us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155574.992124:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4895 00002000:00100000:3.0:1746155574.992134:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a5ae1f80 x1830976123965568/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155574.992143:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1f80 with x1830976123965568 ext(2097152->3145727) 00002000:00010000:3.0:1746155574.992148:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ae1f80 00000100:00100000:2.0:1746155574.992375:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155574.993078:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123966336 00000100:00100000:3.0:1746155574.993087:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123966336 00000100:00100000:3.0:1746155574.993135:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10117 00000100:00100000:3.0:1746155574.993144:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+308:29422:x1830976123966336:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155574.993167:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155574.993185:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7600/0x844e5faceb5ecd0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ad7 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.993275:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecd14 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.993289:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecd14 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155574.993299:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecd14 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155574.993309:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155574.993424:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7600/0x844e5faceb5ecd0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ad7 expref: 311 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.993447:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecd14 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ad7 expref: 310 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155574.993455:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155574.993458:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155574.993461:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2f7200, rc 0) 00000100:00100000:3.0:1746155574.995100:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+310:29422:x1830976123966336:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1951us (2718us total) trans 8589944095 rc 0/0 00000100:00100000:3.0:1746155574.995107:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10117 00000100:00100000:0.0:1746155574.995767:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123966080:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28044us (30408us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155574.995775:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4897 00002000:00100000:0.0:1746155574.995786:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800a5ae0a80 x1830976123966080/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:645/0 lens 488/440 e 0 to 0 dl 1746155585 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155574.995794:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0a80 with x1830976123966080 ext(3145728->4194303) 00002000:00010000:0.0:1746155574.995799:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5ae0a80 00000100:00100000:0.0:1746155575.013437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.013541:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123966592 00000100:00100000:2.0:1746155575.013549:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123966592 00002000:00100000:2.0:1746155575.013594:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800a5ae0700 x1830976123966592/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.013603:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0700 with x1830976123966592 ext(4194304->4956159) 00002000:00010000:2.0:1746155575.013607:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae0700 00000100:00100000:2.0:1746155575.013628:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4898 00000100:00100000:2.0:1746155575.013634:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1963:x1830976123966592:12345-192.168.202.51@tcp:3:cat.0 00000100:00080000:0.0:1746155575.014532:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155575.024854:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1963:x1830976123966592:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11212us (11416us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155575.024864:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4898 00002000:00100000:2.0:1746155575.024873:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800a5ae0700 x1830976123966592/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.024882:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0700 with x1830976123966592 ext(4194304->4956159) 00002000:00010000:2.0:1746155575.024886:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae0700 00000100:00100000:0.0:1746155575.029741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.029839:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123966720 00000100:00100000:3.0:1746155575.029846:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123966720 00000100:00100000:3.0:1746155575.029894:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12519 00000100:00100000:3.0:1746155575.029901:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29422:x1830976123966720:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155575.029916:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.029930:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ade expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.029954:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119fe expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.029962:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946fb200/0x844e5faceb5eccc0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a9f expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.029967:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ceca00/0x844e5faceb5ecbfc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a28 expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.029972:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.029973:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.029975:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [491520->884735] (req 491520->884735) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.030000:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ceca00/0x844e5faceb5ecbfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a28 expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.030009:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ceca00/0x844e5faceb5ecbfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a28 expref: 33 pid: 8436 timeout: 804 lvb_type: 1 00000100:00100000:3.0:1746155575.030023:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124656128:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155575.030676:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800946fb200/0x844e5faceb5eccc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a9f expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.030684:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800946fb200/0x844e5faceb5eccc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a9f expref: 11 pid: 9235 timeout: 804 lvb_type: 1 00000100:00100000:3.0:1746155575.030783:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124656256:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155575.030810:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119fe expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.030817:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119fe expref: 33 pid: 4461 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.030823:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124656384:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155575.030833:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.032329:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.032388:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123966848 00000100:00100000:1.0:1746155575.032393:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123966848 00000100:00100000:1.0:1746155575.032428:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12520 00000100:00100000:1.0:1746155575.032433:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29415:x1830976123966848:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155575.032444:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.032456:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ae5 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.032475:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a67 expref: 37 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.032482:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946fae00/0x844e5faceb5ecce3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ac2 expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.032493:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012df8d000/0x844e5faceb5ecc96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a8a expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.032499:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.032526:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.032530:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 27 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.032549:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012df8d000/0x844e5faceb5ecc96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a8a expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.032557:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012df8d000/0x844e5faceb5ecc96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a8a expref: 27 pid: 8436 timeout: 804 lvb_type: 1 00000100:00100000:1.0:1746155575.032566:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124656512:192.168.202.51@tcp:104: 00000100:00080000:0.0:1746155575.032702:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746155575.032842:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946fae00/0x844e5faceb5ecce3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ac2 expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.032851:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946fae00/0x844e5faceb5ecce3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ac2 expref: 10 pid: 29728 timeout: 804 lvb_type: 1 00000100:00100000:1.0:1746155575.032858:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124656640:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155575.032882:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a67 expref: 37 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.032893:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a67 expref: 37 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746155575.032900:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124656768:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155575.032913:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.035389:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.035449:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123967104 00000100:00100000:2.0:1746155575.035456:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123967104 00000100:00100000:3.0:1746155575.035478:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124656128:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155575.035485:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ceca00/0x844e5faceb5ecbfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a28 expref: 34 pid: 8436 timeout: 804 lvb_type: 1 00000100:00100000:3.0:1746155575.035486:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124656256:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155575.035492:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124656384:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155575.035556:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [491520->884735] (req 491520->884735) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 34 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.035572:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2f7c00, rc 0) 00000100:00100000:3.0:1746155575.035606:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:29422:x1830976123966720:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5706us (5871us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.035613:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12519 00000100:00100000:2.0:1746155575.035902:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6336 00000100:00100000:2.0:1746155575.035911:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1962:x1830976123967104:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155575.035951:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.035969:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ceca00/0x844e5faceb5ecbfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a28 expref: 33 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746155575.035979:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ceca00/0x844e5faceb5ecbfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a28 expref: 33 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746155575.035996:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ceca00/0x844e5faceb5ecbfc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a28 expref: 33 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746155575.036021:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155575.036194:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976123967104:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 283us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.036200:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6336 00000100:00100000:0.0:1746155575.041417:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.041435:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123966976 00000100:00100000:0.0:1746155575.041438:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.041441:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123966976 00000100:00100000:0.0:1746155575.041457:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123967232 00000100:00100000:0.0:1746155575.041461:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123967232 00010000:00010000:3.0:1746155575.041467:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fb200/0x844e5faceb5eccc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a9f expref: 12 pid: 9235 timeout: 804 lvb_type: 1 00000100:00100000:3.0:1746155575.041487:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6337 00000100:00100000:3.0:1746155575.041493:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976123966976:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.041523:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155575.041538:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800946fb200/0x844e5faceb5eccc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a9f expref: 12 pid: 9235 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746155575.041548:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800946fb200/0x844e5faceb5eccc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a9f expref: 12 pid: 9235 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746155575.041564:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946fb200/0x844e5faceb5eccc0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a9f expref: 12 pid: 9235 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746155575.041575:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155575.041605:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123966976:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 112us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.041611:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6337 00000100:00100000:3.0:1746155575.041717:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124656512:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155575.042030:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119fe expref: 34 pid: 4461 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.042057:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6338 00000100:00100000:0.0:1746155575.042062:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1961:x1830976123967232:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.042070:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.042079:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119fe expref: 34 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.042087:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119fe expref: 34 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.042103:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b800/0x844e5faceb5ecbb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f119fe expref: 34 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.042120:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.042121:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.042127:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 31 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.042134:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 31 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.042158:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 31 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.042168:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124656896:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155575.042211:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.046060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.046077:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.046088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.046105:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123967488 00000100:00100000:0.0:1746155575.046111:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123967488 00010000:00010000:0.0:1746155575.046136:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012df8d000/0x844e5faceb5ecc96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a8a expref: 28 pid: 8436 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.046155:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123967360 00000100:00100000:0.0:1746155575.046157:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123967360 00010000:00010000:0.0:1746155575.046165:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946fae00/0x844e5faceb5ecce3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ac2 expref: 11 pid: 29728 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.046174:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123967616 00000100:00100000:0.0:1746155575.046176:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123967616 00010000:00010000:0.0:1746155575.046182:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a67 expref: 38 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.046191:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6339 00000100:00100000:0.0:1746155575.046197:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1961:x1830976123967488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.046207:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.046225:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012df8d000/0x844e5faceb5ecc96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a8a expref: 28 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.046234:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012df8d000/0x844e5faceb5ecc96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a8a expref: 28 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.046251:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df8d000/0x844e5faceb5ecc96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a8a expref: 28 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.046262:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.046295:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+27:1961:x1830976123967488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.046300:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6339 00000100:00100000:0.0:1746155575.046315:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6340 00000100:00100000:0.0:1746155575.046319:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123967360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.046325:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.046332:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946fae00/0x844e5faceb5ecce3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ac2 expref: 11 pid: 29728 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.046339:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946fae00/0x844e5faceb5ecce3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ac2 expref: 11 pid: 29728 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.046348:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.046362:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976123967360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 42us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.046367:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6340 00000100:00100000:0.0:1746155575.046377:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6341 00000100:00100000:0.0:1746155575.046382:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976123967616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.046385:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946fae00/0x844e5faceb5ecce3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ac2 expref: 10 pid: 29728 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.046387:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.046394:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a67 expref: 38 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.046398:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124656640:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155575.046402:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a67 expref: 38 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.046407:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124656768:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155575.046652:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df8d400/0x844e5faceb5ecc3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a67 expref: 38 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.046745:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.046747:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.046753:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 26 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.046760:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 26 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.046801:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 26 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.046811:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df8da00, rc 0) 00010000:00010000:0.0:1746155575.046811:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 26 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.046821:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124657024:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155575.046833:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+26:29415:x1830976123966848:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 14399us (14507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.046838:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12520 00000100:00100000:0.0:1746155575.046859:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.046898:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124656896:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155575.046907:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.046922:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1961:x1830976123967232:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4860us (5483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.046927:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6338 00000100:00100000:3.0:1746155575.047469:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.051270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.051290:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123968000 00000100:00100000:2.0:1746155575.051296:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123968000 00000100:00100000:2.0:1746155575.051328:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12521 00000100:00100000:2.0:1746155575.051335:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976123968000:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155575.051350:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.051363:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a012b400/0x844e5faceb5ecd30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11aec expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.051382:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.051383:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.051391:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a012b400/0x844e5faceb5ecd30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aec expref: 33 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155575.051404:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a012b400/0x844e5faceb5ecd30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aec expref: 33 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155575.051413:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a012b400, rc 0) 00000100:00100000:2.0:1746155575.051451:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123968000:12345-192.168.202.51@tcp:101:cat.0 Request processed in 116us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.051456:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12521 00000100:00100000:2.0:1746155575.051484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.051496:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123968128 00000100:00100000:2.0:1746155575.051499:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123968128 00000100:00100000:2.0:1746155575.051536:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12522 00000100:00100000:2.0:1746155575.051540:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976123968128:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155575.051546:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.051554:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a012b200/0x844e5faceb5ecd37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11af3 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155575.051582:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124657152:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155575.051622:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155575.051707:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.051723:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123967872 00000100:00100000:2.0:1746155575.051726:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123967872 00002000:00100000:2.0:1746155575.051744:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (491520->495615) req@ffff880094c30380 x1830976123967872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.051752:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c30380 with x1830976123967872 ext(491520->495615) 00002000:00010000:2.0:1746155575.051756:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c30380 00000100:00100000:2.0:1746155575.051764:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123968384 00000100:00100000:2.0:1746155575.051766:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123968384 00002000:00100000:2.0:1746155575.051774:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3006464->3010559) req@ffff8800a0ac6680 x1830976123968384/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.051780:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac6680 with x1830976123968384 ext(3006464->3010559) 00002000:00010000:2.0:1746155575.051782:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac6680 00000100:00100000:2.0:1746155575.051791:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4899 00000100:00100000:2.0:1746155575.051796:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123967872:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155575.051903:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123967872:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 106us (4434us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155575.051909:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4899 00002000:00100000:2.0:1746155575.051913:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (491520->495615) req@ffff880094c30380 x1830976123967872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/4536 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.051920:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c30380 with x1830976123967872 ext(491520->495615) 00002000:00010000:2.0:1746155575.051923:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c30380 00000100:00100000:2.0:1746155575.051933:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4900 00000100:00100000:2.0:1746155575.051937:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123968384:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155575.051999:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976123968384:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 61us (292us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155575.052004:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4900 00002000:00100000:2.0:1746155575.052008:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3006464->3010559) req@ffff8800a0ac6680 x1830976123968384/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/4536 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.052014:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac6680 with x1830976123968384 ext(3006464->3010559) 00002000:00010000:2.0:1746155575.052017:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac6680 00000100:00100000:3.0:1746155575.056068:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124657152:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155575.056099:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a012b200/0x844e5faceb5ecd37 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11af3 expref: 39 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.056112:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a012b200/0x844e5faceb5ecd37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11af3 expref: 39 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.056120:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a012b200, rc 0) 00000100:00100000:3.0:1746155575.056157:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976123968128:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4615us (4671us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155575.056163:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12522 00000100:00100000:0.0:1746155575.056342:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976124657024:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155575.056353:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.056372:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1963:x1830976123967616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9990us (10283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.056379:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6341 00000100:00100000:0.0:1746155575.056414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.057406:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.057422:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123968512 00000100:00100000:0.0:1746155575.057426:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123968512 00000100:00100000:0.0:1746155575.057447:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12523 00000100:00100000:0.0:1746155575.057452:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+33:29415:x1830976123968512:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155575.057464:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.057475:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11afa expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.057494:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a59 expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.057524:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946fb000/0x844e5faceb5eccdc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11abb expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.057530:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a83 expref: 34 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.057540:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.057541:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.057544:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->3887103] (req 3145728->3887103) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 34 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.057565:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a83 expref: 34 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.057574:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a83 expref: 34 pid: 18270 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.057584:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124657280:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155575.057629:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800946fb000/0x844e5faceb5eccdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11abb expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.057636:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800946fb000/0x844e5faceb5eccdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11abb expref: 10 pid: 29728 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.057643:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124657408:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155575.057662:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a59 expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.057669:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a59 expref: 32 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.057680:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124657536:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.057695:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.057758:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123968768 00000100:00100000:0.0:1746155575.057761:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123968768 00002000:00100000:0.0:1746155575.057780:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (880640->884735) req@ffff8800a5ae0000 x1830976123968768/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.057788:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0000 with x1830976123968768 ext(880640->884735) 00002000:00010000:0.0:1746155575.057791:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae0000 00000100:00100000:0.0:1746155575.057803:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4901 00000100:00100000:0.0:1746155575.057808:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123968768:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155575.057910:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123968768:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 100us (503us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155575.057914:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4901 00002000:00100000:0.0:1746155575.057919:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (880640->884735) req@ffff8800a5ae0000 x1830976123968768/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/4536 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.057924:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0000 with x1830976123968768 ext(880640->884735) 00002000:00010000:0.0:1746155575.057926:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae0000 00000100:00100000:0.0:1746155575.060849:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124657280:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.064767:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.064792:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123969024 00000100:00100000:0.0:1746155575.064799:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123969024 00002000:00100000:0.0:1746155575.064835:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->491519) req@ffff8800935bca80 x1830976123969024/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.064850:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bca80 with x1830976123969024 ext(0->491519) 00002000:00010000:0.0:1746155575.064855:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bca80 00000100:00100000:0.0:1746155575.064872:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4902 00000100:00100000:0.0:1746155575.064879:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123969024:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155575.065983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.066019:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124657408:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.066028:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124657536:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155575.066053:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [3145728->3887103] (req 3145728->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 34 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.066066:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800946fac00, rc 0) 00000100:00100000:0.0:1746155575.066091:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+34:29415:x1830976123968512:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8638us (9676us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.066097:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12523 00000100:00100000:0.0:1746155575.066122:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123969152 00000100:00100000:0.0:1746155575.066125:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123969152 00010000:00010000:0.0:1746155575.066140:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fb000/0x844e5faceb5eccdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11abb expref: 11 pid: 29728 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.066157:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6342 00000100:00100000:0.0:1746155575.066162:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123969152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.066170:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.066183:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800946fb000/0x844e5faceb5eccdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11abb expref: 11 pid: 29728 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.066191:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800946fb000/0x844e5faceb5eccdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11abb expref: 11 pid: 29728 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.066207:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946fb000/0x844e5faceb5eccdc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11abb expref: 11 pid: 29728 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.066215:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.066229:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123969152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 67us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.066239:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6342 00000100:00100000:1.0:1746155575.070819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.070840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.071005:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123969280 00000100:00100000:0.0:1746155575.071012:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123969280 00010000:00010000:0.0:1746155575.071040:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a83 expref: 34 pid: 18270 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.071062:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123969408 00000100:00100000:0.0:1746155575.071064:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123969408 00010000:00010000:0.0:1746155575.071073:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a59 expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.071089:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6343 00000100:00100000:0.0:1746155575.071095:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1963:x1830976123969280:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.071107:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.071125:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a83 expref: 34 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.071139:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a83 expref: 34 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.071156:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7800/0x844e5faceb5ecc8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a83 expref: 34 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.071168:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.071202:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1963:x1830976123969280:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 107us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.071207:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6343 00000100:00100000:0.0:1746155575.071222:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6344 00000100:00100000:0.0:1746155575.071226:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976123969408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.071232:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.071239:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a59 expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.071246:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a59 expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.071257:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cfe00/0x844e5faceb5ecc2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a59 expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.071264:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.071266:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.071271:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.071278:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.071304:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.071315:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124657664:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155575.072947:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123969024:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8063us (8181us total) trans 0 rc 491520/491520 00000100:00100000:1.0:1746155575.072957:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4902 00002000:00100000:1.0:1746155575.072965:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->491519) req@ffff8800935bca80 x1830976123969024/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 491520/491520 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.072974:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bca80 with x1830976123969024 ext(0->491519) 00002000:00010000:1.0:1746155575.072978:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bca80 00000100:00100000:0.0:1746155575.073709:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155575.077875:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124657664:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155575.077894:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155575.077928:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123969408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6701us (7086us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.077937:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6344 00000100:00100000:0.0:1746155575.079649:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.079673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.079687:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123969664 00000100:00100000:0.0:1746155575.079693:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123969664 00002000:00100000:0.0:1746155575.079721:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (884736->1048575) req@ffff8800935bd880 x1830976123969664/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.079728:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bd880 with x1830976123969664 ext(884736->1048575) 00002000:00010000:0.0:1746155575.079733:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bd880 00000100:00100000:0.0:1746155575.079745:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123969920 00000100:00100000:0.0:1746155575.079746:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123969920 00002000:00100000:0.0:1746155575.079754:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800935bce00 x1830976123969920/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.079759:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bce00 with x1830976123969920 ext(1048576->2097151) 00002000:00010000:0.0:1746155575.079762:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bce00 00000100:00100000:0.0:1746155575.079770:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4903 00000100:00100000:0.0:1746155575.079775:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976123969664:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155575.080008:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4904 00000100:00100000:0.0:1746155575.080013:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976123969920:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155575.089274:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.089306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.090143:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123970176 00000100:00100000:1.0:1746155575.090150:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123970176 00002000:00100000:1.0:1746155575.090192:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3883008->3887103) req@ffff8800948e4380 x1830976123970176/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.090201:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4380 with x1830976123970176 ext(3883008->3887103) 00002000:00010000:1.0:1746155575.090206:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e4380 00000100:00100000:1.0:1746155575.090223:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4905 00000100:00100000:1.0:1746155575.090230:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1963:x1830976123970176:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155575.090351:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1963:x1830976123970176:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 121us (1083us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155575.090356:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4905 00002000:00100000:1.0:1746155575.090361:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3883008->3887103) req@ffff8800948e4380 x1830976123970176/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/4536 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.090367:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4380 with x1830976123970176 ext(3883008->3887103) 00002000:00010000:1.0:1746155575.090370:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e4380 00000100:00100000:2.0:1746155575.092296:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123970304 00000100:00100000:2.0:1746155575.092303:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123970304 00000100:00100000:2.0:1746155575.092336:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10118 00000100:00100000:2.0:1746155575.092347:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:29429:x1830976123970304:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155575.092361:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.092374:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a200/0x844e5faceb5ecd45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b01 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.092417:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a000/0x844e5faceb5ecd4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.092427:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a000/0x844e5faceb5ecd4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.092436:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a000/0x844e5faceb5ecd4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.092446:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a600/0x844e5faceb5ecd53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.092450:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a600/0x844e5faceb5ecd53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.092454:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a600/0x844e5faceb5ecd53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00080000:2.0:1746155575.092536:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746155575.092572:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.092581:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecd14 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ad7 expref: 309 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.092591:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155575.092737:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976123969664:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12959us (13089us total) trans 0 rc 163840/163840 00000100:00100000:1.0:1746155575.092744:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4903 00002000:00100000:1.0:1746155575.092751:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (884736->1048575) req@ffff8800935bd880 x1830976123969664/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 163840/163840 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.092757:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bd880 with x1830976123969664 ext(884736->1048575) 00002000:00010000:1.0:1746155575.092761:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bd880 00010000:00010000:2.0:1746155575.093378:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecd14 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ad7 expref: 309 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.093390:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecd14 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ad7 expref: 309 pid: 15474 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.093400:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124657792:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155575.093613:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155575.094264:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123969920:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14249us (14588us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155575.094271:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4904 00002000:00100000:1.0:1746155575.094277:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800935bce00 x1830976123969920/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.094286:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bce00 with x1830976123969920 ext(1048576->2097151) 00002000:00010000:1.0:1746155575.094289:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bce00 00000100:00100000:0.0:1746155575.098339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.098387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.098409:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123970560 00000100:00100000:3.0:1746155575.098412:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124657792:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.098414:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123970560 00010000:00010000:3.0:1746155575.098430:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155575.098668:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123970816 00000100:00100000:0.0:1746155575.098671:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123970816 00000100:00100000:0.0:1746155575.098686:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4113 00000100:00100000:0.0:1746155575.098693:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+31:29415:x1830976123970560:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155575.098828:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+32:29415:x1830976123970560:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 135us (494us total) trans 8589944096 rc 0/0 00000100:00100000:0.0:1746155575.098834:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4113 00000100:00100000:0.0:1746155575.098847:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4114 00000100:00100000:0.0:1746155575.098851:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+310:27129:x1830976123970816:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746155575.098898:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+311:27129:x1830976123970816:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 46us (510us total) trans 8589944097 rc 0/0 00000100:00100000:0.0:1746155575.098902:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4114 00000100:00080000:2.0:1746155575.099458:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155575.102344:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.102372:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123970944 00000100:00100000:0.0:1746155575.102377:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123970944 00010000:00010000:0.0:1746155575.102402:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecd14 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ad7 expref: 311 pid: 15474 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.102424:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6345 00000100:00100000:0.0:1746155575.102430:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+311:1963:x1830976123970944:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.102441:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.102445:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecd14 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ad7 expref: 311 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.102454:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecd14 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ad7 expref: 311 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.102472:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2f7200/0x844e5faceb5ecd14 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ad7 expref: 311 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.102483:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155575.102487:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.102496:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.104730:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.104794:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.104841:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+310:1963:x1830976123970944:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2407us (2500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.104850:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6345 00010000:00010000:0.0:1746155575.104877:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.104883:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155575.104918:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:0.0:1746155575.104922:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155575.104933:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.104941:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.104949:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a000/0x844e5faceb5ecd4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.104954:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a000/0x844e5faceb5ecd4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.104959:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a000/0x844e5faceb5ecd4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.104963:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a012a000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155575.104965:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a000/0x844e5faceb5ecd4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.104970:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a000/0x844e5faceb5ecd4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.104978:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155575.104980:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155575.104982:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a000/0x844e5faceb5ecd4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.104986:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a000/0x844e5faceb5ecd4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.104996:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a600/0x844e5faceb5ecd53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.105001:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a600/0x844e5faceb5ecd53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.105005:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a600/0x844e5faceb5ecd53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.105008:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a012a600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155575.105010:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a600/0x844e5faceb5ecd53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.105013:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a600/0x844e5faceb5ecd53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.105018:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9c00) 00010000:00010000:0.0:1746155575.105019:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155575.105021:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a600/0x844e5faceb5ecd53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.105024:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a600/0x844e5faceb5ecd53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.105048:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012a200/0x844e5faceb5ecd45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b01 expref: 14 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.105057:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b01 expref: 13 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.105062:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155575.105063:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155575.105065:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a012b200, rc 0) 00000100:00100000:0.0:1746155575.105084:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:29429:x1830976123970304:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 12738us (15777us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.105090:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10118 00000100:00100000:0.0:1746155575.108064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.108127:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.108167:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123971072 00000100:00100000:0.0:1746155575.108173:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123971072 00000100:00100000:0.0:1746155575.108214:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123971200 00000100:00100000:0.0:1746155575.108216:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123971200 00000100:00100000:0.0:1746155575.108236:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12524 00000100:00100000:0.0:1746155575.108242:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123971072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155575.108258:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.108271:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0107800/0x844e5faceb5ecd61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b08 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.108309:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124657920:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155575.108361:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.108381:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12525 00000100:00100000:0.0:1746155575.108387:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976123971200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155575.108393:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.108405:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ecd68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b0f expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.108426:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124658048:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155575.108443:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.113706:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124658048:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155575.113735:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ecd68 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b0f expref: 38 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.113749:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5ecd68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b0f expref: 38 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.113759:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b038e00, rc 0) 00000100:00100000:0.0:1746155575.113793:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976123971200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5406us (5665us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155575.113800:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12525 00000100:00100000:0.0:1746155575.113842:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124657920:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155575.113855:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0107800/0x844e5faceb5ecd61 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b08 expref: 33 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.113863:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107800/0x844e5faceb5ecd61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b08 expref: 33 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.113870:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0107800, rc 0) 00000100:00100000:0.0:1746155575.113885:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976123971072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5644us (5832us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155575.113890:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12524 00000100:00100000:0.0:1746155575.115870:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.115886:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.115906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.115922:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123971328 00000100:00100000:0.0:1746155575.115927:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123971328 00000100:00100000:0.0:1746155575.115950:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123971456 00000100:00100000:0.0:1746155575.115951:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123971456 00000100:00100000:0.0:1746155575.115959:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123971584 00000100:00100000:0.0:1746155575.115961:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123971584 00000100:00100000:0.0:1746155575.115972:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12526 00000100:00100000:0.0:1746155575.115978:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123971328:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155575.115990:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.116001:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbea600/0x844e5faceb5ecd6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b16 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.116035:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124658176:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155575.116077:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.116091:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12527 00000100:00100000:0.0:1746155575.116096:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123971456:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155575.116102:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.116108:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbea200/0x844e5faceb5ecd76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b1d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.116127:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124658304:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155575.116143:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.116156:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12528 00000100:00100000:0.0:1746155575.116161:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123971584:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155575.116167:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.116175:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbeb800/0x844e5faceb5ecd7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b24 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.116195:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124658432:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155575.116212:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.116292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.116349:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123971712 00000100:00100000:0.0:1746155575.116352:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123971712 00000100:00100000:0.0:1746155575.116367:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12529 00000100:00100000:0.0:1746155575.116371:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29427:x1830976123971712:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155575.116378:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.116383:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b2b expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.116396:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.116401:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155575.116403:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155575.116406:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 33 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.116419:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.116429:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 32 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.116436:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124658560:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.116455:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.121208:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124658304:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155575.121236:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbea200/0x844e5faceb5ecd76 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b1d expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.121249:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbea200/0x844e5faceb5ecd76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b1d expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.121257:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbea200, rc 0) 00000100:00100000:0.0:1746155575.121572:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124658432:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155575.121585:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbeb800/0x844e5faceb5ecd7d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b24 expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.121593:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbeb800/0x844e5faceb5ecd7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b24 expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.121599:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeb800, rc 0) 00000100:00100000:0.0:1746155575.121627:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123971584:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5465us (5720us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155575.121633:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12528 00000100:00100000:0.0:1746155575.121662:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123971456:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5566us (5774us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155575.121667:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12527 00002000:00010000:0.0:1746155575.121688:0:18270:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime: 1746155574 -> 1746155575 00002000:00010000:0.0:1746155575.121691:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime: 1746155574 -> 1746155575 00002000:00010000:0.0:1746155575.121692:0:18270:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime: 1746155574 -> 1746155575 00000100:00100000:0.0:1746155575.121700:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124658176:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155575.121710:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbea600/0x844e5faceb5ecd6f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b16 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.121721:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbea600/0x844e5faceb5ecd6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b16 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.121727:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbea600, rc 0) 00000100:00100000:0.0:1746155575.121738:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123971328:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5760us (5871us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155575.121742:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12526 00000100:00100000:0.0:1746155575.121758:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124658560:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155575.121770:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 33 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.121779:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0107e00, rc 0) 00000100:00100000:0.0:1746155575.121789:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:29427:x1830976123971712:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5418us (5498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.121793:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12529 00000100:00100000:0.0:1746155575.123963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.125080:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123971840 00000100:00100000:1.0:1746155575.125087:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123971840 00002000:00100000:1.0:1746155575.125119:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3887103) req@ffff8800a5ae0380 x1830976123971840/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.125128:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0380 with x1830976123971840 ext(3145728->3887103) 00010000:00010000:1.0:1746155575.125139:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 33 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.125150:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 33 pid: 9235 timeout: 804 lvb_type: 0 00002000:00010000:1.0:1746155575.125157:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ae0380 00000100:00100000:1.0:1746155575.125172:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 792 00000100:00100000:1.0:1746155575.125178:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1961:x1830976123971840:12345-192.168.202.51@tcp:4:multiop.0 00010000:00010000:0.0:1746155575.128005:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155575.132941:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.132966:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123972096 00000100:00100000:0.0:1746155575.132974:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123972096 00000100:00100000:0.0:1746155575.133013:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10119 00000100:00100000:0.0:1746155575.133021:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:29429:x1830976123972096:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155575.133038:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.133055:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8200/0x844e5faceb5ecd8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b32 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.133139:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.133151:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b01 expref: 14 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.133157:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.133180:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b01 expref: 14 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.133189:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b01 expref: 14 pid: 15474 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.133200:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124658688:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.133267:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155575.136061:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1961:x1830976123971840:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 10877us (12095us total) trans 21474840659 rc 0/0 00000100:00100000:1.0:1746155575.136070:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 792 00002000:00100000:1.0:1746155575.136079:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->3887103) req@ffff8800a5ae0380 x1830976123971840/t21474840659(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/448 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.136089:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae0380 with x1830976123971840 ext(3145728->3887103) 00010000:00010000:1.0:1746155575.136096:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.136107:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00002000:00010000:1.0:1746155575.136113:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5ae0380 00000100:00100000:1.0:1746155575.140926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.140964:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.140984:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123972224 00000100:00100000:1.0:1746155575.140990:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123972224 00010000:00010000:1.0:1746155575.141018:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746155575.141039:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123972352 00000100:00100000:1.0:1746155575.141041:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123972352 00010000:00010000:1.0:1746155575.141051:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b01 expref: 15 pid: 15474 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746155575.141067:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6346 00000100:00100000:1.0:1746155575.141074:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1960:x1830976123972224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155575.141084:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155575.141101:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.141112:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.141129:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946fac00/0x844e5faceb5ecd3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11afa expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.141140:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.141142:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.141148:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 32 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.141155:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 32 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155575.141178:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6347 00010000:00010000:1.0:1746155575.141181:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 32 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155575.141186:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123972352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155575.141193:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124658816:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155575.141194:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.141199:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b01 expref: 15 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.141207:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b01 expref: 15 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.141219:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155575.141224:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.141232:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.141240:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.141251:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155575.141257:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155575.141271:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123972352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 86us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.141277:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6347 00010000:00010000:0.0:1746155575.141458:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecd5a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b01 expref: 14 pid: 15474 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.141476:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124658688:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155575.141543:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.141550:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.141554:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155575.141575:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155575.141677:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8200/0x844e5faceb5ecd8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b32 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.141688:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b32 expref: 14 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.141694:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155575.141696:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155575.141697:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb9600, rc 0) 00000100:00100000:0.0:1746155575.141720:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:29429:x1830976123972096:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8700us (8784us total) trans 8589944098 rc 0/0 00000100:00100000:0.0:1746155575.141726:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10119 00000100:00100000:0.0:1746155575.145290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.145315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.145330:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123972480 00000100:00100000:0.0:1746155575.145335:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123972480 00000100:00100000:0.0:1746155575.145361:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10120 00000100:00100000:0.0:1746155575.145368:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:29429:x1830976123972480:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155575.145386:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.145399:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeba00/0x844e5faceb5ecda0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b39 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.145676:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976124658816:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155575.145691:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155575.145726:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1960:x1830976123972224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4652us (4803us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.145734:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6346 00000100:00100000:1.0:1746155575.145754:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123972736 00000100:00100000:1.0:1746155575.145757:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123972736 00002000:00100000:1.0:1746155575.145777:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a5ae1500 x1830976123972736/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.145786:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1500 with x1830976123972736 ext(2097152->3145727) 00002000:00010000:1.0:1746155575.145790:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae1500 00000100:00100000:1.0:1746155575.145802:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4906 00000100:00100000:1.0:1746155575.145808:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123972736:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:0.0:1746155575.146352:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.146366:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b32 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.146373:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.146398:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b32 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.146408:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b32 expref: 15 pid: 15474 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.146418:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124658944:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.146462:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.150608:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124658944:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155575.150630:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155575.153671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.154212:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976123972736:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8402us (8895us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155575.154222:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4906 00002000:00100000:1.0:1746155575.154231:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a5ae1500 x1830976123972736/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.154240:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5ae1500 with x1830976123972736 ext(2097152->3145727) 00002000:00010000:1.0:1746155575.154245:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5ae1500 00000100:00100000:2.0:1746155575.154297:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123972864 00000100:00100000:2.0:1746155575.154302:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123972864 00010000:00010000:2.0:1746155575.154321:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b32 expref: 16 pid: 15474 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.154341:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6348 00000100:00100000:2.0:1746155575.154347:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1960:x1830976123972864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155575.154356:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.154361:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b32 expref: 16 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.154370:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b32 expref: 16 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.154386:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9600/0x844e5faceb5ecd92 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b32 expref: 16 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.154396:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155575.154400:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.154412:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.154417:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.154431:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155575.154446:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1960:x1830976123972864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 99us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.154452:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6348 00010000:00010000:0.0:1746155575.154638:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.154644:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155575.154675:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:0.0:1746155575.154679:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155575.154688:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.154803:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeba00/0x844e5faceb5ecda0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b39 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.154818:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b39 expref: 14 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.154824:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155575.154826:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155575.154828:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeaa00, rc 0) 00000100:00100000:0.0:1746155575.154846:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:29429:x1830976123972480:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 9479us (9561us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.154851:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10120 00000100:00100000:1.0:1746155575.155973:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.155989:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123973120 00000100:00100000:0.0:1746155575.155993:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123973120 00000100:00100000:0.0:1746155575.156022:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10121 00000100:00100000:0.0:1746155575.156027:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+32:29433:x1830976123973120:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155575.156041:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.156052:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8c00/0x844e5faceb5ecdae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b40 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.156121:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8000/0x844e5faceb5ecdb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156130:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8000/0x844e5faceb5ecdb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156137:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8000/0x844e5faceb5ecdb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156146:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ecdbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156154:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ecdbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156159:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ecdbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156233:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9800/0x844e5faceb5ecdc3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156240:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9800/0x844e5faceb5ecdc3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156245:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9800/0x844e5faceb5ecdc3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155575.156251:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155575.156308:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8000/0x844e5faceb5ecdb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156313:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8000/0x844e5faceb5ecdb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156318:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8000/0x844e5faceb5ecdb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156322:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbb8000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155575.156325:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8000/0x844e5faceb5ecdb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156330:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8000/0x844e5faceb5ecdb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156337:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155575.156339:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155575.156341:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8000/0x844e5faceb5ecdb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156345:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8000/0x844e5faceb5ecdb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156351:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ecdbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156356:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ecdbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156359:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ecdbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156363:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbb9400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155575.156364:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ecdbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156369:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ecdbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156373:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fff0100) 00010000:00010000:0.0:1746155575.156375:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155575.156377:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ecdbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156381:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9400/0x844e5faceb5ecdbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.156406:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb8c00/0x844e5faceb5ecdae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b40 expref: 35 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.156419:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9800/0x844e5faceb5ecdc3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b40 expref: 34 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.156424:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155575.156426:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155575.156428:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb9800, rc 0) 00000100:00100000:0.0:1746155575.156460:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+34:29433:x1830976123973120:12345-192.168.202.51@tcp:101:cat.0 Request processed in 432us (488us total) trans 8589944099 rc 0/0 00000100:00100000:0.0:1746155575.156466:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10121 00000100:00100000:2.0:1746155575.160773:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.160802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.160840:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.161226:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123973248 00000100:00100000:1.0:1746155575.161233:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123973248 00000100:00100000:0.0:1746155575.161251:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123973504 00000100:00100000:0.0:1746155575.161255:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123973504 00000100:00100000:1.0:1746155575.161265:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123973376 00000100:00100000:1.0:1746155575.161267:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123973376 00000100:00100000:0.0:1746155575.161276:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12530 00000100:00100000:1.0:1746155575.161281:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12531 00000100:00100000:0.0:1746155575.161282:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123973248:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155575.161288:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123973504:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155575.161296:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.161296:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.161308:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe8400/0x844e5faceb5ecdd8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b55 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.161349:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124659072:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155575.161366:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8800/0x844e5faceb5ecdd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b47 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.161392:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124659200:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155575.161413:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.161413:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.161428:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12532 00000100:00100000:0.0:1746155575.161433:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976123973376:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155575.161439:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.161445:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8600/0x844e5faceb5ecddf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b4e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.161459:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.161460:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.161466:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8600/0x844e5faceb5ecddf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b4e expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.161478:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8600/0x844e5faceb5ecddf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b4e expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.161486:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb8600, rc 0) 00000100:00100000:0.0:1746155575.161531:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976123973376:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 67us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.161730:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12532 00000100:00100000:1.0:1746155575.161782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.161804:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123973760 00000100:00100000:0.0:1746155575.161807:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123973760 00000100:00100000:0.0:1746155575.161824:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4115 00000100:00100000:0.0:1746155575.161829:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+34:29433:x1830976123973760:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155575.161830:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.161951:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+35:29433:x1830976123973760:12345-192.168.202.51@tcp:35:cat.0 Request processed in 121us (170us total) trans 8589944100 rc 0/0 00000100:00100000:0.0:1746155575.161956:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4115 00000100:00100000:0.0:1746155575.161972:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123973888 00000100:00100000:0.0:1746155575.161974:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123973888 00000100:00100000:0.0:1746155575.161985:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12533 00000100:00100000:0.0:1746155575.161989:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:29427:x1830976123973888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155575.161994:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.162001:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b5c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.162014:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.162020:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155575.162021:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155575.162024:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 38 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.162038:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.162047:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 25 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.162055:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124659328:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.162076:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.165192:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124659200:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155575.165219:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8800/0x844e5faceb5ecdd1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b47 expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.165230:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8800/0x844e5faceb5ecdd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b47 expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.165238:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbb8800, rc 0) 00000100:00100000:0.0:1746155575.166356:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123973248:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5071us (5588us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155575.166405:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12530 00000100:00100000:0.0:1746155575.166454:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124659072:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155575.166472:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8400/0x844e5faceb5ecdd8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b55 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155575.166640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.166653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.166675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.166691:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123974016 00000100:00100000:1.0:1746155575.166695:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123974016 00000100:00100000:1.0:1746155575.166714:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123974144 00000100:00100000:1.0:1746155575.166715:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123974144 00000100:00100000:2.0:1746155575.166727:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124659328:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155575.166727:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12534 00000100:00100000:1.0:1746155575.166732:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1961:x1830976123974016:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155575.166743:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 38 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.166743:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.166754:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013121e400, rc 0) 00010000:00010000:1.0:1746155575.166754:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ecded lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b63 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.166785:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124659456:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155575.166793:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:29427:x1830976123973888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4802us (4961us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.166798:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12533 00000100:00100000:2.0:1746155575.166814:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12535 00000100:00100000:2.0:1746155575.166819:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1961:x1830976123974144:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155575.166823:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00010000:00010000:2.0:1746155575.166825:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.166832:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecdf4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b6a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.166835:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123974272 00000100:00100000:1.0:1746155575.166838:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123974272 00010000:00010000:2.0:1746155575.166846:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.166848:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.166854:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecdf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b6a expref: 37 pid: 8437 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746155575.166857:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3006464->3145727) req@ffff8800948e4700 x1830976123974272/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746155575.166864:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecdf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b6a expref: 37 pid: 8437 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746155575.166865:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4700 with x1830976123974272 ext(3006464->3145727) 00010000:00010000:2.0:1746155575.166870:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a012b200, rc 0) 00010000:00010000:1.0:1746155575.166871:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 26 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.166881:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 26 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.166885:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+37:1961:x1830976123974144:12345-192.168.202.51@tcp:101:cat.0 Request processed in 66us (230us total) trans 0 rc 0/0 00002000:00010000:1.0:1746155575.166887:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800948e4700 00000100:00100000:2.0:1746155575.166889:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12535 00000100:00100000:1.0:1746155575.166896:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 793 00000100:00100000:1.0:1746155575.166901:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976123974272:12345-192.168.202.51@tcp:4:multiop.0 00010000:00010000:0.0:1746155575.167138:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8400/0x844e5faceb5ecdd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b55 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.167148:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8400, rc 0) 00000100:00100000:0.0:1746155575.167175:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123973504:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5888us (6372us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155575.167180:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12531 00000100:00100000:0.0:1746155575.171566:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124659456:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155575.171599:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ecded lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b63 expref: 36 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.171612:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5ecded lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b63 expref: 36 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.171623:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19a00, rc 0) 00000100:00100000:0.0:1746155575.171679:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1961:x1830976123974016:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4945us (5038us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155575.171687:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12534 00000100:00100000:1.0:1746155575.172321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.172361:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123974528 00000100:00100000:0.0:1746155575.172366:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123974528 00000100:00100000:0.0:1746155575.172406:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10122 00000100:00100000:0.0:1746155575.172412:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:29429:x1830976123974528:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155575.172425:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.172437:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0107200/0x844e5faceb5ecdfb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b71 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.172551:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0106400/0x844e5faceb5ece02 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.172563:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0106400/0x844e5faceb5ece02 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.172571:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0106400/0x844e5faceb5ece02 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155575.172582:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155575.172766:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0107200/0x844e5faceb5ecdfb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b71 expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.172779:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0106400/0x844e5faceb5ece02 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b71 expref: 16 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.172786:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155575.172788:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155575.172791:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0106400, rc 0) 00000100:00100000:0.0:1746155575.172827:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:29429:x1830976123974528:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 414us (506us total) trans 8589944101 rc 0/0 00000100:00100000:0.0:1746155575.172832:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10122 00000100:00100000:2.0:1746155575.173143:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+28:1963:x1830976123974272:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 6240us (6465us total) trans 17179873267 rc 0/0 00000100:00100000:2.0:1746155575.173150:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 793 00002000:00100000:2.0:1746155575.173157:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3dc:0x0] (3006464->3145727) req@ffff8800948e4700 x1830976123974272/t17179873267(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/448 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.173165:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4700 with x1830976123974272 ext(3006464->3145727) 00010000:00010000:2.0:1746155575.173171:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 28 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.173181:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 28 pid: 9235 timeout: 804 lvb_type: 0 00002000:00010000:2.0:1746155575.173186:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800948e4700 00000001:00080000:0.0:1746155575.175232:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873254 is committed 00000001:00080000:0.0:1746155575.175267:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873207 is committed 00000001:00080000:0.0:1746155575.175278:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873261 is committed 00000001:00080000:0.0:1746155575.175286:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873258 is committed 00000001:00080000:0.0:1746155575.175296:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873236 is committed 00000001:00080000:0.0:1746155575.175313:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873218 is committed 00000001:00080000:0.0:1746155575.175320:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873265 is committed 00000001:00080000:0.0:1746155575.175344:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873266 is committed 00000100:00100000:0.0:1746155575.177183:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.177221:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.177242:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.177274:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123974656 00000100:00100000:0.0:1746155575.177276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.177281:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123974656 00000100:00100000:0.0:1746155575.177287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.177298:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.177320:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123974912 00000100:00100000:1.0:1746155575.177323:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123974912 00000100:00100000:0.0:1746155575.177328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.177340:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123975168 00000100:00100000:1.0:1746155575.177342:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123975168 00000100:00100000:0.0:1746155575.177342:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123975424 00000100:00100000:0.0:1746155575.177345:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123975424 00000100:00100000:1.0:1746155575.177352:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123974784 00000100:00100000:1.0:1746155575.177354:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123974784 00000100:00100000:1.0:1746155575.177362:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123975296 00000100:00100000:0.0:1746155575.177362:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123975040 00000100:00100000:1.0:1746155575.177364:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123975296 00000100:00100000:0.0:1746155575.177364:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123975040 00000100:00100000:1.0:1746155575.177375:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12536 00000100:00100000:0.0:1746155575.177379:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12537 00000100:00100000:1.0:1746155575.177381:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+35:29433:x1830976123974656:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155575.177384:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123974912:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155575.177394:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.177407:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b78 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177408:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177422:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a0c expref: 9 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.177423:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177429:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938e6a00/0x844e5faceb5eccc7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aa6 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.177430:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155575.177431:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155575.177434:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 36 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177435:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d5b000/0x844e5faceb5ecc03 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a2f expref: 19 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.177441:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.177442:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.177444:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.177456:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177458:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d5b000/0x844e5faceb5ecc03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a2f expref: 19 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.177464:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 32 pid: 18270 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.177466:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d5b000/0x844e5faceb5ecc03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a2f expref: 19 pid: 18270 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.177476:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124659712:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155575.177477:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124659584:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155575.177537:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12538 00000100:00100000:3.0:1746155575.177545:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976123975168:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:1.0:1746155575.177551:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12539 00000100:00100000:1.0:1746155575.177557:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123975424:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155575.177561:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177561:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938e6a00/0x844e5faceb5eccc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aa6 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.177568:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938e6a00/0x844e5faceb5eccc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aa6 expref: 9 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746155575.177571:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a91 expref: 36 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.177572:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.177576:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124659840:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155575.177578:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a012b400/0x844e5faceb5ecd30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aec expref: 32 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.177580:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155575.177584:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800946fbe00/0x844e5faceb5eccd5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ab4 expref: 13 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.177584:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.177588:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746155575.177589:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.177590:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.177590:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.177592:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177597:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a0c expref: 9 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177604:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a0c expref: 9 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.177606:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800946fbe00/0x844e5faceb5eccd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ab4 expref: 13 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.177609:0:4461:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.177614:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800946fbe00/0x844e5faceb5eccd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ab4 expref: 13 pid: 29728 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.177616:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124659968:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155575.177617:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.177627:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124660224:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.177628:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155575.177634:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12540 00000100:00100000:1.0:1746155575.177639:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976123974784:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:0.0:1746155575.177642:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12541 00000100:00100000:0.0:1746155575.177647:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976123975296:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155575.177650:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.177653:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a012b400/0x844e5faceb5ecd30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aec expref: 32 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.177659:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a012b400/0x844e5faceb5ecd30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aec expref: 32 pid: 9235 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746155575.177660:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155575.177661:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.177663:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 36 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.177665:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124660352:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155575.177668:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746155575.177669:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177670:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 32 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177676:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecdf4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b6a expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.177680:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a91 expref: 36 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177682:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8600/0x844e5faceb5ecddf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b4e expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.177687:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a91 expref: 36 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.177687:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.177688:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.177690:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.177692:0:8436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 36 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.177693:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124660480:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155575.177700:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177702:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8600/0x844e5faceb5ecddf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b4e expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155575.177704:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00010000:00010000:0.0:1746155575.177709:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8600/0x844e5faceb5ecddf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b4e expref: 13 pid: 8437 timeout: 804 lvb_type: 1 00000100:00100000:1.0:1746155575.177716:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12542 00000100:00100000:0.0:1746155575.177717:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124660736:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155575.177721:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123975040:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155575.177733:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177738:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecdf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b6a expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.177741:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a21 expref: 9 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177745:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecdf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b6a expref: 36 pid: 8437 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746155575.177747:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946faa00/0x844e5faceb5eccce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aad expref: 9 pid: 29728 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155575.177751:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124660864:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155575.177753:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cec600/0x844e5faceb5ecc0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a36 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.177759:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.177760:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.177762:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.177770:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 32 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.177775:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5cec600/0x844e5faceb5ecc0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a36 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.177778:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 32 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.177782:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cec600/0x844e5faceb5ecc0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a36 expref: 19 pid: 8436 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.177785:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124660992:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155575.177789:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124661120:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.177798:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd480 going to sleep for 11 seconds 00010000:00010000:1.0:1746155575.177815:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946faa00/0x844e5faceb5eccce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aad expref: 9 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.177821:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946faa00/0x844e5faceb5eccce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aad expref: 9 pid: 29728 timeout: 804 lvb_type: 1 00000100:00100000:1.0:1746155575.177829:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124661248:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155575.177849:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a21 expref: 9 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.177856:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a21 expref: 9 pid: 4461 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746155575.177867:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124661376:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155575.177882:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155575.177891:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155575.178837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.178870:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123975552 00000100:00100000:2.0:1746155575.178873:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123975552 00010000:00010000:2.0:1746155575.178886:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 10 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.178899:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6349 00000100:00100000:2.0:1746155575.178902:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123975552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155575.178908:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.178920:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 10 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.178926:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 10 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.178936:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df8da00/0x844e5faceb5ecd29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ae5 expref: 10 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.178952:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.178953:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.178956:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.178960:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.178973:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.178978:0:15879:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 19 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.178983:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124661504:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155575.179012:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fbeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155575.181155:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124659712:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155575.182282:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124659584:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155575.182305:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 36 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.182319:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9a00, rc 0) 00000100:00100000:1.0:1746155575.182358:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:29433:x1830976123974656:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4976us (5178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.182366:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12536 00000100:00100000:0.0:1746155575.182430:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.182597:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123975808 00000100:00100000:3.0:1746155575.182603:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123975808 00002000:00100000:3.0:1746155575.182629:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (491520->884735) req@ffff880094f0b100 x1830976123975808/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.182637:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0b100 with x1830976123975808 ext(491520->884735) 00010000:00010000:3.0:1746155575.182643:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 33 pid: 18270 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.182658:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 33 pid: 18270 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.182664:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f0b100 00000100:00100000:3.0:1746155575.182676:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 794 00000100:00100000:3.0:1746155575.182681:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1962:x1830976123975808:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155575.192896:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.192909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.192926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.192958:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124660736:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.192967:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124660864:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.192974:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124660992:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155575.192995:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.193015:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123976448 00000100:00100000:0.0:1746155575.193020:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123976448 00002000:00100000:0.0:1746155575.193049:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880094f0ad80 x1830976123976448/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.193057:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0ad80 with x1830976123976448 ext(2097152->3145727) 00010000:00010000:0.0:1746155575.193065:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 20 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.193074:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 20 pid: 8437 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746155575.193080:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f0ad80 00000100:00100000:0.0:1746155575.193093:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123976576 00000100:00100000:0.0:1746155575.193094:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123976576 00002000:00100000:0.0:1746155575.193102:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880094f08e00 x1830976123976576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.193109:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08e00 with x1830976123976576 ext(3145728->4194303) 00010000:00010000:0.0:1746155575.193112:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 21 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.193119:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 21 pid: 8437 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746155575.193123:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f08e00 00000100:00100000:0.0:1746155575.193130:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123976832 00000100:00100000:0.0:1746155575.193132:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123976832 00002000:00100000:0.0:1746155575.193140:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094f08a80 x1830976123976832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.193146:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08a80 with x1830976123976832 ext(3145728->4194303) 00010000:00010000:0.0:1746155575.193149:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 35 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.193156:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 35 pid: 1625 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746155575.193160:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f08a80 00000100:00100000:0.0:1746155575.193168:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 795 00000100:00100000:0.0:1746155575.193174:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123976448:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155575.193897:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 796 00000100:00100000:2.0:1746155575.193905:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123976576:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155575.194328:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124660224:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155575.194336:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124660352:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155575.194343:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124660480:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155575.194358:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.194605:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 797 00000100:00100000:0.0:1746155575.194611:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1962:x1830976123976832:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155575.194888:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124661504:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155575.194897:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155575.194922:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1962:x1830976123975552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 16018us (16086us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.194929:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6349 00000100:00100000:2.0:1746155575.195039:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124659840:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155575.195049:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124659968:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155575.195064:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.195543:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124661120:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.195552:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124661248:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.195558:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124661376:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155575.195585:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.195631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.195680:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.195720:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.195731:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.195742:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.195753:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.195764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.195773:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.195792:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.195806:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123977088 00000100:00100000:0.0:1746155575.195810:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123977088 00010000:00010000:0.0:1746155575.195830:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecdf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b6a expref: 36 pid: 8437 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.195842:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123976960 00000100:00100000:0.0:1746155575.195844:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123976960 00010000:00010000:0.0:1746155575.195851:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a91 expref: 37 pid: 9235 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.195859:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123975680 00000100:00100000:0.0:1746155575.195860:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123975680 00010000:00010000:0.0:1746155575.195868:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d5b000/0x844e5faceb5ecc03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a2f expref: 24 pid: 18270 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.195876:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123976064 00000100:00100000:0.0:1746155575.195877:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123976064 00010000:00010000:0.0:1746155575.195885:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a0c expref: 9 pid: 4461 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.195892:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123977344 00000100:00100000:0.0:1746155575.195894:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123977344 00010000:00010000:0.0:1746155575.195900:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a012b400/0x844e5faceb5ecd30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aec expref: 37 pid: 9235 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.195909:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123977600 00000100:00100000:0.0:1746155575.195910:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123977600 00010000:00010000:0.0:1746155575.195916:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cec600/0x844e5faceb5ecc0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a36 expref: 25 pid: 8436 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.195924:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123975936 00000100:00100000:0.0:1746155575.195926:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123975936 00010000:00010000:0.0:1746155575.195932:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938e6a00/0x844e5faceb5eccc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aa6 expref: 10 pid: 18270 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.195939:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123977216 00000100:00100000:0.0:1746155575.195940:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123977216 00010000:00010000:0.0:1746155575.195947:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8600/0x844e5faceb5ecddf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b4e expref: 14 pid: 8437 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.195954:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123977472 00000100:00100000:0.0:1746155575.195955:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123977472 00010000:00010000:0.0:1746155575.195961:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946faa00/0x844e5faceb5eccce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aad expref: 11 pid: 29728 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.195970:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6350 00000100:00100000:0.0:1746155575.195975:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+37:1963:x1830976123977088:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.195984:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.195997:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecdf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b6a expref: 37 pid: 8437 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196006:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecdf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b6a expref: 37 pid: 8437 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196023:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a012b200/0x844e5faceb5ecdf4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b6a expref: 37 pid: 8437 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196037:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.196056:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1963:x1830976123977088:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 81us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.196062:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6350 00000100:00100000:0.0:1746155575.196073:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6351 00000100:00100000:0.0:1746155575.196077:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1963:x1830976123976960:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.196083:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.196092:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a91 expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.196099:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a91 expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.196109:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df8dc00/0x844e5faceb5ecc9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a91 expref: 35 pid: 9235 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.196116:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.196128:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1963:x1830976123976960:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.196133:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6351 00000100:00100000:0.0:1746155575.196162:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6352 00000100:00100000:0.0:1746155575.196167:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976123975680:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.196174:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.196185:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d5b000/0x844e5faceb5ecc03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a2f expref: 25 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196192:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d5b000/0x844e5faceb5ecc03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a2f expref: 25 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196203:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d5b000/0x844e5faceb5ecc03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a2f expref: 25 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196211:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.196224:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123975680:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.196228:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6352 00000100:00100000:0.0:1746155575.196238:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6353 00000100:00100000:0.0:1746155575.196242:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123976064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.196247:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.196253:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a0c expref: 9 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.196260:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a0c expref: 9 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.196269:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e68b600/0x844e5faceb5ecbe0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a0c expref: 9 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.196280:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.196292:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123976064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.196297:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6353 00000100:00100000:0.0:1746155575.196305:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6354 00000100:00100000:0.0:1746155575.196309:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976123977344:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.196314:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.196320:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a012b400/0x844e5faceb5ecd30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aec expref: 37 pid: 9235 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196327:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a012b400/0x844e5faceb5ecd30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aec expref: 37 pid: 9235 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196335:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a012b400/0x844e5faceb5ecd30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aec expref: 37 pid: 9235 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196342:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.196352:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976123977344:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 43us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.196357:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6354 00000100:00100000:0.0:1746155575.196365:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6355 00000100:00100000:0.0:1746155575.196370:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123977600:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.196376:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746155575.196383:0:7063:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:0.0:1746155575.196387:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5cec600/0x844e5faceb5ecc0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a36 expref: 23 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196394:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5cec600/0x844e5faceb5ecc0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a36 expref: 23 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196404:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cec600/0x844e5faceb5ecc0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a36 expref: 23 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196410:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.196428:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123977600:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 58us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.196433:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6355 00000100:00100000:0.0:1746155575.196441:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6356 00000100:00100000:0.0:1746155575.196445:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976123975936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.196450:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.196455:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938e6a00/0x844e5faceb5eccc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aa6 expref: 11 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196463:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938e6a00/0x844e5faceb5eccc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aa6 expref: 11 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196472:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938e6a00/0x844e5faceb5eccc7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aa6 expref: 11 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196479:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.196481:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.196485:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.196492:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.196534:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.196547:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976123975936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 101us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.196552:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6356 00000100:00100000:0.0:1746155575.196561:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6357 00000100:00100000:0.0:1746155575.196566:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976123977216:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.196572:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.196578:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8600/0x844e5faceb5ecddf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b4e expref: 14 pid: 8437 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196586:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8600/0x844e5faceb5ecddf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b4e expref: 14 pid: 8437 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196595:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbb8600/0x844e5faceb5ecddf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b4e expref: 14 pid: 8437 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196603:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.196615:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1961:x1830976123977216:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.196619:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6357 00000100:00100000:0.0:1746155575.196631:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6358 00000100:00100000:0.0:1746155575.196636:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976123977472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.196641:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.196646:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946faa00/0x844e5faceb5eccce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aad expref: 9 pid: 29728 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196654:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946faa00/0x844e5faceb5eccce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aad expref: 9 pid: 29728 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196661:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946faa00/0x844e5faceb5eccce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11aad expref: 9 pid: 29728 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746155575.196668:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.196677:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976123977472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 41us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.196682:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6358 00010000:00010000:2.0:1746155575.198348:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.198360:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.198381:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.198387:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.198393:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.198399:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0106600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155575.198402:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.198408:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.198418:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.198423:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ece17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155575.198478:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976123974912:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 21090us (21253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.198485:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12537 00000100:00100000:1.0:1746155575.206816:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.206841:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123977728 00000100:00100000:2.0:1746155575.206849:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123977728 00010000:00010000:2.0:1746155575.206876:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800946fbe00/0x844e5faceb5eccd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ab4 expref: 13 pid: 29728 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746155575.206899:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6359 00000100:00100000:2.0:1746155575.206906:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1963:x1830976123977728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155575.206916:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.206932:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800946fbe00/0x844e5faceb5eccd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ab4 expref: 13 pid: 29728 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746155575.206942:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800946fbe00/0x844e5faceb5eccd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ab4 expref: 13 pid: 29728 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746155575.206973:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800946fbe00/0x844e5faceb5eccd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ab4 expref: 13 pid: 29728 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746155575.206983:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.206985:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.206989:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.206996:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.207051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155575.208317:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155575.208338:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123977856 00000100:00100000:2.0:1746155575.208343:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123977856 00010000:00010000:2.0:1746155575.208360:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a21 expref: 8 pid: 4461 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.208378:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6360 00000100:00100000:2.0:1746155575.208384:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123977856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155575.208391:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.208406:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a21 expref: 8 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.208414:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a21 expref: 8 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.208428:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1cec00/0x844e5faceb5ecbf5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11a21 expref: 8 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.208438:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.208439:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.208442:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.208448:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.208460:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155575.208489:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+7:1961:x1830976123977856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 105us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.208494:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6360 00000100:00100000:2.0:1746155575.208587:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976123977728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1680us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.208593:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6359 00010000:00010000:3.0:1746155575.208902:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.208910:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.208932:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.208938:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.208944:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.208950:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0ff800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155575.208953:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.208960:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.208968:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.208973:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f0ff800/0x844e5faceb5ece1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.209007:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976123975168:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 31463us (31763us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.209013:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12538 00000100:00100000:3.0:1746155575.212413:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976123976448:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19231us (19516us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155575.212423:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 795 00002000:00100000:3.0:1746155575.212433:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff880094f0ad80 x1830976123976448/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.212441:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0ad80 with x1830976123976448 ext(2097152->3145727) 00010000:00010000:3.0:1746155575.212450:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 20 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.212461:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 20 pid: 8437 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.212466:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f0ad80 00010000:00010000:0.0:1746155575.212645:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.212654:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.212678:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.212684:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.212695:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.213636:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155575.213641:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.213648:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.213664:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.213670:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0x844e5faceb5ece3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.217105:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1960:x1830976123975040:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 39375us (39797us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.217115:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12542 00000100:00100000:3.0:1746155575.220282:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976123975808:12345-192.168.202.51@tcp:4:cat.0 Request processed in 37592us (37845us total) trans 21474840660 rc 0/0 00000100:00100000:3.0:1746155575.220292:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 794 00002000:00100000:3.0:1746155575.220303:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3d6:0x0] (491520->884735) req@ffff880094f0b100 x1830976123975808/t21474840660(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/448 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.220312:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0b100 with x1830976123975808 ext(491520->884735) 00010000:00010000:3.0:1746155575.220321:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 36 pid: 18270 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.220333:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 36 pid: 18270 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.220339:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f0b100 00000100:00100000:2.0:1746155575.226712:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976123976576:12345-192.168.202.51@tcp:3:cat.0 Request processed in 32798us (33791us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155575.226725:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 796 00002000:00100000:2.0:1746155575.226738:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880094f08e00 x1830976123976576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.226747:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08e00 with x1830976123976576 ext(3145728->4194303) 00010000:00010000:2.0:1746155575.226757:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 18 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.226769:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 18 pid: 8437 timeout: 804 lvb_type: 0 00002000:00010000:2.0:1746155575.226775:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f08e00 00000100:00100000:0.0:1746155575.230368:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.230396:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123977984 00000100:00100000:0.0:1746155575.230404:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123977984 00000100:00100000:0.0:1746155575.230437:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12543 00000100:00100000:0.0:1746155575.230444:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:29427:x1830976123977984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155575.230457:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.230472:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b7f expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.230492:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.230496:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.230526:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155575.230530:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b7f expref: 37 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.230542:0:20200:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.230554:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b7f expref: 37 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.230563:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc0a00, rc 0) 00000100:00100000:0.0:1746155575.230597:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:29427:x1830976123977984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 154us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.230602:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12543 00000100:00100000:0.0:1746155575.233220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.233446:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123978112 00000100:00100000:0.0:1746155575.233453:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123978112 00010000:00010000:0.0:1746155575.233481:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 37 pid: 18270 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.233537:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6361 00000100:00100000:0.0:1746155575.233544:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1963:x1830976123978112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155575.233555:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155575.233572:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 37 pid: 18270 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.233581:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 37 pid: 18270 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.233598:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2f7c00/0x844e5faceb5ecd22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 491520->884735) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ade expref: 37 pid: 18270 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.233609:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.233611:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.233616:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 33 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.233623:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 33 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.233649:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 33 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.233660:0:22680:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 33 pid: 10591 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.233669:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124661632:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155575.233729:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.234892:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1962:x1830976123976832:12345-192.168.202.51@tcp:3:cat.0 Request processed in 40278us (41961us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155575.234901:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 797 00002000:00100000:0.0:1746155575.234909:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094f08a80 x1830976123976832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.234918:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08a80 with x1830976123976832 ext(3145728->4194303) 00010000:00010000:0.0:1746155575.234924:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 35 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.234933:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 35 pid: 1625 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746155575.234939:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f08a80 00000100:00100000:2.0:1746155575.238822:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.238835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.238849:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123978240 00000100:00100000:3.0:1746155575.238857:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123978496 00000100:00100000:2.0:1746155575.238857:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123978240 00000100:00100000:3.0:1746155575.238860:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123978496 00010000:00010000:2.0:1746155575.238882:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 18 pid: 8437 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.238890:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10123 00000100:00100000:3.0:1746155575.238897:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+35:29435:x1830976123978496:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:2.0:1746155575.238901:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6362 00000100:00100000:2.0:1746155575.238906:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976123978240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.238914:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.238916:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155575.238928:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6600/0x844e5faceb5ece48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b86 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.238932:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 18 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.238942:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 18 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.238959:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5ecde6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b5c expref: 18 pid: 8437 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.238979:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.238981:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.238984:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.238990:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.238998:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.239007:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155575.239009:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b39 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.239017:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9800/0x844e5faceb5ecdc3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b40 expref: 36 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.239022:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0106400/0x844e5faceb5ece02 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b71 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.239027:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155575.239046:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0106400/0x844e5faceb5ece02 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b71 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155575.239050:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123978240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 132us (223us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155575.239054:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0106400/0x844e5faceb5ece02 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b71 expref: 15 pid: 15474 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.239056:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6362 00000100:00100000:3.0:1746155575.239070:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124661760:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155575.239076:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.239083:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.239098:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.239105:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.239111:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.239112:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9800/0x844e5faceb5ecdc3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b40 expref: 36 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.239119:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9800/0x844e5faceb5ecdc3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b40 expref: 36 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.239121:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155575.239123:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.239125:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124661888:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155575.239129:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.239138:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.239143:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9800/0x844e5faceb5ece25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155575.239189:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1960:x1830976123975424:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 61631us (61911us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155575.239823:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b39 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.239831:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b39 expref: 15 pid: 15474 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.239838:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124662016:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155575.239861:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155575.240657:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12539 00000100:00100000:3.0:1746155575.240940:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124661632:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155575.240954:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155575.240974:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123978112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7431us (7760us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.240981:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6361 00000100:00100000:3.0:1746155575.242810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.242850:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123978752 00000100:00100000:0.0:1746155575.242857:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123978752 00002000:00100000:0.0:1746155575.242889:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880094c32300 x1830976123978752/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.242898:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c32300 with x1830976123978752 ext(0->1048575) 00010000:00010000:0.0:1746155575.242906:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 34 pid: 10591 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.242917:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 34 pid: 10591 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746155575.242924:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c32300 00000100:00100000:0.0:1746155575.242971:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 798 00000100:00100000:0.0:1746155575.242978:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1960:x1830976123978752:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155575.243147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.245270:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123978880 00000100:00100000:2.0:1746155575.245279:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123978880 00010000:00010000:2.0:1746155575.245303:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 34 pid: 1625 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.245325:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6363 00000100:00100000:2.0:1746155575.245331:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976123978880:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155575.245341:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.245355:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 34 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.245365:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 34 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.245382:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107e00/0x844e5faceb5ecd84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b2b expref: 34 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.245392:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.245394:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.245398:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.245406:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.245424:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155575.245449:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123978880:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 118us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.245455:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6363 00010000:00010000:2.0:1746155575.245474:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.245480:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.245496:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.245527:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.245533:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.245538:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0107c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155575.245541:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.245547:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.245554:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.245555:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.245559:0:1625:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b7f expref: 32 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.245564:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b7f expref: 32 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.245585:0:1625:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b7f expref: 32 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155575.245594:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124662144:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155575.245627:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155575.250307:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.250321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.250457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.250493:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124661760:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155575.250534:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124661888:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155575.250543:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976124662016:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155575.250563:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155575.250585:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123979008 00000100:00100000:2.0:1746155575.250589:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123979008 00010000:00010000:2.0:1746155575.250612:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0106400/0x844e5faceb5ece02 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b71 expref: 16 pid: 15474 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.250630:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6364 00000100:00100000:2.0:1746155575.250636:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1961:x1830976123979008:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155575.250647:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.250651:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0106400/0x844e5faceb5ece02 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b71 expref: 16 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.250659:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0106400/0x844e5faceb5ece02 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b71 expref: 16 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.250675:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0106400/0x844e5faceb5ece02 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b71 expref: 16 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.250685:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155575.250690:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.250696:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.250701:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155575.250732:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976123979008:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.250738:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6364 00000100:00100000:2.0:1746155575.250751:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123979136 00000100:00100000:2.0:1746155575.250753:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123979136 00010000:00010000:2.0:1746155575.250761:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9800/0x844e5faceb5ecdc3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b40 expref: 37 pid: 15474 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.250771:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123979264 00000100:00100000:2.0:1746155575.250773:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123979264 00010000:00010000:2.0:1746155575.250778:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b39 expref: 15 pid: 15474 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.250787:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6365 00000100:00100000:2.0:1746155575.250791:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+37:1961:x1830976123979136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155575.250796:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.250798:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9800/0x844e5faceb5ecdc3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b40 expref: 37 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.250804:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9800/0x844e5faceb5ecdc3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b40 expref: 37 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.250814:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbb9800/0x844e5faceb5ecdc3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b40 expref: 37 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.250823:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155575.250826:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.250831:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.250835:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155575.250848:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1961:x1830976123979136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 56us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.250853:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6365 00000100:00100000:2.0:1746155575.250880:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6366 00000100:00100000:2.0:1746155575.250884:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1960:x1830976123979264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155575.250889:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.250893:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b39 expref: 15 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.250900:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b39 expref: 15 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.250908:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5ecda7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b39 expref: 15 pid: 15474 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.250916:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155575.250918:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.250926:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.250930:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.250943:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155575.250956:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976123979264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 71us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.250961:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6366 00010000:00010000:2.0:1746155575.251016:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155575.251021:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155575.251037:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155575.251130:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6600/0x844e5faceb5ece48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b86 expref: 37 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.251140:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b86 expref: 36 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.251146:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155575.251148:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155575.251151:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01d6a00, rc 0) 00000100:00100000:2.0:1746155575.251169:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:29435:x1830976123978496:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 12273us (12337us total) trans 8589944102 rc 0/0 00000100:00100000:2.0:1746155575.251175:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10123 00000100:00100000:3.0:1746155575.253101:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124662144:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155575.253122:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.253130:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0107c00/0x844e5faceb5ece33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.253175:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976123975296:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 75527us (75846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.253182:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12541 00000100:00100000:3.0:1746155575.253289:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.253544:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123979520 00000100:00100000:2.0:1746155575.253549:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123979520 00002000:00100000:2.0:1746155575.253575:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094c33100 x1830976123979520/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.253584:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c33100 with x1830976123979520 ext(3145728->4194303) 00002000:00010000:2.0:1746155575.253587:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c33100 00000100:00100000:2.0:1746155575.253611:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4907 00000100:00100000:2.0:1746155575.253617:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123979520:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155575.254189:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1960:x1830976123978752:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11210us (11378us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155575.254195:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 798 00002000:00100000:0.0:1746155575.254200:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff880094c32300 x1830976123978752/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.254206:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c32300 with x1830976123978752 ext(0->1048575) 00010000:00010000:0.0:1746155575.254212:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 34 pid: 10591 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.254223:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 34 pid: 10591 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746155575.254229:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c32300 00000100:00100000:3.0:1746155575.276209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.276543:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.276562:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123979648 00000100:00100000:2.0:1746155575.276563:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123979776 00000100:00100000:3.0:1746155575.276569:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123979648 00000100:00100000:2.0:1746155575.276569:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123979776 00000100:00100000:3.0:1746155575.276596:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12544 00010000:00010000:2.0:1746155575.276597:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 34 pid: 10591 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.276603:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+7:29433:x1830976123979648:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155575.276616:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155575.276620:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6367 00000100:00100000:2.0:1746155575.276626:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1962:x1830976123979776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.276629:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5ece5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b8d expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.276636:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155575.276648:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3da:0x0] initial LVB size: 2097152, mtime: 0x68143836, atime: 0x68143835, ctime: 0x68143836, blocks: 0x821 00010000:00010000:2.0:1746155575.276652:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 34 pid: 10591 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.276662:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.276663:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 34 pid: 10591 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.276664:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.276669:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5ece5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b8d expref: 8 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.276680:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ece10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b78 expref: 34 pid: 10591 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.276682:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5ece5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b8d expref: 8 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.276690:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090013000, rc 0) 00010000:00010000:2.0:1746155575.276696:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.276699:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.276703:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.276709:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.277441:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29433:x1830976123979648:12345-192.168.202.51@tcp:101:cat.0 Request processed in 835us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.277447:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12544 00010000:00010000:2.0:1746155575.277500:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155575.277544:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.277552:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155575.277553:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+33:1962:x1830976123979776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 926us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.277559:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6367 00010000:00010000:1.0:1746155575.277571:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.277578:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.277589:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.277594:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155575.277597:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.277604:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.277612:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.277617:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe8800/0x844e5faceb5ece2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.277651:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976123974784:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 100012us (100362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.277657:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12540 00000100:00100000:2.0:1746155575.279425:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976123979520:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25804us (26132us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155575.279434:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4907 00002000:00100000:2.0:1746155575.279443:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094c33100 x1830976123979520/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.279450:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c33100 with x1830976123979520 ext(3145728->4194303) 00002000:00010000:2.0:1746155575.279455:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c33100 00000100:00100000:3.0:1746155575.295998:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.296055:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123980032 00000100:00100000:2.0:1746155575.296065:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123980032 00000100:00100000:2.0:1746155575.296126:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10124 00000100:00100000:2.0:1746155575.296135:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:29429:x1830976123980032:12345-192.168.202.51@tcp:36:lfs.0 00000100:00100000:2.0:1746155575.296254:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:29429:x1830976123980032:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 119us (261us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746155575.296260:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10124 00000100:00100000:3.0:1746155575.301177:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.301216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.301427:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123980544 00000100:00100000:0.0:1746155575.301456:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123980544 00000100:00100000:3.0:1746155575.301566:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.302087:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4116 00000100:00100000:0.0:1746155575.302093:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:29429:x1830976123980544:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:0.0:1746155575.302239:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:29429:x1830976123980544:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 145us (1070us total) trans 8589944103 rc 0/0 00000100:00100000:0.0:1746155575.302245:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4116 00000100:00100000:2.0:1746155575.302603:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123980288 00000100:00100000:2.0:1746155575.302608:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123980288 00002000:00100000:2.0:1746155575.302637:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094c31880 x1830976123980288/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.302645:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c31880 with x1830976123980288 ext(1048576->2097151) 00002000:00010000:2.0:1746155575.302650:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c31880 00000100:00100000:2.0:1746155575.302665:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4908 00000100:00100000:2.0:1746155575.302671:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1960:x1830976123980288:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155575.302951:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123980672 00000100:00100000:1.0:1746155575.302955:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123980672 00000100:00100000:1.0:1746155575.302981:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12545 00000100:00100000:1.0:1746155575.302986:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:29427:x1830976123980672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155575.302994:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.303008:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5ece64 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b94 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155575.303022:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3dc:0x0] initial LVB size: 4194304, mtime: 0x68143837, atime: 0x68143837, ctime: 0x68143837, blocks: 0x1029 00010000:00010000:1.0:1746155575.303035:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.303036:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.303041:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5ece64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b94 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.303052:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5ece64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b94 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.303060:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b400, rc 0) 00000100:00100000:1.0:1746155575.303082:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:29427:x1830976123980672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 95us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.303087:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12545 00000100:00100000:0.0:1746155575.307922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.307979:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123980928 00000100:00100000:1.0:1746155575.307987:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123980928 00000100:00100000:1.0:1746155575.308020:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4117 00000100:00100000:1.0:1746155575.308026:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:29429:x1830976123980928:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:1.0:1746155575.308174:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:29429:x1830976123980928:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 148us (258us total) trans 8589944104 rc 0/0 00000100:00100000:1.0:1746155575.308180:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4117 00000100:00100000:3.0:1746155575.309750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.309882:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123981056 00000100:00100000:0.0:1746155575.309888:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123981056 00000100:00100000:0.0:1746155575.309910:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12546 00000100:00100000:0.0:1746155575.309915:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+33:29435:x1830976123981056:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155575.309927:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.309941:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11b9b expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155575.309959:0:4461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x68143837, atime: 0x68143837, ctime: 0x68143837, blocks: 0x765 00010000:00010000:0.0:1746155575.309973:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.309974:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.309980:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 34 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.309991:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 34 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.309998:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc0400, rc 0) 00000100:00100000:0.0:1746155575.310030:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+34:29435:x1830976123981056:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 114us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.310034:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12546 00000100:00100000:1.0:1746155575.310095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.310597:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1960:x1830976123980288:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7926us (9380us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155575.310604:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4908 00002000:00100000:2.0:1746155575.310610:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094c31880 x1830976123980288/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.310618:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c31880 with x1830976123980288 ext(1048576->2097151) 00002000:00010000:2.0:1746155575.310621:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c31880 00000100:00100000:2.0:1746155575.310632:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123981312 00000100:00100000:2.0:1746155575.310634:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123981312 00002000:00100000:2.0:1746155575.310646:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800948e5c00 x1830976123981312/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.310652:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5c00 with x1830976123981312 ext(3145728->4194303) 00002000:00010000:2.0:1746155575.310655:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e5c00 00000100:00100000:2.0:1746155575.310662:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4909 00000100:00100000:2.0:1746155575.310666:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976123981312:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155575.313846:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.313939:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123981568 00000100:00100000:0.0:1746155575.313945:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123981568 00000100:00100000:0.0:1746155575.313981:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10125 00000100:00100000:0.0:1746155575.313987:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+310:29438:x1830976123981568:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155575.314003:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.314018:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1a00/0x844e5faceb5ece72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ba2 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.314083:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1c00/0x844e5faceb5ece79 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.314097:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1c00/0x844e5faceb5ece79 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155575.314105:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1c00/0x844e5faceb5ece79 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155575.314112:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155575.314180:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1a00/0x844e5faceb5ece72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ba2 expref: 313 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.314191:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1c00/0x844e5faceb5ece79 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ba2 expref: 312 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.314197:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155575.314200:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155575.314202:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc1c00, rc 0) 00000100:00100000:0.0:1746155575.314244:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:29438:x1830976123981568:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 256us (404us total) trans 8589944105 rc 0/0 00000100:00100000:0.0:1746155575.314248:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10125 00000100:00100000:0.0:1746155575.322866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.322944:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123981824 00000100:00100000:0.0:1746155575.322951:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123981824 00002000:00100000:0.0:1746155575.322982:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (647168->651263) req@ffff880094f0b800 x1830976123981824/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.322990:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0b800 with x1830976123981824 ext(647168->651263) 00002000:00010000:0.0:1746155575.322995:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f0b800 00000100:00100000:0.0:1746155575.323010:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4910 00000100:00100000:0.0:1746155575.323017:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1961:x1830976123981824:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155575.323133:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1961:x1830976123981824:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 116us (271us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155575.323139:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4910 00002000:00100000:0.0:1746155575.323144:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (647168->651263) req@ffff880094f0b800 x1830976123981824/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/4536 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.323151:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0b800 with x1830976123981824 ext(647168->651263) 00002000:00010000:0.0:1746155575.323153:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f0b800 00000100:00100000:2.0:1746155575.324585:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976123981312:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13914us (14486us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155575.324593:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4909 00002000:00100000:2.0:1746155575.324601:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800948e5c00 x1830976123981312/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.324608:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5c00 with x1830976123981312 ext(3145728->4194303) 00002000:00010000:2.0:1746155575.324611:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e5c00 00000001:00080000:3.0:1746155575.331894:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840640 is committed 00000001:00080000:3.0:1746155575.331923:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840590 is committed 00000001:00080000:3.0:1746155575.331933:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840659 is committed 00000001:00080000:3.0:1746155575.331947:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840626 is committed 00000001:00080000:3.0:1746155575.331982:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840601 is committed 00000001:00080000:3.0:1746155575.331986:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840658 is committed 00000001:00080000:3.0:1746155575.332015:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840644 is committed 00000001:00080000:3.0:1746155575.332035:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840602 is committed 00000001:00080000:3.0:1746155575.332053:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840645 is committed 00000100:00100000:1.0:1746155575.332084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.332104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.332172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.332190:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123982080 00000100:00100000:0.0:1746155575.332190:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123981952 00000100:00100000:1.0:1746155575.332196:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123982080 00000100:00100000:0.0:1746155575.332196:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123981952 00000100:00100000:0.0:1746155575.332224:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123982208 00000100:00100000:0.0:1746155575.332226:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123982208 00000100:00100000:3.0:1746155575.332601:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12547 00000100:00100000:3.0:1746155575.332610:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1963:x1830976123981952:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155575.332624:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.332638:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd10a00/0x844e5faceb5ece87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ba9 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.332680:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124662272:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155575.332748:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155575.333771:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12548 00000100:00100000:1.0:1746155575.333779:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123982080:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155575.333784:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12549 00010000:00010000:1.0:1746155575.333788:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155575.333792:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123982208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155575.333798:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ece8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11bb0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.333799:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.333808:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8400/0x844e5faceb5ece95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11bb7 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.333810:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.333812:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.333818:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ece8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb0 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746155575.333827:0:20200:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3db:0x0] initial LVB size: 2097152, mtime: 0x68143836, atime: 0x68143836, ctime: 0x68143836, blocks: 0x821 00010000:00010000:1.0:1746155575.333829:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ece8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb0 expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155575.333835:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.333837:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.333837:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3be00, rc 0) 00010000:00010000:2.0:1746155575.333842:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8400/0x844e5faceb5ece95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb7 expref: 21 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155575.333851:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8400/0x844e5faceb5ece95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb7 expref: 21 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155575.333858:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc8400, rc 0) 00000100:00100000:1.0:1746155575.333860:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123982080:12345-192.168.202.51@tcp:101:cat.0 Request processed in 83us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.333865:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12548 00000100:00100000:2.0:1746155575.333876:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976123982208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 86us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.333881:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12549 00000100:00100000:0.0:1746155575.336604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.336636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.337360:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123982336 00000100:00100000:1.0:1746155575.337368:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123982336 00000100:00100000:1.0:1746155575.337398:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123982464 00000100:00100000:1.0:1746155575.337400:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123982464 00000100:00100000:1.0:1746155575.337414:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12550 00000100:00100000:1.0:1746155575.337420:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976123982336:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155575.337434:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.337450:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ece9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11bbe expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155575.337470:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x68143837, atime: 0x68143836, ctime: 0x68143837, blocks: 0x821 00010000:00010000:1.0:1746155575.337483:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.337485:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.337492:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ece9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bbe expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.337540:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ece9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bbe expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.337549:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b800, rc 0) 00000100:00100000:1.0:1746155575.337584:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976123982336:12345-192.168.202.51@tcp:101:cat.0 Request processed in 164us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.337589:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12550 00000100:00100000:1.0:1746155575.337601:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12551 00000100:00100000:1.0:1746155575.337606:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29433:x1830976123982464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155575.337613:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.337621:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ba00/0x844e5faceb5ecea3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11bc5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.337633:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.337634:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.337638:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ba00/0x844e5faceb5ecea3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bc5 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.337646:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ba00/0x844e5faceb5ecea3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bc5 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.337657:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3ba00, rc 0) 00000100:00100000:1.0:1746155575.337670:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29433:x1830976123982464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 64us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.337674:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12551 00000100:00100000:3.0:1746155575.337871:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124662272:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155575.337894:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd10a00/0x844e5faceb5ece87 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ba9 expref: 15 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.337903:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10a00/0x844e5faceb5ece87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ba9 expref: 15 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.337914:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd10a00, rc 0) 00000100:00100000:3.0:1746155575.337932:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1963:x1830976123981952:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5324us (5852us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155575.337937:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12547 00000100:00100000:0.0:1746155575.339761:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.339976:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123982592 00000100:00100000:3.0:1746155575.339982:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123982592 00000100:00100000:3.0:1746155575.340011:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12552 00000100:00100000:3.0:1746155575.340017:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29435:x1830976123982592:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155575.340029:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.340039:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11bcc expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.340057:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5ece5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b8d expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.340064:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ece8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb0 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.340073:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.340074:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.340076:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->1175551] (req 1048576->1175551) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.340095:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ece8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb0 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.340104:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ece8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb0 expref: 19 pid: 8436 timeout: 804 lvb_type: 1 00000100:00100000:3.0:1746155575.340113:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124662400:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155575.340804:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5ece5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b8d expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.340811:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5ece5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b8d expref: 10 pid: 1625 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.340819:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124662528:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155575.340838:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.346770:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.346841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.347027:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124662400:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155575.347037:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124662528:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155575.347061:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->1175551] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.347082:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd10800, rc 0) 00000100:00100000:3.0:1746155575.347120:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29435:x1830976123982592:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7104us (7363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.347127:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12552 00000100:00100000:1.0:1746155575.347261:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123982720 00000100:00100000:1.0:1746155575.347267:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123982720 00010000:00010000:1.0:1746155575.347290:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ece8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb0 expref: 20 pid: 8436 timeout: 804 lvb_type: 1 00000100:00100000:1.0:1746155575.347315:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123982848 00000100:00100000:1.0:1746155575.347317:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123982848 00010000:00010000:1.0:1746155575.347326:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5ece5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b8d expref: 10 pid: 1625 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746155575.347340:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6368 00000100:00100000:1.0:1746155575.347346:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976123982720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155575.347357:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155575.347376:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ece8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb0 expref: 20 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746155575.347385:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ece8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb0 expref: 20 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746155575.347402:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ece8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb0 expref: 20 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746155575.347415:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155575.347435:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123982720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 89us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.347440:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6368 00000100:00100000:1.0:1746155575.347450:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6369 00000100:00100000:1.0:1746155575.347459:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123982848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155575.347467:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155575.347473:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5ece5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b8d expref: 10 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.347481:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5ece5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b8d expref: 10 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.347490:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090013000/0x844e5faceb5ece5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b8d expref: 10 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.347498:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.347500:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.347533:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.347541:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.347563:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.347573:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124662656:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155575.347743:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.347774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.348309:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155575.348322:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123983104 00000100:00100000:1.0:1746155575.348325:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123983104 00000100:00100000:2.0:1746155575.348361:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123983360 00000100:00100000:2.0:1746155575.348364:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123983360 00002000:00100000:1.0:1746155575.348486:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880094f0b480 x1830976123983104/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.348495:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0b480 with x1830976123983104 ext(1048576->2097151) 00002000:00010000:1.0:1746155575.348499:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f0b480 00000100:00100000:1.0:1746155575.348541:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4911 00000100:00100000:1.0:1746155575.348547:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123983104:12345-192.168.202.51@tcp:3:multiop.0 00002000:00100000:2.0:1746155575.349050:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880094f0a300 x1830976123983360/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.349063:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0a300 with x1830976123983360 ext(4194304->4956159) 00002000:00010000:2.0:1746155575.349066:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f0a300 00000100:00100000:2.0:1746155575.349078:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4912 00000100:00100000:2.0:1746155575.349084:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976123983360:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155575.350973:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124662656:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155575.350989:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155575.351027:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976123982848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3572us (4185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.351035:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6369 00000100:00100000:1.0:1746155575.351893:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.352526:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123983616 00000100:00100000:0.0:1746155575.352532:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123983616 00002000:00100000:0.0:1746155575.352559:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1171456->1175551) req@ffff8800948e7800 x1830976123983616/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.352568:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e7800 with x1830976123983616 ext(1171456->1175551) 00002000:00010000:0.0:1746155575.352572:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e7800 00000100:00100000:0.0:1746155575.352598:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4913 00000100:00100000:0.0:1746155575.352603:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123983616:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155575.352704:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123983616:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 100us (812us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155575.352710:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4913 00002000:00100000:0.0:1746155575.352714:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1171456->1175551) req@ffff8800948e7800 x1830976123983616/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/4536 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.352720:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e7800 with x1830976123983616 ext(1171456->1175551) 00002000:00010000:0.0:1746155575.352723:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e7800 00000100:00100000:1.0:1746155575.362404:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123983104:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13845us (14649us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155575.362416:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4911 00002000:00100000:1.0:1746155575.362428:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880094f0b480 x1830976123983104/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.362437:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0b480 with x1830976123983104 ext(1048576->2097151) 00002000:00010000:1.0:1746155575.362442:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f0b480 00000100:00100000:3.0:1746155575.363094:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976123983360:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14009us (15318us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155575.363101:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4912 00002000:00100000:3.0:1746155575.363106:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff880094f0a300 x1830976123983360/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.363112:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0a300 with x1830976123983360 ext(4194304->4956159) 00002000:00010000:3.0:1746155575.363116:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094f0a300 00000100:00100000:0.0:1746155575.370875:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.372194:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.374080:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123983744 00000100:00100000:3.0:1746155575.374091:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123983744 00000100:00100000:0.0:1746155575.374574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.375476:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123983872 00000100:00100000:1.0:1746155575.375482:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123983872 00000100:00100000:1.0:1746155575.375538:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123984000 00000100:00100000:1.0:1746155575.375541:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123984000 00000100:00100000:1.0:1746155575.375557:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12553 00000100:00100000:1.0:1746155575.375564:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976123983744:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155575.375581:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.375594:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012de0ba00/0x844e5faceb5eceb1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11bd3 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.375646:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124662784:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155575.375703:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155575.375719:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12554 00000100:00100000:1.0:1746155575.375725:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123983872:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155575.375731:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.375740:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55f7800/0x844e5faceb5eceb8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11bda expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.375759:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124662912:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155575.375776:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.375821:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12555 00000100:00100000:0.0:1746155575.375827:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+6:29433:x1830976123984000:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155575.375833:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.375839:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136863200/0x844e5faceb5ecebf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11be1 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.375850:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.375852:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.375857:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136863200/0x844e5faceb5ecebf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11be1 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.375873:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136863200/0x844e5faceb5ecebf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11be1 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.375880:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136863200, rc 0) 00000100:00100000:0.0:1746155575.375899:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+7:29433:x1830976123984000:12345-192.168.202.51@tcp:101:cat.0 Request processed in 72us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155575.375904:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12555 00002000:00010000:1.0:1746155575.378637:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155574 -> 1746155575 00002000:00010000:1.0:1746155575.378644:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155573 -> 1746155575 00002000:00010000:1.0:1746155575.378646:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155574 -> 1746155575 00000100:00100000:1.0:1746155575.378664:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124662912:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155575.378688:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55f7800/0x844e5faceb5eceb8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bda expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.378699:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55f7800/0x844e5faceb5eceb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bda expref: 20 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.378711:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55f7800, rc 0) 00000100:00100000:1.0:1746155575.378744:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123983872:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3018us (6553us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155575.378751:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12554 00000100:00100000:2.0:1746155575.378836:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124662784:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155575.378852:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012de0ba00/0x844e5faceb5eceb1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bd3 expref: 15 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155575.378860:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012de0ba00/0x844e5faceb5eceb1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bd3 expref: 15 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155575.378879:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012de0ba00, rc 0) 00000100:00100000:2.0:1746155575.378895:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976123983744:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3332us (8027us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155575.378900:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12553 00000100:00100000:0.0:1746155575.385898:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.387028:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.387388:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.387447:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123984384 00000100:00100000:1.0:1746155575.387454:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123984384 00000100:00100000:1.0:1746155575.387485:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123984512 00000100:00100000:1.0:1746155575.387487:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123984512 00000100:00100000:3.0:1746155575.387498:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123984256 00000100:00100000:3.0:1746155575.387541:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123984256 00000100:00100000:1.0:1746155575.387545:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12556 00000100:00100000:1.0:1746155575.387552:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123984384:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155575.387561:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12557 00010000:00010000:1.0:1746155575.387568:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155575.387571:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123984512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155575.387581:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.387581:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5ecec6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11be8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.387592:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd10600/0x844e5faceb5ececd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11bef expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.387621:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124663040:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155575.387625:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124663168:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155575.387698:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00002000:00100000:3.0:1746155575.387702:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800935be680 x1830976123984256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.387715:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935be680 with x1830976123984256 ext(1048576->2097151) 00002000:00010000:3.0:1746155575.387719:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935be680 00000100:00100000:3.0:1746155575.387755:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.387774:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4914 00000100:00100000:3.0:1746155575.387782:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+7:1960:x1830976123984256:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155575.393593:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124663168:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155575.393593:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124663040:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155575.393621:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd10600/0x844e5faceb5ececd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bef expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.393621:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5ecec6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11be8 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.393632:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10600/0x844e5faceb5ececd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bef expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.393632:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5ecec6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11be8 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.393645:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55f7600, rc 0) 00010000:00010000:3.0:1746155575.393655:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd10600, rc 0) 00000100:00100000:3.0:1746155575.393690:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976123984512:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6122us (6304us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155575.393697:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12557 00000100:00100000:1.0:1746155575.393790:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123984384:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6238us (6766us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155575.393795:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12556 00000100:00100000:3.0:1746155575.400360:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+7:1960:x1830976123984256:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12571us (14460us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155575.400370:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4914 00002000:00100000:3.0:1746155575.400380:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800935be680 x1830976123984256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.400389:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935be680 with x1830976123984256 ext(1048576->2097151) 00002000:00010000:3.0:1746155575.400393:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935be680 00000100:00100000:0.0:1746155575.412063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.412131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.412196:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123984640 00000100:00100000:3.0:1746155575.412205:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123984640 00000100:00100000:3.0:1746155575.412250:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12558 00000100:00100000:3.0:1746155575.412258:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+7:1961:x1830976123984640:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155575.412261:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123984768 00000100:00100000:1.0:1746155575.412266:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123984768 00010000:00010000:3.0:1746155575.412274:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.412288:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11bf6 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.412295:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12559 00000100:00100000:1.0:1746155575.412301:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123984768:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155575.412307:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.412309:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.412310:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.412315:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 8 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.412321:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a55f6200/0x844e5faceb5ecedb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11bfd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.412327:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 8 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.412334:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.412336:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd10e00, rc 0) 00010000:00010000:1.0:1746155575.412336:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.412341:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55f6200/0x844e5faceb5ecedb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bfd expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.412352:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a55f6200/0x844e5faceb5ecedb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bfd expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.412359:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55f6200, rc 0) 00000100:00100000:3.0:1746155575.412426:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123984640:12345-192.168.202.51@tcp:101:cat.0 Request processed in 167us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.412432:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12558 00000100:00100000:1.0:1746155575.412612:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123984768:12345-192.168.202.51@tcp:101:cat.0 Request processed in 309us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.412618:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12559 00000100:00100000:0.0:1746155575.421119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.421154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.421178:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.421249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.421270:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123985280 00000100:00100000:0.0:1746155575.421277:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123985280 00002000:00100000:0.0:1746155575.421309:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009366d500 x1830976123985280/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.421319:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d500 with x1830976123985280 ext(3145728->4194303) 00002000:00010000:0.0:1746155575.421323:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366d500 00000100:00100000:0.0:1746155575.421336:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123985152 00000100:00100000:0.0:1746155575.421338:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123985152 00002000:00100000:0.0:1746155575.421347:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009366fb80 x1830976123985152/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.421353:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366fb80 with x1830976123985152 ext(2097152->3145727) 00002000:00010000:0.0:1746155575.421355:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366fb80 00000100:00100000:0.0:1746155575.421362:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123985536 00000100:00100000:0.0:1746155575.421364:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123985536 00002000:00100000:0.0:1746155575.421374:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009451c000 x1830976123985536/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.421379:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451c000 with x1830976123985536 ext(2097152->3145727) 00002000:00010000:0.0:1746155575.421382:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451c000 00000100:00100000:0.0:1746155575.421388:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123985664 00000100:00100000:0.0:1746155575.421390:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123985664 00002000:00100000:0.0:1746155575.421397:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009451df80 x1830976123985664/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.421403:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451df80 with x1830976123985664 ext(3145728->4194303) 00002000:00010000:0.0:1746155575.421405:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451df80 00000100:00100000:0.0:1746155575.421414:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4915 00000100:00100000:0.0:1746155575.421420:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123985280:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155575.421466:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4916 00000100:00100000:3.0:1746155575.421473:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123985152:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155575.421578:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4917 00000100:00100000:2.0:1746155575.421586:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976123985536:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155575.421631:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4918 00000100:00100000:0.0:1746155575.421637:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976123985664:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155575.429398:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.429618:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123985920 00000100:00100000:0.0:1746155575.429626:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123985920 00000100:00100000:0.0:1746155575.429661:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12560 00000100:00100000:0.0:1746155575.429668:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:29438:x1830976123985920:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155575.429682:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155575.429696:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c04 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.429721:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b7f expref: 15 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.429729:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.429735:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.429737:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155575.429740:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4173824->4194303] (req 4173824->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.429911:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.429923:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 11 pid: 18270 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746155575.429933:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124663296:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155575.430002:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b7f expref: 15 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155575.430010:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b7f expref: 15 pid: 20200 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746155575.430018:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124663424:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155575.430037:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.431629:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123985280:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10206us (10514us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155575.431638:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4915 00002000:00100000:3.0:1746155575.431646:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009366d500 x1830976123985280/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.431659:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d500 with x1830976123985280 ext(3145728->4194303) 00002000:00010000:3.0:1746155575.431664:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366d500 00000100:00100000:2.0:1746155575.434377:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124663296:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155575.434389:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124663424:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155575.434411:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4173824->4194303] (req 4173824->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.434431:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca1da00, rc 0) 00000100:00100000:2.0:1746155575.434477:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:29438:x1830976123985920:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4808us (5084us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.434484:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12560 00000100:00100000:3.0:1746155575.440075:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123985152:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18594us (18912us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155575.440085:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4916 00002000:00100000:3.0:1746155575.440095:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009366fb80 x1830976123985152/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.440103:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366fb80 with x1830976123985152 ext(2097152->3145727) 00002000:00010000:3.0:1746155575.440108:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366fb80 00000100:00100000:0.0:1746155575.440196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.440349:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123986048 00000100:00100000:1.0:1746155575.440356:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123986048 00010000:00010000:1.0:1746155575.440378:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b7f expref: 15 pid: 20200 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746155575.440409:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6370 00000100:00100000:1.0:1746155575.440667:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976123986048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155575.440678:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155575.440695:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b7f expref: 15 pid: 20200 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.440704:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b7f expref: 15 pid: 20200 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.440720:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0a00/0x844e5faceb5ece41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b7f expref: 15 pid: 20200 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.440737:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155575.440763:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976123986048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 97us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.440768:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6370 00000100:00100000:2.0:1746155575.441332:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123985664:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19693us (20081us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155575.441339:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4918 00002000:00100000:2.0:1746155575.441345:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009451df80 x1830976123985664/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.441352:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451df80 with x1830976123985664 ext(3145728->4194303) 00010000:00010000:2.0:1746155575.441358:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 10 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:2.0:1746155575.441368:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 10 pid: 18270 timeout: 804 lvb_type: 1 00002000:00010000:2.0:1746155575.441374:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451df80 00000100:00100000:3.0:1746155575.442254:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1960:x1830976123985536:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20667us (21073us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155575.442260:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4917 00002000:00100000:3.0:1746155575.442265:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009451c000 x1830976123985536/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.442272:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451c000 with x1830976123985536 ext(2097152->3145727) 00010000:00010000:3.0:1746155575.442277:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 8 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746155575.442286:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 8 pid: 18270 timeout: 804 lvb_type: 1 00002000:00010000:3.0:1746155575.442291:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451c000 00000100:00100000:0.0:1746155575.447292:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.447413:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123986176 00000100:00100000:2.0:1746155575.447421:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123986176 00000100:00100000:2.0:1746155575.447454:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12561 00000100:00100000:2.0:1746155575.447466:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29433:x1830976123986176:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155575.447481:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.447496:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c0b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.447547:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.447553:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4173824->4194303] (req 4173824->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.447558:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155575.447561:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c0b expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.447586:0:8436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [4173824->4194303] (req 4173824->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.447596:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c0b expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.447605:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc9c00, rc 0) 00000100:00100000:2.0:1746155575.447745:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29433:x1830976123986176:12345-192.168.202.51@tcp:101:cat.0 Request processed in 280us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.447751:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12561 00000100:00100000:0.0:1746155575.449904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.449998:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123986304 00000100:00100000:1.0:1746155575.450004:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123986304 00010000:00010000:1.0:1746155575.450025:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 9 pid: 18270 timeout: 804 lvb_type: 1 00000100:00100000:3.0:1746155575.451142:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6371 00000100:00100000:3.0:1746155575.451150:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1962:x1830976123986304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.451166:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155575.451185:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 9 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746155575.451195:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 9 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746155575.451214:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd10e00/0x844e5faceb5eced4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bf6 expref: 9 pid: 18270 timeout: 804 lvb_type: 1 00010000:00010000:3.0:1746155575.451242:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.451244:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.451249:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.451256:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.451281:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.451290:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 13 pid: 8436 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.451301:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124663680:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155575.451356:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.452720:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124663680:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155575.452732:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155575.453063:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1962:x1830976123986304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1913us (3162us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.453071:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6371 00000100:00100000:0.0:1746155575.453288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.453370:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123986560 00000100:00100000:3.0:1746155575.453374:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123986560 00002000:00100000:3.0:1746155575.453396:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4173824->4177919) req@ffff88009451d500 x1830976123986560/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.453405:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d500 with x1830976123986560 ext(4173824->4177919) 00010000:00010000:3.0:1746155575.453410:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 14 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.453420:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 14 pid: 8436 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.453426:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451d500 00000100:00100000:3.0:1746155575.453694:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 799 00000100:00100000:3.0:1746155575.453700:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123986560:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155575.453923:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123986560:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 222us (635us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155575.453929:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 799 00002000:00100000:3.0:1746155575.453933:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4173824->4177919) req@ffff88009451d500 x1830976123986560/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/4536 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.453939:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d500 with x1830976123986560 ext(4173824->4177919) 00010000:00010000:3.0:1746155575.453943:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 14 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.453952:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 14 pid: 8436 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.453957:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451d500 00000100:00100000:0.0:1746155575.456163:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.456373:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123986816 00000100:00100000:2.0:1746155575.456379:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123986816 00000100:00100000:2.0:1746155575.456415:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12562 00000100:00100000:2.0:1746155575.456421:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:29438:x1830976123986816:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155575.456433:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.456446:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c12 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155575.456470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.456544:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123986944 00000100:00100000:3.0:1746155575.456548:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123986944 00002000:00100000:3.0:1746155575.456566:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4173824->4194303) req@ffff88009451f480 x1830976123986944/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746155575.456568:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5ece64 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b94 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746155575.456574:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451f480 with x1830976123986944 ext(4173824->4194303) 00010000:00010000:2.0:1746155575.456575:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a55f6200/0x844e5faceb5ecedb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bfd expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.456579:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 14 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.456581:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.456582:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.456585:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->3887103] (req 3145728->3887103) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.456589:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 14 pid: 8436 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.456595:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451f480 00010000:00010000:2.0:1746155575.456607:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a55f6200/0x844e5faceb5ecedb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bfd expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155575.456610:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 800 00000100:00100000:3.0:1746155575.456615:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976123986944:12345-192.168.202.51@tcp:4:multiop.0 00010000:00010000:2.0:1746155575.456617:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a55f6200/0x844e5faceb5ecedb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bfd expref: 9 pid: 8436 timeout: 804 lvb_type: 1 00000100:00100000:2.0:1746155575.456627:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124663808:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155575.456682:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5ece64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b94 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.456690:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5ece64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b94 expref: 20 pid: 8436 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.456697:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124663936:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155575.456713:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.459444:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123986944:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 2822us (2967us total) trans 21474840661 rc 0/0 00000100:00100000:3.0:1746155575.459453:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 800 00002000:00100000:3.0:1746155575.459462:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4173824->4194303) req@ffff88009451f480 x1830976123986944/t21474840661(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/448 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.459470:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451f480 with x1830976123986944 ext(4173824->4194303) 00010000:00010000:3.0:1746155575.459477:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 16 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.459488:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 16 pid: 8436 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.459494:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451f480 00000100:00100000:2.0:1746155575.459851:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124663808:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155575.459859:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124663936:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155575.459876:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->3887103] (req 3145728->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.459887:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc9400, rc 0) 00000100:00100000:2.0:1746155575.459904:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29438:x1830976123986816:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3483us (3747us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.459909:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12562 00000100:00100000:0.0:1746155575.461890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.461923:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.461984:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123987072 00000100:00100000:1.0:1746155575.461991:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123987072 00010000:00010000:1.0:1746155575.462012:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5ece64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b94 expref: 20 pid: 8436 timeout: 804 lvb_type: 0 00000100:00100000:1.0:1746155575.462037:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123987200 00000100:00100000:1.0:1746155575.462046:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123987200 00010000:00010000:1.0:1746155575.462054:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a55f6200/0x844e5faceb5ecedb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bfd expref: 10 pid: 8436 timeout: 804 lvb_type: 1 00000100:00100000:1.0:1746155575.462067:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6372 00000100:00100000:1.0:1746155575.462074:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976123987072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155575.462084:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155575.462098:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5ece64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b94 expref: 20 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.462107:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5ece64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b94 expref: 20 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.462124:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3b400/0x844e5faceb5ece64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b94 expref: 20 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:1.0:1746155575.462137:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155575.462158:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976123987072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.462164:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6372 00000100:00100000:1.0:1746155575.462195:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6373 00000100:00100000:1.0:1746155575.462199:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123987200:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155575.462204:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155575.462209:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a55f6200/0x844e5faceb5ecedb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bfd expref: 10 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746155575.462216:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a55f6200/0x844e5faceb5ecedb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bfd expref: 10 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746155575.462224:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a55f6200/0x844e5faceb5ecedb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bfd expref: 10 pid: 8436 timeout: 804 lvb_type: 1 00010000:00010000:1.0:1746155575.462236:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.462237:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.462242:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.462248:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.462269:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.462278:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124664064:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155575.462316:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.464980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.465050:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123987328 00000100:00100000:3.0:1746155575.465056:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123987328 00010000:00010000:3.0:1746155575.465079:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 16 pid: 8436 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.465111:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6374 00000100:00100000:3.0:1746155575.465117:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123987328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.465127:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155575.465141:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 16 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.465151:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 16 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.465167:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca1da00/0x844e5faceb5ecee2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c04 expref: 16 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.465182:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.465183:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.465188:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c0b expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.465200:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c0b expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.465221:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c0b expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.465230:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124664192:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155575.466586:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155575.467190:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124664064:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155575.467206:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155575.467231:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1961:x1830976123987200:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5030us (5306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155575.467239:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6373 00000100:00100000:0.0:1746155575.477106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.477193:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123987584 00000100:00100000:3.0:1746155575.477201:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123987584 00002000:00100000:3.0:1746155575.477238:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3883008->3887103) req@ffff88009451d180 x1830976123987584/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.477247:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d180 with x1830976123987584 ext(3883008->3887103) 00002000:00010000:3.0:1746155575.477251:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451d180 00000100:00100000:3.0:1746155575.477267:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4919 00000100:00100000:3.0:1746155575.477273:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123987584:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155575.479314:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976123987584:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 2032us (2205us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155575.479324:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4919 00002000:00100000:3.0:1746155575.479333:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3883008->3887103) req@ffff88009451d180 x1830976123987584/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/4536 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.479340:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d180 with x1830976123987584 ext(3883008->3887103) 00002000:00010000:3.0:1746155575.479345:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451d180 00000100:00100000:3.0:1746155575.480863:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124664192:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155575.480880:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155575.480924:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976123987328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 15806us (15949us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.480933:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6374 00000100:00100000:0.0:1746155575.482323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.482387:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123987840 00000100:00100000:3.0:1746155575.482392:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123987840 00002000:00100000:3.0:1746155575.482419:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009451d880 x1830976123987840/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.482426:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d880 with x1830976123987840 ext(3145728->4194303) 00002000:00010000:3.0:1746155575.482429:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451d880 00000100:00100000:3.0:1746155575.482442:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4920 00000100:00100000:3.0:1746155575.482447:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123987840:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155575.494594:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976123987840:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12131us (12258us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155575.494607:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4920 00002000:00100000:3.0:1746155575.494620:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88009451d880 x1830976123987840/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.494629:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451d880 with x1830976123987840 ext(3145728->4194303) 00002000:00010000:3.0:1746155575.494635:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451d880 00000100:00100000:0.0:1746155575.499136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.500791:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123987968 00000100:00100000:2.0:1746155575.500798:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123987968 00000100:00100000:2.0:1746155575.500839:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12563 00000100:00100000:2.0:1746155575.500846:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29433:x1830976123987968:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155575.500862:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.500876:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c19 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.500898:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.500905:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155575.500907:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155575.500909:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c19 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.500938:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.500952:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 18 pid: 8436 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.500962:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124664320:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155575.501031:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155575.502883:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124664320:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155575.502901:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c19 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.502912:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc8600, rc 0) 00000100:00100000:2.0:1746155575.502948:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29433:x1830976123987968:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2101us (3817us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.502955:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12563 00000100:00100000:0.0:1746155575.503406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.503552:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123988096 00000100:00100000:3.0:1746155575.503557:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123988096 00002000:00100000:3.0:1746155575.503582:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->3887103) req@ffff88009451dc00 x1830976123988096/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.503589:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451dc00 with x1830976123988096 ext(3145728->3887103) 00010000:00010000:3.0:1746155575.503595:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 19 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.503603:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 19 pid: 8436 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.503608:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009451dc00 00000100:00100000:3.0:1746155575.503626:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 801 00000100:00100000:3.0:1746155575.503631:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123988096:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155575.517215:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123988096:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 13574us (13800us total) trans 17179873268 rc 0/0 00000100:00100000:3.0:1746155575.517228:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 801 00002000:00100000:3.0:1746155575.517238:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->3887103) req@ffff88009451dc00 x1830976123988096/t17179873268(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/448 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.517247:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451dc00 with x1830976123988096 ext(3145728->3887103) 00010000:00010000:3.0:1746155575.517255:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 21 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.517268:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 21 pid: 8436 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.517274:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009451dc00 00000100:00100000:0.0:1746155575.521457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.521625:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123988224 00000100:00100000:3.0:1746155575.521634:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123988224 00010000:00010000:3.0:1746155575.521671:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 21 pid: 8436 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.521730:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6375 00000100:00100000:3.0:1746155575.521741:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123988224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.521757:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155575.521780:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 21 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.521792:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 21 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.521814:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc9400/0x844e5faceb5ecef0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c12 expref: 21 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.521833:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.521836:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.521843:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c19 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.521851:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c19 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.521884:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c19 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.521897:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124664448:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155575.521993:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.527012:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124664448:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155575.527030:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155575.527086:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976123988224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5348us (5638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.527095:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6375 00000100:00100000:0.0:1746155575.530136:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.530290:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123988480 00000100:00100000:2.0:1746155575.530297:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123988480 00002000:00100000:2.0:1746155575.530329:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009451e300 x1830976123988480/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.530337:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451e300 with x1830976123988480 ext(3145728->4194303) 00002000:00010000:2.0:1746155575.530341:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451e300 00000100:00100000:2.0:1746155575.530356:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4921 00000100:00100000:2.0:1746155575.530362:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123988480:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155575.536107:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.536140:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.536165:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.536386:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.536462:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123988608 00000100:00100000:3.0:1746155575.536469:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123988608 00000100:00100000:3.0:1746155575.536536:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123988736 00000100:00100000:3.0:1746155575.536539:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123988736 00000100:00100000:3.0:1746155575.536551:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123988864 00000100:00100000:3.0:1746155575.536553:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123988864 00000100:00100000:3.0:1746155575.536561:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123988992 00000100:00100000:3.0:1746155575.536563:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123988992 00000100:00100000:3.0:1746155575.536575:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12564 00000100:00100000:3.0:1746155575.536580:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123988608:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155575.536595:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.536610:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094218e00/0x844e5faceb5ecefe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c20 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.536650:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124664576:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155575.536711:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.536727:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12565 00000100:00100000:3.0:1746155575.536732:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123988736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155575.536739:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.536747:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129c85800/0x844e5faceb5ecf05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c27 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.536770:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124664704:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155575.536790:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.536810:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12566 00000100:00100000:3.0:1746155575.536815:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123988864:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155575.536820:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.536827:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135363800/0x844e5faceb5ecf0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c2e expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.536837:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.536839:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.536846:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135363800/0x844e5faceb5ecf0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c2e expref: 18 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.536858:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135363800/0x844e5faceb5ecf0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c2e expref: 18 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.536866:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135363800, rc 0) 00000100:00100000:3.0:1746155575.536884:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123988864:12345-192.168.202.51@tcp:101:cat.0 Request processed in 69us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.536889:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12566 00000100:00100000:3.0:1746155575.536904:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12567 00000100:00100000:3.0:1746155575.536908:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123988992:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155575.536913:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.536919:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094219a00/0x844e5faceb5ecf13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c35 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.536928:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.536930:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.536933:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094219a00/0x844e5faceb5ecf13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c35 expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.536941:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094219a00/0x844e5faceb5ecf13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c35 expref: 23 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.536947:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094219a00, rc 0) 00000100:00100000:3.0:1746155575.536960:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123988992:12345-192.168.202.51@tcp:101:cat.0 Request processed in 52us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.536965:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12567 00000100:00100000:0.0:1746155575.538739:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123988480:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8371us (8603us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155575.538748:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4921 00002000:00100000:0.0:1746155575.538756:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009451e300 x1830976123988480/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.538764:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451e300 with x1830976123988480 ext(3145728->4194303) 00002000:00010000:0.0:1746155575.538769:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009451e300 00002000:00010000:3.0:1746155575.540122:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime: 1746155575 -> 1746155576 00000100:00100000:3.0:1746155575.540145:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124664704:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155575.540169:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129c85800/0x844e5faceb5ecf05 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c27 expref: 22 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.540181:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129c85800/0x844e5faceb5ecf05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c27 expref: 22 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.540203:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c85800, rc 0) 00000100:00100000:3.0:1746155575.540227:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123988736:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3494us (4086us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155575.540232:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12565 00002000:00010000:3.0:1746155575.540259:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime: 1746155575 -> 1746155576 00000100:00100000:3.0:1746155575.540270:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124664576:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155575.540285:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094218e00/0x844e5faceb5ecefe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c20 expref: 17 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.540295:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094218e00/0x844e5faceb5ecefe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c20 expref: 17 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.540302:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094218e00, rc 0) 00000100:00100000:3.0:1746155575.540318:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123988608:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3739us (4218us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155575.540324:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12564 00000100:00100000:0.0:1746155575.545967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.546063:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123989248 00000100:00100000:2.0:1746155575.546071:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123989248 00002000:00100000:2.0:1746155575.546108:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009451ce00 x1830976123989248/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.546118:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451ce00 with x1830976123989248 ext(4194304->4956159) 00002000:00010000:2.0:1746155575.546123:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451ce00 00000100:00100000:2.0:1746155575.546155:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4922 00000100:00100000:2.0:1746155575.546162:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1960:x1830976123989248:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155575.552141:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.552445:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123989376 00000100:00100000:2.0:1746155575.552451:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123989376 00000100:00100000:2.0:1746155575.552483:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12568 00000100:00100000:2.0:1746155575.552489:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:29447:x1830976123989376:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155575.552529:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.552543:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c3c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.552566:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 9 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.552573:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155575.552574:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155575.552577:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.552598:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 9 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.552611:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 9 pid: 4461 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.552620:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124664832:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155575.556682:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1960:x1830976123989248:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10510us (10712us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155575.556693:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4922 00002000:00100000:3.0:1746155575.556703:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009451ce00 x1830976123989248/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.556711:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451ce00 with x1830976123989248 ext(4194304->4956159) 00002000:00010000:3.0:1746155575.556716:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009451ce00 00000100:00100000:2.0:1746155575.557806:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.559655:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124664832:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155575.559685:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.559701:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ee1200, rc 0) 00000100:00100000:3.0:1746155575.559764:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:29447:x1830976123989376:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7272us (7629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.559772:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12568 00000100:00100000:0.0:1746155575.563119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.563369:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.563429:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123989632 00000100:00100000:2.0:1746155575.563439:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123989632 00000100:00100000:2.0:1746155575.563477:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12569 00000100:00100000:2.0:1746155575.563484:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1960:x1830976123989632:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155575.563533:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.563552:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5318e00/0x844e5faceb5ecf21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c43 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155575.563597:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124664960:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155575.563675:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.564859:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123989504 00000100:00100000:3.0:1746155575.564865:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123989504 00002000:00100000:3.0:1746155575.564894:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (647168->1048575) req@ffff88009451f100 x1830976123989504/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.564902:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451f100 with x1830976123989504 ext(647168->1048575) 00010000:00010000:3.0:1746155575.564909:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 10 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.564919:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 10 pid: 4461 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.564926:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451f100 00000100:00100000:3.0:1746155575.564948:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 802 00000100:00100000:3.0:1746155575.564955:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009451f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123989504:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155575.566774:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124664960:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155575.566800:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5318e00/0x844e5faceb5ecf21 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c43 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155575.566809:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5318e00/0x844e5faceb5ecf21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c43 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155575.566837:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5318e00, rc 0) 00000100:00100000:2.0:1746155575.566875:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123989632:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3391us (3505us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155575.566882:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12569 00000100:00100000:0.0:1746155575.570441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.570492:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123989760 00000100:00100000:2.0:1746155575.570498:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123989760 00000100:00100000:2.0:1746155575.570553:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12570 00000100:00100000:2.0:1746155575.570561:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123989760:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155575.570575:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.570587:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a236200/0x844e5faceb5ecf28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c4a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155575.570626:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124665088:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155575.570688:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.573888:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009451f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123989504:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8928us (10771us total) trans 21474840662 rc 0/0 00000100:00100000:3.0:1746155575.573899:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 802 00002000:00100000:3.0:1746155575.573907:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (647168->1048575) req@ffff88009451f100 x1830976123989504/t21474840662(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/448 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.573915:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009451f100 with x1830976123989504 ext(647168->1048575) 00010000:00010000:3.0:1746155575.573923:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 12 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.573935:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 12 pid: 4461 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.573941:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009451f100 00000100:00100000:0.0:1746155575.574663:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.575347:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123989888 00000100:00100000:2.0:1746155575.575355:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123989888 00000100:00100000:2.0:1746155575.575392:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12571 00000100:00100000:2.0:1746155575.575399:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29443:x1830976123989888:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:3.0:1746155575.575404:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124665088:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155575.575411:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.575423:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c51 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.575426:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a236200/0x844e5faceb5ecf28 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c4a expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.575437:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a236200/0x844e5faceb5ecf28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c4a expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155575.575442:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155575.575447:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.575449:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a236200, rc 0) 00010000:00010000:2.0:1746155575.575452:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746155575.575456:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [946176->1048575] (req 946176->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 12 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.575471:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123989760:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4912us (5034us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155575.575477:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12570 00010000:00010000:2.0:1746155575.575484:0:18270:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.575493:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [946176->1048575] (req 946176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 11 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.575500:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a236400, rc 0) 00000100:00100000:2.0:1746155575.575545:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29443:x1830976123989888:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 146us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.575550:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12571 00000100:00100000:0.0:1746155575.580207:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.582449:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123990016 00000100:00100000:3.0:1746155575.582458:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123990016 00010000:00010000:3.0:1746155575.582491:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 11 pid: 4461 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.582568:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6376 00000100:00100000:3.0:1746155575.582576:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1960:x1830976123990016:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.582587:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155575.582610:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 11 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.582620:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 11 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.582638:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0400/0x844e5faceb5ece6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b9b expref: 11 pid: 4461 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.582666:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.582668:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.582674:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.582681:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.582708:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.582718:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 16 pid: 8436 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.582727:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124665344:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155575.582803:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.592009:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124665344:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155575.592028:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155575.592068:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123990016:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9491us (12342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.592077:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6376 00000100:00100000:1.0:1746155575.592760:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.592879:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123990272 00000100:00100000:3.0:1746155575.592884:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123990272 00002000:00100000:3.0:1746155575.592913:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800948e6d80 x1830976123990272/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.592926:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e6d80 with x1830976123990272 ext(0->1048575) 00010000:00010000:3.0:1746155575.592934:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 17 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.592945:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 17 pid: 8436 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.592951:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800948e6d80 00000100:00100000:3.0:1746155575.592976:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 803 00000100:00100000:3.0:1746155575.592982:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976123990272:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155575.606542:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976123990272:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13549us (13772us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155575.606553:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 803 00002000:00100000:3.0:1746155575.606563:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800948e6d80 x1830976123990272/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.606572:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e6d80 with x1830976123990272 ext(0->1048575) 00010000:00010000:3.0:1746155575.606581:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 17 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.606595:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 17 pid: 8436 timeout: 804 lvb_type: 0 00002000:00010000:3.0:1746155575.606601:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800948e6d80 00000100:00100000:0.0:1746155575.614188:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.614261:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123990400 00000100:00100000:2.0:1746155575.614269:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123990400 00000100:00100000:0.0:1746155575.614272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.614309:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12572 00000100:00100000:2.0:1746155575.614317:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29447:x1830976123990400:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155575.614334:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.614351:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c58 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.614367:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123990528 00000100:00100000:3.0:1746155575.614371:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123990528 00010000:00010000:2.0:1746155575.614378:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.614385:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155575.614386:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155575.614388:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 17 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.614390:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 22 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.614418:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.614428:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 9 pid: 1625 timeout: 804 lvb_type: 0 00000100:00100000:2.0:1746155575.614439:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124665472:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155575.614542:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.617600:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6377 00000100:00100000:3.0:1746155575.617614:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976123990528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.617628:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155575.617647:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 17 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.617659:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 17 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.617676:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ee1200/0x844e5faceb5ecf1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c3c expref: 17 pid: 8436 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.617699:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.617701:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.617706:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.617713:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.617743:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.617752:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124665600:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155575.617826:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155575.619059:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124665472:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155575.619079:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 22 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.619090:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a27d000, rc 0) 00000100:00100000:2.0:1746155575.619131:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29447:x1830976123990400:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4815us (4949us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.619138:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12572 00000100:00100000:3.0:1746155575.619769:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124665600:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155575.619770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155575.619780:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155575.619818:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123990912 00000100:00100000:2.0:1746155575.619823:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123990912 00002000:00100000:2.0:1746155575.619864:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (946176->950271) req@ffff88009b882680 x1830976123990912/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.619872:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882680 with x1830976123990912 ext(946176->950271) 00002000:00010000:2.0:1746155575.619875:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b882680 00000100:00100000:2.0:1746155575.619894:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4923 00000100:00100000:2.0:1746155575.619900:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123990912:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155575.622528:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123990528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4895us (8231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.622539:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6377 00000100:00100000:2.0:1746155575.622825:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123990912:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 2922us (3053us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155575.622834:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4923 00002000:00100000:2.0:1746155575.622842:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d6:0x0] (946176->950271) req@ffff88009b882680 x1830976123990912/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/4536 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.622851:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882680 with x1830976123990912 ext(946176->950271) 00002000:00010000:2.0:1746155575.622856:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b882680 00000100:00100000:0.0:1746155575.622983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.623718:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123990656 00000100:00100000:2.0:1746155575.623725:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123990656 00002000:00100000:2.0:1746155575.623761:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1175551) req@ffff88009b882300 x1830976123990656/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.623768:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882300 with x1830976123990656 ext(1048576->1175551) 00010000:00010000:2.0:1746155575.623776:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 10 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.623791:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 10 pid: 1625 timeout: 804 lvb_type: 0 00002000:00010000:2.0:1746155575.623797:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b882300 00000100:00100000:2.0:1746155575.623843:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 804 00000100:00100000:2.0:1746155575.623858:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123990656:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155575.627397:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.627585:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123991040 00000100:00100000:3.0:1746155575.627592:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123991040 00000100:00100000:3.0:1746155575.627635:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12573 00000100:00100000:3.0:1746155575.627641:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29443:x1830976123991040:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155575.627655:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.627668:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c5f expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.627688:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155575.627693:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.627699:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746155575.627701:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->1638399] (req 1048576->1638399) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 13 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.627728:0:18270:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.627738:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->1638399] (req 1048576->1638399) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 13 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.627749:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1ce00, rc 0) 00000100:00100000:3.0:1746155575.627780:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29443:x1830976123991040:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 139us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.627785:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12573 00000100:00100000:0.0:1746155575.628164:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976123990656:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 4314us (5181us total) trans 17179873269 rc 0/0 00000100:00100000:0.0:1746155575.628171:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 804 00002000:00100000:0.0:1746155575.628178:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1175551) req@ffff88009b882300 x1830976123990656/t17179873269(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/448 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.628185:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882300 with x1830976123990656 ext(1048576->1175551) 00010000:00010000:0.0:1746155575.628190:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 13 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746155575.628200:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 13 pid: 1625 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746155575.628205:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b882300 00000100:00100000:0.0:1746155575.632233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.632320:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123991168 00000100:00100000:3.0:1746155575.632326:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123991168 00010000:00010000:3.0:1746155575.632352:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 13 pid: 1625 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.632388:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6378 00000100:00100000:3.0:1746155575.632394:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1960:x1830976123991168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.632404:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155575.632421:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 13 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.632431:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 13 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.632449:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd10800/0x844e5faceb5eceaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bcc expref: 13 pid: 1625 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.632475:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.632477:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.632483:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.632494:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.632549:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.632559:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 21 pid: 18270 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.632569:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124665856:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155575.632638:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.636482:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124665856:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155575.636554:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155575.636605:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123991168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4207us (4374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.636615:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6378 00000100:00100000:0.0:1746155575.645489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.645571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.645642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.645741:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123991552 00000100:00100000:2.0:1746155575.645749:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123991552 00002000:00100000:2.0:1746155575.645791:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009b881c00 x1830976123991552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.645806:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881c00 with x1830976123991552 ext(1048576->2097151) 00002000:00010000:2.0:1746155575.645811:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b881c00 00000100:00100000:2.0:1746155575.645826:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123991808 00000100:00100000:2.0:1746155575.645828:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123991808 00002000:00100000:2.0:1746155575.645839:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009b881500 x1830976123991808/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.645845:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881500 with x1830976123991808 ext(1048576->2097151) 00002000:00010000:2.0:1746155575.645849:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881500 00000100:00100000:2.0:1746155575.645863:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123991680 00000100:00100000:2.0:1746155575.645865:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123991680 00002000:00100000:2.0:1746155575.645876:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800948e6a00 x1830976123991680/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.645883:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e6a00 with x1830976123991680 ext(1048576->2097151) 00010000:00010000:2.0:1746155575.645890:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 23 pid: 18270 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.645903:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 23 pid: 18270 timeout: 804 lvb_type: 0 00002000:00010000:2.0:1746155575.645908:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800948e6a00 00000100:00100000:2.0:1746155575.647629:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 805 00000100:00100000:2.0:1746155575.647641:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123991680:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155575.648726:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4924 00000100:00100000:0.0:1746155575.648735:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123991552:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155575.649726:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4925 00000100:00100000:1.0:1746155575.649735:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123991808:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155575.662193:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123991552:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13452us (16705us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155575.662207:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4924 00002000:00100000:2.0:1746155575.662217:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009b881c00 x1830976123991552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.662225:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881c00 with x1830976123991552 ext(1048576->2097151) 00002000:00010000:2.0:1746155575.662231:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b881c00 00000100:00100000:1.0:1746155575.666992:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976123991808:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17247us (21409us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155575.667006:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4925 00002000:00100000:1.0:1746155575.667016:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009b881500 x1830976123991808/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.667029:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881500 with x1830976123991808 ext(1048576->2097151) 00002000:00010000:1.0:1746155575.667034:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881500 00000100:00100000:2.0:1746155575.678098:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123991680:12345-192.168.202.51@tcp:3:cat.0 Request processed in 30451us (32446us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155575.678109:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 805 00002000:00100000:2.0:1746155575.678120:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800948e6a00 x1830976123991680/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.678128:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e6a00 with x1830976123991680 ext(1048576->2097151) 00010000:00010000:2.0:1746155575.678136:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 22 pid: 18270 timeout: 804 lvb_type: 0 00010000:00010000:2.0:1746155575.678148:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 22 pid: 18270 timeout: 804 lvb_type: 0 00002000:00010000:2.0:1746155575.678154:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800948e6a00 00000100:00100000:0.0:1746155575.694837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.694902:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123992064 00000100:00100000:3.0:1746155575.694910:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123992064 00010000:00010000:3.0:1746155575.694940:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 22 pid: 18270 timeout: 804 lvb_type: 0 00000100:00100000:3.0:1746155575.694978:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6379 00000100:00100000:3.0:1746155575.694985:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123992064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.694997:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155575.695014:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 22 pid: 18270 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.695024:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 22 pid: 18270 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.695043:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a27d000/0x844e5faceb5ecf36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c58 expref: 22 pid: 18270 timeout: 804 lvb_type: 0 00010000:00010000:3.0:1746155575.695067:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.695070:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.695075:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 11 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.695083:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 11 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.695110:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 11 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.695121:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124665984:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155575.695196:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.701955:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.702013:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123992320 00000100:00100000:2.0:1746155575.702021:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123992320 00002000:00100000:2.0:1746155575.702066:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009b883800 x1830976123992320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.702075:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883800 with x1830976123992320 ext(2097152->3145727) 00002000:00010000:2.0:1746155575.702079:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b883800 00000100:00100000:2.0:1746155575.702110:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4926 00000100:00100000:2.0:1746155575.702117:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123992320:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155575.712997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.713087:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123992576 00000100:00100000:2.0:1746155575.713096:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123992576 00002000:00100000:2.0:1746155575.713132:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800948e7100 x1830976123992576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.713141:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e7100 with x1830976123992576 ext(3145728->4194303) 00002000:00010000:2.0:1746155575.713146:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e7100 00000100:00100000:2.0:1746155575.713173:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4927 00000100:00100000:2.0:1746155575.713180:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976123992576:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155575.716203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.716226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.716280:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124665984:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155575.716297:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155575.716334:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123992064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 21349us (21505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.716343:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6379 00000100:00100000:1.0:1746155575.717259:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123992832 00000100:00100000:1.0:1746155575.717265:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123992832 00002000:00100000:1.0:1746155575.717294:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009b880a80 x1830976123992832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.717302:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880a80 with x1830976123992832 ext(2097152->3145727) 00002000:00010000:1.0:1746155575.717306:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880a80 00000100:00100000:1.0:1746155575.717329:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123993088 00000100:00100000:1.0:1746155575.717332:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123993088 00002000:00100000:1.0:1746155575.717343:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009b882a00 x1830976123993088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.717349:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882a00 with x1830976123993088 ext(3145728->4194303) 00002000:00010000:1.0:1746155575.717351:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b882a00 00000100:00100000:1.0:1746155575.717362:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4928 00000100:00100000:1.0:1746155575.717367:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123992832:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155575.717460:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4929 00000100:00100000:3.0:1746155575.717466:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976123993088:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155575.722410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.722444:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976123992320:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20325us (20493us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155575.722454:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4926 00002000:00100000:2.0:1746155575.722464:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009b883800 x1830976123992320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.722473:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883800 with x1830976123992320 ext(2097152->3145727) 00002000:00010000:2.0:1746155575.722478:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b883800 00000100:00100000:2.0:1746155575.722495:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123993344 00000100:00100000:2.0:1746155575.722520:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123993344 00002000:00100000:2.0:1746155575.722544:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1634304->1638399) req@ffff88009b880700 x1830976123993344/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.722551:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880700 with x1830976123993344 ext(1634304->1638399) 00002000:00010000:2.0:1746155575.722554:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880700 00000100:00100000:2.0:1746155575.722574:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4930 00000100:00100000:2.0:1746155575.722581:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123993344:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155575.722668:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123993344:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 86us (263us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155575.722673:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4930 00002000:00100000:2.0:1746155575.722677:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1634304->1638399) req@ffff88009b880700 x1830976123993344/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/4536 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.722684:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880700 with x1830976123993344 ext(1634304->1638399) 00002000:00010000:2.0:1746155575.722686:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880700 00000100:00100000:2.0:1746155575.729387:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976123992576:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16196us (16387us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155575.729398:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4927 00002000:00100000:2.0:1746155575.729408:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800948e7100 x1830976123992576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.729418:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e7100 with x1830976123992576 ext(3145728->4194303) 00002000:00010000:2.0:1746155575.729422:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e7100 00000100:00100000:1.0:1746155575.744053:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976123992832:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26676us (27847us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155575.744065:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4928 00002000:00100000:1.0:1746155575.744077:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009b880a80 x1830976123992832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.744088:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880a80 with x1830976123992832 ext(2097152->3145727) 00002000:00010000:1.0:1746155575.744095:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880a80 00000100:00100000:3.0:1746155575.751074:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976123993088:12345-192.168.202.51@tcp:3:cat.0 Request processed in 33600us (34838us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155575.751084:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4929 00002000:00100000:3.0:1746155575.751093:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009b882a00 x1830976123993088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.751101:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882a00 with x1830976123993088 ext(3145728->4194303) 00002000:00010000:3.0:1746155575.751106:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b882a00 00000100:00100000:0.0:1746155575.763000:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.765002:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123993472 00000100:00100000:1.0:1746155575.765012:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123993472 00000100:00100000:1.0:1746155575.765061:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12574 00000100:00100000:1.0:1746155575.765067:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123993472:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155575.765082:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.765096:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ecf44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c66 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.765135:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124666112:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155575.765209:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.771881:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:1.0:1746155575.776989:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime: 1746155575 -> 1746155576 00002000:00010000:1.0:1746155575.776998:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime: 1746155575 -> 1746155576 00000100:00100000:1.0:1746155575.777024:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124666112:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155575.777055:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ecf44 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c66 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.777070:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b200/0x844e5faceb5ecf44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c66 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.777106:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3b200, rc 0) 00000100:00100000:1.0:1746155575.777163:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976123993472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 12092us (14167us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155575.777171:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12574 00000100:00100000:1.0:1746155575.777197:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123993600 00000100:00100000:1.0:1746155575.777204:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123993600 00000100:00100000:1.0:1746155575.777263:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12575 00000100:00100000:1.0:1746155575.777273:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976123993600:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155575.777287:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.777301:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ecf4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c6d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.777349:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124666240:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155575.777415:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91cc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746155575.804646:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime: 1746155575 -> 1746155576 00002000:00010000:1.0:1746155575.804652:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime: 1746155575 -> 1746155576 00000100:00100000:1.0:1746155575.804672:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124666240:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155575.804701:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ecf4b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c6d expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.804712:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3be00/0x844e5faceb5ecf4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c6d expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.809672:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe3be00, rc 0) 00000100:00100000:1.0:1746155575.809771:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976123993600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 32493us (37888us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155575.809779:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12575 00000100:00100000:1.0:1746155575.816326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.816385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.816425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.816465:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123993856 00000100:00100000:1.0:1746155575.816474:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123993856 00002000:00100000:1.0:1746155575.816546:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d6:0x0] (0->946175) req@ffff8800948e4e00 x1830976123993856/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.816555:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4e00 with x1830976123993856 ext(0->946175) 00002000:00010000:1.0:1746155575.816560:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e4e00 00000100:00100000:1.0:1746155575.816582:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123994112 00000100:00100000:1.0:1746155575.816586:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123994112 00002000:00100000:1.0:1746155575.816604:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3da:0x0] (1638400->2097151) req@ffff8800948e7b80 x1830976123994112/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.816611:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e7b80 with x1830976123994112 ext(1638400->2097151) 00002000:00010000:1.0:1746155575.816614:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e7b80 00000100:00100000:1.0:1746155575.816627:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123994368 00000100:00100000:1.0:1746155575.816630:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123994368 00002000:00100000:1.0:1746155575.816645:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800948e5880 x1830976123994368/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.816651:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5880 with x1830976123994368 ext(4194304->4956159) 00002000:00010000:1.0:1746155575.816654:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e5880 00000100:00100000:1.0:1746155575.816680:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4931 00000100:00100000:1.0:1746155575.816690:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123993856:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155575.818117:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4932 00000100:00100000:1.0:1746155575.818124:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123994112:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155575.819755:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4933 00000100:00100000:1.0:1746155575.819767:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123994368:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155575.828320:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123993856:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11621us (11991us total) trans 0 rc 946176/946176 00000100:00100000:0.0:1746155575.828332:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4931 00002000:00100000:0.0:1746155575.828344:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->946175) req@ffff8800948e4e00 x1830976123993856/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 946176/946176 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.828352:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e4e00 with x1830976123993856 ext(0->946175) 00002000:00010000:0.0:1746155575.828358:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e4e00 00000100:00100000:2.0:1746155575.834568:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123994368:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14796us (18135us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155575.834578:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4933 00002000:00100000:2.0:1746155575.834587:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff8800948e5880 x1830976123994368/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155575.834596:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123994112:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16471us (18211us total) trans 0 rc 458752/458752 00002000:00100000:2.0:1746155575.834597:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5880 with x1830976123994368 ext(4194304->4956159) 00002000:00010000:2.0:1746155575.834602:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e5880 00000100:00100000:1.0:1746155575.834603:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4932 00002000:00100000:1.0:1746155575.834608:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3da:0x0] (1638400->2097151) req@ffff8800948e7b80 x1830976123994112/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 458752/458752 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.834614:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e7b80 with x1830976123994112 ext(1638400->2097151) 00002000:00010000:1.0:1746155575.834617:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e7b80 00000100:00100000:2.0:1746155575.842765:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124666368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746155575.842823:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155575.842867:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746155575.842872:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124666496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746155575.842891:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155575.842915:0:8439:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124666368 00000100:00100000:2.0:1746155575.842921:0:8439:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124666368 00000100:00100000:2.0:1746155575.842953:0:8439:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124666496 00000100:00100000:2.0:1746155575.842955:0:8439:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124666496 00000100:00100000:2.0:1746155575.842968:0:8439:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1746155575.842973:0:8439:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830976124666368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746155575.842989:0:8439:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 488570880 pending 5111808 free 3850371072 avail 3829399552 00000100:00100000:2.0:1746155575.843022:0:8439:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830976124666368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.843028:0:8439:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1746155575.843040:0:8439:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1746155575.843044:0:8439:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830976124666496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746155575.843052:0:8439:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 492109824 pending 5111808 free 3847225344 avail 3817865216 00000100:00100000:2.0:1746155575.843071:0:8439:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830976124666496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 26us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.843076:0:8439:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:2.0:1746155575.843087:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746155575.843090:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155575.843105:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840645 gen 2 00000004:00080000:2.0:1746155575.843109:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131494a80, transno 21474840591 00000004:00080000:2.0:1746155575.843115:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ef100, transno 21474840592 00000004:00080000:2.0:1746155575.843117:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131494e00, transno 21474840593 00000004:00080000:2.0:1746155575.843119:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131494000, transno 21474840594 00000004:00080000:2.0:1746155575.843121:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131497480, transno 21474840595 00000004:00080000:2.0:1746155575.843123:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131495180, transno 21474840596 00000004:00080000:2.0:1746155575.843124:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131497b80, transno 21474840597 00000004:00080000:2.0:1746155575.843126:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131497800, transno 21474840598 00000004:00080000:2.0:1746155575.843128:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c5880, transno 21474840599 00000004:00080000:2.0:1746155575.843130:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a0700, transno 21474840603 00000004:00080000:2.0:1746155575.843132:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a3800, transno 21474840604 00000004:00080000:2.0:1746155575.843133:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a2680, transno 21474840605 00000004:00080000:2.0:1746155575.843135:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a3100, transno 21474840606 00000004:00080000:2.0:1746155575.843137:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a1c00, transno 21474840607 00000004:00080000:2.0:1746155575.843139:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a3b80, transno 21474840608 00000004:00080000:2.0:1746155575.843140:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a0e00, transno 21474840609 00000004:00080000:2.0:1746155575.843142:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a1f80, transno 21474840610 00000004:00080000:2.0:1746155575.843143:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a2d80, transno 21474840611 00000004:00080000:2.0:1746155575.843145:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6060e00, transno 21474840612 00000004:00080000:2.0:1746155575.843147:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc4a80, transno 21474840613 00000004:00080000:2.0:1746155575.843148:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6061c00, transno 21474840614 00000004:00080000:2.0:1746155575.843149:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc5f80, transno 21474840615 00000004:00080000:2.0:1746155575.843151:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6063b80, transno 21474840616 00000004:00080000:2.0:1746155575.843153:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc6a00, transno 21474840617 00000004:00080000:2.0:1746155575.843155:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800944ac700, transno 21474840618 00000004:00080000:2.0:1746155575.843156:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6062d80, transno 21474840619 00000004:00080000:2.0:1746155575.843158:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc7480, transno 21474840620 00000004:00080000:2.0:1746155575.843160:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a46a00, transno 21474840628 00000004:00080000:2.0:1746155575.843162:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a45180, transno 21474840629 00000004:00080000:2.0:1746155575.843163:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a44380, transno 21474840630 00000004:00080000:2.0:1746155575.843165:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a44700, transno 21474840631 00000004:00080000:2.0:1746155575.843167:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a44000, transno 21474840632 00000004:00080000:2.0:1746155575.843169:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a47b80, transno 21474840633 00000004:00080000:2.0:1746155575.843171:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a46d80, transno 21474840634 00000004:00080000:2.0:1746155575.843173:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a44a80, transno 21474840635 00000004:00080000:2.0:1746155575.843176:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8ca80, transno 21474840636 00000004:00080000:2.0:1746155575.843178:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b6c0700, transno 21474840637 00000004:00080000:2.0:1746155575.843180:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b6c3b80, transno 21474840638 00000004:00080000:2.0:1746155575.843182:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b6c0380, transno 21474840639 00000004:00080000:2.0:1746155575.843184:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c7480, transno 21474840640 00000004:00080000:2.0:1746155575.843185:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b6c2300, transno 21474840641 00000004:00080000:2.0:1746155575.843188:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008ff19180, transno 21474840642 00000004:00080000:2.0:1746155575.843198:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b6c1c00, transno 21474840643 00000004:00080000:2.0:1746155575.843201:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094f09180, transno 21474840644 00000004:00080000:2.0:1746155575.843203:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c5f80, transno 21474840645 00000100:00100000:2.0:1746155575.843211:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124666496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746155575.843223:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873258 gen 2 00000004:00080000:2.0:1746155575.843225:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910d9f80, transno 17179873208 00000004:00080000:2.0:1746155575.843230:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910d8700, transno 17179873209 00000004:00080000:2.0:1746155575.843233:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910d8e00, transno 17179873210 00000004:00080000:2.0:1746155575.843234:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910dbb80, transno 17179873211 00000004:00080000:2.0:1746155575.843236:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910d8a80, transno 17179873212 00000004:00080000:2.0:1746155575.843238:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910d9880, transno 17179873213 00000004:00080000:2.0:1746155575.843240:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910da680, transno 17179873214 00000004:00080000:2.0:1746155575.843242:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c212a00, transno 17179873215 00000004:00080000:2.0:1746155575.843244:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131497100, transno 17179873219 00000004:00080000:2.0:1746155575.843246:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f703b80, transno 17179873220 00000004:00080000:2.0:1746155575.843248:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a1500, transno 17179873221 00000004:00080000:2.0:1746155575.843250:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f700e00, transno 17179873222 00000004:00080000:2.0:1746155575.843252:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a1880, transno 17179873223 00000004:00080000:2.0:1746155575.843254:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f702a00, transno 17179873224 00000004:00080000:2.0:1746155575.843256:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a0380, transno 17179873225 00000004:00080000:2.0:1746155575.843257:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f701180, transno 17179873226 00000004:00080000:2.0:1746155575.843260:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca97480, transno 17179873227 00000004:00080000:2.0:1746155575.843262:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6062a00, transno 17179873228 00000004:00080000:2.0:1746155575.843264:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca94000, transno 17179873229 00000004:00080000:2.0:1746155575.843265:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6062680, transno 17179873230 00000004:00080000:2.0:1746155575.843267:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca94380, transno 17179873231 00000004:00080000:2.0:1746155575.843269:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6061180, transno 17179873232 00000004:00080000:2.0:1746155575.843271:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca95c00, transno 17179873233 00000004:00080000:2.0:1746155575.843272:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6063100, transno 17179873234 00000004:00080000:2.0:1746155575.843274:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094084380, transno 17179873243 00000004:00080000:2.0:1746155575.843276:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdeea00, transno 17179873244 00000004:00080000:2.0:1746155575.843278:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094087800, transno 17179873245 00000004:00080000:2.0:1746155575.843279:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6db100, transno 17179873246 00000004:00080000:2.0:1746155575.843281:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dbb80, transno 17179873247 00000004:00080000:2.0:1746155575.843282:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb69f80, transno 17179873248 00000004:00080000:2.0:1746155575.843284:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093a45f80, transno 17179873249 00000004:00080000:2.0:1746155575.843286:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136633100, transno 17179873250 00000004:00080000:2.0:1746155575.843288:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f881880, transno 17179873251 00000004:00080000:2.0:1746155575.843289:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3efb80, transno 17179873252 00000004:00080000:2.0:1746155575.843291:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f882300, transno 17179873253 00000004:00080000:2.0:1746155575.843293:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3eea00, transno 17179873254 00000004:00080000:2.0:1746155575.843295:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f880e00, transno 17179873255 00000004:00080000:2.0:1746155575.843296:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f881180, transno 17179873256 00000004:00080000:2.0:1746155575.843298:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f881f80, transno 17179873257 00000004:00080000:2.0:1746155575.843299:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ec000, transno 17179873258 00000100:00100000:2.0:1746155575.843304:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124666368:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1746155575.843710:0:14274:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 45 done 00000004:00080000:2.0:1746155575.843874:0:14277:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 40 done 00000100:00100000:2.0:1746155575.847826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.847854:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.847931:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123994496 00000100:00100000:3.0:1746155575.847938:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123994496 00000100:00100000:3.0:1746155575.848934:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123994624 00000100:00100000:3.0:1746155575.848937:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123994624 00000100:00100000:2.0:1746155575.848982:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12576 00000100:00100000:2.0:1746155575.848989:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123994496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155575.849003:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.849015:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ecf52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c74 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155575.849053:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124666624:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155575.849114:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155575.850223:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12577 00000100:00100000:1.0:1746155575.850232:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123994624:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155575.850241:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.850250:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ecf59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c7b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.850276:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124666752:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155575.850328:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155575.852681:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124666752:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155575.852706:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ecf59 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c7b expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.852718:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ecf59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c7b expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.852731:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c4ca00, rc 0) 00000100:00100000:1.0:1746155575.852763:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976123994624:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2532us (4906us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155575.852770:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12577 00000100:00100000:2.0:1746155575.852972:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124666624:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155575.852987:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ecf52 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c74 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155575.852995:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ecf52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c74 expref: 17 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155575.853015:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4fd8800, rc 0) 00000100:00100000:2.0:1746155575.853034:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123994496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4046us (5214us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155575.853039:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12576 00000100:00100000:0.0:1746155575.859214:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155575.859256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.859324:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123994752 00000100:00100000:1.0:1746155575.859331:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123994752 00000100:00100000:1.0:1746155575.859361:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123994880 00000100:00100000:1.0:1746155575.859363:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123994880 00000100:00100000:1.0:1746155575.859388:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12578 00000100:00100000:1.0:1746155575.859395:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123994752:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155575.859409:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.859423:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c4de00/0x844e5faceb5ecf60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c82 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155575.859462:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124666880:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155575.859548:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.859667:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12579 00000100:00100000:3.0:1746155575.859674:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123994880:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155575.859681:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.859690:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5ecf67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c89 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.859710:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124667008:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155575.859734:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155575.862816:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.863321:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.863343:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123995136 00000100:00100000:2.0:1746155575.863350:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123995136 00002000:00100000:2.0:1746155575.863382:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a0ac6300 x1830976123995136/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.863391:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac6300 with x1830976123995136 ext(2097152->3145727) 00002000:00010000:2.0:1746155575.863396:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac6300 00000100:00100000:2.0:1746155575.863408:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123995392 00000100:00100000:2.0:1746155575.863410:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123995392 00002000:00100000:2.0:1746155575.863419:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a0ac5180 x1830976123995392/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.863426:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac5180 with x1830976123995392 ext(2097152->3145727) 00002000:00010000:2.0:1746155575.863428:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac5180 00000100:00100000:2.0:1746155575.863438:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4934 00000100:00100000:2.0:1746155575.863443:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123995136:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155575.864607:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4935 00000100:00100000:0.0:1746155575.864616:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123995392:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155575.865693:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124667008:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155575.865719:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5ecf67 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c89 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.865736:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5ecf67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c89 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.865752:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d400, rc 0) 00000100:00100000:0.0:1746155575.874372:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124666880:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155575.874399:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c4de00/0x844e5faceb5ecf60 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c82 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.874416:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c4de00/0x844e5faceb5ecf60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c82 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155575.874433:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c4de00, rc 0) 00000100:00100000:0.0:1746155575.874472:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123994752:12345-192.168.202.51@tcp:101:cat.0 Request processed in 15077us (15264us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155575.874479:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12578 00000100:00100000:3.0:1746155575.874890:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123994880:12345-192.168.202.51@tcp:101:cat.0 Request processed in 15215us (15631us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155575.874896:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12579 00000100:00100000:2.0:1746155575.897233:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123995136:12345-192.168.202.51@tcp:3:cat.0 Request processed in 33780us (34415us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155575.897243:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4934 00002000:00100000:2.0:1746155575.897253:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a0ac6300 x1830976123995136/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.897261:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac6300 with x1830976123995136 ext(2097152->3145727) 00002000:00010000:2.0:1746155575.897266:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac6300 00000100:00100000:1.0:1746155575.898589:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1963:x1830976123995392:12345-192.168.202.51@tcp:3:cat.0 Request processed in 33970us (35264us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155575.898596:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4935 00002000:00100000:1.0:1746155575.898601:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a0ac5180 x1830976123995392/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.898608:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac5180 with x1830976123995392 ext(2097152->3145727) 00002000:00010000:1.0:1746155575.898611:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac5180 00000100:00100000:0.0:1746155575.900743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.901600:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123995520 00000100:00100000:3.0:1746155575.901609:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123995520 00000100:00100000:3.0:1746155575.901646:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12580 00000100:00100000:3.0:1746155575.901653:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:29450:x1830976123995520:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155575.901668:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.901682:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c90 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.901706:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c0b expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.901714:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135363800/0x844e5faceb5ecf0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c2e expref: 17 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.901720:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.901722:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.901724:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3207168->4194303] (req 3207168->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 17 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.901753:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135363800/0x844e5faceb5ecf0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c2e expref: 17 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155575.901763:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135363800/0x844e5faceb5ecf0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c2e expref: 17 pid: 4461 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1746155575.901773:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124667136:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155575.901859:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c0b expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.901866:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c0b expref: 9 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155575.901873:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124667264:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155575.901888:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.906618:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.907088:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124667136:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155575.907098:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124667264:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155575.907119:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3207168->4194303] (req 3207168->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 17 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.907133:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1ca00, rc 0) 00000100:00100000:2.0:1746155575.907170:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123995648 00000100:00100000:2.0:1746155575.907176:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123995648 00010000:00010000:2.0:1746155575.907198:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c0b expref: 10 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155575.907206:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:29450:x1830976123995520:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5553us (6468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.907216:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12580 00000100:00100000:2.0:1746155575.907217:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6380 00000100:00100000:2.0:1746155575.907223:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976123995648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155575.907232:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.907249:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c0b expref: 10 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155575.907258:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c0b expref: 10 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155575.907277:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9c00/0x844e5faceb5ecee9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c0b expref: 10 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155575.907295:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155575.907311:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976123995648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 89us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.907315:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6380 00000100:00100000:0.0:1746155575.907335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.907401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.907456:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123995776 00000100:00100000:3.0:1746155575.907459:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123995776 00000100:00100000:3.0:1746155575.907547:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12581 00000100:00100000:3.0:1746155575.907553:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29455:x1830976123995776:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155575.907563:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155575.907571:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c97 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.907583:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.907587:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3207168->4194303] (req 3207168->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.907592:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155575.907594:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c97 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.907614:0:18270:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3207168->4194303] (req 3207168->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.907623:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c97 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.907629:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d800, rc 0) 00000100:00100000:3.0:1746155575.907644:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29455:x1830976123995776:12345-192.168.202.51@tcp:101:cat.0 Request processed in 91us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.907648:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12581 00000100:00100000:2.0:1746155575.907710:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123995904 00000100:00100000:2.0:1746155575.907714:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123995904 00010000:00010000:2.0:1746155575.907724:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135363800/0x844e5faceb5ecf0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c2e expref: 17 pid: 4461 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746155575.907737:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6381 00000100:00100000:2.0:1746155575.907742:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123995904:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155575.907747:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.907753:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135363800/0x844e5faceb5ecf0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c2e expref: 17 pid: 4461 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1746155575.907760:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135363800/0x844e5faceb5ecf0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c2e expref: 17 pid: 4461 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1746155575.907770:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135363800/0x844e5faceb5ecf0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c2e expref: 17 pid: 4461 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1746155575.907777:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.907778:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155575.907782:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.907788:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.907803:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.907811:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 16 pid: 18270 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155575.907820:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124667520:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155575.907865:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155575.909165:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124667520:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155575.909175:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155575.909369:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123995904:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1532us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.909377:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6381 00000100:00100000:0.0:1746155575.909602:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.909710:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123996160 00000100:00100000:1.0:1746155575.909714:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123996160 00002000:00100000:1.0:1746155575.909739:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3207168->3211263) req@ffff88012fef3b80 x1830976123996160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.909752:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef3b80 with x1830976123996160 ext(3207168->3211263) 00010000:00010000:1.0:1746155575.909758:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 16 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155575.909768:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 16 pid: 18270 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746155575.909774:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fef3b80 00000100:00100000:1.0:1746155575.909786:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 806 00000100:00100000:1.0:1746155575.909792:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123996160:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155575.909905:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976123996160:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 113us (303us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155575.909911:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 806 00002000:00100000:1.0:1746155575.909916:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3207168->3211263) req@ffff88012fef3b80 x1830976123996160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/4536 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155575.909922:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef3b80 with x1830976123996160 ext(3207168->3211263) 00010000:00010000:1.0:1746155575.909926:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 16 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155575.909934:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 16 pid: 18270 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746155575.909939:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fef3b80 00000100:00100000:0.0:1746155575.917484:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.917551:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123996416 00000100:00100000:2.0:1746155575.917559:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123996416 00002000:00100000:2.0:1746155575.917594:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3207168->4194303) req@ffff88012fef1180 x1830976123996416/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.917609:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef1180 with x1830976123996416 ext(3207168->4194303) 00010000:00010000:2.0:1746155575.917616:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 16 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155575.917629:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 16 pid: 18270 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155575.917636:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fef1180 00000100:00100000:2.0:1746155575.917659:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 807 00000100:00100000:2.0:1746155575.917666:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976123996416:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155575.918010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155575.918176:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123996544 00000100:00100000:1.0:1746155575.918180:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123996544 00000100:00100000:1.0:1746155575.918212:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12582 00000100:00100000:1.0:1746155575.918218:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29450:x1830976123996544:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155575.918226:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155575.918238:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11c9e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.918257:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c19 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.918265:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094219a00/0x844e5faceb5ecf13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c35 expref: 22 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.918270:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.918272:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155575.918275:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->3158015] (req 3145728->3158015) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.918295:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094219a00/0x844e5faceb5ecf13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c35 expref: 22 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155575.918304:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094219a00/0x844e5faceb5ecf13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c35 expref: 22 pid: 4461 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746155575.918312:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800948e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124667648:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155575.918378:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c19 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155575.918389:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c19 expref: 11 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155575.918396:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124667776:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155575.918411:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155575.922887:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800948e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124667648:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155575.922897:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124667776:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155575.922922:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->3158015] (req 3145728->3158015) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.922936:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a20bc00, rc 0) 00000100:00100000:2.0:1746155575.922965:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29450:x1830976123996544:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4747us (4955us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.922972:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12582 00000100:00100000:0.0:1746155575.923612:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.923665:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123996672 00000100:00100000:2.0:1746155575.923670:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123996672 00010000:00010000:2.0:1746155575.923691:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094219a00/0x844e5faceb5ecf13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c35 expref: 22 pid: 4461 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746155575.923725:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6382 00000100:00100000:2.0:1746155575.923731:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976123996672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155575.923740:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155575.923755:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094219a00/0x844e5faceb5ecf13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c35 expref: 22 pid: 4461 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1746155575.923765:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094219a00/0x844e5faceb5ecf13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c35 expref: 22 pid: 4461 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1746155575.923781:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094219a00/0x844e5faceb5ecf13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c35 expref: 22 pid: 4461 timeout: 805 lvb_type: 1 00010000:00010000:2.0:1746155575.923793:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155575.923819:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123996672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.923825:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6382 00000100:00100000:0.0:1746155575.926180:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.926276:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123996800 00000100:00100000:3.0:1746155575.926283:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123996800 00010000:00010000:3.0:1746155575.926307:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c19 expref: 12 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155575.926382:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6383 00000100:00100000:3.0:1746155575.926388:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976123996800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.926399:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155575.926414:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c19 expref: 12 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155575.926423:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c19 expref: 12 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155575.926439:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ecef7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c19 expref: 12 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155575.926647:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.926649:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.926655:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.926662:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.926686:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.926701:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124667904:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155575.927672:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155575.931657:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.931730:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124667904:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155575.931746:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155575.931780:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123996800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5392us (5607us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.931789:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6383 00000100:00100000:0.0:1746155575.931893:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123997056 00000100:00100000:0.0:1746155575.931898:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123997056 00002000:00100000:0.0:1746155575.931924:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (3153920->3158015) req@ffff8800a0ac7480 x1830976123997056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.931932:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac7480 with x1830976123997056 ext(3153920->3158015) 00002000:00010000:0.0:1746155575.931936:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac7480 00000100:00100000:0.0:1746155575.931948:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4936 00000100:00100000:0.0:1746155575.931952:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123997056:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155575.932055:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123997056:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 102us (406us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155575.932061:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4936 00002000:00100000:0.0:1746155575.932065:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (3153920->3158015) req@ffff8800a0ac7480 x1830976123997056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/4536 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155575.932071:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac7480 with x1830976123997056 ext(3153920->3158015) 00002000:00010000:0.0:1746155575.932073:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac7480 00000100:00100000:2.0:1746155575.939446:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976123996416:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 21773us (21963us total) trans 21474840663 rc 0/0 00000100:00100000:2.0:1746155575.939456:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 807 00002000:00100000:2.0:1746155575.939466:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3207168->4194303) req@ffff88012fef1180 x1830976123996416/t21474840663(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 488/448 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.939474:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef1180 with x1830976123996416 ext(3207168->4194303) 00010000:00010000:2.0:1746155575.939482:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 18 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155575.939496:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 18 pid: 18270 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155575.939945:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fef1180 00000100:00100000:0.0:1746155575.942559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.942667:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123997184 00000100:00100000:3.0:1746155575.942674:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123997184 00010000:00010000:3.0:1746155575.942699:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 18 pid: 18270 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155575.942772:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6384 00000100:00100000:3.0:1746155575.942779:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976123997184:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.942792:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155575.942807:0:7062:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155575 -> 1746155576 00002000:00010000:3.0:1746155575.942809:0:7062:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155575 -> 1746155576 00010000:00010000:3.0:1746155575.942814:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 18 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155575.942829:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 18 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155575.942850:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecf6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c90 expref: 18 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155575.942865:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.942867:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.942873:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c97 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.942879:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c97 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.942909:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c97 expref: 9 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.942919:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124668032:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155575.944370:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155575.947355:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.947420:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124668032:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155575.947433:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155575.947464:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976123997184:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4685us (4911us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.947472:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6384 00000100:00100000:2.0:1746155575.947543:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123997440 00000100:00100000:2.0:1746155575.947549:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123997440 00002000:00100000:2.0:1746155575.947580:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012fef0380 x1830976123997440/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.947588:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0380 with x1830976123997440 ext(3145728->4194303) 00002000:00010000:2.0:1746155575.947592:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef0380 00000100:00100000:2.0:1746155575.947605:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4937 00000100:00100000:2.0:1746155575.947611:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123997440:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155575.955299:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1962:x1830976123997440:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7682us (7943us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155575.955309:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4937 00002000:00100000:2.0:1746155575.955319:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012fef0380 x1830976123997440/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.955328:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0380 with x1830976123997440 ext(3145728->4194303) 00002000:00010000:2.0:1746155575.955332:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef0380 00000100:00100000:0.0:1746155575.958152:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.958254:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123997568 00000100:00100000:2.0:1746155575.958261:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123997568 00000100:00100000:2.0:1746155575.958899:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12583 00000100:00100000:2.0:1746155575.958907:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29455:x1830976123997568:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155575.958924:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155575.958938:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ca5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.958961:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.958968:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155575.958969:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155575.958972:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ca5 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.958993:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.959002:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 20 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155575.959012:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124668160:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155575.959594:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155575.963312:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124668160:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155575.963335:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ca5 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155575.963348:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f089000, rc 0) 00000100:00100000:2.0:1746155575.963394:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29455:x1830976123997568:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4487us (5246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155575.963402:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12583 00000100:00100000:0.0:1746155575.965061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155575.965362:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123997696 00000100:00100000:2.0:1746155575.965368:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123997696 00002000:00100000:2.0:1746155575.965399:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->3158015) req@ffff88012fef2d80 x1830976123997696/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 12776/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.965407:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef2d80 with x1830976123997696 ext(3145728->3158015) 00010000:00010000:2.0:1746155575.965415:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 21 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155575.965426:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 21 pid: 8436 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155575.965432:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fef2d80 00000100:00100000:2.0:1746155575.965462:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 808 00000100:00100000:2.0:1746155575.965469:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976123997696:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155575.965777:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976123997696:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 308us (718us total) trans 17179873270 rc 0/0 00000100:00100000:2.0:1746155575.965783:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 808 00002000:00100000:2.0:1746155575.965788:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->3158015) req@ffff88012fef2d80 x1830976123997696/t17179873270(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:646/0 lens 12776/448 e 0 to 0 dl 1746155586 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.965796:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef2d80 with x1830976123997696 ext(3145728->3158015) 00010000:00010000:2.0:1746155575.965800:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 23 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155575.965813:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 23 pid: 8436 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155575.965819:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fef2d80 00000100:00100000:0.0:1746155575.967388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.967779:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123997824 00000100:00100000:3.0:1746155575.967784:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123997824 00010000:00010000:3.0:1746155575.967805:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 23 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155575.968110:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6385 00000100:00100000:3.0:1746155575.968117:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123997824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155575.968128:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155575.968140:0:7062:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155575 -> 1746155576 00002000:00010000:3.0:1746155575.968187:0:7062:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155575 -> 1746155576 00010000:00010000:3.0:1746155575.968193:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 23 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155575.968202:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 23 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155575.968220:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a20bc00/0x844e5faceb5ecf7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c9e expref: 23 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155575.968239:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.968241:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155575.968246:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ca5 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.968252:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ca5 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155575.968275:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ca5 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155575.968284:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124668288:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155575.968340:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155575.973624:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124668288:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155575.973645:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155575.973678:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123997824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5560us (6292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155575.973686:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6385 00000100:00100000:0.0:1746155575.974184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155575.975478:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123998080 00000100:00100000:3.0:1746155575.975486:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123998080 00002000:00100000:3.0:1746155575.975554:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012fef0700 x1830976123998080/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/0 e 0 to 0 dl 1746155586 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155575.975563:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0700 with x1830976123998080 ext(3145728->4194303) 00002000:00010000:3.0:1746155575.975568:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef0700 00000100:00100000:3.0:1746155575.975612:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4938 00000100:00100000:3.0:1746155575.975622:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123998080:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155575.998105:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976123998080:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22477us (23916us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155575.998115:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4938 00002000:00100000:2.0:1746155575.998125:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88012fef0700 x1830976123998080/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:646/0 lens 488/440 e 0 to 0 dl 1746155586 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155575.998133:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0700 with x1830976123998080 ext(3145728->4194303) 00002000:00010000:2.0:1746155575.998138:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef0700 00000100:00100000:0.0:1746155576.011147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.011268:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123998336 00000100:00100000:2.0:1746155576.011277:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123998336 00002000:00100000:2.0:1746155576.011311:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012fef2a00 x1830976123998336/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.011320:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef2a00 with x1830976123998336 ext(4194304->4956159) 00002000:00010000:2.0:1746155576.011324:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef2a00 00000100:00100000:2.0:1746155576.011340:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4939 00000100:00100000:2.0:1746155576.011346:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123998336:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155576.015825:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123998336:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4470us (4679us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155576.015836:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4939 00002000:00100000:2.0:1746155576.015846:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012fef2a00 x1830976123998336/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.015855:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef2a00 with x1830976123998336 ext(4194304->4956159) 00002000:00010000:2.0:1746155576.015861:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef2a00 00000100:00100000:0.0:1746155576.092254:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.092357:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123998464 00000100:00100000:2.0:1746155576.092364:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123998464 00000100:00100000:2.0:1746155576.092646:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12584 00000100:00100000:2.0:1746155576.092654:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29459:x1830976123998464:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155576.092671:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.092687:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11cac expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.092713:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8400/0x844e5faceb5ece95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb7 expref: 21 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.092720:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ba00/0x844e5faceb5ecea3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bc5 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.092726:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.092727:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.092730:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1622016->2097151] (req 1622016->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.092756:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ba00/0x844e5faceb5ecea3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bc5 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.092765:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ba00/0x844e5faceb5ecea3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bc5 expref: 13 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.092779:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124668416:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.095329:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8400/0x844e5faceb5ece95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb7 expref: 21 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.095342:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8400/0x844e5faceb5ece95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb7 expref: 21 pid: 20200 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746155576.095354:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124668544:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155576.096862:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.098431:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.098777:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124668416:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155576.099252:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123998592 00000100:00100000:3.0:1746155576.099258:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123998592 00010000:00010000:3.0:1746155576.099286:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ba00/0x844e5faceb5ecea3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bc5 expref: 14 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155576.099321:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6386 00000100:00100000:3.0:1746155576.099328:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976123998592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155576.099339:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155576.099357:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ba00/0x844e5faceb5ecea3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bc5 expref: 14 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.099367:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ba00/0x844e5faceb5ecea3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bc5 expref: 14 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.099386:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3ba00/0x844e5faceb5ecea3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bc5 expref: 14 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.100864:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155576.101469:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1962:x1830976123998592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2136us (3037us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.101478:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6386 00000100:00100000:3.0:1746155576.104960:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124668544:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155576.104988:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1622016->2097151] (req 1622016->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.105002:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f089600, rc 0) 00000100:00100000:3.0:1746155576.105043:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29459:x1830976123998464:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 12388us (12794us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.105050:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12584 00000100:00100000:0.0:1746155576.113335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.115145:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123998720 00000100:00100000:3.0:1746155576.115154:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123998720 00010000:00010000:3.0:1746155576.115205:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8400/0x844e5faceb5ece95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb7 expref: 22 pid: 20200 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1746155576.115230:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6387 00000100:00100000:3.0:1746155576.115238:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123998720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155576.115249:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155576.115266:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8400/0x844e5faceb5ece95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb7 expref: 22 pid: 20200 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1746155576.115277:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8400/0x844e5faceb5ece95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb7 expref: 22 pid: 20200 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1746155576.115294:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8400/0x844e5faceb5ece95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bb7 expref: 22 pid: 20200 timeout: 805 lvb_type: 1 00010000:00010000:3.0:1746155576.115317:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.115318:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.115324:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.115331:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.115359:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155576.115369:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124668672:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155576.115435:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e840 going to sleep for 11 seconds 00000100:00080000:2.0:1746155576.115674:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155576.119347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.119411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.119438:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123999104 00000100:00100000:0.0:1746155576.119445:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123999104 00000100:00100000:0.0:1746155576.119485:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12585 00000100:00100000:0.0:1746155576.119492:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976123999104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155576.119535:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155576.119549:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800939e3e00/0x844e5faceb5ecf91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11cb3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155576.119591:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124668800:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155576.119646:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338259c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746155576.119664:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155576.119673:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123998976 00000100:00100000:0.0:1746155576.119675:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123998976 00002000:00100000:0.0:1746155576.119741:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1622016->1626111) req@ffff88009018ad80 x1830976123998976/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155576.119750:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018ad80 with x1830976123998976 ext(1622016->1626111) 00002000:00010000:0.0:1746155576.119754:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009018ad80 00000100:00100000:0.0:1746155576.119765:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4940 00000100:00100000:0.0:1746155576.119770:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123998976:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155576.119880:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1962:x1830976123998976:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 109us (538us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155576.119885:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4940 00002000:00100000:0.0:1746155576.119889:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1622016->1626111) req@ffff88009018ad80 x1830976123998976/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/4536 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155576.119895:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018ad80 with x1830976123998976 ext(1622016->1626111) 00002000:00010000:0.0:1746155576.119897:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009018ad80 00000100:00100000:0.0:1746155576.119928:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.119941:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123999232 00000100:00100000:0.0:1746155576.119944:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123999232 00000100:00100000:0.0:1746155576.119957:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12586 00000100:00100000:0.0:1746155576.119961:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123999232:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155576.119967:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155576.119975:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800939e3200/0x844e5faceb5ecf98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11cba expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155576.119999:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124668928:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155576.120017:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.120052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.120109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.120143:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123999360 00000100:00100000:0.0:1746155576.120146:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123999360 00000100:00100000:0.0:1746155576.120160:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123999488 00000100:00100000:0.0:1746155576.120162:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123999488 00000100:00100000:0.0:1746155576.120173:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12587 00000100:00100000:0.0:1746155576.120178:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123999360:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155576.120183:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155576.120190:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800939e2600/0x844e5faceb5ecf9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11cc1 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155576.120210:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124669056:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155576.120231:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.120243:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12588 00000100:00100000:0.0:1746155576.120248:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976123999488:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155576.120254:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155576.120260:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800939e3600/0x844e5faceb5ecfa6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11cc8 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.120270:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.120271:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.120277:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800939e3600/0x844e5faceb5ecfa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cc8 expref: 20 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155576.120288:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800939e3600/0x844e5faceb5ecfa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cc8 expref: 20 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155576.120295:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939e3600, rc 0) 00000100:00100000:0.0:1746155576.120309:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976123999488:12345-192.168.202.51@tcp:101:cat.0 Request processed in 61us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.120313:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12588 00000100:00100000:3.0:1746155576.120450:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124668672:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155576.120461:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155576.120480:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976123998720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5243us (7153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.120487:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6387 00010000:00010000:2.0:1746155576.131902:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1746155576.137049:0:10591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime: 1746155574 -> 1746155576 00002000:00010000:0.0:1746155576.137055:0:10591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime: 1746155574 -> 1746155576 00000100:00100000:2.0:1746155576.137276:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124668800:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155576.137303:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800939e3e00/0x844e5faceb5ecf91 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cb3 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.137317:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800939e3e00/0x844e5faceb5ecf91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cb3 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155576.137438:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124668928:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155576.137456:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800939e3200/0x844e5faceb5ecf98 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cba expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.137465:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800939e3200/0x844e5faceb5ecf98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cba expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.137477:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939e3200, rc 0) 00000100:00100000:1.0:1746155576.137541:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123999232:12345-192.168.202.51@tcp:101:cat.0 Request processed in 17578us (17611us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155576.137549:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12586 00000100:00100000:1.0:1746155576.137606:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.137620:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123999616 00000100:00100000:1.0:1746155576.137625:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123999616 00000100:00100000:1.0:1746155576.137648:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12589 00000100:00100000:1.0:1746155576.137654:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976123999616:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155576.137664:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155576.137673:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc7e600/0x844e5faceb5ecfad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ccf expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.137693:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.137695:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.137701:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc7e600/0x844e5faceb5ecfad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ccf expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.137711:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc7e600/0x844e5faceb5ecfad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ccf expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.137718:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7e600, rc 0) 00000100:00100000:1.0:1746155576.137732:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976123999616:12345-192.168.202.51@tcp:101:cat.0 Request processed in 79us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.137737:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12589 00010000:00010000:2.0:1746155576.137741:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939e3e00, rc 0) 00000100:00100000:2.0:1746155576.137762:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976123999104:12345-192.168.202.51@tcp:101:cat.0 Request processed in 18270us (18350us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155576.137768:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12585 00000100:00100000:1.0:1746155576.137793:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:0.0:1746155576.138321:0:10591:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime: 1746155574 -> 1746155576 00000100:00100000:0.0:1746155576.138333:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124669056:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155576.138348:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800939e2600/0x844e5faceb5ecf9f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cc1 expref: 23 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155576.138357:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800939e2600/0x844e5faceb5ecf9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cc1 expref: 23 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155576.138369:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800939e2600, rc 0) 00000100:00100000:0.0:1746155576.138391:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976123999360:12345-192.168.202.51@tcp:101:cat.0 Request processed in 18212us (18338us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155576.138396:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12587 00000100:00100000:2.0:1746155576.138648:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123999744 00000100:00100000:2.0:1746155576.138651:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123999744 00000100:00100000:2.0:1746155576.138716:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12590 00000100:00100000:2.0:1746155576.138721:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29459:x1830976123999744:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155576.138730:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.138737:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11cd6 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.138753:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ece9c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bbe expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.138760:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136863200/0x844e5faceb5ecebf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11be1 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.138765:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.138766:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.138768:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.138788:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136863200/0x844e5faceb5ecebf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11be1 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.138797:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136863200/0x844e5faceb5ecebf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11be1 expref: 11 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.138806:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124669184:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.138867:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ece9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bbe expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.138878:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ece9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bbe expref: 17 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746155576.138885:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124669312:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155576.138901:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155576.141227:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124669184:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155576.141238:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124669312:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155576.141261:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.141274:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c052400, rc 0) 00000100:00100000:3.0:1746155576.141315:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29459:x1830976123999744:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2593us (3521us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.141321:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12590 00000100:00100000:0.0:1746155576.149190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.149226:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124000000 00000100:00100000:0.0:1746155576.149233:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124000000 00010000:00010000:0.0:1746155576.149264:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ece9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bbe expref: 18 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746155576.149288:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6388 00000100:00100000:0.0:1746155576.149294:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976124000000:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.149306:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.149326:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ece9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bbe expref: 18 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746155576.149335:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ece9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bbe expref: 18 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746155576.149352:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe3b800/0x844e5faceb5ece9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11bbe expref: 18 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746155576.149364:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155576.149397:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976124000000:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 103us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.149402:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6388 00000100:00100000:0.0:1746155576.152668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.152726:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976123999872 00000100:00100000:1.0:1746155576.152732:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976123999872 00010000:00010000:1.0:1746155576.152757:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136863200/0x844e5faceb5ecebf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11be1 expref: 11 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.152793:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6389 00000100:00100000:1.0:1746155576.152800:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976123999872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.152811:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.152827:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136863200/0x844e5faceb5ecebf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11be1 expref: 11 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.152837:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136863200/0x844e5faceb5ecebf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11be1 expref: 11 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.152854:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136863200/0x844e5faceb5ecebf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11be1 expref: 11 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.152880:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.152882:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.152888:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.152895:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.152923:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.152933:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124669440:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155576.152999:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.156440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.156706:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124000128 00000100:00100000:3.0:1746155576.156712:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124000128 00000100:00100000:3.0:1746155576.158073:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12591 00000100:00100000:3.0:1746155576.158082:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:29465:x1830976124000128:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155576.158098:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.158113:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11cdd expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.158139:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.158147:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155576.158149:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155576.158152:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.158177:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 10 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.158191:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 10 pid: 18270 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155576.158202:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124669568:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155576.158258:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.159008:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.159028:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124000384 00000100:00100000:0.0:1746155576.159032:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124000384 00002000:00100000:0.0:1746155576.159059:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1314816->1318911) req@ffff880090189f80 x1830976124000384/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155576.159068:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189f80 with x1830976124000384 ext(1314816->1318911) 00002000:00010000:0.0:1746155576.159073:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090189f80 00000100:00100000:0.0:1746155576.159092:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4941 00000100:00100000:0.0:1746155576.159097:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976124000384:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155576.159218:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976124000384:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 119us (211us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155576.159223:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4941 00002000:00100000:0.0:1746155576.159228:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1314816->1318911) req@ffff880090189f80 x1830976124000384/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/4536 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155576.159235:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189f80 with x1830976124000384 ext(1314816->1318911) 00002000:00010000:0.0:1746155576.159237:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090189f80 00000100:00100000:1.0:1746155576.159451:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124669440:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155576.159466:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.159487:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1961:x1830976123999872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6688us (6825us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.159493:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6389 00000100:00100000:0.0:1746155576.184949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.189205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.189258:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124000640 00000100:00100000:0.0:1746155576.189265:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124000640 00002000:00100000:0.0:1746155576.189298:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (946176->1048575) req@ffff880094f08000 x1830976124000640/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155576.189307:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08000 with x1830976124000640 ext(946176->1048575) 00010000:00010000:0.0:1746155576.189314:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 10 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.189325:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 10 pid: 18270 timeout: 805 lvb_type: 0 00002000:00010000:0.0:1746155576.189332:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f08000 00000100:00100000:0.0:1746155576.189346:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 809 00000100:00100000:0.0:1746155576.189351:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1960:x1830976124000640:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155576.189535:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124669568:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155576.189555:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.189566:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d200, rc 0) 00000100:00100000:0.0:1746155576.189589:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:29465:x1830976124000128:12345-192.168.202.51@tcp:101:cat.0 Request processed in 31507us (33155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.189595:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12591 00000100:00100000:2.0:1746155576.194209:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124000512 00000100:00100000:2.0:1746155576.194219:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124000512 00000100:00100000:2.0:1746155576.194276:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12592 00000100:00100000:2.0:1746155576.194283:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:29462:x1830976124000512:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155576.194296:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.194310:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ce4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.194330:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155576.194335:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.194340:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746155576.194343:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [446464->1048575] (req 446464->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.194369:0:8436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.194379:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [446464->1048575] (req 446464->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.194392:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0fa00, rc 0) 00000100:00100000:2.0:1746155576.194421:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:29462:x1830976124000512:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 139us (9480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.194427:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12592 00000100:00100000:2.0:1746155576.194863:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976124000640:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 5511us (5665us total) trans 21474840664 rc 0/0 00000100:00100000:2.0:1746155576.194870:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 809 00002000:00100000:2.0:1746155576.194876:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (946176->1048575) req@ffff880094f08000 x1830976124000640/t21474840664(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/448 e 0 to 0 dl 1746155587 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.194883:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f08000 with x1830976124000640 ext(946176->1048575) 00010000:00010000:2.0:1746155576.194889:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 12 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.194899:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 12 pid: 18270 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155576.194905:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094f08000 00000100:00100000:0.0:1746155576.197087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.197151:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124000768 00000100:00100000:1.0:1746155576.197157:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124000768 00010000:00010000:1.0:1746155576.197179:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 12 pid: 18270 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.197204:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6390 00000100:00100000:1.0:1746155576.197209:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976124000768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.197218:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.197231:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 12 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.197241:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 12 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.197257:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a236400/0x844e5faceb5ecf2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 946176->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c51 expref: 12 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.197281:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.197282:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.197288:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.197295:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.197318:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.197327:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 18 pid: 1625 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.197342:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f09f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124669824:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155576.197400:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.200550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.200626:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124001024 00000100:00100000:2.0:1746155576.200633:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124001024 00002000:00100000:2.0:1746155576.200667:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009018b100 x1830976124001024/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.200677:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018b100 with x1830976124001024 ext(0->1048575) 00010000:00010000:2.0:1746155576.200685:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 19 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.200702:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 19 pid: 1625 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155576.200707:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009018b100 00000100:00100000:2.0:1746155576.200723:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 810 00000100:00100000:2.0:1746155576.200729:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976124001024:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155576.202759:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f09f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124669824:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155576.202780:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.202809:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1961:x1830976124000768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5599us (5725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.202818:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6390 00000100:00100000:2.0:1746155576.216543:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976124001024:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 15806us (15994us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155576.216554:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 810 00002000:00100000:2.0:1746155576.216562:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009018b100 x1830976124001024/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.216571:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018b100 with x1830976124001024 ext(0->1048575) 00010000:00010000:2.0:1746155576.216579:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 19 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.216590:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 19 pid: 1625 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155576.216597:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009018b100 00000100:00100000:1.0:1746155576.234725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.234761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.234851:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124001280 00000100:00100000:0.0:1746155576.234858:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124001280 00010000:00010000:0.0:1746155576.234884:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 19 pid: 1625 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.234905:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6391 00000100:00100000:0.0:1746155576.234910:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976124001280:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.234921:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.234936:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 19 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.234945:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 19 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.234961:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5ecfbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cdd expref: 19 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.234979:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.234981:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.234986:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.234993:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.235015:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155576.235024:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124669952:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155576.235077:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825780 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.235191:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124001152 00000100:00100000:2.0:1746155576.235195:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124001152 00000100:00100000:2.0:1746155576.235213:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12593 00000100:00100000:2.0:1746155576.235217:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29465:x1830976124001152:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155576.235231:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.235241:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ceb expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.235256:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 11 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.235261:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155576.235262:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155576.235265:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.235280:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 11 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.235289:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 11 pid: 18270 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.235296:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124670080:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155576.235316:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dad80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.238355:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.238386:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124001536 00000100:00100000:0.0:1746155576.238392:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124001536 00002000:00100000:0.0:1746155576.238422:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (446464->450559) req@ffff880090189500 x1830976124001536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155576.238431:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189500 with x1830976124001536 ext(446464->450559) 00002000:00010000:0.0:1746155576.238436:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090189500 00000100:00100000:0.0:1746155576.238464:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4942 00000100:00100000:0.0:1746155576.238470:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976124001536:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155576.238633:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976124001536:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 163us (284us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155576.238642:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4942 00002000:00100000:0.0:1746155576.238648:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (446464->450559) req@ffff880090189500 x1830976124001536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/4536 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155576.238655:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090189500 with x1830976124001536 ext(446464->450559) 00002000:00010000:0.0:1746155576.238658:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090189500 00000100:00100000:3.0:1746155576.238797:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124670080:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155576.238817:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.238830:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6e00, rc 0) 00000100:00100000:3.0:1746155576.238850:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29465:x1830976124001152:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3632us (4131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.238856:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12593 00000100:00100000:2.0:1746155576.239151:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124669952:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155576.239161:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155576.239181:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976124001280:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4270us (4419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.239187:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6391 00000100:00100000:2.0:1746155576.240162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.240793:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124001664 00000100:00100000:1.0:1746155576.240798:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124001664 00002000:00100000:1.0:1746155576.240817:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1638399) req@ffff8800a0ac6d80 x1830976124001664/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.240826:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac6d80 with x1830976124001664 ext(1048576->1638399) 00010000:00010000:1.0:1746155576.240831:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 12 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.240842:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 12 pid: 18270 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746155576.240848:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0ac6d80 00000100:00100000:1.0:1746155576.240864:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 811 00000100:00100000:1.0:1746155576.240869:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1960:x1830976124001664:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155576.251575:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.252637:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124001792 00000100:00100000:3.0:1746155576.252645:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124001792 00000100:00100000:3.0:1746155576.252684:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12594 00000100:00100000:3.0:1746155576.252692:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29462:x1830976124001792:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155576.252708:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.252722:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11cf2 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.252749:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155576.252754:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.252765:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746155576.252768:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->1130495] (req 1048576->1130495) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.252802:0:1625:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.252813:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->1130495] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.252821:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c600, rc 0) 00000100:00100000:3.0:1746155576.252875:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:29462:x1830976124001792:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 183us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.252880:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12594 00000100:00100000:0.0:1746155576.263135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.263171:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.263237:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124001920 00000100:00100000:2.0:1746155576.263246:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124001920 00000100:00100000:2.0:1746155576.263277:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124002048 00000100:00100000:2.0:1746155576.263279:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124002048 00000100:00100000:2.0:1746155576.263294:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12595 00000100:00100000:2.0:1746155576.263301:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976124001920:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155576.263316:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.263330:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ecfd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11cf9 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155576.263373:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124670336:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155576.263432:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.263449:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12596 00000100:00100000:2.0:1746155576.263454:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976124002048:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155576.263461:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.263469:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ecfde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d00 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155576.263490:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124670464:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155576.263531:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155576.265699:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976124001664:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 24824us (25532us total) trans 17179873271 rc 0/0 00000100:00100000:1.0:1746155576.265709:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 811 00002000:00100000:1.0:1746155576.265718:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1638399) req@ffff8800a0ac6d80 x1830976124001664/t17179873271(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/448 e 0 to 0 dl 1746155587 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.265727:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac6d80 with x1830976124001664 ext(1048576->1638399) 00010000:00010000:1.0:1746155576.265734:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 16 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.265747:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 16 pid: 18270 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746155576.265753:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0ac6d80 00000100:00100000:2.0:1746155576.269063:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124670336:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155576.269092:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ecfd7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf9 expref: 12 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.269104:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ecfd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf9 expref: 12 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.269124:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6200, rc 0) 00000100:00100000:2.0:1746155576.269158:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:1963:x1830976124001920:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5857us (6030us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155576.269168:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12595 00000100:00100000:3.0:1746155576.269356:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124670464:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155576.269555:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ecfde lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d00 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.269565:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ecfde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d00 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.269576:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6000, rc 0) 00000100:00100000:3.0:1746155576.269595:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976124002048:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6140us (6423us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155576.269600:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12596 00000100:00100000:1.0:1746155576.271285:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.271341:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124002176 00000100:00100000:2.0:1746155576.271347:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124002176 00010000:00010000:2.0:1746155576.271372:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 14 pid: 18270 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.271392:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6392 00000100:00100000:2.0:1746155576.271399:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976124002176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155576.271409:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155576.271424:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 14 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.271433:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 14 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.271450:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ce00/0x844e5faceb5ecf3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1638399) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c5f expref: 14 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.271461:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.271462:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155576.271462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155576.271468:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.271476:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.271528:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.271539:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 23 pid: 1625 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.271549:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124670592:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155576.271607:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155576.272111:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124002304 00000100:00100000:3.0:1746155576.272115:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124002304 00000100:00100000:3.0:1746155576.272135:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12597 00000100:00100000:3.0:1746155576.272140:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29471:x1830976124002304:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155576.272152:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.272163:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d07 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.272180:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.272186:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155576.272187:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155576.272190:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d07 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.272205:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.272212:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 17 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155576.272220:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124670720:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155576.272255:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.275787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.275876:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124670592:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155576.275889:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155576.275917:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1963:x1830976124002176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4518us (4640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.275926:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6392 00000100:00100000:1.0:1746155576.276011:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124002432 00000100:00100000:1.0:1746155576.276016:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124002432 00002000:00100000:1.0:1746155576.276047:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (446464->1048575) req@ffff8800a0ac4000 x1830976124002432/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.276057:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac4000 with x1830976124002432 ext(446464->1048575) 00010000:00010000:1.0:1746155576.276065:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 18 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.276075:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 18 pid: 8436 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746155576.276081:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0ac4000 00000100:00100000:1.0:1746155576.276093:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 812 00000100:00100000:1.0:1746155576.276100:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976124002432:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155576.277671:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124670720:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155576.277692:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d07 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.277709:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1ca00, rc 0) 00000100:00100000:3.0:1746155576.277742:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29471:x1830976124002304:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5601us (6281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.277748:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12597 00000100:00100000:1.0:1746155576.283232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.283768:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124002688 00000100:00100000:0.0:1746155576.283776:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124002688 00002000:00100000:0.0:1746155576.283808:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094f0bb80 x1830976124002688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155576.283818:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0bb80 with x1830976124002688 ext(1048576->2097151) 00010000:00010000:0.0:1746155576.283830:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 24 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.283840:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 24 pid: 1625 timeout: 805 lvb_type: 0 00002000:00010000:0.0:1746155576.283847:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f0bb80 00000100:00100000:0.0:1746155576.283865:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 813 00000100:00100000:0.0:1746155576.283872:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976124002688:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155576.289131:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976124002432:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 13023us (13342us total) trans 21474840665 rc 0/0 00000100:00100000:0.0:1746155576.289141:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 812 00002000:00100000:0.0:1746155576.289151:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (446464->1048575) req@ffff8800a0ac4000 x1830976124002432/t21474840665(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/448 e 0 to 0 dl 1746155587 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155576.289159:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac4000 with x1830976124002432 ext(446464->1048575) 00010000:00010000:0.0:1746155576.289167:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 20 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.289179:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 20 pid: 8436 timeout: 805 lvb_type: 0 00002000:00010000:0.0:1746155576.289185:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0ac4000 00000100:00100000:2.0:1746155576.296546:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976124002688:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12667us (13313us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155576.296555:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 813 00002000:00100000:2.0:1746155576.296564:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094f0bb80 x1830976124002688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.296572:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0bb80 with x1830976124002688 ext(1048576->2097151) 00010000:00010000:2.0:1746155576.296580:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 24 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.296591:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 24 pid: 1625 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155576.296601:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f0bb80 00000100:00100000:0.0:1746155576.302920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.303163:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124002816 00000100:00100000:2.0:1746155576.303171:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124002816 00010000:00010000:2.0:1746155576.303201:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 20 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.305461:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6393 00000100:00100000:2.0:1746155576.305474:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976124002816:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155576.305489:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155576.305532:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 20 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.305545:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 20 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.305565:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5ecfc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 446464->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ce4 expref: 20 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.305592:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.305593:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.305600:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d07 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.305608:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d07 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.305641:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d07 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155576.305651:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124670848:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155576.305729:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.318060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.318144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.318210:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124002944 00000100:00100000:3.0:1746155576.318217:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124002944 00000100:00100000:3.0:1746155576.318261:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12598 00000100:00100000:3.0:1746155576.318268:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:29465:x1830976124002944:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155576.318283:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.318297:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d0e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.318320:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.318327:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155576.318328:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155576.318331:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d0e expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.318355:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.318365:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 12 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155576.318381:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124670976:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155576.318442:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746155576.318982:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124003072 00000100:00100000:1.0:1746155576.318985:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124003072 00010000:00010000:1.0:1746155576.318998:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 26 pid: 1625 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.319012:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6394 00000100:00100000:1.0:1746155576.319017:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976124003072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.319023:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.319038:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 26 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.319047:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 26 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.319060:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6e00/0x844e5faceb5ecfc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ceb expref: 26 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.319072:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.319074:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.319078:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.319084:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.319106:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.319114:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124671104:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155576.319143:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea910c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.319327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.319343:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124003328 00000100:00100000:2.0:1746155576.319346:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124003328 00002000:00100000:2.0:1746155576.319368:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800a0ac6a00 x1830976124003328/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.319375:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac6a00 with x1830976124003328 ext(0->1048575) 00002000:00010000:2.0:1746155576.319379:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac6a00 00000100:00100000:3.0:1746155576.319603:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124670848:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155576.319614:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155576.319633:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976124002816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 14164us (16720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.319639:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6393 00000100:00100000:1.0:1746155576.320255:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4943 00000100:00100000:1.0:1746155576.320262:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976124003328:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155576.324025:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124671104:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155576.324043:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155576.324089:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976124003072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5070us (5943us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.324098:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6394 00000100:00100000:3.0:1746155576.327554:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124670976:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155576.327579:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d0e expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.327594:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0106600, rc 0) 00000100:00100000:3.0:1746155576.327647:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:29465:x1830976124002944:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9379us (9593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.327654:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12598 00000100:00100000:0.0:1746155576.329366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.329445:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124003584 00000100:00100000:2.0:1746155576.329451:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124003584 00002000:00100000:2.0:1746155576.329480:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1126400->1130495) req@ffff88009fe91880 x1830976124003584/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.329488:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe91880 with x1830976124003584 ext(1126400->1130495) 00002000:00010000:2.0:1746155576.329492:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe91880 00000100:00100000:2.0:1746155576.329543:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4944 00000100:00100000:2.0:1746155576.329551:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976124003584:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155576.329730:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976124003584:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 179us (367us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155576.329735:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4944 00002000:00100000:2.0:1746155576.329990:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1126400->1130495) req@ffff88009fe91880 x1830976124003584/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/4536 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746155576.330101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.330186:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124003712 00000100:00100000:3.0:1746155576.330189:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124003712 00002000:00100000:3.0:1746155576.330204:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1622016->2097151) req@ffff88009fe92d80 x1830976124003712/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.330216:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe92d80 with x1830976124003712 ext(1622016->2097151) 00010000:00010000:3.0:1746155576.330223:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 13 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.330237:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 13 pid: 8436 timeout: 805 lvb_type: 0 00002000:00010000:3.0:1746155576.330242:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe92d80 00000100:00100000:3.0:1746155576.330266:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 814 00000100:00100000:3.0:1746155576.330271:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976124003712:12345-192.168.202.51@tcp:4:cat.0 00002000:00100000:2.0:1746155576.330465:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe91880 with x1830976124003584 ext(1126400->1130495) 00002000:00010000:2.0:1746155576.330468:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe91880 00000100:00100000:1.0:1746155576.335227:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976124003328:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14958us (15892us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155576.335237:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4943 00002000:00100000:1.0:1746155576.335246:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800a0ac6a00 x1830976124003328/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.335253:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac6a00 with x1830976124003328 ext(0->1048575) 00002000:00010000:1.0:1746155576.335258:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac6a00 00000100:00100000:0.0:1746155576.356260:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.358857:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976124003712:12345-192.168.202.51@tcp:4:cat.0 Request processed in 28577us (28748us total) trans 17179873272 rc 0/0 00000100:00100000:3.0:1746155576.358866:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 814 00002000:00100000:3.0:1746155576.358874:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1622016->2097151) req@ffff88009fe92d80 x1830976124003712/t17179873272(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/448 e 0 to 0 dl 1746155587 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.358882:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe92d80 with x1830976124003712 ext(1622016->2097151) 00010000:00010000:3.0:1746155576.358891:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 15 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.358903:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 15 pid: 8436 timeout: 805 lvb_type: 0 00002000:00010000:3.0:1746155576.358910:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe92d80 00000100:00100000:3.0:1746155576.359469:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124003840 00000100:00100000:3.0:1746155576.359475:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124003840 00000100:00100000:0.0:1746155576.361043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.361106:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124003968 00000100:00100000:1.0:1746155576.361111:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124003968 00010000:00010000:1.0:1746155576.361131:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 16 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.361156:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6395 00000100:00100000:1.0:1746155576.361162:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976124003968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.361172:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.361186:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 16 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.361195:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 16 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.361212:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5ecf8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cac expref: 16 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.361225:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.361227:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.361232:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d0e expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.361239:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d0e expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.361262:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d0e expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.361270:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124671232:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155576.364639:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155576.365354:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12599 00000100:00100000:3.0:1746155576.365365:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29471:x1830976124003840:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155576.365380:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.365393:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d15 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.365417:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.365423:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155576.365424:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155576.365427:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d15 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.365449:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.365459:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 23 pid: 1625 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155576.365468:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124671360:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155576.367634:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.368567:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.369193:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124671232:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155576.369210:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155576.369277:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976124671360:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155576.369293:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d15 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.369306:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090d06000, rc 0) 00000100:00100000:1.0:1746155576.369492:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976124003968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8329us (8452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.369521:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6395 00000100:00100000:3.0:1746155576.369613:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29471:x1830976124003840:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4251us (13359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.369619:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12599 00000100:00100000:0.0:1746155576.369723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.369872:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124004096 00000100:00100000:1.0:1746155576.369878:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124004096 00002000:00100000:1.0:1746155576.369904:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1130495) req@ffff88009fe91180 x1830976124004096/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.369913:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe91180 with x1830976124004096 ext(1048576->1130495) 00010000:00010000:1.0:1746155576.369918:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 24 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.369928:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 24 pid: 1625 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746155576.369934:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe91180 00000100:00100000:1.0:1746155576.369949:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124004352 00000100:00100000:1.0:1746155576.369951:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124004352 00002000:00100000:1.0:1746155576.369961:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009fe93b80 x1830976124004352/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.369966:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe93b80 with x1830976124004352 ext(1048576->2097151) 00002000:00010000:1.0:1746155576.369969:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe93b80 00000100:00100000:1.0:1746155576.369988:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 815 00000100:00100000:1.0:1746155576.369994:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976124004096:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155576.370112:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4945 00000100:00100000:1.0:1746155576.370117:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976124004352:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155576.377302:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976124004352:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7177us (7571us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155576.377306:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976124004096:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 7312us (8741us total) trans 17179873273 rc 0/0 00000100:00100000:0.0:1746155576.377313:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4945 00002000:00100000:0.0:1746155576.377322:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009fe93b80 x1830976124004352/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155576.377330:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe93b80 with x1830976124004352 ext(1048576->2097151) 00002000:00010000:0.0:1746155576.377335:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe93b80 00000100:00100000:2.0:1746155576.377547:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 815 00002000:00100000:2.0:1746155576.377553:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1130495) req@ffff88009fe91180 x1830976124004096/t17179873273(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/448 e 0 to 0 dl 1746155587 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.377560:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe91180 with x1830976124004096 ext(1048576->1130495) 00010000:00010000:2.0:1746155576.377567:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 26 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.377579:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 26 pid: 1625 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155576.377584:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fe91180 00000100:00100000:0.0:1746155576.383938:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.383996:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124004608 00000100:00100000:3.0:1746155576.384003:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124004608 00000100:00100000:3.0:1746155576.384047:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12600 00000100:00100000:3.0:1746155576.384054:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:29465:x1830976124004608:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155576.384071:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.384087:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d1c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.384111:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.384118:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155576.384119:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155576.384122:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d1c expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.384147:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.384157:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 11 pid: 1625 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155576.384166:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124671488:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155576.384241:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746155576.384337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.384634:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124004480 00000100:00100000:0.0:1746155576.384638:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124004480 00010000:00010000:0.0:1746155576.384653:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 26 pid: 1625 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.385016:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6396 00000100:00100000:0.0:1746155576.385022:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976124004480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.385029:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.385044:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 26 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.385053:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 26 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.385065:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c600/0x844e5faceb5ecfd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cf2 expref: 26 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.385088:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.385090:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.385094:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d15 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.385100:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d15 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.385116:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d15 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155576.385124:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124671616:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155576.385159:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.386997:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124671488:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155576.387016:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d1c expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.387028:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090d06400, rc 0) 00000100:00100000:0.0:1746155576.387066:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29465:x1830976124004608:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3011us (3134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.387072:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12600 00000100:00100000:2.0:1746155576.387804:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124671616:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155576.387815:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155576.387884:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976124004480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2861us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.387890:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6396 00000100:00100000:0.0:1746155576.389220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.389287:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124004736 00000100:00100000:2.0:1746155576.389292:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124004736 00002000:00100000:2.0:1746155576.389323:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1318911) req@ffff88009fe90e00 x1830976124004736/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.389337:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe90e00 with x1830976124004736 ext(1048576->1318911) 00010000:00010000:2.0:1746155576.389344:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 12 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.389354:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 12 pid: 1625 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155576.389360:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe90e00 00000100:00100000:2.0:1746155576.389374:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 816 00000100:00100000:2.0:1746155576.389380:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+12:1961:x1830976124004736:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155576.393206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.394723:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976124004736:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5340us (5502us total) trans 21474840666 rc 0/0 00000100:00100000:3.0:1746155576.394736:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 816 00002000:00100000:3.0:1746155576.394744:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1318911) req@ffff88009fe90e00 x1830976124004736/t21474840666(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/448 e 0 to 0 dl 1746155587 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.394753:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe90e00 with x1830976124004736 ext(1048576->1318911) 00010000:00010000:3.0:1746155576.394760:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 14 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.394773:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 14 pid: 1625 timeout: 805 lvb_type: 0 00002000:00010000:3.0:1746155576.394780:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fe90e00 00000100:00100000:3.0:1746155576.394795:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124004992 00000100:00100000:3.0:1746155576.394800:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124004992 00002000:00100000:3.0:1746155576.394819:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094f09c00 x1830976124004992/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.394826:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09c00 with x1830976124004992 ext(1048576->2097151) 00002000:00010000:3.0:1746155576.394828:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f09c00 00000100:00100000:3.0:1746155576.394839:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4946 00000100:00100000:3.0:1746155576.394844:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976124004992:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155576.401426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.401534:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124005120 00000100:00100000:2.0:1746155576.401541:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124005120 00010000:00010000:2.0:1746155576.401572:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 14 pid: 1625 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.401597:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6397 00000100:00100000:2.0:1746155576.401604:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976124005120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155576.401615:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746155576.401630:0:7062:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155575 -> 1746155576 00002000:00010000:2.0:1746155576.401632:0:7062:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155575 -> 1746155576 00010000:00010000:2.0:1746155576.401637:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 14 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.401648:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 14 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.401667:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c052400/0x844e5faceb5ecfb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cd6 expref: 14 pid: 1625 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.401694:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.401696:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.401701:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d1c expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.401708:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d1c expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.401734:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d1c expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155576.401744:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124671744:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155576.401802:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.407106:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.407194:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124671744:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155576.407209:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155576.407243:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+13:1961:x1830976124005120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5639us (5824us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.407251:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6397 00000100:00100000:1.0:1746155576.407402:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124005376 00000100:00100000:1.0:1746155576.407407:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124005376 00002000:00100000:1.0:1746155576.407437:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009fe90380 x1830976124005376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.407450:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe90380 with x1830976124005376 ext(1048576->2097151) 00002000:00010000:1.0:1746155576.407453:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe90380 00000100:00100000:1.0:1746155576.407467:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4947 00000100:00100000:1.0:1746155576.407473:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976124005376:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155576.408399:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976124004992:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13553us (15198us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155576.408406:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4946 00002000:00100000:3.0:1746155576.408412:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094f09c00 x1830976124004992/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.408424:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f09c00 with x1830976124004992 ext(1048576->2097151) 00002000:00010000:3.0:1746155576.408427:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094f09c00 00000100:00100000:0.0:1746155576.419055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.419133:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124005504 00000100:00100000:2.0:1746155576.419141:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124005504 00000100:00100000:2.0:1746155576.419181:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12601 00000100:00100000:2.0:1746155576.419188:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29471:x1830976124005504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155576.419204:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.419216:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ed001 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d23 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.419235:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.419236:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.419242:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ed001 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d23 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.419255:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ed001 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d23 expref: 16 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.419263:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6000, rc 0) 00000100:00100000:2.0:1746155576.419305:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29471:x1830976124005504:12345-192.168.202.51@tcp:101:cat.0 Request processed in 118us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.419310:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12601 00000100:00100000:1.0:1746155576.426071:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976124005376:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 18589us (18962us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155576.426081:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4947 00002000:00100000:1.0:1746155576.426090:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009fe90380 x1830976124005376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.426099:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe90380 with x1830976124005376 ext(1048576->2097151) 00002000:00010000:1.0:1746155576.426104:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe90380 00000100:00100000:0.0:1746155576.426753:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.427475:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124005760 00000100:00100000:1.0:1746155576.427481:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124005760 00002000:00100000:1.0:1746155576.427766:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88013089b480 x1830976124005760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.427773:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089b480 with x1830976124005760 ext(1048576->2097151) 00002000:00010000:1.0:1746155576.427777:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013089b480 00000100:00100000:1.0:1746155576.427805:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4948 00000100:00100000:1.0:1746155576.427812:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976124005760:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155576.438051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.438159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.438176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.438194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.438208:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124006272 00000100:00100000:2.0:1746155576.438214:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124006272 00002000:00100000:2.0:1746155576.438244:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880130899f80 x1830976124006272/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.438254:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899f80 with x1830976124006272 ext(3145728->4194303) 00002000:00010000:2.0:1746155576.438259:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899f80 00000100:00100000:2.0:1746155576.438271:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124006144 00000100:00100000:2.0:1746155576.438273:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124006144 00002000:00100000:2.0:1746155576.438284:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a0ac7800 x1830976124006144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.438290:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac7800 with x1830976124006144 ext(2097152->3145727) 00002000:00010000:2.0:1746155576.438293:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac7800 00000100:00100000:2.0:1746155576.438300:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124006528 00000100:00100000:2.0:1746155576.438302:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124006528 00002000:00100000:2.0:1746155576.438310:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a0ac7b80 x1830976124006528/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.438316:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac7b80 with x1830976124006528 ext(2097152->3145727) 00002000:00010000:2.0:1746155576.438318:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac7b80 00000100:00100000:2.0:1746155576.438325:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124006656 00000100:00100000:2.0:1746155576.438326:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124006656 00002000:00100000:2.0:1746155576.438335:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800a0ac5f80 x1830976124006656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.438340:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac5f80 with x1830976124006656 ext(3145728->4194303) 00002000:00010000:2.0:1746155576.438342:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac5f80 00000100:00100000:2.0:1746155576.438352:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4949 00000100:00100000:2.0:1746155576.438358:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976124006272:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155576.439364:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4950 00000100:00100000:2.0:1746155576.439371:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976124006144:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155576.439922:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4951 00000100:00100000:3.0:1746155576.439931:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976124006528:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155576.440438:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4952 00000100:00100000:2.0:1746155576.440444:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976124006656:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155576.452733:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976124005760:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24911us (25970us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155576.452746:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4948 00002000:00100000:1.0:1746155576.452759:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88013089b480 x1830976124005760/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.452768:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089b480 with x1830976124005760 ext(1048576->2097151) 00002000:00010000:1.0:1746155576.452773:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013089b480 00000100:00100000:3.0:1746155576.466128:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976124006272:12345-192.168.202.51@tcp:3:cat.0 Request processed in 27761us (28076us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155576.466140:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4949 00002000:00100000:3.0:1746155576.466151:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880130899f80 x1830976124006272/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.466163:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899f80 with x1830976124006272 ext(3145728->4194303) 00002000:00010000:3.0:1746155576.466168:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899f80 00000100:00100000:0.0:1746155576.468631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.470564:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124006912 00000100:00100000:1.0:1746155576.470573:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124006912 00000100:00100000:1.0:1746155576.470619:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12602 00000100:00100000:1.0:1746155576.470626:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29471:x1830976124006912:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155576.470643:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155576.470657:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ed008 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d2a expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.470679:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.470680:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.470686:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ed008 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d2a expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.470698:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ed008 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d2a expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.470706:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9a00, rc 0) 00000100:00100000:1.0:1746155576.470761:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29471:x1830976124006912:12345-192.168.202.51@tcp:101:cat.0 Request processed in 135us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.470767:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12602 00000100:00100000:2.0:1746155576.471863:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976124006144:12345-192.168.202.51@tcp:3:cat.0 Request processed in 32491us (33703us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155576.471874:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4950 00002000:00100000:2.0:1746155576.471882:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800a0ac7800 x1830976124006144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.471890:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac7800 with x1830976124006144 ext(2097152->3145727) 00002000:00010000:2.0:1746155576.471895:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac7800 00000100:00100000:0.0:1746155576.480609:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.480682:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124007168 00000100:00100000:2.0:1746155576.480689:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124007168 00002000:00100000:2.0:1746155576.480721:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880130898e00 x1830976124007168/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.480731:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898e00 with x1830976124007168 ext(1048576->2097151) 00002000:00010000:2.0:1746155576.480735:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130898e00 00000100:00100000:2.0:1746155576.480753:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4953 00000100:00100000:2.0:1746155576.480759:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976124007168:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155576.480865:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976124006528:12345-192.168.202.51@tcp:3:cat.0 Request processed in 40931us (42682us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155576.480874:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4951 00002000:00100000:3.0:1746155576.480882:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800a0ac7b80 x1830976124006528/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.480890:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac7b80 with x1830976124006528 ext(2097152->3145727) 00002000:00010000:3.0:1746155576.480894:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac7b80 00000100:00100000:2.0:1746155576.491372:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976124006656:12345-192.168.202.51@tcp:3:cat.0 Request processed in 50917us (53165us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155576.491384:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4952 00002000:00100000:2.0:1746155576.491396:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800a0ac5f80 x1830976124006656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.491405:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac5f80 with x1830976124006656 ext(3145728->4194303) 00002000:00010000:2.0:1746155576.491410:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac5f80 00000100:00100000:2.0:1746155576.492277:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976124007168:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11515us (11673us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155576.492283:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4953 00002000:00100000:2.0:1746155576.492290:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880130898e00 x1830976124007168/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.492296:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898e00 with x1830976124007168 ext(1048576->2097151) 00002000:00010000:2.0:1746155576.492299:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130898e00 00000100:00100000:0.0:1746155576.506899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.506947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.507019:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124007296 00000100:00100000:1.0:1746155576.507027:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124007296 00000100:00100000:1.0:1746155576.507069:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124007424 00000100:00100000:1.0:1746155576.507072:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124007424 00000100:00100000:1.0:1746155576.507099:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12603 00000100:00100000:1.0:1746155576.507106:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976124007296:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155576.507121:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155576.507134:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0x844e5faceb5ed00f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d31 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.507154:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.507155:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.507163:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0x844e5faceb5ed00f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d31 expref: 21 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.507175:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0x844e5faceb5ed00f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d31 expref: 21 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.507183:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9000, rc 0) 00000100:00100000:1.0:1746155576.507217:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976124007296:12345-192.168.202.51@tcp:101:cat.0 Request processed in 112us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.507222:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12603 00000100:00100000:1.0:1746155576.507240:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12604 00000100:00100000:1.0:1746155576.507244:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976124007424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155576.507249:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155576.507256:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe8800/0x844e5faceb5ed016 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d38 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.507264:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.507265:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.507268:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8800/0x844e5faceb5ed016 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d38 expref: 26 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.507277:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8800/0x844e5faceb5ed016 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d38 expref: 26 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.507282:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8800, rc 0) 00000100:00100000:1.0:1746155576.507292:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976124007424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 48us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.507295:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12604 00000100:00100000:2.0:1746155576.529702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.529742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.530872:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.531171:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124007552 00000100:00100000:0.0:1746155576.531180:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124007552 00000100:00100000:0.0:1746155576.531219:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12605 00000100:00100000:0.0:1746155576.531226:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29474:x1830976124007552:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155576.531242:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155576.531256:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d3f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.531282:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d0e expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.531290:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ed001 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d23 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.531296:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.531298:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.531301:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1548288->2097151] (req 1548288->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.531325:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ed001 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d23 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.531335:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ed001 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d23 expref: 17 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.531350:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124671872:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155576.531416:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d0e expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.531423:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d0e expref: 25 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.531431:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124672000:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155576.531447:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.531761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.531838:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124007808 00000100:00100000:3.0:1746155576.531842:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124007808 00002000:00100000:3.0:1746155576.531866:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800948e5f80 x1830976124007808/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.531879:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5f80 with x1830976124007808 ext(2097152->3145727) 00002000:00010000:3.0:1746155576.531883:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e5f80 00000100:00100000:3.0:1746155576.531899:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124008064 00000100:00100000:3.0:1746155576.531901:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124008064 00002000:00100000:3.0:1746155576.531914:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800948e5500 x1830976124008064/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.531919:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5500 with x1830976124008064 ext(2097152->3145727) 00002000:00010000:3.0:1746155576.531922:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e5500 00000100:00100000:3.0:1746155576.531932:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4954 00000100:00100000:3.0:1746155576.531937:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976124007808:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155576.533081:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4955 00000100:00100000:3.0:1746155576.533090:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976124008064:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155576.535456:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124671872:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155576.535490:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124672000:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155576.535536:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [1548288->2097151] (req 1548288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.535550:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1ce400, rc 0) 00000100:00100000:0.0:1746155576.535576:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29474:x1830976124007552:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4350us (5881us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.535582:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12605 00000100:00100000:0.0:1746155576.537342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.537366:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.537380:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124008576 00000100:00100000:0.0:1746155576.537386:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124008576 00010000:00010000:0.0:1746155576.537409:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d0e expref: 26 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.537426:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124008448 00000100:00100000:0.0:1746155576.537427:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124008448 00010000:00010000:0.0:1746155576.537589:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ed001 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d23 expref: 19 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.537609:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6398 00000100:00100000:0.0:1746155576.537615:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976124008576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.537623:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155576.537625:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6399 00000100:00100000:2.0:1746155576.537634:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976124008448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.537640:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d0e expref: 26 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.537641:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.537648:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d0e expref: 26 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.537905:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ed001 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d23 expref: 19 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.537916:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ed001 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d23 expref: 19 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.537934:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6000/0x844e5faceb5ed001 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d23 expref: 19 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.537951:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155576.537986:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124008448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 353us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.537991:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6399 00010000:00010000:0.0:1746155576.538143:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0106600/0x844e5faceb5ecfec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d0e expref: 26 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.538157:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.538159:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.538164:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.538171:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.538195:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155576.538205:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124672128:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155576.538245:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155576.538608:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124008320 00000100:00100000:1.0:1746155576.538613:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124008320 00002000:00100000:1.0:1746155576.538636:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009f881880 x1830976124008320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.538644:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881880 with x1830976124008320 ext(4194304->4956159) 00002000:00010000:1.0:1746155576.538648:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f881880 00000100:00100000:1.0:1746155576.538666:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4956 00000100:00100000:1.0:1746155576.538671:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976124008320:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155576.550090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.550279:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124008832 00000100:00100000:2.0:1746155576.550290:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124008832 00002000:00100000:2.0:1746155576.550325:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1548288->1552383) req@ffff880130899500 x1830976124008832/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.550333:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899500 with x1830976124008832 ext(1548288->1552383) 00002000:00010000:2.0:1746155576.550338:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899500 00000100:00100000:2.0:1746155576.550366:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4957 00000100:00100000:2.0:1746155576.550376:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124008832:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155576.550541:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124008832:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 165us (458us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155576.550547:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4957 00002000:00100000:2.0:1746155576.550552:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1548288->1552383) req@ffff880130899500 x1830976124008832/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/4536 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.550559:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899500 with x1830976124008832 ext(1548288->1552383) 00002000:00010000:2.0:1746155576.550566:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899500 00000100:00100000:1.0:1746155576.551478:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124672128:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155576.551519:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.551556:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976124008576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 13940us (14217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.551563:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6398 00000100:00100000:3.0:1746155576.555746:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1961:x1830976124007808:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 23800us (25996us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155576.555758:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4954 00002000:00100000:3.0:1746155576.555769:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff8800948e5f80 x1830976124007808/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.555778:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5f80 with x1830976124007808 ext(2097152->3145727) 00002000:00010000:3.0:1746155576.555783:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800948e5f80 00000100:00100000:3.0:1746155576.566552:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976124008064:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 33455us (35673us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155576.566563:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4955 00002000:00100000:3.0:1746155576.566573:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff8800948e5500 x1830976124008064/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.568355:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800948e5500 with x1830976124008064 ext(2097152->3145727) 00002000:00010000:3.0:1746155576.568360:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800948e5500 00000100:00100000:1.0:1746155576.568646:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976124008320:12345-192.168.202.51@tcp:3:cat.0 Request processed in 29972us (36882us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155576.568654:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4956 00002000:00100000:1.0:1746155576.568661:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009f881880 x1830976124008320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/440 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.568668:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881880 with x1830976124008320 ext(4194304->4956159) 00002000:00010000:1.0:1746155576.568671:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f881880 00000100:00100000:0.0:1746155576.579885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.580309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.580382:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124008960 00000100:00100000:2.0:1746155576.580391:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124008960 00000100:00100000:2.0:1746155576.580436:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124009088 00000100:00100000:2.0:1746155576.580439:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124009088 00000100:00100000:2.0:1746155576.580461:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12606 00000100:00100000:2.0:1746155576.580467:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976124008960:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155576.580483:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.580523:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5ed024 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d46 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155576.580565:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124672256:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155576.580636:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.580739:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12607 00000100:00100000:0.0:1746155576.580746:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29474:x1830976124009088:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155576.580754:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155576.580762:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d4d expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.580779:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d1c expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.580787:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ed008 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d2a expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.580793:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.580795:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.580798:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.580814:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ed008 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d2a expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.580827:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ed008 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d2a expref: 15 pid: 10591 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.580835:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124672384:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155576.580873:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d1c expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.580881:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d1c expref: 20 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.580888:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124672512:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155576.580903:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825840 going to sleep for 11 seconds 00002000:00010000:2.0:1746155576.583969:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime: 1746155576 -> 1746155577 00002000:00010000:2.0:1746155576.583975:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime: 1746155576 -> 1746155577 00002000:00010000:2.0:1746155576.583977:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime: 1746155576 -> 1746155577 00000100:00100000:2.0:1746155576.583998:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124672256:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155576.584023:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5ed024 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d46 expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.584033:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a236c00/0x844e5faceb5ed024 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d46 expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.584082:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a236c00, rc 0) 00000100:00100000:2.0:1746155576.584264:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976124008960:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3794us (4384us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155576.584271:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12606 00000100:00100000:0.0:1746155576.590885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.590926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.590948:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124009216 00000100:00100000:0.0:1746155576.590954:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124009216 00010000:00010000:0.0:1746155576.590981:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ed008 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d2a expref: 16 pid: 10591 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.591014:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124009344 00000100:00100000:0.0:1746155576.591016:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124009344 00010000:00010000:0.0:1746155576.591026:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d1c expref: 21 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.591040:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6400 00000100:00100000:0.0:1746155576.591046:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976124009216:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.591058:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.591075:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ed008 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d2a expref: 16 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.591084:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ed008 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d2a expref: 16 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.591103:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155576.591134:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976124009216:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.591139:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6400 00000100:00100000:0.0:1746155576.591175:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6401 00000100:00100000:0.0:1746155576.591180:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976124009344:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.591185:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.591192:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d1c expref: 21 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.591200:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d1c expref: 21 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.591211:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.591213:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.591218:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.591224:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.591251:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155576.591261:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124672640:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155576.591307:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825540 going to sleep for 11 seconds 00010000:00010000:2.0:1746155576.591691:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9a00/0x844e5faceb5ed008 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d2a expref: 15 pid: 10591 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.591721:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124672384:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.591730:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090d06400/0x844e5faceb5ecffa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d1c expref: 21 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.591737:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124672512:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.591756:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.591768:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1cea00, rc 0) 00000100:00100000:2.0:1746155576.593628:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29474:x1830976124009088:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 12876us (13312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.593637:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12607 00000100:00100000:0.0:1746155576.595235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.595451:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124009472 00000100:00100000:2.0:1746155576.595459:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124009472 00000100:00100000:2.0:1746155576.595491:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12608 00000100:00100000:2.0:1746155576.595525:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976124009472:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155576.595540:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.595555:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a236800/0x844e5faceb5ed032 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d54 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155576.595598:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124672768:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155576.595655:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155576.597339:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.597741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.598091:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124009600 00000100:00100000:3.0:1746155576.598097:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124009600 00000100:00100000:0.0:1746155576.599150:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124672640:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155576.599166:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155576.599205:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976124009344:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8023us (8278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.599213:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6401 00000100:00100000:3.0:1746155576.599990:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124009728 00000100:00100000:3.0:1746155576.599995:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124009728 00000100:00100000:2.0:1746155576.600075:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12609 00000100:00100000:0.0:1746155576.600076:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.600084:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976124009600:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155576.600100:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.600113:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a237600/0x844e5faceb5ed039 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d5b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155576.600153:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124672896:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155576.600209:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.600247:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124672768:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155576.600264:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a236800/0x844e5faceb5ed032 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d54 expref: 26 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.600274:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a236800/0x844e5faceb5ed032 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d54 expref: 26 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.600290:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a236800, rc 0) 00000100:00100000:2.0:1746155576.600308:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976124009472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4811us (5077us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155576.600313:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12608 00000100:00100000:2.0:1746155576.600326:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12610 00000100:00100000:2.0:1746155576.600330:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29476:x1830976124009728:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155576.600336:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.600341:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d62 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.600354:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.600360:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155576.600362:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155576.600365:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1343488->1654783] (req 1343488->1654783) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.600378:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.600392:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 13 pid: 10591 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.600400:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124673024:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155576.600418:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.600429:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124009984 00000100:00100000:2.0:1746155576.600432:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124009984 00002000:00100000:2.0:1746155576.600452:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1114112->1118207) req@ffff880130899180 x1830976124009984/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.600461:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899180 with x1830976124009984 ext(1114112->1118207) 00010000:00010000:2.0:1746155576.600466:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 14 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.600474:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 14 pid: 10591 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155576.600480:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130899180 00000100:00100000:2.0:1746155576.600491:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 817 00000100:00100000:2.0:1746155576.600520:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976124009984:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155576.600627:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976124009984:12345-192.168.202.51@tcp:3:cat.0 Request processed in 130us (558us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155576.600632:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 817 00002000:00100000:2.0:1746155576.600636:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1114112->1118207) req@ffff880130899180 x1830976124009984/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/4536 e 0 to 0 dl 1746155587 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.600647:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899180 with x1830976124009984 ext(1114112->1118207) 00010000:00010000:2.0:1746155576.600651:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 14 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.600660:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 14 pid: 10591 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155576.600665:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130899180 00002000:00010000:2.0:1746155576.602647:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime: 1746155576 -> 1746155577 00002000:00010000:2.0:1746155576.602653:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime: 1746155574 -> 1746155577 00002000:00010000:2.0:1746155576.602655:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime: 1746155576 -> 1746155577 00000100:00100000:2.0:1746155576.602671:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124672896:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155576.602692:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a237600/0x844e5faceb5ed039 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d5b expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.602704:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a237600/0x844e5faceb5ed039 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d5b expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.602713:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237600, rc 0) 00000100:00100000:2.0:1746155576.602743:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976124009600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2660us (5406us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155576.602750:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12609 00000100:00100000:2.0:1746155576.606229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.606315:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976124673024:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155576.606325:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124010112 00000100:00100000:1.0:1746155576.606331:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124010112 00010000:00010000:0.0:1746155576.606339:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1343488->1654783] (req 1343488->1654783) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.606358:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237a00, rc 0) 00002000:00100000:1.0:1746155576.606364:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1118207) req@ffff88009f880e00 x1830976124010112/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.606373:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f880e00 with x1830976124010112 ext(1048576->1118207) 00010000:00010000:1.0:1746155576.606378:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 14 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.606389:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 14 pid: 10591 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746155576.606395:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f880e00 00000100:00100000:0.0:1746155576.606403:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29476:x1830976124009728:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6072us (8663us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.606410:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12610 00000100:00100000:1.0:1746155576.606422:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 818 00000100:00100000:1.0:1746155576.606428:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1962:x1830976124010112:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155576.612997:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976124010112:12345-192.168.202.51@tcp:4:cat.0 Request processed in 6558us (6765us total) trans 21474840667 rc 0/0 00000100:00100000:2.0:1746155576.613012:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 818 00002000:00100000:2.0:1746155576.613022:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->1118207) req@ffff88009f880e00 x1830976124010112/t21474840667(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/448 e 0 to 0 dl 1746155587 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.613031:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f880e00 with x1830976124010112 ext(1048576->1118207) 00010000:00010000:2.0:1746155576.613039:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 16 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.613054:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 16 pid: 10591 timeout: 805 lvb_type: 0 00002000:00010000:2.0:1746155576.613060:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f880e00 00000100:00100000:0.0:1746155576.614756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.614846:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124010240 00000100:00100000:2.0:1746155576.614853:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124010240 00010000:00010000:2.0:1746155576.614878:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 16 pid: 10591 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.614913:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6402 00000100:00100000:2.0:1746155576.614919:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976124010240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155576.614930:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155576.614947:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 16 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.614957:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 16 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.614978:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1cea00/0x844e5faceb5ed02b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d4d expref: 16 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.616946:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.616951:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.616962:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.616972:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.617007:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155576.617020:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124673152:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155576.617981:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.626278:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124673152:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155576.626297:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155576.626336:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976124010240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 11415us (11583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.626345:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6402 00000100:00100000:0.0:1746155576.630256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.630377:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124010496 00000100:00100000:2.0:1746155576.630384:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124010496 00002000:00100000:2.0:1746155576.630417:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1343488->1347583) req@ffff88013089ad80 x1830976124010496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.630431:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089ad80 with x1830976124010496 ext(1343488->1347583) 00002000:00010000:2.0:1746155576.630435:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089ad80 00000100:00100000:2.0:1746155576.630459:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4958 00000100:00100000:2.0:1746155576.630465:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976124010496:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155576.630636:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976124010496:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 170us (385us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155576.630641:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4958 00002000:00100000:2.0:1746155576.630646:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1343488->1347583) req@ffff88013089ad80 x1830976124010496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/4536 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155576.630652:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089ad80 with x1830976124010496 ext(1343488->1347583) 00002000:00010000:2.0:1746155576.630655:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089ad80 00000100:00100000:0.0:1746155576.635902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.635983:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124010752 00000100:00100000:3.0:1746155576.635991:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124010752 00002000:00100000:3.0:1746155576.636030:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1650688->1654783) req@ffff88009fe93480 x1830976124010752/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.636039:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe93480 with x1830976124010752 ext(1650688->1654783) 00002000:00010000:3.0:1746155576.636044:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe93480 00000100:00100000:3.0:1746155576.636075:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4959 00000100:00100000:3.0:1746155576.636082:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976124010752:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155576.636230:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976124010752:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 148us (334us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155576.636236:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4959 00002000:00100000:3.0:1746155576.636240:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1650688->1654783) req@ffff88009fe93480 x1830976124010752/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/4536 e 0 to 0 dl 1746155587 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155576.636247:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe93480 with x1830976124010752 ext(1650688->1654783) 00002000:00010000:3.0:1746155576.636249:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe93480 00000100:00100000:0.0:1746155576.651429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.651540:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124010880 00000100:00100000:3.0:1746155576.651549:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124010880 00000100:00100000:3.0:1746155576.651587:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10126 00000100:00100000:3.0:1746155576.651594:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:29481:x1830976124010880:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155576.651615:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.651630:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad400/0x844e5faceb5ed047 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d69 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.651675:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed04e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.651685:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed04e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.651693:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed04e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.651703:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac000/0x844e5faceb5ed055 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.651707:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac000/0x844e5faceb5ed055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.651712:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac000/0x844e5faceb5ed055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.651915:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.651924:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b86 expref: 35 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.651930:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1c00/0x844e5faceb5ece79 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ba2 expref: 311 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.651939:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 5/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.651962:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1c00/0x844e5faceb5ece79 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ba2 expref: 311 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.651972:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1c00/0x844e5faceb5ece79 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ba2 expref: 311 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155576.651982:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124673280:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155576.652066:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b86 expref: 35 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.652074:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b86 expref: 35 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155576.652081:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124673408:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155576.652096:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155576.655134:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124673280:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155576.655145:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124673408:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155576.655165:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155576.656233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.656270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.656342:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124011136 00000100:00100000:2.0:1746155576.656347:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124011136 00000100:00100000:2.0:1746155576.656382:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124011392 00000100:00100000:2.0:1746155576.656384:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124011392 00000100:00100000:2.0:1746155576.656408:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4118 00000100:00100000:2.0:1746155576.656414:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a651450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:23568:x1830976124011136:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746155576.656650:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a651450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+313:23568:x1830976124011136:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 235us (418us total) trans 8589944106 rc 0/0 00000100:00100000:2.0:1746155576.656656:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4118 00000100:00100000:2.0:1746155576.656705:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4119 00000100:00100000:2.0:1746155576.656711:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+36:7660:x1830976124011392:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746155576.656776:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+37:7660:x1830976124011392:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 64us (505us total) trans 8589944107 rc 0/0 00000100:00100000:2.0:1746155576.656782:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4119 00000100:00080000:0.0:1746155576.657113:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155576.660162:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.660204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.660271:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124011648 00000100:00100000:2.0:1746155576.660280:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124011648 00010000:00010000:2.0:1746155576.660309:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b86 expref: 37 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155576.661989:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124011520 00000100:00100000:3.0:1746155576.661995:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124011520 00010000:00010000:3.0:1746155576.662015:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1c00/0x844e5faceb5ece79 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ba2 expref: 313 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155576.662041:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6403 00000100:00100000:3.0:1746155576.662049:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+37:1960:x1830976124011648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155576.662060:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155576.662065:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b86 expref: 37 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.662075:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b86 expref: 37 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.662091:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6a00/0x844e5faceb5ece4f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11b86 expref: 37 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.662107:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155576.662111:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.662118:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.662123:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.662127:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155576.662171:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1960:x1830976124011648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 122us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.662177:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6403 00000100:00100000:3.0:1746155576.662191:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6404 00000100:00100000:3.0:1746155576.662195:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+313:1960:x1830976124011520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155576.662202:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155576.662205:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1c00/0x844e5faceb5ece79 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ba2 expref: 313 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.662212:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1c00/0x844e5faceb5ece79 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ba2 expref: 313 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.662221:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1c00/0x844e5faceb5ece79 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ba2 expref: 313 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.662228:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155576.662231:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.662237:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.662242:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.662259:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155576.662318:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662325:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155576.662360:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:0.0:1746155576.662364:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155576.662376:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662385:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662392:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed04e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662397:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed04e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662402:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed04e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662407:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cbad600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155576.662410:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed04e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662416:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed04e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662424:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155576.662427:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155576.662429:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed04e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662433:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed04e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662445:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac000/0x844e5faceb5ed055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662448:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac000/0x844e5faceb5ed055 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662453:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac000/0x844e5faceb5ed055 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662456:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cbac000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155576.662458:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac000/0x844e5faceb5ed055 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662462:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac000/0x844e5faceb5ed055 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662466:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800942dc900) 00010000:00010000:0.0:1746155576.662468:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155576.662469:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac000/0x844e5faceb5ed055 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662473:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac000/0x844e5faceb5ed055 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155576.662516:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad400/0x844e5faceb5ed047 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d69 expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.662526:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d69 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.662532:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155576.662533:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155576.662535:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbac200, rc 0) 00000100:00100000:0.0:1746155576.662555:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:29481:x1830976124010880:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 10962us (11134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.662570:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10126 00000100:00100000:3.0:1746155576.663804:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1960:x1830976124011520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1605us (3597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.663811:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6404 00000100:00100000:0.0:1746155576.665560:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.665971:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.665996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.666348:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.667055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.667070:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124011776 00000100:00100000:3.0:1746155576.667076:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124011776 00000100:00100000:3.0:1746155576.667117:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124011904 00000100:00100000:3.0:1746155576.667119:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124011904 00000100:00100000:3.0:1746155576.667129:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124012032 00000100:00100000:3.0:1746155576.667131:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124012032 00000100:00100000:3.0:1746155576.667138:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124012160 00000100:00100000:3.0:1746155576.667140:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124012160 00000100:00100000:3.0:1746155576.667149:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12611 00000100:00100000:3.0:1746155576.667155:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976124011776:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155576.667169:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.667182:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cbaca00/0x844e5faceb5ed063 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d70 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.667201:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.667203:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.667209:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbaca00/0x844e5faceb5ed063 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d70 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.667221:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cbaca00/0x844e5faceb5ed063 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d70 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.667229:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbaca00, rc 0) 00000100:00100000:3.0:1746155576.667262:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976124011776:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 107us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.667266:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12611 00000100:00100000:3.0:1746155576.667401:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12612 00000100:00100000:3.0:1746155576.667405:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976124011904:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155576.667411:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.667419:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5ed06a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d77 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.667427:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.667428:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.667432:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5ed06a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d77 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.667440:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5ed06a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d77 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.667445:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbac800, rc 0) 00000100:00100000:3.0:1746155576.667457:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976124011904:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 52us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.667461:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12612 00000100:00100000:3.0:1746155576.667469:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12613 00000100:00100000:3.0:1746155576.667473:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976124012032:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155576.667477:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.667481:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cbade00/0x844e5faceb5ed071 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d7e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155576.667529:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124673536:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155576.667566:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155576.667583:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12614 00000100:00100000:3.0:1746155576.667589:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976124012160:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155576.667594:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.667601:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c88800/0x844e5faceb5ed078 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d85 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155576.667620:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124673664:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155576.667638:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e480 going to sleep for 11 seconds 00000100:00080000:2.0:1746155576.668004:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746155576.668007:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746155576.668331:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124012288 00000100:00100000:1.0:1746155576.668335:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124012288 00000100:00100000:1.0:1746155576.668361:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12615 00000100:00100000:1.0:1746155576.668366:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976124012288:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155576.668372:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155576.668378:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5ed07f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d8c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.668391:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.668393:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.668397:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5ed07f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d8c expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.668405:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5ed07f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d8c expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.668411:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9c00, rc 0) 00000100:00100000:1.0:1746155576.668426:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976124012288:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 61us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.668431:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12615 00000100:00100000:2.0:1746155576.671189:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.671335:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124673664:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155576.671357:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c88800/0x844e5faceb5ed078 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d85 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.671369:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c88800/0x844e5faceb5ed078 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d85 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.671378:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c88800, rc 0) 00000100:00100000:3.0:1746155576.671419:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976124012160:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3829us (5070us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155576.671425:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12614 00000100:00100000:3.0:1746155576.671444:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124012416 00000100:00100000:3.0:1746155576.671448:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124012416 00000100:00100000:3.0:1746155576.671467:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12616 00000100:00100000:3.0:1746155576.671473:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976124012416:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155576.671482:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.671493:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ed086 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d93 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.671535:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.671537:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.671543:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ed086 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d93 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.671554:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ed086 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d93 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.671566:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc8600, rc 0) 00000100:00100000:3.0:1746155576.671580:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976124012416:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 107us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.671585:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12616 00000100:00100000:3.0:1746155576.671617:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976124673536:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155576.671630:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cbade00/0x844e5faceb5ed071 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d7e expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.671637:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cbade00/0x844e5faceb5ed071 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d7e expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.671643:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbade00, rc 0) 00000100:00100000:3.0:1746155576.671659:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976124012032:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4186us (5663us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155576.671664:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12613 00000100:00100000:0.0:1746155576.676323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.676449:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124012672 00000100:00100000:2.0:1746155576.676457:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124012672 00000100:00100000:2.0:1746155576.676528:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10127 00000100:00100000:2.0:1746155576.676537:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:29481:x1830976124012672:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155576.676553:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.676568:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237800/0x844e5faceb5ed08d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11d9a expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.677711:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155576.677726:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d69 expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.677732:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155576.677759:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d69 expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.677773:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d69 expref: 18 pid: 27374 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.677784:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124673792:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155576.677853:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.679554:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124673792:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.679572:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155576.680919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.681065:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124012800 00000100:00100000:1.0:1746155576.681071:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124012800 00010000:00010000:1.0:1746155576.681097:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d69 expref: 19 pid: 27374 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.681131:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6405 00000100:00100000:1.0:1746155576.681138:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+19:1961:x1830976124012800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.681148:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.681153:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d69 expref: 19 pid: 27374 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.681162:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d69 expref: 19 pid: 27374 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.681181:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed05c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d69 expref: 19 pid: 27374 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.681196:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155576.681199:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155576.681207:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155576.681212:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155576.681226:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.681256:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1961:x1830976124012800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 118us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.681261:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6405 00010000:00010000:2.0:1746155576.681679:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155576.681685:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155576.681700:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155576.681811:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237800/0x844e5faceb5ed08d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d9a expref: 19 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.681838:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d9a expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.681843:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155576.681845:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155576.681847:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237000, rc 0) 00000100:00100000:2.0:1746155576.681870:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:29481:x1830976124012672:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5335us (5556us total) trans 8589944108 rc 0/0 00000100:00100000:2.0:1746155576.681879:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10127 00000100:00100000:0.0:1746155576.684377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.684773:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124012928 00000100:00100000:2.0:1746155576.684780:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124012928 00000100:00100000:2.0:1746155576.684812:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10128 00000100:00100000:2.0:1746155576.684819:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:29481:x1830976124012928:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155576.684838:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.684851:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5ed0a2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11da1 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.684910:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed0a9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155576.684921:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d9a expref: 19 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.684927:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed0a9 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155576.684948:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d9a expref: 19 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.684958:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d9a expref: 19 pid: 27374 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.684967:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124673920:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155576.686792:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.689041:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124673920:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.689062:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed0a9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155576.689116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.689711:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124013056 00000100:00100000:3.0:1746155576.689716:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124013056 00010000:00010000:3.0:1746155576.689738:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d9a expref: 20 pid: 27374 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155576.689764:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6406 00000100:00100000:3.0:1746155576.689770:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:1961:x1830976124013056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155576.689780:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155576.689784:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d9a expref: 20 pid: 27374 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.689794:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d9a expref: 20 pid: 27374 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.689810:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237000/0x844e5faceb5ed094 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d9a expref: 20 pid: 27374 timeout: 805 lvb_type: 0 00010000:00010000:3.0:1746155576.689827:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155576.689830:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed0a9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.689837:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.689842:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed0a9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155576.689861:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155576.689944:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155576.689949:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155576.689981:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155576.689984:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155576.689994:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155576.690018:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236400/0x844e5faceb5ed0a2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11da1 expref: 20 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.690028:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11da1 expref: 19 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.690033:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155576.690035:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155576.690037:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237400, rc 0) 00000100:00100000:3.0:1746155576.691149:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+19:1961:x1830976124013056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1377us (2032us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.691157:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6406 00000100:00100000:2.0:1746155576.691296:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:29481:x1830976124012928:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 6477us (6925us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.691302:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10128 00000100:00100000:0.0:1746155576.695568:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.695607:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.695671:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124013184 00000100:00100000:2.0:1746155576.695679:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124013184 00000100:00100000:2.0:1746155576.695711:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124013312 00000100:00100000:2.0:1746155576.695713:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124013312 00000100:00100000:2.0:1746155576.695727:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12617 00000100:00100000:2.0:1746155576.695734:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976124013184:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155576.695751:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.695766:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a237600/0x844e5faceb5ed0b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11da8 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155576.695811:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124674048:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155576.695883:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155576.695946:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12618 00000100:00100000:3.0:1746155576.695953:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976124013312:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155576.695961:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.695970:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8400/0x844e5faceb5ed0b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11daf expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155576.695992:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124674176:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155576.696031:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.698164:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124674048:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155576.698189:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a237600/0x844e5faceb5ed0b0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11da8 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.698200:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a237600/0x844e5faceb5ed0b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11da8 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.698213:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237600, rc 0) 00000100:00100000:2.0:1746155576.698259:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976124013184:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2524us (2696us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155576.698266:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12617 00000100:00100000:3.0:1746155576.700770:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124674176:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155576.700793:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8400/0x844e5faceb5ed0b7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11daf expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.700802:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8400/0x844e5faceb5ed0b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11daf expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.700821:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc8400, rc 0) 00000100:00100000:3.0:1746155576.700876:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976124013312:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4923us (5267us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155576.700882:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12618 00000100:00100000:1.0:1746155576.702659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.702776:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124013568 00000100:00100000:2.0:1746155576.702782:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124013568 00000100:00100000:2.0:1746155576.703201:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10129 00000100:00100000:2.0:1746155576.703209:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:29481:x1830976124013568:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155576.703225:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.703239:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5ed0be lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11db6 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.703313:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237c00/0x844e5faceb5ed0c5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155576.703325:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237c00/0x844e5faceb5ed0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155576.703334:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237c00/0x844e5faceb5ed0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155576.703345:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155576.703435:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a236200/0x844e5faceb5ed0be lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11db6 expref: 21 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.703464:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237c00/0x844e5faceb5ed0c5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11db6 expref: 20 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.703471:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155576.703473:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155576.703475:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237c00, rc 0) 00000100:00100000:2.0:1746155576.704360:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:29481:x1830976124013568:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1149us (1703us total) trans 8589944109 rc 0/0 00000100:00100000:2.0:1746155576.704367:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10129 00000100:00100000:0.0:1746155576.707373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.707406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.707430:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.707633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.707836:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.707851:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124013696 00000100:00100000:2.0:1746155576.707859:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124013696 00000100:00100000:2.0:1746155576.707889:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124013952 00000100:00100000:2.0:1746155576.707891:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124013952 00000100:00100000:2.0:1746155576.707900:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124014208 00000100:00100000:2.0:1746155576.707901:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124014208 00000100:00100000:2.0:1746155576.707911:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124013824 00000100:00100000:2.0:1746155576.707912:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124013824 00000100:00100000:2.0:1746155576.707924:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12619 00000100:00100000:2.0:1746155576.707931:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976124013696:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155576.707969:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.707983:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d07 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.707990:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cbaca00/0x844e5faceb5ed063 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d70 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.707997:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0x844e5faceb5ed00f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d31 expref: 20 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.708003:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.708005:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.708007:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708031:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0x844e5faceb5ed00f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d31 expref: 20 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.708042:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0x844e5faceb5ed00f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d31 expref: 20 pid: 10591 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746155576.708053:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124674304:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.708117:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cbaca00/0x844e5faceb5ed063 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d70 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.708131:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cbaca00/0x844e5faceb5ed063 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d70 expref: 9 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746155576.708138:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124674432:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.708162:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d07 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708169:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d07 expref: 14 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.708176:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124674560:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155576.708191:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.708210:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12620 00000100:00100000:2.0:1746155576.708215:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976124013952:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155576.708233:0:20796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708243:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708248:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155576.708249:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155576.708250:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708267:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708275:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 15 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.708283:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124674688:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155576.708301:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.708316:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12621 00000100:00100000:2.0:1746155576.708321:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976124014208:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155576.708336:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708343:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c97 expref: 14 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708349:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5ed07f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d8c expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.708356:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800939e3600/0x844e5faceb5ecfa6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cc8 expref: 20 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.708361:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.708362:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.708363:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708377:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800939e3600/0x844e5faceb5ecfa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cc8 expref: 20 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.708384:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800939e3600/0x844e5faceb5ecfa6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cc8 expref: 20 pid: 4461 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746155576.708390:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124674816:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.708412:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5ed07f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d8c expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.708419:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5ed07f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d8c expref: 9 pid: 8436 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746155576.708425:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124674944:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.708443:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c97 expref: 14 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708449:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c97 expref: 14 pid: 18270 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.708455:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124675072:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155576.708466:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9a780 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.708479:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12622 00000100:00100000:2.0:1746155576.708484:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976124013824:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155576.708523:0:10591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708532:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d15 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708538:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5ed06a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d77 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.708544:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8800/0x844e5faceb5ed016 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d38 expref: 24 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.708548:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.708549:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.708551:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708565:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe8800/0x844e5faceb5ed016 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d38 expref: 24 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.708573:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8800/0x844e5faceb5ed016 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d38 expref: 24 pid: 10591 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746155576.708580:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124675200:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.708603:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5ed06a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d77 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.708613:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5ed06a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d77 expref: 8 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746155576.708620:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124675328:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.708634:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d15 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.708640:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d15 expref: 15 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.708646:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124675456:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155576.708655:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bf20cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155576.709708:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.709757:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124014080 00000100:00100000:1.0:1746155576.709762:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124014080 00000100:00100000:1.0:1746155576.709786:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124014336 00000100:00100000:1.0:1746155576.709787:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124014336 00000100:00100000:1.0:1746155576.709797:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12623 00000100:00100000:1.0:1746155576.709802:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976124014080:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155576.709818:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.709828:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.709838:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155576.709839:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155576.709842:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.709856:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.709863:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 20 pid: 10591 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.709871:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124675584:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155576.709905:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155576.709949:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12624 00000100:00100000:3.0:1746155576.709955:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976124014336:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155576.709971:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.709980:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ca5 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.709986:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ed086 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d93 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.709992:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc7e600/0x844e5faceb5ecfad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ccf expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.710000:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.710001:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.710003:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.710016:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc7e600/0x844e5faceb5ecfad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ccf expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.710023:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc7e600/0x844e5faceb5ecfad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ccf expref: 24 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1746155576.710030:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124675712:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155576.710056:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ed086 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d93 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155576.710062:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ed086 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d93 expref: 9 pid: 20200 timeout: 805 lvb_type: 1 00000100:00100000:3.0:1746155576.710070:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124675840:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155576.710089:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ca5 expref: 15 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.710096:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ca5 expref: 15 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:3.0:1746155576.710106:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124675968:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155576.710120:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155576.733197:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124674304:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155576.733349:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.733364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.733392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.733422:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124674816:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155576.733439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.733458:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124014720 00000100:00100000:1.0:1746155576.733463:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124014720 00010000:00010000:1.0:1746155576.733539:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d07 expref: 15 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.733561:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124014592 00000100:00100000:1.0:1746155576.733564:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124014592 00010000:00010000:1.0:1746155576.733574:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbaca00/0x844e5faceb5ed063 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d70 expref: 11 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746155576.733585:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124014464 00000100:00100000:1.0:1746155576.733587:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124014464 00010000:00010000:1.0:1746155576.733594:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0x844e5faceb5ed00f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d31 expref: 21 pid: 10591 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746155576.733613:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6407 00000100:00100000:1.0:1746155576.733619:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976124014720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.733630:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.733648:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d07 expref: 15 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.733656:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d07 expref: 15 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.733677:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.733709:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976124014720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 89us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.733714:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6407 00000100:00100000:1.0:1746155576.733762:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6408 00000100:00100000:1.0:1746155576.733767:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124014592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.733772:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.733778:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cbaca00/0x844e5faceb5ed063 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d70 expref: 11 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.733786:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cbaca00/0x844e5faceb5ed063 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d70 expref: 11 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.733795:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.733808:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124014592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 41us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.733812:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6408 00000100:00100000:1.0:1746155576.733829:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6409 00000100:00100000:1.0:1746155576.733833:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976124014464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.733838:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.733844:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0x844e5faceb5ed00f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d31 expref: 21 pid: 10591 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.733851:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0x844e5faceb5ed00f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d31 expref: 21 pid: 10591 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.733861:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0x844e5faceb5ed00f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d31 expref: 21 pid: 10591 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.733874:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.733876:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.733879:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.733886:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.733898:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.733910:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976124014464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 76us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.733914:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6409 00000100:00100000:1.0:1746155576.733954:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124675328:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155576.734006:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124674944:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155576.734036:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124675072:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.734053:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.734136:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124675200:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155576.734151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.734159:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124014976 00000100:00100000:1.0:1746155576.734162:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124014976 00010000:00010000:1.0:1746155576.734172:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5ed06a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d77 expref: 10 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746155576.734187:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6410 00000100:00100000:1.0:1746155576.734192:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124014976:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.734197:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.734209:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5ed06a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d77 expref: 10 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.734216:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5ed06a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d77 expref: 10 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.734229:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5ed06a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d77 expref: 10 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.734238:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.734253:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976124014976:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 61us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.734258:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6410 00000100:00100000:1.0:1746155576.734284:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.734293:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124015232 00000100:00100000:1.0:1746155576.734295:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124015232 00010000:00010000:1.0:1746155576.734304:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c97 expref: 15 pid: 18270 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.734319:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6411 00000100:00100000:1.0:1746155576.734323:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976124015232:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.734328:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.734335:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c97 expref: 15 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.734342:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c97 expref: 15 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.734351:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d800/0x844e5faceb5ecf75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11c97 expref: 15 pid: 18270 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.734358:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.734371:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976124015232:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 47us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.734378:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6411 00000100:00100000:1.0:1746155576.734411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.734421:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124015104 00000100:00100000:1.0:1746155576.734424:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124015104 00010000:00010000:1.0:1746155576.734432:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5ed07f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d8c expref: 11 pid: 8436 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746155576.734446:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6412 00000100:00100000:1.0:1746155576.734450:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124015104:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.734457:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.734463:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5ed07f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d8c expref: 11 pid: 8436 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.734470:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5ed07f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d8c expref: 11 pid: 8436 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.734480:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9c00/0x844e5faceb5ed07f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d8c expref: 11 pid: 8436 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.734489:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.734526:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124015104:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 75us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.734531:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6412 00000100:00100000:1.0:1746155576.734558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.734565:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124015360 00000100:00100000:1.0:1746155576.734567:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124015360 00010000:00010000:1.0:1746155576.734575:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8800/0x844e5faceb5ed016 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d38 expref: 25 pid: 10591 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746155576.734586:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6413 00000100:00100000:1.0:1746155576.734590:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976124015360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.734594:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.734600:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fe8800/0x844e5faceb5ed016 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d38 expref: 25 pid: 10591 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.734606:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fe8800/0x844e5faceb5ed016 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d38 expref: 25 pid: 10591 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.734615:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8800/0x844e5faceb5ed016 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d38 expref: 25 pid: 10591 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.734623:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.734633:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976124015360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 43us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.734637:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6413 00000100:00100000:1.0:1746155576.734670:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976124675456:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.734682:0:10591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.734727:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124675584:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.734738:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.734771:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124675712:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155576.734789:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124675840:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155576.734809:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124675968:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.734821:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.734842:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.734851:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124015488 00000100:00100000:1.0:1746155576.734853:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124015488 00010000:00010000:1.0:1746155576.734862:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d15 expref: 16 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.734876:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6414 00000100:00100000:1.0:1746155576.734880:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1963:x1830976124015488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.734885:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.734891:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d15 expref: 16 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.734898:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d15 expref: 16 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.734908:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090d06000/0x844e5faceb5ecff3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d15 expref: 16 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.734919:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.734921:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.734923:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.734928:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.734939:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.734953:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1963:x1830976124015488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.734957:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6414 00010000:00010000:1.0:1746155576.734984:0:10591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.734989:0:10591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735005:0:10591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735011:0:10591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735018:0:10591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735028:0:10591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009520c600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155576.735031:0:10591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735039:0:10591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735047:0:10591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735053:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009520c600/0x844e5faceb5ed0e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.735083:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976124013824:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 26599us (27450us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.735089:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12622 00000100:00100000:1.0:1746155576.735119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.735144:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.735153:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124015744 00000100:00100000:1.0:1746155576.735155:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124015744 00010000:00010000:1.0:1746155576.735164:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc7e600/0x844e5faceb5ecfad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ccf expref: 24 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746155576.735178:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6415 00000100:00100000:1.0:1746155576.735182:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976124015744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.735190:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.735197:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc7e600/0x844e5faceb5ecfad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ccf expref: 24 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.735204:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc7e600/0x844e5faceb5ecfad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ccf expref: 24 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.735212:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc7e600/0x844e5faceb5ecfad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ccf expref: 24 pid: 8437 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.735220:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.735234:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976124015744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.735239:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6415 00000100:00100000:1.0:1746155576.735270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.735279:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124016000 00000100:00100000:1.0:1746155576.735282:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124016000 00010000:00010000:1.0:1746155576.735290:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ca5 expref: 15 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.735303:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6416 00000100:00100000:1.0:1746155576.735307:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1960:x1830976124016000:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.735312:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.735319:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ca5 expref: 15 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.735330:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ca5 expref: 15 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.735340:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f089000/0x844e5faceb5ecf83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ca5 expref: 15 pid: 8436 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.735347:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.735361:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976124016000:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 53us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.735364:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6416 00000100:00100000:1.0:1746155576.735395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.735403:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124015872 00000100:00100000:1.0:1746155576.735406:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124015872 00010000:00010000:1.0:1746155576.735415:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ed086 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d93 expref: 8 pid: 20200 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746155576.735426:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6417 00000100:00100000:1.0:1746155576.735430:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976124015872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.735435:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.735441:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ed086 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d93 expref: 8 pid: 20200 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.735448:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ed086 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d93 expref: 8 pid: 20200 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.735460:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8600/0x844e5faceb5ed086 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d93 expref: 8 pid: 20200 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.735467:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.735468:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.735470:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735476:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735487:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155576.735529:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976124015872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 97us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.735534:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6417 00010000:00010000:1.0:1746155576.735549:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735555:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735567:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735572:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735582:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735587:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdc8800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155576.735589:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735594:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735601:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735606:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed0f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.735631:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976124014336:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 25676us (25926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.735636:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12624 00000100:00100000:1.0:1746155576.735688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.735701:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124016128 00000100:00100000:1.0:1746155576.735703:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124016128 00010000:00010000:1.0:1746155576.735712:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800939e3600/0x844e5faceb5ecfa6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cc8 expref: 20 pid: 4461 timeout: 805 lvb_type: 1 00000100:00100000:1.0:1746155576.735723:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6418 00000100:00100000:1.0:1746155576.735729:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976124016128:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155576.735734:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.735741:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800939e3600/0x844e5faceb5ecfa6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cc8 expref: 20 pid: 4461 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.735748:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800939e3600/0x844e5faceb5ecfa6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cc8 expref: 20 pid: 4461 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.735757:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800939e3600/0x844e5faceb5ecfa6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11cc8 expref: 20 pid: 4461 timeout: 805 lvb_type: 1 00010000:00010000:1.0:1746155576.735764:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.735765:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.735768:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735773:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735785:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155576.735794:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735800:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735811:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735821:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735826:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735830:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1ce000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155576.735833:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735838:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735845:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.735850:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1ce000/0x844e5faceb5ed0e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.735877:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976124014208:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 27556us (28446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.735881:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12621 00000100:00100000:1.0:1746155576.735902:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976124016128:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 173us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.735906:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6418 00000100:00100000:1.0:1746155576.735998:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124014848 00000100:00100000:1.0:1746155576.736002:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124014848 00002000:00100000:1.0:1746155576.736022:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3db:0x0] (1548288->2097151) req@ffff880094f0aa00 x1830976124014848/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.736029:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0aa00 with x1830976124014848 ext(1548288->2097151) 00010000:00010000:1.0:1746155576.736034:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 14 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.736042:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 14 pid: 8437 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746155576.736047:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f0aa00 00000100:00100000:1.0:1746155576.736057:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124015616 00000100:00100000:1.0:1746155576.736059:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124015616 00002000:00100000:1.0:1746155576.736067:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1343488->1654783) req@ffff88009a6db100 x1830976124015616/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/0 e 0 to 0 dl 1746155587 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.736073:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6db100 with x1830976124015616 ext(1343488->1654783) 00010000:00010000:1.0:1746155576.736077:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 19 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.736083:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 19 pid: 10591 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746155576.736089:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6db100 00000100:00100000:1.0:1746155576.736098:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 819 00000100:00100000:1.0:1746155576.736102:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1960:x1830976124014848:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155576.736547:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 820 00000100:00100000:1.0:1746155576.736553:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976124015616:12345-192.168.202.51@tcp:4:multiop.0 00010000:00010000:2.0:1746155576.736928:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cbaca00/0x844e5faceb5ed063 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d70 expref: 8 pid: 8437 timeout: 805 lvb_type: 1 00000100:00100000:2.0:1746155576.736943:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124674432:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.736953:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1ca00/0x844e5faceb5ecfe5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d07 expref: 13 pid: 8436 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.736960:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976124674560:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155576.736975:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.736985:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.736990:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.737004:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.737009:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.737014:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.737018:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a237200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155576.737020:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.737025:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.737033:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.737038:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a237200/0x844e5faceb5ed0d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155576.737068:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976124013696:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 29138us (29702us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.737074:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12619 00000100:00100000:3.0:1746155576.737687:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124674688:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155576.737698:0:20796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.771267:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976124014848:12345-192.168.202.51@tcp:4:cat.0 Request processed in 35157us (37867us total) trans 17179873274 rc 0/0 00000100:00100000:1.0:1746155576.771277:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 819 00002000:00100000:1.0:1746155576.771286:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3db:0x0] (1548288->2097151) req@ffff880094f0aa00 x1830976124014848/t17179873274(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:647/0 lens 488/448 e 0 to 0 dl 1746155587 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.771294:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094f0aa00 with x1830976124014848 ext(1548288->2097151) 00010000:00010000:1.0:1746155576.771302:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 16 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.771312:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 16 pid: 8437 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746155576.771319:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094f0aa00 00000100:00100000:0.0:1746155576.784294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.784324:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124016256 00000100:00100000:0.0:1746155576.784330:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124016256 00010000:00010000:0.0:1746155576.784358:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 16 pid: 8437 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.784383:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6419 00000100:00100000:0.0:1746155576.784389:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1962:x1830976124016256:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.784401:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.784418:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 16 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.784428:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 16 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.784446:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1ce400/0x844e5faceb5ed01d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d3f expref: 16 pid: 8437 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.784475:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.784477:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.784481:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.784489:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.784541:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976124015616:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 47985us (49418us total) trans 21474840668 rc 0/0 00000100:00100000:1.0:1746155576.784553:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 820 00002000:00100000:1.0:1746155576.784565:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1343488->1654783) req@ffff88009a6db100 x1830976124015616/t21474840668(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:647/0 lens 488/448 e 0 to 0 dl 1746155587 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155576.784573:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6db100 with x1830976124015616 ext(1343488->1654783) 00010000:00010000:1.0:1746155576.784580:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 21 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:1.0:1746155576.784590:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 21 pid: 10591 timeout: 805 lvb_type: 0 00002000:00010000:1.0:1746155576.784596:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6db100 00010000:00010000:3.0:1746155576.786307:0:20796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.786316:0:20796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.786336:0:20796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.786343:0:20796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.786349:0:20796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.786356:0:20796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1cea00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155576.786359:0:20796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.786370:0:20796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.786379:0:20796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.786754:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed0da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.786778:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155576.786858:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1961:x1830976124013952:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 78639us (79448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.786866:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12620 00000100:00100000:1.0:1746155576.787057:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1962:x1830976124016256:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2667us (2769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.787064:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6419 00000100:00100000:3.0:1746155576.787252:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830976124676352:0@lo:400:kworker.0 00000100:00100000:3.0:1746155576.787285:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155576.787318:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746155576.787322:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124676480:0@lo:400:kworker.0 00000100:00100000:3.0:1746155576.787339:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155576.787362:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124676480 00000100:00100000:3.0:1746155576.787365:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124676480 00000100:00100000:3.0:1746155576.787383:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1746155576.787388:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3295:x1830976124676480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155576.787413:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3295:x1830976124676480:12345-0@lo:400:kworker.0 Request processed in 25us (73us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.787418:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1746155576.787439:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124676480:0@lo:400:kworker.0 00000100:00100000:3.0:1746155576.787459:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124676352 00000100:00100000:3.0:1746155576.787461:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124676352 00000100:00100000:3.0:1746155576.787480:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1746155576.787485:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830976124676352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155576.787533:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830976124676352:12345-0@lo:400:kworker.0 Request processed in 47us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.787538:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1746155576.787553:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830976124676352:0@lo:400:kworker.0 00000100:00080000:3.0:1746155576.787585:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155576.787647:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1830976124676224:0@lo:400:kworker.0 00000100:00100000:1.0:1746155576.787666:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155576.787686:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830976124676736:0@lo:400:kworker.0 00000100:00100000:1.0:1746155576.787699:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155576.787709:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746155576.787712:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3298:1830976124676096:0@lo:400:kworker.0 00000100:00100000:1.0:1746155576.787730:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155576.787751:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124676608:0@lo:400:kworker.0 00000100:00100000:1.0:1746155576.787764:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155576.787780:0:14230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124676096 00000100:00100000:1.0:1746155576.787782:0:14230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124676096 00000100:00100000:1.0:1746155576.787797:0:14230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1746155576.787802:0:14230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3298:x1830976124676096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155576.787821:0:14230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3298:x1830976124676096:12345-0@lo:400:kworker.0 Request processed in 19us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.787825:0:14230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1746155576.787849:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3298:1830976124676096:0@lo:400:kworker.0 00000100:00100000:3.0:1746155576.789056:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124676224 00000100:00100000:3.0:1746155576.789060:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124676224 00000100:00080000:0.0:1746155576.789470:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155576.789530:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124676736 00000100:00100000:3.0:1746155576.789533:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124676736 00000100:00100000:3.0:1746155576.789549:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1746155576.789554:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830976124676224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155576.789626:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1746155576.789632:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830976124676736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746155576.789991:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124676608 00000100:00100000:0.0:1746155576.789994:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124676608 00000100:00100000:3.0:1746155576.790083:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830976124676224:12345-0@lo:400:kworker.0 Request processed in 529us (2415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.790089:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1746155576.790318:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830976124676736:12345-0@lo:400:kworker.0 Request processed in 686us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.790324:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1746155576.790698:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1830976124676224:0@lo:400:kworker.0 00000100:00100000:3.0:1746155576.790708:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830976124676736:0@lo:400:kworker.0 00000100:00100000:2.0:1746155576.790901:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1746155576.790908:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3298:x1830976124676608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746155576.790943:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3298:x1830976124676608:12345-0@lo:400:kworker.0 Request processed in 37us (3178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.790948:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1746155576.790998:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.791054:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124676608:0@lo:400:kworker.0 00000100:00100000:0.0:1746155576.791095:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124016384 00000100:00100000:0.0:1746155576.791098:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124016384 00010000:00010000:0.0:1746155576.791114:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 21 pid: 10591 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.791131:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6420 00000100:00100000:0.0:1746155576.791136:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976124016384:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.791144:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.791160:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 21 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.791170:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 21 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.791188:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a237a00/0x844e5faceb5ed040 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1343488->1654783) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11d62 expref: 21 pid: 10591 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.791199:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.791201:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155576.791205:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.791212:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.791229:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155576.791261:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976124016384:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 125us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.791266:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6420 00010000:00010000:0.0:1746155576.791285:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.791292:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.791307:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.791314:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.791321:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.791326:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe8c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155576.791329:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.791335:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.791347:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.791353:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe8c00/0x844e5faceb5ed0ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155576.791389:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976124014080:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 81587us (83553us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.791394:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12623 00000100:00100000:0.0:1746155576.797839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.798595:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124016640 00000100:00100000:1.0:1746155576.798602:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124016640 00000100:00100000:1.0:1746155576.798645:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10130 00000100:00100000:1.0:1746155576.798651:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+20:29481:x1830976124016640:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:1.0:1746155576.798692:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155576.798713:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed0a9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11da1 expref: 20 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.798731:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155576.798734:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155576.798756:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155576.798766:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11711 expref: 311 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.798773:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 35 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.798778:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 311 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.798784:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272e00/0x844e5faceb5ec779 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1177a expref: 35 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.798794:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5ec79c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1178f expref: 311 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.798799:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ec9b0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118e6 expref: 311 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.798805:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a000/0x844e5faceb5eca04 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11902 expref: 35 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.798810:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 10/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155576.798832:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a000/0x844e5faceb5eca04 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11902 expref: 35 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.798841:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a000/0x844e5faceb5eca04 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11902 expref: 35 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.798850:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f09180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124676864:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.798925:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ec9b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118e6 expref: 311 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.798932:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ec9b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118e6 expref: 311 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.798939:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094f09500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124676992:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.798958:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5ec79c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1178f expref: 311 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.798965:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5ec79c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1178f expref: 311 pid: 27374 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.798971:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124677120:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.798986:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272e00/0x844e5faceb5ec779 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1177a expref: 35 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.798992:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272e00/0x844e5faceb5ec779 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1177a expref: 35 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.798998:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124677248:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.799014:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 311 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.799020:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 311 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.799026:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124677376:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.799042:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 35 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.799048:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 35 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.799054:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124677504:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.799072:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11711 expref: 311 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.799078:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11711 expref: 311 pid: 27374 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.799084:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124677632:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155576.799095:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155576.809488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.809543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.809570:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.809582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.809599:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124016768 00000100:00100000:0.0:1746155576.809605:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124016768 00010000:00010000:0.0:1746155576.809631:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ec9b0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118e6 expref: 312 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.809649:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124017536 00000100:00100000:0.0:1746155576.809650:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124017536 00010000:00010000:0.0:1746155576.809657:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 36 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.809669:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6421 00000100:00100000:0.0:1746155576.809675:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1960:x1830976124016768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.809688:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.809693:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ec9b0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118e6 expref: 312 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.809702:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ec9b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118e6 expref: 312 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.809721:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155576.809726:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155576.809733:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155576.809764:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1960:x1830976124016768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 89us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.809769:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6421 00000100:00100000:0.0:1746155576.809806:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6422 00000100:00100000:0.0:1746155576.809811:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1962:x1830976124017536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.809816:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.809819:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 36 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.809826:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 36 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.809834:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155576.809837:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155576.809845:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155576.809854:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1962:x1830976124017536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 44us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.809859:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6422 00000100:00100000:0.0:1746155576.809879:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.809889:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124017408 00000100:00100000:0.0:1746155576.809891:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124017408 00010000:00010000:0.0:1746155576.809898:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 312 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.809909:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6423 00000100:00100000:0.0:1746155576.809913:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1962:x1830976124017408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.809918:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.809921:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 312 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.809928:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 312 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.809936:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155576.809938:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155576.809943:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155576.809952:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1962:x1830976124017408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.809957:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6423 00000100:00100000:0.0:1746155576.809994:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.810001:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124017664 00000100:00100000:0.0:1746155576.810003:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124017664 00010000:00010000:0.0:1746155576.810010:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11711 expref: 312 pid: 27374 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.810021:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6424 00000100:00100000:0.0:1746155576.810025:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1962:x1830976124017664:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.810029:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.810032:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11711 expref: 312 pid: 27374 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.810039:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11711 expref: 312 pid: 27374 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.810047:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155576.810050:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155576.810054:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155576.810063:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1962:x1830976124017664:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 38us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.810068:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6424 00000100:00100000:0.0:1746155576.810111:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.810120:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124017792 00000100:00100000:0.0:1746155576.810122:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124017792 00010000:00010000:0.0:1746155576.810130:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a000/0x844e5faceb5eca04 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11902 expref: 36 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.810143:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6425 00000100:00100000:0.0:1746155576.810147:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1963:x1830976124017792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.810152:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155576.810155:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a000/0x844e5faceb5eca04 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11902 expref: 36 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.810162:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a000/0x844e5faceb5eca04 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11902 expref: 36 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.810170:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155576.810173:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155576.810177:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155576.810187:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+36:1963:x1830976124017792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 40us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.810192:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6425 00010000:00010000:1.0:1746155576.810343:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e2a000/0x844e5faceb5eca04 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11902 expref: 35 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.810358:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f09180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124676864:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.810367:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ec9b0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f118e6 expref: 311 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.810374:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094f09500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124676992:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155576.810381:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124677120:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155576.810386:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124677248:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.810392:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3bc00/0x844e5faceb5ec6df lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1171f expref: 310 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.810399:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124677376:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.810405:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe3a400/0x844e5faceb5ec6d8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11718 expref: 34 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.810415:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124677504:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.810421:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ec6d1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11711 expref: 309 pid: 27374 timeout: 805 lvb_type: 0 00000100:00100000:1.0:1746155576.810428:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124677632:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155576.810468:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155576.810541:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124017024 00000100:00100000:3.0:1746155576.810544:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124017024 00000100:00100000:3.0:1746155576.810561:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124017280 00000100:00100000:3.0:1746155576.810563:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124017280 00000100:00100000:3.0:1746155576.810574:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4120 00000100:00100000:3.0:1746155576.810579:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:27128:x1830976124017024:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155576.810711:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+310:27128:x1830976124017024:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 132us (1229us total) trans 8589944110 rc 0/0 00000100:00100000:3.0:1746155576.810717:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4120 00000100:00100000:3.0:1746155576.810728:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4121 00000100:00100000:3.0:1746155576.810732:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+34:27129:x1830976124017280:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155576.810784:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+35:27129:x1830976124017280:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 51us (1240us total) trans 8589944111 rc 0/0 00000100:00100000:3.0:1746155576.810789:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4121 00000100:00100000:0.0:1746155576.815702:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.815756:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124017920 00000100:00100000:2.0:1746155576.815763:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124017920 00000100:00100000:0.0:1746155576.815783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155576.815788:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5ec79c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1178f expref: 310 pid: 27374 timeout: 805 lvb_type: 0 00000100:00100000:2.0:1746155576.815811:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124018048 00000100:00100000:2.0:1746155576.815813:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124018048 00000100:00100000:0.0:1746155576.815818:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6426 00010000:00010000:2.0:1746155576.815821:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272e00/0x844e5faceb5ec779 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1177a expref: 35 pid: 15474 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746155576.815825:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+310:1960:x1830976124017920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155576.815834:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6427 00010000:00010000:0.0:1746155576.815836:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155576.815839:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+35:1961:x1830976124018048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155576.815842:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5ec79c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1178f expref: 310 pid: 27374 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.815845:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155576.815849:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272e00/0x844e5faceb5ec779 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1177a expref: 35 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.815853:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5ec79c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1178f expref: 310 pid: 27374 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.815865:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272e00/0x844e5faceb5ec779 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1177a expref: 35 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.815888:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca19400/0x844e5faceb5ec79c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1178f expref: 310 pid: 27374 timeout: 805 lvb_type: 0 00010000:00010000:2.0:1746155576.815892:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a272e00/0x844e5faceb5ec779 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1177a expref: 35 pid: 15474 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746155576.815902:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155576.815906:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155576.815914:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155576.815919:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155576.815939:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:0.0:1746155576.815941:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155576.815942:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155576.815973:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:1960:x1830976124017920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 148us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155576.815979:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6426 00000100:00100000:2.0:1746155576.816000:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+34:1961:x1830976124018048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 160us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.816006:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6427 00010000:00010000:2.0:1746155576.816029:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155576.816035:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000040:00080000:2.0:1746155576.816590:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2945, 88 off246552 00000004:00080000:2.0:1746155576.816597:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705966093386ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155576.816626:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2882, 88 off240736 00000004:00080000:2.0:1746155576.816629:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705966126484ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155576.816639:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2883, 88 off240824 00000004:00080000:2.0:1746155576.816641:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705966138489ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155576.816648:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2946, 88 off246640 00000004:00080000:2.0:1746155576.816650:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705966147421ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155576.816656:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2947, 88 off246728 00000004:00080000:2.0:1746155576.816659:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705966155774ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155576.816664:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2884, 88 off240912 00000004:00080000:2.0:1746155576.816667:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705966164004ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155576.816673:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2885, 88 off241000 00000004:00080000:2.0:1746155576.816676:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705966172662ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155576.816682:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2886, 88 off241088 00000004:00080000:2.0:1746155576.816684:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705966180964ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155576.816690:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2948, 88 off246816 00000004:00080000:2.0:1746155576.816692:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705966188996ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155576.816698:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2887, 88 off241176 00000004:00080000:2.0:1746155576.816700:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705966197054ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155576.816706:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2949, 88 off246904 00000004:00080000:2.0:1746155576.816708:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705966204769ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155576.816713:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2888, 88 off241264 00000004:00080000:2.0:1746155576.816716:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705966212722ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155576.816722:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2950, 88 off246992 00000004:00080000:2.0:1746155576.816724:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705966221021ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155576.816730:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2951, 88 off247080 00000004:00080000:2.0:1746155576.816732:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705966229304ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155576.816738:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2952, 88 off247168 00000004:00080000:2.0:1746155576.816740:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705966237154ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155576.816746:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2953, 88 off247256 00000004:00080000:2.0:1746155576.816748:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705966244889ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155576.816754:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2889, 88 off241352 00000004:00080000:2.0:1746155576.816756:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 705966252722ns, next at 645866785986ns, rc = 0 00000001:00080000:0.0:1746155576.856398:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944105 is committed 00000001:00080000:0.0:1746155576.856409:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944103 is committed 00000001:00080000:0.0:1746155576.856415:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944100 is committed 00000001:00080000:0.0:1746155576.856434:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944104 is committed 00000001:00080000:0.0:1746155576.856457:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944112 is committed 00000004:00080000:0.0:1746155576.856460:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2081 committed 00000004:00080000:0.0:1746155576.856465:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2151 committed 00000004:00010000:3.0:1746155576.856637:0:20364:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093a45180 reply state ffff88009f85f000 transno 8589944112 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155576.856647:0:20364:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746155576.856720:0:20364:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746155576.856732:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:29481:x1830976124016640:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 58077us (58895us total) trans 8589944112 rc 0/0 00000100:00100000:3.0:1746155576.856738:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10130 00000004:00080000:0.0:1746155576.856883:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2150 committed 00000004:00080000:0.0:1746155576.856886:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2149 committed 00000004:00080000:0.0:1746155576.856888:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2148 committed 00000004:00080000:0.0:1746155576.856889:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2080 committed 00000004:00080000:0.0:1746155576.856891:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2147 committed 00000004:00080000:0.0:1746155576.856893:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2079 committed 00000004:00080000:0.0:1746155576.856894:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2146 committed 00000004:00080000:0.0:1746155576.856896:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2078 committed 00000004:00080000:0.0:1746155576.856897:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2077 committed 00000004:00080000:0.0:1746155576.856899:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2076 committed 00000004:00080000:0.0:1746155576.856900:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2145 committed 00000004:00080000:0.0:1746155576.856902:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2144 committed 00000004:00080000:0.0:1746155576.856903:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2075 committed 00000004:00080000:0.0:1746155576.856904:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2074 committed 00000004:00080000:0.0:1746155576.856906:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2143 committed 00000001:00080000:0.0:1746155576.856914:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944107 is committed 00000001:00080000:0.0:1746155576.856917:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944106 is committed 00000001:00080000:0.0:1746155576.856953:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944111 is committed 00000001:00080000:0.0:1746155576.856957:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944110 is committed 00010000:00010000:2.0:1746155576.857213:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155576.857221:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155576.857227:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155576.857233:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffc1000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155576.857236:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155576.857242:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155576.857256:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155576.857258:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155576.857261:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155576.857266:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ffc1000/0x844e5faceb5ed0fd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155576.857285:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124677888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155576.857321:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155576.857534:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124677760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155576.857554:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124678144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155576.857631:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124678016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155576.857901:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124678400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155576.857918:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155576.857931:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124678912:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155576.857943:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155576.857953:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124679424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155576.857963:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155576.857981:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124677888 00000100:00100000:2.0:1746155576.857987:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124677888 00000100:00100000:2.0:1746155576.858009:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124678400 00000100:00100000:2.0:1746155576.858011:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124678400 00000100:00100000:2.0:1746155576.858021:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124678912 00000100:00100000:2.0:1746155576.858022:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124678912 00000100:00100000:2.0:1746155576.858032:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124679424 00000100:00100000:2.0:1746155576.858034:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124679424 00000100:00100000:2.0:1746155576.858044:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12625 00000100:00100000:2.0:1746155576.858049:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3296:x1830976124677888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155576.858204:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3296:x1830976124677888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (881us total) trans 17179873275 rc 0/0 00000100:00100000:2.0:1746155576.858209:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12625 00000100:00100000:2.0:1746155576.858222:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12626 00000100:00100000:2.0:1746155576.858226:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3296:x1830976124678400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155576.858304:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3296:x1830976124678400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (384us total) trans 17179873276 rc 0/0 00000100:00100000:2.0:1746155576.858308:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12626 00000100:00100000:2.0:1746155576.858316:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12627 00000100:00100000:2.0:1746155576.858321:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3296:x1830976124678912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155576.858413:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3296:x1830976124678912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (468us total) trans 21474840669 rc 0/0 00000100:00100000:2.0:1746155576.858417:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12627 00000100:00100000:2.0:1746155576.858425:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12628 00000100:00100000:2.0:1746155576.858429:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3296:x1830976124679424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155576.858526:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3296:x1830976124679424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (561us total) trans 21474840670 rc 0/0 00000100:00100000:2.0:1746155576.858532:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12628 00000004:00080000:2.0:1746155576.858564:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c33b80/2, rc 0, transno 21474840669 00000100:00100000:2.0:1746155576.858570:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124678912:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155576.858577:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c31500/2, rc 0, transno 21474840670 00000100:00100000:2.0:1746155576.858580:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124679424:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155576.858586:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f881f80/2, rc 0, transno 17179873275 00000100:00100000:2.0:1746155576.858589:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124677888:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155576.858594:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f883800/2, rc 0, transno 17179873276 00000100:00100000:2.0:1746155576.858596:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124678400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155576.858617:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746155576.858622:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124679808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155576.858638:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155576.858662:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124679808 00000100:00100000:2.0:1746155576.858664:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124679808 00000100:00100000:2.0:1746155576.858677:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12629 00000100:00100000:2.0:1746155576.858681:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3296:x1830976124679808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155576.858757:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3296:x1830976124679808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (118us total) trans 21474840671 rc 0/0 00000100:00100000:2.0:1746155576.858762:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12629 00000004:00080000:2.0:1746155576.858779:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f882300/2, rc 0, transno 21474840671 00000100:00100000:2.0:1746155576.858782:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124679808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155576.859044:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155576.859058:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124678528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155576.859074:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155576.859082:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124679040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155576.859092:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155576.859100:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124679552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155576.859110:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155576.859126:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124678016 00000100:00100000:0.0:1746155576.859128:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124678016 00000100:00100000:0.0:1746155576.859140:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124678528 00000100:00100000:0.0:1746155576.859142:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124678528 00000100:00100000:0.0:1746155576.859149:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124679040 00000100:00100000:0.0:1746155576.859151:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124679040 00000100:00100000:0.0:1746155576.859158:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124679552 00000100:00100000:0.0:1746155576.859160:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124679552 00000100:00100000:0.0:1746155576.859169:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12630 00000100:00100000:0.0:1746155576.859174:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3297:x1830976124678016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155576.859256:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3297:x1830976124678016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (211us total) trans 17179873277 rc 0/0 00000100:00100000:0.0:1746155576.859261:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12630 00000100:00100000:0.0:1746155576.859271:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12631 00000100:00100000:0.0:1746155576.859275:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3297:x1830976124678528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155576.859341:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3297:x1830976124678528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (266us total) trans 17179873278 rc 0/0 00000100:00100000:0.0:1746155576.859346:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12631 00000100:00100000:0.0:1746155576.859355:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12632 00000100:00100000:0.0:1746155576.859359:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3297:x1830976124679040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155576.859429:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3297:x1830976124679040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (335us total) trans 21474840672 rc 0/0 00000100:00100000:0.0:1746155576.859434:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12632 00000100:00100000:0.0:1746155576.859442:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12633 00000100:00100000:0.0:1746155576.859446:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3297:x1830976124679552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155576.859578:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3297:x1830976124679552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (466us total) trans 21474840673 rc 0/0 00000100:00100000:0.0:1746155576.859583:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12633 00000004:00080000:0.0:1746155576.859603:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f881c00/2, rc 0, transno 17179873277 00000100:00100000:0.0:1746155576.859606:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124678016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155576.859613:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f883480/2, rc 0, transno 17179873278 00000100:00100000:0.0:1746155576.859615:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124678528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155576.859621:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c30e00/2, rc 0, transno 21474840672 00000100:00100000:0.0:1746155576.859623:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124679040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155576.859628:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c33800/2, rc 0, transno 21474840673 00000100:00100000:0.0:1746155576.859631:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124679552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155576.859689:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155576.859707:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124678656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155576.859721:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155576.859729:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124679168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155576.859739:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155576.859746:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124679680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155576.859756:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155576.859770:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155576.859780:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124678272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155576.859791:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155576.859800:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124678784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155576.859811:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155576.859816:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124679296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155576.859826:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155576.859838:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124678144 00000100:00100000:3.0:1746155576.859841:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124678144 00000100:00100000:3.0:1746155576.859852:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124678656 00000100:00100000:3.0:1746155576.859854:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124678656 00000100:00100000:3.0:1746155576.859860:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124679168 00000100:00100000:3.0:1746155576.859862:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124679168 00000100:00100000:3.0:1746155576.859867:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124679680 00000100:00100000:3.0:1746155576.859868:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124679680 00000100:00100000:3.0:1746155576.859873:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124677760 00000100:00100000:3.0:1746155576.859874:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124677760 00000100:00100000:3.0:1746155576.859880:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124678272 00000100:00100000:3.0:1746155576.859882:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124678272 00000100:00100000:3.0:1746155576.859886:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124678784 00000100:00100000:3.0:1746155576.859888:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124678784 00000100:00100000:3.0:1746155576.859893:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124679296 00000100:00100000:3.0:1746155576.859895:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124679296 00000100:00100000:3.0:1746155576.859902:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12634 00000100:00100000:3.0:1746155576.859906:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976124678144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155576.860012:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124678144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (322us total) trans 17179873279 rc 0/0 00000100:00100000:3.0:1746155576.860017:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12634 00000100:00100000:3.0:1746155576.860027:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12635 00000100:00100000:3.0:1746155576.860031:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976124678656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155576.860101:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124678656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (378us total) trans 17179873280 rc 0/0 00000100:00100000:3.0:1746155576.860106:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12635 00000100:00100000:3.0:1746155576.860114:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12636 00000100:00100000:3.0:1746155576.860118:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124679168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155576.860198:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:3.0:1746155576.860201:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155576.860203:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746155576.860205:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155576.860206:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:3.0:1746155576.860222:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3298:x1830976124679168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (481us total) trans 21474840674 rc 0/0 00000100:00100000:3.0:1746155576.860226:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12636 00000100:00100000:3.0:1746155576.860234:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12637 00000100:00100000:3.0:1746155576.860238:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124679680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155576.860303:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3298:x1830976124679680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (545us total) trans 21474840675 rc 0/0 00000100:00100000:3.0:1746155576.860308:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12637 00000100:00100000:3.0:1746155576.860315:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12638 00000100:00100000:3.0:1746155576.860319:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976124677760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155576.860390:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976124677760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (618us total) trans 17179873281 rc 0/0 00000100:00100000:3.0:1746155576.860395:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12638 00000100:00100000:3.0:1746155576.860403:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12639 00000100:00100000:3.0:1746155576.860407:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976124678272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155576.860521:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976124678272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (700us total) trans 17179873282 rc 0/0 00000100:00100000:3.0:1746155576.860527:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12639 00000100:00100000:3.0:1746155576.860536:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12640 00000100:00100000:3.0:1746155576.860541:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976124678784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155576.860611:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1830976124678784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (798us total) trans 21474840676 rc 0/0 00000100:00100000:3.0:1746155576.860615:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12640 00000100:00100000:3.0:1746155576.860623:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12641 00000100:00100000:3.0:1746155576.860627:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976124679296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155576.860692:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1830976124679296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (864us total) trans 21474840677 rc 0/0 00000100:00100000:3.0:1746155576.860696:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12641 00000004:00080000:3.0:1746155576.860716:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f883100/2, rc 0, transno 17179873281 00000100:00100000:3.0:1746155576.860719:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124677760:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155576.860724:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f882a00/2, rc 0, transno 17179873282 00000100:00100000:3.0:1746155576.860727:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124678272:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155576.860732:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c30000/2, rc 0, transno 21474840676 00000100:00100000:3.0:1746155576.860735:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124678784:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155576.860740:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c33480/2, rc 0, transno 21474840677 00000100:00100000:3.0:1746155576.860742:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124679296:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155576.860753:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f883b80/2, rc 0, transno 17179873279 00000100:00100000:3.0:1746155576.860756:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124678144:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155576.860763:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f882680/2, rc 0, transno 17179873280 00000100:00100000:3.0:1746155576.860767:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124678656:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155576.860771:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c31180/2, rc 0, transno 21474840674 00000100:00100000:3.0:1746155576.860774:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124679168:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155576.860779:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b881880/2, rc 0, transno 21474840675 00000100:00100000:3.0:1746155576.860781:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124679680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155576.862727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.865309:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124018176 00000100:00100000:3.0:1746155576.865317:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124018176 00000100:00100000:3.0:1746155576.865454:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10131 00000100:00100000:3.0:1746155576.865461:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29481:x1830976124018176:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155576.865480:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.865517:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5ed104 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11dbd expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.865563:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5ed104 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dbd expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.865574:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5ed104 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dbd expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.865588:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155576.865591:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155576.865594:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1ce400, rc 0) 00000100:00100000:3.0:1746155576.866227:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29481:x1830976124018176:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 765us (3501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.866233:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10131 00000100:00100000:0.0:1746155576.872446:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.873131:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124018304 00000100:00100000:3.0:1746155576.873139:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124018304 00000100:00100000:3.0:1746155576.873652:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10132 00000100:00100000:3.0:1746155576.873661:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29481:x1830976124018304:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155576.873677:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155576.873691:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ed10b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11dc4 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.873750:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed112 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155576.873760:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed112 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155576.873768:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed112 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155576.873788:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155576.873792:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155576.873803:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed112 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155576.873821:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1cf600/0x844e5faceb5ed10b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dc4 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.873843:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed112 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dc4 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.873849:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:3.0:1746155576.873852:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155576.873854:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a237400, rc 0) 00000100:00100000:3.0:1746155576.873901:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29481:x1830976124018304:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 242us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155576.873907:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10132 00000100:00100000:0.0:1746155576.878895:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.878931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.879269:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.879423:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.879440:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124018432 00000100:00100000:2.0:1746155576.879447:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124018432 00000100:00100000:2.0:1746155576.879473:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124018560 00000100:00100000:2.0:1746155576.879475:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124018560 00000100:00100000:2.0:1746155576.879483:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124018688 00000100:00100000:2.0:1746155576.879485:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124018688 00000100:00100000:2.0:1746155576.879532:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12642 00000100:00100000:2.0:1746155576.879539:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1960:x1830976124018432:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155576.879540:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12643 00000100:00100000:1.0:1746155576.879547:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1961:x1830976124018560:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155576.879554:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155576.879554:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.879567:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7800/0x844e5faceb5ed119 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11dcb expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.879567:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5ed120 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11dd2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155576.879586:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x68143838, atime: 0x68143838, ctime: 0x68143838, blocks: 0x765 00002000:00010000:1.0:1746155576.879586:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3da:0x0] initial LVB size: 2097152, mtime: 0x68143838, atime: 0x68143838, ctime: 0x68143838, blocks: 0x821 00010000:00010000:2.0:1746155576.879600:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.879600:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.879602:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.879602:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.879608:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7800/0x844e5faceb5ed119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dcb expref: 7 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.879608:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5ed120 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd2 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.879622:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7800/0x844e5faceb5ed119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dcb expref: 7 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.879622:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5ed120 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd2 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.879630:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55f7800, rc 0) 00010000:00010000:1.0:1746155576.879630:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8000, rc 0) 00000100:00100000:1.0:1746155576.879664:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1961:x1830976124018560:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 117us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.879670:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12643 00000100:00100000:1.0:1746155576.879683:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12644 00000100:00100000:1.0:1746155576.879688:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1960:x1830976124018688:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155576.879692:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155576.879699:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe8c00/0x844e5faceb5ed127 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11dd9 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155576.879707:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3db:0x0] initial LVB size: 2097152, mtime: 0x68143839, atime: 0x68143838, ctime: 0x68143839, blocks: 0x821 00010000:00010000:1.0:1746155576.879714:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.879715:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.879718:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8c00/0x844e5faceb5ed127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd9 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.879726:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8c00/0x844e5faceb5ed127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd9 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.879732:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe8c00, rc 0) 00000100:00100000:2.0:1746155576.880377:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976124018432:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 837us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.880382:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12642 00000100:00100000:2.0:1746155576.880392:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124018816 00000100:00100000:2.0:1746155576.880394:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124018816 00000100:00100000:2.0:1746155576.880406:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12645 00000100:00100000:2.0:1746155576.880410:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976124018816:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155576.880416:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155576.880423:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55f6400/0x844e5faceb5ed12e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11de0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155576.880432:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x68143839, atime: 0x68143839, ctime: 0x68143839, blocks: 0x821 00010000:00010000:2.0:1746155576.880439:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.880441:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.880444:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55f6400/0x844e5faceb5ed12e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de0 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.880453:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55f6400/0x844e5faceb5ed12e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de0 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155576.880460:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55f6400, rc 0) 00000100:00100000:2.0:1746155576.880474:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976124018816:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 63us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155576.880478:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12645 00000100:00100000:1.0:1746155576.880740:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976124018688:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1051us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.880745:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12644 00000100:00100000:0.0:1746155576.880821:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155576.880838:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124018944 00000100:00100000:1.0:1746155576.880841:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124018944 00000100:00100000:1.0:1746155576.880861:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12646 00000100:00100000:1.0:1746155576.880865:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976124018944:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155576.880871:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155576.880879:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ed135 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11de7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155576.880888:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d9:0x0] initial LVB size: 4954272, mtime: 0x68143838, atime: 0x68143837, ctime: 0x68143838, blocks: 0x1613 00010000:00010000:1.0:1746155576.880895:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.880896:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.880900:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ed135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de7 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155576.880901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155576.880909:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ed135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de7 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.880915:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad800, rc 0) 00000100:00100000:1.0:1746155576.880929:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976124018944:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 63us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.880934:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12646 00000100:00100000:1.0:1746155576.880941:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124019072 00000100:00100000:1.0:1746155576.880943:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124019072 00000100:00100000:1.0:1746155576.880955:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12647 00000100:00100000:1.0:1746155576.880959:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1960:x1830976124019072:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155576.880965:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155576.880972:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090344200/0x844e5faceb5ed13c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11dee expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155576.880981:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3dc:0x0] initial LVB size: 4194304, mtime: 0x68143838, atime: 0x68143837, ctime: 0x68143838, blocks: 0x1029 00010000:00010000:1.0:1746155576.880988:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.880989:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.880992:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090344200/0x844e5faceb5ed13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dee expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.881001:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090344200/0x844e5faceb5ed13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dee expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155576.881007:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090344200, rc 0) 00000100:00100000:1.0:1746155576.881022:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976124019072:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 63us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155576.881026:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12647 00000100:00100000:0.0:1746155576.901353:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.901403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.901490:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124019328 00000100:00100000:2.0:1746155576.901532:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124019328 00000100:00100000:2.0:1746155576.901575:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124019584 00000100:00100000:2.0:1746155576.901577:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124019584 00000100:00100000:2.0:1746155576.901594:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4960 00000100:00100000:2.0:1746155576.901601:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976124019328:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155576.901634:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7e00/0x844e5faceb5ed143 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.901646:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.901647:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.901651:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7e00/0x844e5faceb5ed143 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.901662:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7e00/0x844e5faceb5ed143 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.901829:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4961 00000100:00100000:1.0:1746155576.901837:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976124019584:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155576.901853:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ed14a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.901861:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.901862:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.901864:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ed14a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.901873:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ed14a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155576.912479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.912535:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.914779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.917556:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.918762:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124019840 00000100:00100000:1.0:1746155576.918762:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124020096 00000100:00100000:2.0:1746155576.918770:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124019840 00000100:00100000:1.0:1746155576.918770:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124020096 00000100:00100000:2.0:1746155576.918813:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124020352 00000100:00100000:2.0:1746155576.918817:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124020352 00000100:00100000:1.0:1746155576.918819:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4962 00000100:00100000:1.0:1746155576.918826:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124019840:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:2.0:1746155576.918837:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4963 00000100:00100000:2.0:1746155576.918843:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976124020096:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155576.918859:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0200/0x844e5faceb5ed151 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.918861:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5ed158 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.918870:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.918870:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.918872:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.918872:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155576.918876:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5ed158 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.918876:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0200/0x844e5faceb5ed151 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.918886:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5ed158 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.918886:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0200/0x844e5faceb5ed151 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.919180:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4964 00000100:00100000:1.0:1746155576.919192:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976124020352:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155576.919207:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1800/0x844e5faceb5ed15f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.919213:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.919214:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.919217:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1800/0x844e5faceb5ed15f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.919223:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1800/0x844e5faceb5ed15f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155576.919358:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124020608 00000100:00100000:3.0:1746155576.919362:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124020608 00000100:00100000:3.0:1746155576.919385:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4965 00000100:00100000:3.0:1746155576.919391:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976124020608:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155576.919404:0:10888:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed166 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.919411:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.919413:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.919415:0:10888:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed166 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.919422:0:10888:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed166 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155576.921703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155576.922471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155576.923073:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124020864 00000100:00100000:3.0:1746155576.923080:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124020864 00000100:00100000:3.0:1746155576.923114:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124021120 00000100:00100000:3.0:1746155576.923117:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124021120 00000100:00100000:3.0:1746155576.923132:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4966 00000100:00100000:3.0:1746155576.923138:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1962:x1830976124020864:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155576.923169:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed16d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.923181:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.923182:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155576.923187:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed16d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.923198:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed16d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.923223:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ed14a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.923233:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ed14a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.923240:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ed14a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.923247:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe3a400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155576.923250:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ed14a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.923257:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ed14a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.923270:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ed14a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.923275:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe3a400/0x844e5faceb5ed14a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.923318:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976124019584:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 21482us (21914us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155576.923325:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4961 00000100:00100000:1.0:1746155576.923339:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4967 00000100:00100000:1.0:1746155576.923344:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976124021120:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155576.923357:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed174 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.923363:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.923364:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155576.923367:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed174 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.923378:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed174 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.941789:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1800/0x844e5faceb5ed15f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.941804:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1800/0x844e5faceb5ed15f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.941811:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1800/0x844e5faceb5ed15f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.941817:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffc1800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155576.941821:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1800/0x844e5faceb5ed15f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.941828:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1800/0x844e5faceb5ed15f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.941844:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1800/0x844e5faceb5ed15f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.941849:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1800/0x844e5faceb5ed15f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.941922:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1962:x1830976124020352:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 22727us (27145us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155576.941932:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4964 00010000:00010000:2.0:1746155576.942527:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7e00/0x844e5faceb5ed143 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.942536:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7e00/0x844e5faceb5ed143 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.942542:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7e00/0x844e5faceb5ed143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.942547:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a55f7e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155576.942549:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7e00/0x844e5faceb5ed143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.942554:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7e00/0x844e5faceb5ed143 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.942567:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7e00/0x844e5faceb5ed143 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.942572:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7e00/0x844e5faceb5ed143 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155576.942608:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976124019328:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 41007us (41263us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155576.942613:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4960 00010000:00010000:3.0:1746155576.951880:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5ed158 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.951895:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5ed158 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.951901:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5ed158 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.951907:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e123400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155576.951911:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5ed158 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.951918:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5ed158 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.951933:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5ed158 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.951938:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e123400/0x844e5faceb5ed158 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155576.952004:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976124020096:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 33156us (39464us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155576.952014:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4963 00010000:00010000:1.0:1746155576.962432:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0200/0x844e5faceb5ed151 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.962447:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0200/0x844e5faceb5ed151 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.962454:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0200/0x844e5faceb5ed151 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.962460:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffc0200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155576.962463:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0200/0x844e5faceb5ed151 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.962469:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0200/0x844e5faceb5ed151 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.962485:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0200/0x844e5faceb5ed151 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.962489:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0200/0x844e5faceb5ed151 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155576.963908:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976124019840:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 45076us (51429us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155576.963918:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4962 00010000:00010000:3.0:1746155576.969757:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed16d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.969771:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed16d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.969778:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed16d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.969783:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cbac200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155576.969786:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed16d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.969793:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed16d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.969808:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed16d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155576.969813:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed16d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155576.969894:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1962:x1830976124020864:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 46752us (48191us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155576.969903:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4966 00010000:00010000:0.0:1746155576.975121:0:10888:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed166 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.975141:0:10888:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed166 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.975147:0:10888:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.975153:0:10888:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1cea00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155576.975157:0:10888:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed166 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.975163:0:10888:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed166 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.975178:0:10888:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed166 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.975431:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed174 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.975438:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed174 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.975442:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed174 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.975447:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ffc1400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155576.975449:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed174 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.975454:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed174 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.975461:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed174 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155576.975466:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed174 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155576.977162:0:10888:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1cea00/0x844e5faceb5ed166 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155576.977249:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1962:x1830976124020608:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 57853us (59695us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155576.977258:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4965 00000100:00100000:1.0:1746155576.977434:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976124021120:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 54089us (54962us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155576.977439:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4967 00000100:00100000:0.0:1746155576.992834:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155576.993550:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124021376 00000100:00100000:2.0:1746155576.993557:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124021376 00000100:00100000:2.0:1746155576.994139:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10133 00000100:00100000:2.0:1746155576.994147:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29481:x1830976124021376:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155576.994185:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155576.994206:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237400/0x844e5faceb5ed112 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dc4 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155576.994235:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155576.994239:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155576.994269:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123200/0x844e5faceb5ed17b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155576.994283:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123200/0x844e5faceb5ed17b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155576.994291:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123200/0x844e5faceb5ed17b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00010000:2.0:1746155576.994442:0:27374:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f3ed500 reply state ffff88009bde8000 transno 8589944113 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123200/0x844e5faceb5ed17b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155576.994448:0:27374:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746155576.994556:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29481:x1830976124021376:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 409us (1728us total) trans 8589944113 rc 0/0 00000100:00100000:2.0:1746155576.994561:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10133 00000100:00100000:2.0:1746155577.000641:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.000685:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.000710:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124021632 00000100:00100000:2.0:1746155577.000717:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124021632 00000100:00100000:2.0:1746155577.000746:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124021888 00000100:00100000:2.0:1746155577.000748:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124021888 00000100:00100000:2.0:1746155577.000761:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12648 00000100:00100000:2.0:1746155577.000767:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976124021632:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:2.0:1746155577.000904:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155577.000907:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155576 -> 1746155577 00002000:00010000:2.0:1746155577.000909:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155576 -> 1746155577 00002000:00010000:2.0:1746155577.000911:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155576 -> 1746155577 00002000:00010000:2.0:1746155577.000912:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155577.000955:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976124021632:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 187us (320us total) trans 17179873283 rc 0/0 00000100:00100000:2.0:1746155577.000960:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12648 00000100:00100000:2.0:1746155577.000975:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12649 00000100:00100000:2.0:1746155577.000980:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976124021888:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:2.0:1746155577.001051:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155577.001054:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.001056:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.001057:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.001059:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155577.001074:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124021888:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 94us (388us total) trans 21474840678 rc 0/0 00000100:00100000:2.0:1746155577.001079:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12649 00000100:00100000:0.0:1746155577.001192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.001227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.001241:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124022144 00000100:00100000:0.0:1746155577.001243:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124022144 00000100:00100000:0.0:1746155577.001258:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124021504 00000100:00100000:0.0:1746155577.001259:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124021504 00000100:00100000:0.0:1746155577.001268:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12650 00000100:00100000:0.0:1746155577.001273:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976124022144:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:0.0:1746155577.001338:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155577.001341:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155576 -> 1746155577 00002000:00010000:0.0:1746155577.001343:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155575 -> 1746155577 00002000:00010000:0.0:1746155577.001345:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155576 -> 1746155577 00002000:00010000:0.0:1746155577.001346:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155577.001366:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124022144:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 93us (175us total) trans 17179873284 rc 0/0 00000100:00100000:0.0:1746155577.001371:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12650 00000100:00100000:0.0:1746155577.001381:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12651 00000100:00100000:0.0:1746155577.001386:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124021504:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:0.0:1746155577.001444:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155577.001446:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155576 -> 1746155577 00002000:00010000:0.0:1746155577.001448:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155576 -> 1746155577 00002000:00010000:0.0:1746155577.001449:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155576 -> 1746155577 00002000:00010000:0.0:1746155577.001451:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1893 -> 1893 00000100:00100000:0.0:1746155577.001464:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124021504:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 78us (236us total) trans 21474840679 rc 0/0 00000100:00100000:0.0:1746155577.001469:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12651 00000100:00100000:0.0:1746155577.001534:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155577.001574:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123200/0x844e5faceb5ed17b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.001583:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123200/0x844e5faceb5ed17b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.001592:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123200/0x844e5faceb5ed17b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.001597:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e123200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155577.001600:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123200/0x844e5faceb5ed17b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.001605:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123200/0x844e5faceb5ed17b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.001616:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155577.001618:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155577.001620:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123200/0x844e5faceb5ed17b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.001624:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123200/0x844e5faceb5ed17b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155577.001922:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124021760 00000100:00100000:1.0:1746155577.001926:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124021760 00000100:00100000:1.0:1746155577.001942:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12652 00000100:00100000:1.0:1746155577.001947:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124021760:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155577.002012:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155577.002014:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:1.0:1746155577.002016:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155576 -> 1746155577 00002000:00010000:1.0:1746155577.002018:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:1.0:1746155577.002019:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155577.002036:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124021760:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 88us (502us total) trans 17179873285 rc 0/0 00000100:00100000:1.0:1746155577.002043:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12652 00000100:00100000:1.0:1746155577.002076:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.002087:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124022016 00000100:00100000:1.0:1746155577.002090:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124022016 00000100:00100000:1.0:1746155577.002102:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12653 00000100:00100000:1.0:1746155577.002106:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124022016:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155577.002165:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:1.0:1746155577.002167:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155576 -> 1746155577 00002000:00010000:1.0:1746155577.002169:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155575 -> 1746155577 00002000:00010000:1.0:1746155577.002170:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155576 -> 1746155577 00002000:00010000:1.0:1746155577.002172:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:1.0:1746155577.002187:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976124022016:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 79us (110us total) trans 21474840680 rc 0/0 00000100:00100000:1.0:1746155577.002191:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12653 00000100:00100000:0.0:1746155577.005485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.005605:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124022400 00000100:00100000:3.0:1746155577.005614:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124022400 00000100:00100000:3.0:1746155577.005663:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4122 00000100:00100000:3.0:1746155577.005671:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29481:x1830976124022400:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:3.0:1746155577.005716:0:16336:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x35b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237c00/0x844e5faceb5ed0c5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11db6 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.005751:0:16336:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155577.005760:0:16336:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5ed104 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dbd expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.005766:0:16336:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155577.005790:0:16336:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5ed104 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dbd expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.005800:0:16336:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5ed104 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dbd expref: 9 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.005811:0:16336:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe90a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16336:1830976124679936:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.005878:0:16336:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61610c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746155577.006439:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155577.008067:0:16336:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe90a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16336:1830976124679936:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155577.008079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155577.008085:0:16336:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:1.0:1746155577.008144:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124022528 00000100:00100000:1.0:1746155577.008151:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124022528 00010000:00010000:1.0:1746155577.008175:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5ed104 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dbd expref: 10 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:1.0:1746155577.008377:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6428 00000100:00100000:1.0:1746155577.008382:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976124022528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.008437:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.008444:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5ed104 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dbd expref: 10 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.008454:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5ed104 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dbd expref: 10 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.008469:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ce400/0x844e5faceb5ed104 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dbd expref: 10 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.008774:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:1.0:1746155577.008780:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:1.0:1746155577.008787:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16336 initiator: MDT0 00010000:00010000:1.0:1746155577.008794:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155577.008919:0:16336:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155577.008932:0:16336:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:1.0:1746155577.009318:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.009416:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976124022528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1032us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.009422:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6428 00000040:00080000:3.0:1746155577.010055:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2954, 88 off247344 00000004:00080000:3.0:1746155577.010062:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706159558347ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155577.012423:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2890, 88 off241440 00000004:00080000:3.0:1746155577.012433:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706161930080ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155577.012461:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2891, 88 off241528 00000004:00080000:3.0:1746155577.012464:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706161961201ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155577.012476:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2955, 88 off247432 00000004:00080000:3.0:1746155577.012479:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706161975683ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155577.012485:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2956, 88 off247520 00000004:00080000:3.0:1746155577.012487:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706161984068ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155577.012518:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2892, 88 off241616 00000004:00080000:3.0:1746155577.012521:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706162018121ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155577.012529:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2893, 88 off241704 00000004:00080000:3.0:1746155577.012531:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706162028393ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155577.012538:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2894, 88 off241792 00000004:00080000:3.0:1746155577.012540:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706162037273ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155577.012546:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2957, 88 off247608 00000004:00080000:3.0:1746155577.012549:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706162046451ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155577.012556:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2895, 88 off241880 00000004:00080000:3.0:1746155577.012558:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706162055023ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155577.012564:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2958, 88 off247696 00000004:00080000:3.0:1746155577.012566:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706162063140ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155577.012572:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2896, 88 off241968 00000004:00080000:3.0:1746155577.012575:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706162072348ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155577.012581:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2959, 88 off247784 00000004:00080000:3.0:1746155577.012583:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706162080595ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155577.012589:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2960, 88 off247872 00000004:00080000:3.0:1746155577.012591:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706162088543ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155577.012597:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2961, 88 off247960 00000004:00080000:3.0:1746155577.012600:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706162096685ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155577.012605:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2962, 88 off248048 00000004:00080000:3.0:1746155577.012607:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706162104661ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155577.012613:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2897, 88 off242056 00000004:00080000:3.0:1746155577.012615:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706162112436ns, next at 645866785986ns, rc = 0 00000001:00080000:1.0:1746155577.079175:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944113 is committed 00000001:00080000:1.0:1746155577.079191:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944114 is committed 00000004:00080000:1.0:1746155577.079193:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2089 committed 00000004:00080000:1.0:1746155577.079200:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2160 committed 00000004:00080000:1.0:1746155577.079206:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2159 committed 00000004:00080000:1.0:1746155577.079207:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2158 committed 00000004:00080000:1.0:1746155577.079209:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2157 committed 00000004:00080000:1.0:1746155577.079210:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2088 committed 00000004:00080000:1.0:1746155577.079211:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2156 committed 00000004:00080000:1.0:1746155577.079213:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2087 committed 00000004:00080000:1.0:1746155577.079214:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2155 committed 00000004:00080000:1.0:1746155577.079215:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2086 committed 00000004:00080000:1.0:1746155577.079218:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2085 committed 00000004:00080000:1.0:1746155577.079219:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2084 committed 00000004:00080000:1.0:1746155577.079221:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2154 committed 00000004:00080000:1.0:1746155577.079222:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2153 committed 00000004:00080000:1.0:1746155577.079223:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2083 committed 00000004:00080000:1.0:1746155577.079225:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2082 committed 00000004:00080000:1.0:1746155577.079226:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2152 committed 00000004:00010000:2.0:1746155577.079265:0:16336:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f3ec700 reply state ffff88008e3b7400 transno 8589944114 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:2.0:1746155577.079276:0:16336:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746155577.079282:0:16336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155577.079285:0:16336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155577.079292:0:16336:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a237c00/0x844e5faceb5ed0c5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11db6 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.079312:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124680320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155577.079365:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1746155577.079370:0:16336:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746155577.079381:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29481:x1830976124022400:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 73710us (73901us total) trans 8589944114 rc 0/0 00000100:00100000:2.0:1746155577.079390:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4122 00000100:00100000:1.0:1746155577.079399:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124680832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155577.079410:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746155577.079417:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16336 initiator: MDT0 00000100:00100000:1.0:1746155577.079422:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746155577.079425:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124680192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155577.079435:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746155577.079436:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155577.079442:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16336 initiator: MDT0 00000100:00100000:1.0:1746155577.079443:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124680704:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746155577.079446:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd4f600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155577.079450:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16336 initiator: MDT0 00000100:00100000:1.0:1746155577.079452:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746155577.079456:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155577.079467:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff8800a5171400) 00010000:00010000:2.0:1746155577.079470:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155577.079472:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155577.079476:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4f600/0x844e5faceb5ed182 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16336 initiator: MDT0 00000100:00100000:2.0:1746155577.079521:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124680320 00000100:00100000:2.0:1746155577.079527:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124680320 00000100:00100000:2.0:1746155577.079553:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124680832 00000100:00100000:2.0:1746155577.079555:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124680832 00000100:00100000:2.0:1746155577.079564:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124680192 00000100:00100000:2.0:1746155577.079566:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124680192 00000100:00100000:2.0:1746155577.079576:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124680704 00000100:00100000:2.0:1746155577.079578:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124680704 00000100:00100000:1.0:1746155577.079583:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12654 00000100:00100000:1.0:1746155577.079590:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3298:x1830976124680320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155577.079706:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124680064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155577.079726:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746155577.079728:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155577.079731:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:1.0:1746155577.079733:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:1.0:1746155577.079735:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:1.0:1746155577.079736:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155577.079743:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124680576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155577.079755:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155577.079759:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3298:x1830976124680320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (394us total) trans 17179873286 rc 0/0 00000100:00100000:0.0:1746155577.079767:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746155577.079771:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124680448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155577.079781:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155577.079797:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124680960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155577.079808:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155577.079825:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124680064 00000100:00100000:0.0:1746155577.079828:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124680064 00000100:00100000:3.0:1746155577.080016:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124681472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155577.080035:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155577.080046:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124681984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155577.080056:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155577.080063:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746155577.080066:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124681088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155577.080076:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155577.080082:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124681600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155577.080092:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155577.080106:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124680576 00000100:00100000:3.0:1746155577.080108:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124680576 00000100:00100000:2.0:1746155577.080154:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124680448 00000100:00100000:2.0:1746155577.080157:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124680448 00000100:00100000:2.0:1746155577.080165:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124680960 00000100:00100000:2.0:1746155577.080166:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124680960 00000100:00100000:2.0:1746155577.080172:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124681472 00000100:00100000:2.0:1746155577.080173:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124681472 00000100:00100000:2.0:1746155577.080184:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124681984 00000100:00100000:2.0:1746155577.080185:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124681984 00000100:00100000:2.0:1746155577.080190:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124681088 00000100:00100000:2.0:1746155577.080192:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124681088 00000100:00100000:2.0:1746155577.080198:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124681600 00000100:00100000:2.0:1746155577.080199:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124681600 00000100:00100000:2.0:1746155577.080208:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12655 00000100:00100000:2.0:1746155577.080213:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976124680832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155577.080302:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976124680832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (890us total) trans 17179873287 rc 0/0 00000100:00100000:2.0:1746155577.080308:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12655 00000100:00100000:2.0:1746155577.080317:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12656 00000100:00100000:2.0:1746155577.080322:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976124680192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155577.080385:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155577.080388:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.080390:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.080392:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.080393:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155577.080410:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976124680192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (973us total) trans 17179873288 rc 0/0 00000100:00100000:2.0:1746155577.080415:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12656 00000100:00100000:2.0:1746155577.080422:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12657 00000100:00100000:2.0:1746155577.080426:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976124680704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155577.080517:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12654 00000100:00100000:2.0:1746155577.080523:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976124680704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (1068us total) trans 17179873289 rc 0/0 00000100:00100000:2.0:1746155577.080529:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12657 00000100:00100000:1.0:1746155577.080532:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12658 00000100:00100000:1.0:1746155577.080537:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976124680448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155577.080539:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12659 00000100:00100000:2.0:1746155577.080544:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976124680960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155577.080616:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3296:x1830976124680960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (807us total) trans 17179873290 rc 0/0 00000100:00100000:2.0:1746155577.080621:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12659 00000100:00100000:2.0:1746155577.080630:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12660 00000100:00100000:2.0:1746155577.080635:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976124681472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155577.080637:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976124680448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (854us total) trans 17179873291 rc 0/0 00000100:00100000:1.0:1746155577.080642:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12658 00000100:00100000:1.0:1746155577.080651:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12661 00000100:00100000:1.0:1746155577.080655:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976124681984:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1746155577.080708:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746155577.080711:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155577.080721:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12662 00000100:00100000:2.0:1746155577.080725:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3295:x1830976124681088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155577.080733:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3295:x1830976124681984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (675us total) trans 21474840681 rc 0/0 00000100:00100000:1.0:1746155577.080738:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12661 00000100:00100000:1.0:1746155577.080748:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12663 00000100:00100000:1.0:1746155577.080752:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3295:x1830976124681600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155577.080790:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155577.080792:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.080794:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.080796:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.080797:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1893 -> 1893 00000100:00100000:2.0:1746155577.080818:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976124681088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (739us total) trans 21474840683 rc 0/0 00000100:00100000:1.0:1746155577.080820:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976124681600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (726us total) trans 21474840684 rc 0/0 00000100:00100000:2.0:1746155577.080823:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12662 00000100:00100000:1.0:1746155577.080826:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12663 00002000:00010000:2.0:1746155577.080853:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00000100:00100000:1.0:1746155577.080854:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124681344:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155577.080855:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155577.080857:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155577.080858:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155577.080860:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:1.0:1746155577.080869:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155577.080876:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3295:x1830976124681472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 242us (840us total) trans 21474840682 rc 0/0 00000100:00100000:2.0:1746155577.080881:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12660 00000100:00100000:1.0:1746155577.080885:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124681856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155577.080888:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124681344 00000100:00100000:2.0:1746155577.080891:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124681344 00000100:00100000:1.0:1746155577.080896:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746155577.081721:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf7100/2, rc 0, transno 17179873288 00000100:00100000:1.0:1746155577.081726:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124680192:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155577.081734:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf5180/2, rc 0, transno 17179873289 00000100:00100000:1.0:1746155577.081736:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124680704:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155577.081742:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf4000/2, rc 0, transno 17179873286 00000100:00100000:1.0:1746155577.081745:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124680320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155577.081751:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf7480/2, rc 0, transno 17179873287 00000100:00100000:1.0:1746155577.081753:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124680832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155577.081760:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746155577.081765:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124681216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155577.081782:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155577.084301:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124681856 00000100:00100000:2.0:1746155577.084310:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124681856 00000100:00100000:2.0:1746155577.084346:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12664 00000100:00100000:2.0:1746155577.084352:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3298:x1830976124681344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155577.084482:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:2.0:1746155577.084484:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.084487:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.084488:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.084490:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:2.0:1746155577.085736:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976124681344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1381us (4862us total) trans 21474840685 rc 0/0 00000100:00100000:2.0:1746155577.085744:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12664 00000100:00100000:2.0:1746155577.085763:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12665 00000100:00100000:2.0:1746155577.085769:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976124680064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155577.085882:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155577.085885:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.085887:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.085889:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.085890:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155577.085915:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976124680064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 148us (6188us total) trans 17179873292 rc 0/0 00000100:00100000:2.0:1746155577.085920:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12665 00000100:00100000:2.0:1746155577.085930:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12666 00000100:00100000:2.0:1746155577.085935:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976124680576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155577.086014:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976124680576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (6256us total) trans 17179873293 rc 0/0 00000100:00100000:2.0:1746155577.086019:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12666 00000100:00100000:2.0:1746155577.086029:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12667 00000100:00100000:2.0:1746155577.086033:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3298:x1830976124681856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155577.086123:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976124681856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (5225us total) trans 21474840686 rc 0/0 00000100:00100000:2.0:1746155577.086127:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12667 00000100:00100000:1.0:1746155577.087195:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124681216 00000100:00100000:1.0:1746155577.087200:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124681216 00000100:00100000:1.0:1746155577.087226:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12668 00000100:00100000:1.0:1746155577.087232:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976124681216:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155577.087266:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe90a80/2, rc 0, transno 21474840683 00000100:00100000:3.0:1746155577.087275:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124681088:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155577.087286:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe92300/2, rc 0, transno 21474840684 00000100:00100000:3.0:1746155577.087288:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124681600:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155577.087295:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe92680/2, rc 0, transno 21474840682 00000100:00100000:3.0:1746155577.087298:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124681472:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155577.087303:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0ac4380/2, rc 0, transno 21474840681 00000100:00100000:3.0:1746155577.087306:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124681984:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155577.087323:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155577.087326:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:1.0:1746155577.087328:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:1.0:1746155577.087329:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:1.0:1746155577.087331:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155577.087343:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746155577.087349:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124682112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155577.087353:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976124681216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (5570us total) trans 21474840687 rc 0/0 00000100:00100000:1.0:1746155577.087358:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12668 00000100:00100000:3.0:1746155577.087370:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155577.087377:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124682112 00000100:00100000:1.0:1746155577.087380:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124682112 00000100:00100000:1.0:1746155577.087393:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12669 00000100:00100000:1.0:1746155577.087397:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124682112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155577.087467:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124682112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (95us total) trans 21474840688 rc 0/0 00000100:00100000:0.0:1746155577.087540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.087558:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124022656 00000100:00100000:0.0:1746155577.087560:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124022656 00000100:00100000:0.0:1746155577.087578:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10134 00000100:00100000:0.0:1746155577.087582:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:29481:x1830976124022656:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155577.087593:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155577.087606:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed189 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11df5 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.087641:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed189 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11df5 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.087651:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed189 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11df5 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.087662:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:0.0:1746155577.087665:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155577.087667:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbad600, rc 0) 00000100:00100000:0.0:1746155577.087688:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29481:x1830976124022656:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 105us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.087692:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10134 00000004:00080000:0.0:1746155577.087746:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf4700/2, rc 0, transno 17179873291 00000100:00100000:0.0:1746155577.087749:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124680448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155577.087756:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf4e00/2, rc 0, transno 17179873290 00000100:00100000:0.0:1746155577.087758:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124680960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155577.087764:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf5880/2, rc 0, transno 17179873292 00000100:00100000:0.0:1746155577.087766:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124680064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155577.087770:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf5c00/2, rc 0, transno 17179873293 00000100:00100000:0.0:1746155577.087771:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124680576:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155577.087833:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130899880/2, rc 0, transno 21474840688 00000100:00100000:3.0:1746155577.087835:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124682112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155577.087968:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12669 00000004:00080000:1.0:1746155577.088002:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe91500/2, rc 0, transno 21474840687 00000100:00100000:1.0:1746155577.088007:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124681216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155577.088012:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124681728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155577.088029:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746155577.088045:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe90000/2, rc 0, transno 21474840685 00000100:00100000:1.0:1746155577.088048:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124681344:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155577.088054:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0ac5500/2, rc 0, transno 21474840686 00000100:00100000:1.0:1746155577.088056:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124681856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155577.088066:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124681728 00000100:00100000:1.0:1746155577.088069:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124681728 00000100:00100000:1.0:1746155577.088082:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12670 00000100:00100000:1.0:1746155577.088086:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976124681728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155577.088181:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3298:x1830976124681728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (150us total) trans 21474840689 rc 0/0 00000100:00100000:1.0:1746155577.088186:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12670 00000004:00080000:0.0:1746155577.088195:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0ac4e00/2, rc 0, transno 21474840689 00000100:00100000:0.0:1746155577.088199:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124681728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155577.096574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.096862:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124022912 00000100:00100000:2.0:1746155577.096870:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124022912 00000100:00100000:2.0:1746155577.096917:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4123 00000100:00100000:2.0:1746155577.096925:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a651050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29481:x1830976124022912:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:2.0:1746155577.097145:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a651050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29481:x1830976124022912:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 220us (577us total) trans 8589944115 rc 0/0 00000100:00100000:2.0:1746155577.097151:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4123 00000100:00100000:0.0:1746155577.120864:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.121460:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124023168 00000100:00100000:3.0:1746155577.121468:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124023168 00000100:00100000:3.0:1746155577.121562:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10135 00000100:00100000:3.0:1746155577.121569:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+6:29493:x1830976124023168:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.121589:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.121603:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8e00/0x844e5faceb5ed190 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11dfc expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.121687:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5ed197 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121697:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5ed197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121706:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5ed197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121716:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8a00/0x844e5faceb5ed19e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121724:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8a00/0x844e5faceb5ed19e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121729:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8a00/0x844e5faceb5ed19e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121810:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed1a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121816:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121821:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155577.121827:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155577.121887:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5ed197 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121893:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5ed197 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121898:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5ed197 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121902:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5cc9a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155577.121906:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5ed197 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121911:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5ed197 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121919:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155577.121922:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155577.121925:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5ed197 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121930:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9a00/0x844e5faceb5ed197 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121956:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8a00/0x844e5faceb5ed19e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121960:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8a00/0x844e5faceb5ed19e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121965:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8a00/0x844e5faceb5ed19e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121968:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5cc8a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155577.121970:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8a00/0x844e5faceb5ed19e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121974:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8a00/0x844e5faceb5ed19e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121979:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800942dc000) 00010000:00010000:3.0:1746155577.121981:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155577.121983:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8a00/0x844e5faceb5ed19e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.121987:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8a00/0x844e5faceb5ed19e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.122015:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8e00/0x844e5faceb5ed190 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dfc expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.122028:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dfc expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.122033:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.122035:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155577.122037:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cc9e00, rc 0) 00000100:00100000:3.0:1746155577.122070:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29493:x1830976124023168:12345-192.168.202.51@tcp:101:cat.0 Request processed in 502us (1213us total) trans 8589944116 rc 0/0 00000100:00100000:3.0:1746155577.122076:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10135 00000100:00080000:2.0:1746155577.122208:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155577.128370:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.128443:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124023424 00000100:00100000:1.0:1746155577.128451:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124023424 00000100:00100000:3.0:1746155577.128530:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10136 00000100:00100000:3.0:1746155577.128540:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+285:29489:x1830976124023424:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155577.128565:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.128580:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed1b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e03 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.128666:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226e00/0x844e5faceb5ed1ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128676:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226e00/0x844e5faceb5ed1ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128684:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226e00/0x844e5faceb5ed1ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128694:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227a00/0x844e5faceb5ed1c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128698:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227a00/0x844e5faceb5ed1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128703:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227a00/0x844e5faceb5ed1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128783:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226200/0x844e5faceb5ed1c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128790:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226200/0x844e5faceb5ed1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128796:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226200/0x844e5faceb5ed1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155577.128802:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155577.128867:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226e00/0x844e5faceb5ed1ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128872:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226e00/0x844e5faceb5ed1ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128877:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226e00/0x844e5faceb5ed1ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128881:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a226e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155577.128883:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226e00/0x844e5faceb5ed1ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128888:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226e00/0x844e5faceb5ed1ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128896:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155577.128898:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155577.128901:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226e00/0x844e5faceb5ed1ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128908:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226e00/0x844e5faceb5ed1ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128916:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227a00/0x844e5faceb5ed1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128920:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227a00/0x844e5faceb5ed1c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128924:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227a00/0x844e5faceb5ed1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128928:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a227a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155577.128930:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227a00/0x844e5faceb5ed1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128934:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227a00/0x844e5faceb5ed1c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128939:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800942dc600) 00010000:00010000:3.0:1746155577.128941:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155577.128943:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227a00/0x844e5faceb5ed1c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128946:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a227a00/0x844e5faceb5ed1c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.128976:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed1b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e03 expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.128986:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226200/0x844e5faceb5ed1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e03 expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.128995:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.128997:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155577.128999:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a226200, rc 0) 00000100:00100000:3.0:1746155577.129043:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29489:x1830976124023424:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 505us (680us total) trans 8589944117 rc 0/0 00000100:00100000:3.0:1746155577.129049:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10136 00000100:00100000:0.0:1746155577.130255:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.131536:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124023552 00000100:00100000:2.0:1746155577.131546:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124023552 00000100:00100000:2.0:1746155577.131601:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12671 00000100:00100000:2.0:1746155577.131609:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29493:x1830976124023552:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155577.131622:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.131641:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cda5200/0x844e5faceb5ed1d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e0a expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.131661:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.131663:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.131670:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cda5200/0x844e5faceb5ed1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e0a expref: 14 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.131681:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cda5200/0x844e5faceb5ed1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e0a expref: 14 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.131694:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cda5200, rc 0) 00000100:00100000:2.0:1746155577.131742:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29493:x1830976124023552:12345-192.168.202.51@tcp:101:cat.0 Request processed in 134us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.131747:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12671 00000100:00080000:0.0:1746155577.131819:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155577.132555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.132602:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124023808 00000100:00100000:3.0:1746155577.132607:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124023808 00000100:00100000:3.0:1746155577.132642:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10137 00000100:00100000:3.0:1746155577.132648:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29487:x1830976124023808:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155577.132660:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.132672:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4d600/0x844e5faceb5ed1dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e11 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.132746:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.132757:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed1a5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dfc expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.132763:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226200/0x844e5faceb5ed1c8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e03 expref: 286 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.132773:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.132799:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226200/0x844e5faceb5ed1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e03 expref: 286 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.132809:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226200/0x844e5faceb5ed1c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e03 expref: 286 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.132819:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124682240:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.133783:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dfc expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.133794:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed1a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dfc expref: 9 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.133802:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124682368:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.134525:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fbe240 going to sleep for 11 seconds 00010000:00010000:3.0:1746155577.134874:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155577.135289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.136344:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124024064 00000100:00100000:1.0:1746155577.136352:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124024064 00000100:00100000:1.0:1746155577.136465:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10138 00000100:00100000:1.0:1746155577.136475:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29492:x1830976124024064:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155577.136520:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155577.136534:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5318a00/0x844e5faceb5ed1eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e18 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.136605:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8e00/0x844e5faceb5ed1f2 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.136616:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8e00/0x844e5faceb5ed1f2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.136623:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8e00/0x844e5faceb5ed1f2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155577.136631:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155577.136720:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5318a00/0x844e5faceb5ed1eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e18 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.137686:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8e00/0x844e5faceb5ed1f2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e18 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.137694:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:1.0:1746155577.137696:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746155577.137698:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.137704:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.137709:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cc8e00, rc 0) 00000100:00100000:1.0:1746155577.137759:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29492:x1830976124024064:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1287us (2474us total) trans 8589944118 rc 0/0 00000100:00100000:1.0:1746155577.137764:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10138 00000100:00100000:2.0:1746155577.141092:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.141140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.141975:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124024192 00000100:00100000:1.0:1746155577.141983:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124024192 00010000:00010000:1.0:1746155577.142018:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed1a5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dfc expref: 10 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:1.0:1746155577.142058:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6429 00000100:00100000:1.0:1746155577.142066:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976124024192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.142079:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.142084:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed1a5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dfc expref: 10 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.142095:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed1a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dfc expref: 10 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.142114:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:1.0:1746155577.142119:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.142126:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.142130:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155577.142779:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed1a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dfc expref: 10 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.142793:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124682368:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155577.142888:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124024448 00000100:00100000:0.0:1746155577.142893:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124024448 00002000:00100000:0.0:1746155577.142923:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009f702a00 x1830976124024448/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155577.142931:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f702a00 with x1830976124024448 ext(0->1048575) 00002000:00010000:0.0:1746155577.142935:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f702a00 00000100:00100000:0.0:1746155577.142951:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4968 00000100:00100000:0.0:1746155577.142958:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976124024448:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155577.144328:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1963:x1830976124024192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2259us (3241us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.144336:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6429 00000100:00100000:2.0:1746155577.144865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.144879:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124024576 00000100:00100000:2.0:1746155577.144883:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124024576 00010000:00010000:2.0:1746155577.144899:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226200/0x844e5faceb5ed1c8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e03 expref: 289 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:2.0:1746155577.144920:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6430 00000100:00100000:2.0:1746155577.144926:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1961:x1830976124024576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155577.144934:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155577.144939:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226200/0x844e5faceb5ed1c8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e03 expref: 289 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.144947:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226200/0x844e5faceb5ed1c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e03 expref: 289 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.144962:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155577.144966:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.144977:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.144983:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.144996:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155577.145016:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1961:x1830976124024576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 91us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.145021:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6430 00010000:00010000:3.0:1746155577.146389:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a226200/0x844e5faceb5ed1c8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e03 expref: 288 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.146403:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124682240:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.146421:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.146427:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.146435:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155577.146450:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155577.146587:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4d600/0x844e5faceb5ed1dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e11 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.146598:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e11 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.146605:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.146607:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155577.146609:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c4ca00, rc 0) 00000100:00100000:3.0:1746155577.146639:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29487:x1830976124023808:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 13990us (14083us total) trans 8589944119 rc 0/0 00000100:00100000:3.0:1746155577.146645:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10137 00000100:00100000:2.0:1746155577.150949:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.151169:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124024704 00000100:00100000:3.0:1746155577.151177:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124024704 00000100:00100000:3.0:1746155577.151210:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10139 00000100:00100000:3.0:1746155577.151217:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29492:x1830976124024704:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.151235:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.151251:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed207 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e1f expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.151315:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.151327:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e11 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.151334:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.151357:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e11 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.151366:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e11 expref: 8 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.151375:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124682496:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.151424:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fbeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155577.159231:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124682496:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.159252:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155577.162461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.162645:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124024832 00000100:00100000:1.0:1746155577.162654:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124024832 00010000:00010000:1.0:1746155577.162686:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e11 expref: 9 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:1.0:1746155577.162721:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6431 00000100:00100000:1.0:1746155577.162728:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976124024832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.162739:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.162744:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e11 expref: 9 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.162753:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e11 expref: 9 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.162771:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c4ca00/0x844e5faceb5ed1e4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e11 expref: 9 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.162787:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:1.0:1746155577.162791:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.162803:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.162808:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.163351:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155577.163363:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.163369:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155577.163389:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1960:x1830976124024832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 661us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.163395:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6431 00000004:00200000:3.0:1746155577.163401:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:3.0:1746155577.163405:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155577.163417:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.164054:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed207 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e1f expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.164083:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e1f expref: 289 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.164089:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.164091:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155577.164094:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094128c00, rc 0) 00000100:00100000:3.0:1746155577.164125:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29492:x1830976124024704:12345-192.168.202.51@tcp:101:cat.0 Request processed in 12909us (13182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.164130:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10139 00000100:00100000:0.0:1746155577.164434:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.164451:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:1963:x1830976124024448:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21493us (23311us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155577.164459:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4968 00002000:00100000:2.0:1746155577.164466:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88009f702a00 x1830976124024448/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.164474:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f702a00 with x1830976124024448 ext(0->1048575) 00002000:00010000:2.0:1746155577.164477:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f702a00 00000100:00100000:0.0:1746155577.164516:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.165119:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124025216 00000100:00100000:3.0:1746155577.165125:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124025216 00000100:00100000:3.0:1746155577.165143:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124024960 00000100:00100000:3.0:1746155577.165145:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124024960 00000100:00100000:1.0:1746155577.165147:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10140 00000100:00100000:1.0:1746155577.165154:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29489:x1830976124025216:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:3.0:1746155577.165166:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10141 00010000:00010000:1.0:1746155577.165167:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155577.165168:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:3.0:1746155577.165170:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29487:x1830976124024960:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155577.165178:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155577.165181:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc8e00/0x844e5faceb5ed1f2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e18 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.165187:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094128a00/0x844e5faceb5ed215 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e26 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.165190:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:1.0:1746155577.165193:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155577.165196:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed21c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e2d expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.165215:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094128a00/0x844e5faceb5ed215 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e26 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.165218:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155577.165223:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094128a00/0x844e5faceb5ed215 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e26 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.165226:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed189 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11df5 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.165231:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128a00/0x844e5faceb5ed215 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e26 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.165235:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e1f expref: 289 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.165241:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155577.165916:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.165919:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155577.165922:0:20364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155577.165953:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094128a00, rc 0) 00010000:00010000:1.0:1746155577.165977:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e1f expref: 289 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.165987:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e1f expref: 289 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.165988:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29487:x1830976124024960:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 817us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.165994:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10141 00000100:00100000:1.0:1746155577.165997:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124682624:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155577.166080:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094128a00/0x844e5faceb5ed215 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e26 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.166087:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094128a00/0x844e5faceb5ed215 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e26 expref: 8 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:1.0:1746155577.166094:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb79180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124682752:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155577.166119:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed189 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11df5 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.166125:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed189 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11df5 expref: 7 pid: 27374 timeout: 806 lvb_type: 0 00000100:00100000:1.0:1746155577.166133:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb78000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124682880:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155577.166149:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155577.167419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.167518:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124025344 00000100:00100000:2.0:1746155577.167524:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124025344 00000100:00100000:2.0:1746155577.167812:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12672 00000100:00100000:2.0:1746155577.167819:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29492:x1830976124025344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155577.167829:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.167841:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ed22a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e34 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.167858:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.167860:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.167865:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ed22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e34 expref: 21 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.167875:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ed22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e34 expref: 21 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.167883:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc02200, rc 0) 00000100:00100000:2.0:1746155577.168002:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29492:x1830976124025344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 183us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.168007:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12672 00000100:00100000:0.0:1746155577.170011:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.170329:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124682624:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155577.170339:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb79180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124682752:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155577.170346:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb78000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124682880:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155577.170368:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155577.172090:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.173175:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.173193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.173217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.173334:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124025472 00000100:00100000:2.0:1746155577.173341:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124025472 00000100:00100000:3.0:1746155577.173369:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124025600 00010000:00010000:2.0:1746155577.173371:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e1f expref: 290 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.173373:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124025600 00010000:00010000:3.0:1746155577.173388:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed189 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11df5 expref: 8 pid: 27374 timeout: 806 lvb_type: 0 00000100:00100000:2.0:1746155577.173397:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124025856 00000100:00100000:2.0:1746155577.173399:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124025856 00000100:00100000:3.0:1746155577.173405:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6432 00010000:00010000:2.0:1746155577.173408:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094128a00/0x844e5faceb5ed215 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e26 expref: 9 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.173411:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1962:x1830976124025472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155577.173421:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155577.173421:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6433 00010000:00010000:3.0:1746155577.173426:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e1f expref: 290 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:2.0:1746155577.173426:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1962:x1830976124025600:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155577.173433:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155577.173435:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e1f expref: 290 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.173437:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed189 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11df5 expref: 8 pid: 27374 timeout: 806 lvb_type: 0 00010000:00010000:3.0:1746155577.173451:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed20e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e1f expref: 290 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:1.0:1746155577.173523:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6434 00000100:00100000:1.0:1746155577.173529:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976124025856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.173536:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.173540:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094128a00/0x844e5faceb5ed215 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e26 expref: 9 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.173825:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed189 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11df5 expref: 8 pid: 27374 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.173842:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad600/0x844e5faceb5ed189 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11df5 expref: 8 pid: 27374 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.173853:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155577.173857:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155577.173863:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155577.173867:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155577.173898:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1962:x1830976124025600:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 472us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.173903:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6433 00000100:00100000:2.0:1746155577.173922:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124025728 00000100:00100000:2.0:1746155577.173924:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124025728 00000100:00100000:2.0:1746155577.173936:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124025984 00000100:00100000:2.0:1746155577.173937:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124025984 00000100:00100000:2.0:1746155577.173947:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10142 00000100:00100000:2.0:1746155577.173951:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29487:x1830976124025728:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155577.173963:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.173972:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e3b expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.174005:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155577.174012:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.174025:0:15474:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155577.174035:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.174042:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155577.174045:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155577.174047:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155577.174051:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e122400, rc 0) 00000100:00100000:2.0:1746155577.174068:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29487:x1830976124025728:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 116us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.174072:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10142 00000100:00100000:2.0:1746155577.174084:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10143 00000100:00100000:2.0:1746155577.174088:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29492:x1830976124025984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155577.174094:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.174098:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e42 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.174115:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.174122:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.174132:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155577.174134:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155577.174135:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155577.174140:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e123600, rc 0) 00000100:00100000:2.0:1746155577.174152:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29492:x1830976124025984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 64us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.174156:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10143 00010000:00010000:3.0:1746155577.174683:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.174688:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155577.174698:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155577.174702:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155577.174708:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094128a00/0x844e5faceb5ed215 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e26 expref: 10 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.174720:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128a00/0x844e5faceb5ed215 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e26 expref: 10 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.174732:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1962:x1830976124025472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1321us (4725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.174738:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6432 00010000:00010000:1.0:1746155577.174862:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:1.0:1746155577.174866:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.174871:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.174875:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.174883:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.174905:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.174933:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1960:x1830976124025856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1404us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.174939:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6434 00010000:00010000:2.0:1746155577.174991:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155577.174997:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00000004:02000000:2.0:1746155577.175028:0:27374:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:2.0:1746155577.175886:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2963, 88 off248136 00000004:00080000:2.0:1746155577.175893:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706325389474ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155577.175941:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2898, 88 off242144 00000004:00080000:2.0:1746155577.175944:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706325441202ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155577.175964:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2899, 88 off242232 00000004:00080000:2.0:1746155577.175967:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706325463819ns, next at 645866785986ns, rc = 0 00000100:00100000:0.0:1746155577.176261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.176304:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124026112 00000100:00100000:3.0:1746155577.176309:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124026112 00000100:00100000:3.0:1746155577.176337:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12673 00000100:00100000:3.0:1746155577.176342:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29493:x1830976124026112:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.176350:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.176360:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ed23f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e49 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.176375:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.176377:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.176381:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ed23f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e49 expref: 16 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.176392:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ed23f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e49 expref: 16 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.176399:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094128600, rc 0) 00000100:00080000:0.0:1746155577.176406:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746155577.176417:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29493:x1830976124026112:12345-192.168.202.51@tcp:101:cat.0 Request processed in 75us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.176422:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12673 00000040:00080000:2.0:1746155577.177110:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2964, 88 off248224 00000004:00080000:2.0:1746155577.177116:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706326612659ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155577.177790:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2965, 88 off248312 00000004:00080000:2.0:1746155577.177794:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706327290896ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155577.177805:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2900, 88 off242320 00000004:00080000:2.0:1746155577.177807:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706327304190ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155577.178078:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2901, 88 off242408 00000004:00080000:2.0:1746155577.178082:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706327579132ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155577.178094:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2902, 88 off242496 00000004:00080000:2.0:1746155577.178096:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706327593542ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155577.178103:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2966, 88 off248400 00000004:00080000:2.0:1746155577.178105:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706327602574ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155577.178218:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2903, 88 off242584 00000004:00080000:2.0:1746155577.178222:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706327718675ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155577.178231:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2967, 88 off248488 00000004:00080000:2.0:1746155577.178234:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706327731134ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155577.178240:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2904, 88 off242672 00000004:00080000:2.0:1746155577.178242:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706327739224ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155577.178248:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2968, 88 off248576 00000004:00080000:2.0:1746155577.178251:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706327747727ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155577.178256:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2969, 88 off248664 00000004:00080000:2.0:1746155577.178258:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706327755672ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155577.178265:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2970, 88 off248752 00000004:00080000:2.0:1746155577.178267:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706327763884ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155577.178272:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2971, 88 off248840 00000004:00080000:2.0:1746155577.178274:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 706327771112ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155577.178279:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2905, 88 off242760 00000004:00080000:2.0:1746155577.178281:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 706327778669ns, next at 645866785986ns, rc = 0 00010000:00010000:3.0:1746155577.210907:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e2d expref: 291 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.210919:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.210921:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746155577.210925:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.210934:0:27374:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.210940:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.210946:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.210951:0:27374:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.210957:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746155577.210967:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944118 is committed 00000001:00080000:1.0:1746155577.210979:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944120 is committed 00000004:00080000:1.0:1746155577.210982:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2097 committed 00010000:00010000:3.0:1746155577.210985:0:27374:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 289 pid: 15474 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746155577.210988:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2169 committed 00000004:00080000:1.0:1746155577.210994:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2168 committed 00000004:00080000:1.0:1746155577.210995:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2167 committed 00000100:00100000:3.0:1746155577.210996:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124683008:192.168.202.51@tcp:105: 00000004:00080000:1.0:1746155577.210997:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2166 committed 00000004:00080000:1.0:1746155577.210999:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2096 committed 00000004:00080000:1.0:1746155577.211001:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2165 committed 00000004:00080000:1.0:1746155577.211003:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2095 committed 00000004:00080000:1.0:1746155577.211004:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2164 committed 00000004:00080000:1.0:1746155577.211006:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2094 committed 00000004:00080000:1.0:1746155577.211007:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2093 committed 00000004:00080000:1.0:1746155577.211008:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2092 committed 00000004:00080000:1.0:1746155577.211009:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2163 committed 00000004:00080000:1.0:1746155577.211010:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2162 committed 00000004:00080000:1.0:1746155577.211012:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2091 committed 00000004:00080000:1.0:1746155577.211013:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2090 committed 00000004:00080000:1.0:1746155577.211016:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2161 committed 00000001:00080000:1.0:1746155577.211019:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944115 is committed 00000001:00080000:1.0:1746155577.211023:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944119 is committed 00010000:00010000:3.0:1746155577.211072:0:27374:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 6 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155577.211082:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124683392:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155577.211097:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4300 going to sleep for 11 seconds 00000100:00100000:3.0:1746155577.211123:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124683520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155577.211136:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124683136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155577.211151:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155577.211170:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124683648:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155577.211185:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155577.211188:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124684032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155577.211195:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124684160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155577.211200:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155577.211206:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155577.211219:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124683520 00000100:00100000:1.0:1746155577.211220:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124683648 00000100:00100000:3.0:1746155577.211224:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124683520 00000100:00100000:1.0:1746155577.211224:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124683648 00000100:00100000:3.0:1746155577.211245:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124684160 00000100:00100000:1.0:1746155577.211245:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124684032 00000100:00100000:1.0:1746155577.211246:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124684032 00000100:00100000:3.0:1746155577.211247:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124684160 00000100:00100000:3.0:1746155577.211257:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12674 00000100:00100000:3.0:1746155577.211262:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3296:x1830976124683648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155577.211417:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3296:x1830976124683648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (230us total) trans 17179873294 rc 0/0 00000100:00100000:2.0:1746155577.211556:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124684544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155577.211574:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155577.211585:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124685056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155577.211594:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155577.211603:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746155577.211607:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124684672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155577.211615:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155577.211622:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124685184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155577.211630:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155577.211642:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124684544 00000100:00100000:2.0:1746155577.211644:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124684544 00000100:00100000:0.0:1746155577.211847:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124683264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155577.211866:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155577.211902:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12675 00000100:00100000:3.0:1746155577.211906:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12674 00000100:00100000:1.0:1746155577.211908:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3295:x1830976124683520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155577.211918:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124685056 00000100:00100000:3.0:1746155577.211920:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124685056 00000100:00100000:3.0:1746155577.211928:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124684672 00000100:00100000:3.0:1746155577.211929:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124684672 00000100:00100000:3.0:1746155577.211934:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124685184 00000100:00100000:3.0:1746155577.211936:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124685184 00000100:00100000:3.0:1746155577.211941:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124683264 00000100:00100000:3.0:1746155577.211942:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124683264 00000100:00100000:3.0:1746155577.211950:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12676 00000100:00100000:3.0:1746155577.211954:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3296:x1830976124684160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155577.211984:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155577.211986:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:1.0:1746155577.211989:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:1.0:1746155577.211991:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:1.0:1746155577.211992:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746155577.212013:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3295:x1830976124683520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (862us total) trans 17179873295 rc 0/0 00000100:00100000:3.0:1746155577.212017:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3296:x1830976124684160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (810us total) trans 17179873296 rc 0/0 00000100:00100000:1.0:1746155577.212018:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12675 00000100:00100000:3.0:1746155577.212022:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12676 00000100:00100000:3.0:1746155577.212029:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12677 00000100:00100000:3.0:1746155577.212032:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3295:x1830976124684032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155577.212104:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3295:x1830976124684032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (903us total) trans 17179873297 rc 0/0 00000100:00100000:3.0:1746155577.212109:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12677 00000100:00100000:2.0:1746155577.212118:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12678 00000100:00100000:3.0:1746155577.212121:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12679 00000100:00100000:2.0:1746155577.212123:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3295:x1830976124685056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155577.212124:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3295:x1830976124684672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155577.212139:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12680 00000100:00100000:2.0:1746155577.212143:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3295:x1830976124685184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155577.212164:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12681 00000100:00100000:2.0:1746155577.212168:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3298:x1830976124683264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155577.212221:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:3.0:1746155577.212223:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:3.0:1746155577.212225:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155577.212225:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155577.212226:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155577.212227:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:3.0:1746155577.212228:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00002000:00010000:2.0:1746155577.212228:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.212230:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.212231:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155577.212245:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3295:x1830976124684672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (628us total) trans 21474840690 rc 0/0 00000100:00100000:2.0:1746155577.212245:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3298:x1830976124683264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (378us total) trans 17179873298 rc 0/0 00000100:00100000:3.0:1746155577.212249:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12679 00000004:00080000:0.0:1746155577.212283:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb79180/2, rc 0, transno 17179873298 00000100:00100000:0.0:1746155577.212287:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124683264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155577.212291:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124683904:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155577.212366:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12681 00000100:00100000:2.0:1746155577.212376:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12682 00000100:00100000:2.0:1746155577.212381:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3295:x1830976124684544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155577.212408:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155577.212422:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124683776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155577.212437:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746155577.212446:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00000100:00100000:3.0:1746155577.212448:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124684288:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155577.212448:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.212451:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.212452:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:2.0:1746155577.212454:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:3.0:1746155577.212462:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155577.212468:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3295:x1830976124684544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (893us total) trans 21474840691 rc 0/0 00000100:00100000:3.0:1746155577.212470:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124684800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155577.212473:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12682 00000100:00100000:2.0:1746155577.212480:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124683136 00000100:00100000:3.0:1746155577.212482:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155577.212482:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124683136 00000100:00100000:2.0:1746155577.212489:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124683776 00000100:00100000:2.0:1746155577.212517:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124683776 00000100:00100000:3.0:1746155577.212518:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124684288 00000100:00100000:3.0:1746155577.212520:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124684288 00000100:00100000:2.0:1746155577.212525:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124684800 00000100:00100000:2.0:1746155577.212526:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124684800 00000100:00100000:3.0:1746155577.212530:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12683 00000100:00100000:3.0:1746155577.212533:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3297:x1830976124683136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155577.212534:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12684 00000100:00100000:2.0:1746155577.212537:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3297:x1830976124683776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155577.212564:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12685 00000100:00100000:3.0:1746155577.212568:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976124684288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155577.212614:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976124683776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (176us total) trans 17179873299 rc 0/0 00000100:00100000:2.0:1746155577.212619:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12684 00000100:00100000:2.0:1746155577.212628:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12686 00002000:00010000:3.0:1746155577.212629:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746155577.212631:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00000100:00100000:2.0:1746155577.212632:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976124684800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155577.212633:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:3.0:1746155577.212634:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:3.0:1746155577.212636:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1893 -> 1893 00000100:00100000:3.0:1746155577.212651:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976124684288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (188us total) trans 21474840692 rc 0/0 00000100:00100000:3.0:1746155577.212656:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12685 00000100:00100000:2.0:1746155577.212696:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976124684800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (213us total) trans 21474840693 rc 0/0 00000100:00100000:2.0:1746155577.212701:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12686 00002000:00010000:3.0:1746155577.212706:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155577.212708:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:3.0:1746155577.212709:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:3.0:1746155577.212711:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:3.0:1746155577.212712:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155577.212766:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3295:x1830976124685184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 622us (1134us total) trans 21474840694 rc 0/0 00000100:00100000:2.0:1746155577.212771:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12680 00000004:00080000:2.0:1746155577.212789:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe91c00/2, rc 0, transno 21474840690 00000100:00100000:2.0:1746155577.212795:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124684672:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155577.212801:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f882d80/2, rc 0, transno 21474840694 00000100:00100000:2.0:1746155577.212804:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124685184:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155577.212809:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f700a80/2, rc 0, transno 21474840691 00000100:00100000:3.0:1746155577.212811:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976124683136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (320us total) trans 17179873300 rc 0/0 00000100:00100000:2.0:1746155577.212812:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124684544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155577.212816:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12683 00000004:00080000:2.0:1746155577.212818:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb78e00/2, rc 0, transno 17179873297 00000100:00100000:2.0:1746155577.212820:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124684032:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155577.212826:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb7bb80/2, rc 0, transno 17179873295 00000100:00100000:2.0:1746155577.212828:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124683520:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155577.212832:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f703800/2, rc 0, transno 21474840692 00000100:00100000:3.0:1746155577.212834:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124684288:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155577.212839:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c32d80/2, rc 0, transno 21474840693 00000100:00100000:3.0:1746155577.212841:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124684800:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155577.212849:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb78000/2, rc 0, transno 17179873300 00000100:00100000:3.0:1746155577.212851:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124683136:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155577.212856:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb79500/2, rc 0, transno 17179873299 00000100:00100000:3.0:1746155577.212858:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124683776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155577.212864:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124685312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155577.212880:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155577.212892:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124685312 00000100:00100000:3.0:1746155577.212894:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124685312 00000100:00100000:3.0:1746155577.212905:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12687 00000100:00100000:3.0:1746155577.212909:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976124685312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155577.212980:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3297:x1830976124685312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (99us total) trans 21474840695 rc 0/0 00000100:00100000:3.0:1746155577.212985:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12687 00000100:00100000:0.0:1746155577.212992:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155577.213005:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124684416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155577.213017:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155577.213025:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124684928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155577.213035:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155577.213051:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124683904 00000100:00100000:0.0:1746155577.213053:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124683904 00000100:00100000:3.0:1746155577.213065:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3295:x1830976124685056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 942us (1469us total) trans 21474840696 rc 0/0 00000100:00100000:0.0:1746155577.213065:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124684416 00000100:00100000:0.0:1746155577.213067:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124684416 00000100:00100000:3.0:1746155577.213070:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12678 00000100:00100000:0.0:1746155577.213082:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124684928 00000100:00100000:0.0:1746155577.213083:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124684928 00000100:00100000:0.0:1746155577.213090:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12688 00000100:00100000:0.0:1746155577.213095:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3298:x1830976124683904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155577.213147:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12689 00000100:00100000:3.0:1746155577.213151:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3298:x1830976124684416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155577.213172:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3298:x1830976124683904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (179us total) trans 17179873301 rc 0/0 00000100:00100000:0.0:1746155577.213177:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12688 00000100:00100000:0.0:1746155577.213186:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12690 00000100:00100000:0.0:1746155577.213190:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3298:x1830976124684928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155577.213208:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155577.213210:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155577 -> 1746155577 00002000:00010000:3.0:1746155577.213212:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155577 -> 1746155577 00002000:00010000:3.0:1746155577.213213:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155577 -> 1746155577 00002000:00010000:3.0:1746155577.213215:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155577.213231:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3298:x1830976124684416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (213us total) trans 21474840697 rc 0/0 00000100:00100000:3.0:1746155577.213236:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12689 00000100:00100000:0.0:1746155577.213249:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3298:x1830976124684928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (212us total) trans 21474840698 rc 0/0 00000100:00100000:0.0:1746155577.213253:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12690 00000004:00080000:1.0:1746155577.213358:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb78380/2, rc 0, transno 17179873294 00000100:00100000:1.0:1746155577.213362:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124683648:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155577.213368:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb7aa00/2, rc 0, transno 17179873296 00000100:00100000:1.0:1746155577.213370:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124684160:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155577.213472:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b883480/2, rc 0, transno 21474840695 00000100:00100000:2.0:1746155577.213476:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124685312:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155577.213488:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f881180/2, rc 0, transno 21474840696 00000100:00100000:2.0:1746155577.213500:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124685056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155577.213659:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb7a300/2, rc 0, transno 17179873301 00000100:00100000:0.0:1746155577.213663:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124683904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155577.213672:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f702d80/2, rc 0, transno 21474840697 00000100:00100000:0.0:1746155577.213674:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124684416:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155577.213679:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c31c00/2, rc 0, transno 21474840698 00000100:00100000:0.0:1746155577.213682:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124684928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155577.213757:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124683008:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155577.213764:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124683392:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155577.213798:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.213844:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124026240 00000100:00100000:1.0:1746155577.213847:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124026240 00000100:00100000:1.0:1746155577.213867:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4124 00000100:00100000:1.0:1746155577.213872:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+7:29487:x1830976124026240:12345-192.168.202.51@tcp:49:multiop.0 00010000:00010000:0.0:1746155577.213892:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed21c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e2d expref: 288 pid: 27374 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746155577.213910:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e2d expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.213924:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cc9600, rc 0) 00000100:00100000:1.0:1746155577.213932:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+7:29487:x1830976124026240:12345-192.168.202.51@tcp:49:multiop.0 Request processed in 60us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.213937:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29489:x1830976124025216:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 48785us (49504us total) trans 8589944120 rc 0/0 00000100:00100000:1.0:1746155577.213938:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4124 00000100:00100000:0.0:1746155577.213942:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10140 00000100:00100000:0.0:1746155577.216598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.216636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.216735:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124026496 00000100:00100000:2.0:1746155577.216742:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124026496 00000100:00100000:2.0:1746155577.216776:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10144 00000100:00100000:2.0:1746155577.216783:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+7:29493:x1830976124026496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155577.216799:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.216813:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0e200/0x844e5faceb5ed246 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e50 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.216854:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0e200/0x844e5faceb5ed246 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e50 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.216865:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0e200/0x844e5faceb5ed246 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e50 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.216879:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155577.216881:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155577.216884:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b0e200, rc 0) 00000100:00100000:2.0:1746155577.216923:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29493:x1830976124026496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 140us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.216928:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10144 00000100:00100000:2.0:1746155577.216999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.217104:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124026368 00000100:00100000:0.0:1746155577.217108:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124026368 00000100:00100000:0.0:1746155577.217126:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124026624 00000100:00100000:0.0:1746155577.217127:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124026624 00000100:00100000:0.0:1746155577.217138:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4125 00000100:00100000:0.0:1746155577.217143:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29492:x1830976124026368:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:3.0:1746155577.217163:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4126 00000100:00100000:3.0:1746155577.217170:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29489:x1830976124026624:12345-192.168.202.51@tcp:49:multiop.0 00000100:00100000:0.0:1746155577.217193:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29492:x1830976124026368:12345-192.168.202.51@tcp:49:cat.0 Request processed in 50us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.217198:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4125 00000100:00100000:3.0:1746155577.217211:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29489:x1830976124026624:12345-192.168.202.51@tcp:49:multiop.0 Request processed in 42us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.217216:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4126 00000100:00100000:3.0:1746155577.226056:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.226096:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.226121:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.226138:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124027008 00000100:00100000:2.0:1746155577.226146:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124027008 00002000:00100000:2.0:1746155577.226180:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880130c9ea00 x1830976124027008/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.226189:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ea00 with x1830976124027008 ext(1048576->2097151) 00002000:00010000:2.0:1746155577.226193:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9ea00 00000100:00100000:3.0:1746155577.226200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.226211:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4969 00000100:00100000:3.0:1746155577.226216:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124026752 00000100:00100000:2.0:1746155577.226217:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976124027008:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155577.226219:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124026752 00000100:00100000:3.0:1746155577.226237:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124027264 00000100:00100000:3.0:1746155577.226238:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124027264 00000100:00100000:3.0:1746155577.226250:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12691 00000100:00100000:3.0:1746155577.226255:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29487:x1830976124026752:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155577.226263:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.226276:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e57 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.226294:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55f6400/0x844e5faceb5ed12e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de0 expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.226301:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.226302:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.226305:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1863680->2035711] (req 1863680->2035711) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.226326:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55f6400/0x844e5faceb5ed12e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de0 expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.226335:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55f6400/0x844e5faceb5ed12e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de0 expref: 11 pid: 20796 timeout: 806 lvb_type: 1 00000100:00100000:3.0:1746155577.226345:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124685440:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.226398:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155577.226412:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12692 00000100:00100000:3.0:1746155577.226417:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29489:x1830976124027264:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155577.226423:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.226430:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e5e expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.226441:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8c00/0x844e5faceb5ed127 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd9 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.226447:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.226448:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.226451:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1261568->1605631] (req 1261568->1605631) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.226461:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe8c00/0x844e5faceb5ed127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd9 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.226472:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8c00/0x844e5faceb5ed127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd9 expref: 10 pid: 8437 timeout: 806 lvb_type: 1 00000100:00100000:3.0:1746155577.226478:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124685568:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.226535:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155577.226943:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124027136 00000100:00100000:1.0:1746155577.226947:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124027136 00000100:00100000:1.0:1746155577.226971:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 614 00000100:00100000:1.0:1746155577.226976:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1961:x1830976124027136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.226982:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.226996:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0e200/0x844e5faceb5ed246 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e50 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.227012:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:1.0:1746155577.227016:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.227034:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+7:1961:x1830976124027136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 59us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.227039:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 614 00000100:00100000:0.0:1746155577.234397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.234455:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124027520 00000100:00100000:3.0:1746155577.234462:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124027520 00002000:00100000:3.0:1746155577.234525:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800910dad80 x1830976124027520/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.234534:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910dad80 with x1830976124027520 ext(0->1048575) 00002000:00010000:3.0:1746155577.234538:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910dad80 00000100:00100000:3.0:1746155577.234554:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4970 00000100:00100000:3.0:1746155577.234560:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976124027520:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155577.234692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.234799:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124685440:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.234820:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1863680->2035711] (req 1863680->2035711) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.234833:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc0000, rc 0) 00000100:00100000:2.0:1746155577.234863:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29487:x1830976124026752:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8608us (8814us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.234869:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12691 00000100:00100000:3.0:1746155577.235758:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124685568:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.235773:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1261568->1605631] (req 1261568->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.235782:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc1400, rc 0) 00000100:00100000:3.0:1746155577.235799:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:29489:x1830976124027264:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 9383us (9600us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.235804:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12692 00000100:00100000:1.0:1746155577.236411:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124027648 00000100:00100000:1.0:1746155577.236416:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124027648 00010000:00010000:1.0:1746155577.236436:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55f6400/0x844e5faceb5ed12e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de0 expref: 12 pid: 20796 timeout: 806 lvb_type: 1 00000100:00100000:1.0:1746155577.236455:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6435 00000100:00100000:1.0:1746155577.236460:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976124027648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.236467:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.236482:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a55f6400/0x844e5faceb5ed12e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de0 expref: 12 pid: 20796 timeout: 806 lvb_type: 1 00010000:00010000:1.0:1746155577.236521:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a55f6400/0x844e5faceb5ed12e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de0 expref: 12 pid: 20796 timeout: 806 lvb_type: 1 00010000:00010000:1.0:1746155577.236539:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55f6400/0x844e5faceb5ed12e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de0 expref: 12 pid: 20796 timeout: 806 lvb_type: 1 00010000:00010000:1.0:1746155577.236552:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.236554:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.236559:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.236565:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.236595:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.236605:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb7ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124685696:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155577.236619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.236651:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155577.236663:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124027776 00000100:00100000:1.0:1746155577.236666:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124027776 00010000:00010000:1.0:1746155577.236677:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8c00/0x844e5faceb5ed127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd9 expref: 11 pid: 8437 timeout: 806 lvb_type: 1 00000100:00100000:1.0:1746155577.236690:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6436 00000100:00100000:1.0:1746155577.236695:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124027776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.236701:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.236712:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fe8c00/0x844e5faceb5ed127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd9 expref: 11 pid: 8437 timeout: 806 lvb_type: 1 00010000:00010000:1.0:1746155577.236719:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fe8c00/0x844e5faceb5ed127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd9 expref: 11 pid: 8437 timeout: 806 lvb_type: 1 00010000:00010000:1.0:1746155577.236729:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8c00/0x844e5faceb5ed127 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd9 expref: 11 pid: 8437 timeout: 806 lvb_type: 1 00010000:00010000:1.0:1746155577.236744:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.236746:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.236749:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.236756:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.236772:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.236779:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb79c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124685824:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155577.238621:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155577.238714:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1960:x1830976124027008:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12491us (12611us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155577.238724:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4969 00002000:00100000:2.0:1746155577.238732:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880130c9ea00 x1830976124027008/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.238741:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ea00 with x1830976124027008 ext(1048576->2097151) 00002000:00010000:2.0:1746155577.238750:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9ea00 00000100:00100000:1.0:1746155577.240868:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb7ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124685696:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155577.240886:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.240931:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124027648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4469us (6237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.240940:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6435 00000100:00100000:0.0:1746155577.245209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.245244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.245327:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb79c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124685824:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155577.245343:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.245380:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124027776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8683us (8760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.245390:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6436 00000100:00100000:2.0:1746155577.245543:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124028032 00000100:00100000:2.0:1746155577.245548:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124028032 00002000:00100000:2.0:1746155577.245577:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1863680->1867775) req@ffff8800910d9180 x1830976124028032/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.245586:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9180 with x1830976124028032 ext(1863680->1867775) 00002000:00010000:2.0:1746155577.245589:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d9180 00000100:00100000:2.0:1746155577.245727:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4971 00000100:00100000:2.0:1746155577.245735:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976124028032:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155577.245854:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976124028032:12345-192.168.202.51@tcp:3:cat.0 Request processed in 120us (651us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155577.245859:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4971 00002000:00100000:2.0:1746155577.245863:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1863680->1867775) req@ffff8800910d9180 x1830976124028032/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/4536 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.245870:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9180 with x1830976124028032 ext(1863680->1867775) 00002000:00010000:2.0:1746155577.245872:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d9180 00000100:00100000:3.0:1746155577.245889:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124028160 00000100:00100000:3.0:1746155577.245894:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124028160 00000100:00100000:3.0:1746155577.245927:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12693 00000100:00100000:3.0:1746155577.245933:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+16:29493:x1830976124028160:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.245942:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.245955:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e65 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.245976:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.245982:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155577.245983:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155577.245986:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e65 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.246007:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.246017:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 23 pid: 20796 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.246026:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124685952:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155577.247173:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.247272:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124028416 00000100:00100000:2.0:1746155577.247275:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124028416 00002000:00100000:2.0:1746155577.247290:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1261568->1265663) req@ffff8800910db100 x1830976124028416/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.247303:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910db100 with x1830976124028416 ext(1261568->1265663) 00010000:00010000:2.0:1746155577.247309:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 24 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.247318:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 24 pid: 20796 timeout: 806 lvb_type: 0 00002000:00010000:2.0:1746155577.247324:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910db100 00000100:00100000:2.0:1746155577.247336:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 821 00000100:00100000:2.0:1746155577.247341:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976124028416:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155577.247421:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976124028416:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 79us (249us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155577.247427:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 821 00002000:00100000:2.0:1746155577.247432:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3db:0x0] (1261568->1265663) req@ffff8800910db100 x1830976124028416/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/4536 e 0 to 0 dl 1746155588 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.247437:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910db100 with x1830976124028416 ext(1261568->1265663) 00010000:00010000:2.0:1746155577.247441:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 24 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.247450:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 24 pid: 20796 timeout: 806 lvb_type: 0 00002000:00010000:2.0:1746155577.247455:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910db100 00000100:00100000:3.0:1746155577.247526:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155577.247539:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124685952:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.247551:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e65 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.247561:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c4d800, rc 0) 00000100:00100000:3.0:1746155577.247907:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29493:x1830976124028160:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1974us (2660us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.247913:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12693 00000100:00100000:0.0:1746155577.248141:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976124027520:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13579us (13750us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155577.248148:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4970 00002000:00100000:0.0:1746155577.248153:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800910dad80 x1830976124027520/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155577.248159:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910dad80 with x1830976124027520 ext(0->1048575) 00002000:00010000:0.0:1746155577.248162:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910dad80 00000100:00100000:0.0:1746155577.250834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.250948:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124028672 00000100:00100000:2.0:1746155577.250955:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124028672 00002000:00100000:2.0:1746155577.250984:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (2031616->2035711) req@ffff880137120e00 x1830976124028672/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.250991:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120e00 with x1830976124028672 ext(2031616->2035711) 00002000:00010000:2.0:1746155577.250995:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120e00 00000100:00100000:2.0:1746155577.251010:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4972 00000100:00100000:2.0:1746155577.251016:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976124028672:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155577.251143:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976124028672:12345-192.168.202.51@tcp:3:cat.0 Request processed in 126us (313us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155577.251148:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4972 00002000:00100000:2.0:1746155577.251152:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d8:0x0] (2031616->2035711) req@ffff880137120e00 x1830976124028672/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/4536 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.251159:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120e00 with x1830976124028672 ext(2031616->2035711) 00002000:00010000:2.0:1746155577.251162:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120e00 00000100:00100000:0.0:1746155577.257597:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.257688:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124028928 00000100:00100000:2.0:1746155577.257696:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124028928 00002000:00100000:2.0:1746155577.257731:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1601536->1605631) req@ffff880137121180 x1830976124028928/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.257739:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121180 with x1830976124028928 ext(1601536->1605631) 00010000:00010000:2.0:1746155577.257747:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 24 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.257759:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 24 pid: 20796 timeout: 806 lvb_type: 0 00002000:00010000:2.0:1746155577.257770:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880137121180 00000100:00100000:2.0:1746155577.257786:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 822 00000100:00100000:2.0:1746155577.257792:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976124028928:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155577.257929:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976124028928:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 136us (337us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155577.257935:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 822 00002000:00100000:2.0:1746155577.257940:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1601536->1605631) req@ffff880137121180 x1830976124028928/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/4536 e 0 to 0 dl 1746155588 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.257946:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121180 with x1830976124028928 ext(1601536->1605631) 00010000:00010000:2.0:1746155577.257950:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 24 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.257958:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 24 pid: 20796 timeout: 806 lvb_type: 0 00002000:00010000:2.0:1746155577.257963:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880137121180 00000100:00100000:0.0:1746155577.263804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.263943:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124029184 00000100:00100000:2.0:1746155577.263950:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124029184 00000100:00100000:2.0:1746155577.263999:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4127 00000100:00100000:2.0:1746155577.264007:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+7:29487:x1830976124029184:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155577.264217:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29487:x1830976124029184:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 209us (418us total) trans 8589944121 rc 0/0 00000100:00100000:2.0:1746155577.264223:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4127 00000100:00100000:0.0:1746155577.270036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.270075:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.270112:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.270187:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124029696 00000100:00100000:2.0:1746155577.270194:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124029696 00000100:00100000:2.0:1746155577.270228:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4128 00000100:00100000:2.0:1746155577.270234:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a653850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29489:x1830976124029696:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155577.270395:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a653850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29489:x1830976124029696:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 161us (318us total) trans 8589944122 rc 0/0 00000100:00100000:2.0:1746155577.270401:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4128 00000100:00100000:1.0:1746155577.270579:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124029824 00000100:00100000:1.0:1746155577.270582:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124029824 00002000:00100000:1.0:1746155577.270605:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1261568->1605631) req@ffff880137121500 x1830976124029824/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.270614:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121500 with x1830976124029824 ext(1261568->1605631) 00010000:00010000:1.0:1746155577.270620:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 24 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.270632:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 24 pid: 20796 timeout: 806 lvb_type: 0 00002000:00010000:1.0:1746155577.270638:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880137121500 00000100:00100000:1.0:1746155577.270649:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 823 00000100:00100000:1.0:1746155577.270654:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976124029824:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155577.270956:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124029312 00000100:00100000:3.0:1746155577.270960:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124029312 00000100:00100000:3.0:1746155577.270976:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12694 00000100:00100000:3.0:1746155577.270980:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:29492:x1830976124029312:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.270987:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.270998:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5ed262 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e6c expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.271012:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.271014:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.271019:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5ed262 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e6c expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.271030:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5ed262 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e6c expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.271038:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c4de00, rc 0) 00000100:00100000:3.0:1746155577.271053:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29492:x1830976124029312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 72us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.271057:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12694 00000100:00100000:0.0:1746155577.284246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.285895:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976124029824:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 15235us (15778us total) trans 17179873302 rc 0/0 00000100:00100000:1.0:1746155577.285905:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 823 00002000:00100000:1.0:1746155577.285913:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3db:0x0] (1261568->1605631) req@ffff880137121500 x1830976124029824/t17179873302(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/448 e 0 to 0 dl 1746155588 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.285922:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121500 with x1830976124029824 ext(1261568->1605631) 00010000:00010000:1.0:1746155577.285931:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 27 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.285943:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 27 pid: 20796 timeout: 806 lvb_type: 0 00002000:00010000:1.0:1746155577.285950:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880137121500 00000100:00100000:1.0:1746155577.285964:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124030080 00000100:00100000:1.0:1746155577.285969:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124030080 00002000:00100000:1.0:1746155577.285991:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880137123b80 x1830976124030080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.285997:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123b80 with x1830976124030080 ext(1048576->2097151) 00002000:00010000:1.0:1746155577.286000:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137123b80 00000100:00100000:1.0:1746155577.286015:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4973 00000100:00100000:1.0:1746155577.286020:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976124030080:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155577.294930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.294986:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.296367:0:14231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124030336 00000100:00100000:2.0:1746155577.296376:0:14231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124030336 00000100:00100000:2.0:1746155577.296415:0:14231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 171 00000100:00100000:2.0:1746155577.296422:0:14231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06793f43-a06c-4add-b66d-476e36bacde6+15:1961:x1830976124030336:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:2.0:1746155577.296471:0:14231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06793f43-a06c-4add-b66d-476e36bacde6+15:1961:x1830976124030336:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 49us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.296476:0:14231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 171 00000100:00100000:1.0:1746155577.296784:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124030208 00000100:00100000:1.0:1746155577.296788:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124030208 00010000:00010000:1.0:1746155577.296808:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 29 pid: 20796 timeout: 806 lvb_type: 0 00000100:00100000:1.0:1746155577.296827:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6437 00000100:00100000:1.0:1746155577.296832:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976124030208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.296840:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.296858:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 29 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.296867:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 29 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.296884:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc1400/0x844e5faceb5ed254 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1605631) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e5e expref: 29 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.296899:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.296901:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.296907:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e65 expref: 16 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.296914:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e65 expref: 16 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.296945:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e65 expref: 16 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.296954:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb79c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124686080:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155577.299981:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155577.300478:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976124030080:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14452us (16235us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155577.300488:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4973 00002000:00100000:0.0:1746155577.300517:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880137123b80 x1830976124030080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155577.300525:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123b80 with x1830976124030080 ext(1048576->2097151) 00002000:00010000:0.0:1746155577.300529:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137123b80 00000100:00100000:1.0:1746155577.305657:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb79c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976124686080:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155577.305677:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.305734:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976124030208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8900us (10808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.305743:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6437 00000100:00100000:0.0:1746155577.306880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.308380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.308691:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124030848 00000100:00100000:3.0:1746155577.308699:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124030848 00002000:00100000:3.0:1746155577.308735:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880137123100 x1830976124030848/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.308748:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123100 with x1830976124030848 ext(1048576->2097151) 00002000:00010000:3.0:1746155577.308753:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137123100 00000100:00100000:3.0:1746155577.308777:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124030976 00000100:00100000:3.0:1746155577.308780:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124030976 00002000:00100000:3.0:1746155577.308792:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880137120700 x1830976124030976/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 504/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.308798:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120700 with x1830976124030976 ext(1048576->2097151) 00002000:00010000:3.0:1746155577.308801:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120700 00000100:00100000:3.0:1746155577.310484:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4974 00000100:00100000:0.0:1746155577.310565:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4975 00000100:00100000:0.0:1746155577.310573:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976124030976:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155577.312381:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976124030848:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155577.314368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.317574:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124030720 00000100:00100000:3.0:1746155577.317586:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124030720 00000100:00100000:3.0:1746155577.317652:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12695 00000100:00100000:3.0:1746155577.317660:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:29492:x1830976124030720:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.317675:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.317690:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed269 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e73 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.317710:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.317711:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.317717:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e73 expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.317730:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e73 expref: 27 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.317745:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cc9e00, rc 0) 00000100:00100000:3.0:1746155577.317803:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:29492:x1830976124030720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 144us (3440us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.317809:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12695 00000100:00100000:2.0:1746155577.323262:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976124030976:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12680us (14873us total) trans 0 rc 876544/876544 00000100:00100000:2.0:1746155577.323272:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4975 00002000:00100000:2.0:1746155577.323282:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880137120700 x1830976124030976/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 504/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 876544/876544 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.323289:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120700 with x1830976124030976 ext(1048576->2097151) 00002000:00010000:2.0:1746155577.323294:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120700 00000100:00100000:3.0:1746155577.326010:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976124030848:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15513us (19127us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155577.326019:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4974 00002000:00100000:3.0:1746155577.326026:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880137123100 x1830976124030848/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.326033:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123100 with x1830976124030848 ext(1048576->2097151) 00002000:00010000:3.0:1746155577.326038:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137123100 00000100:00100000:0.0:1746155577.339095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.339295:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124031232 00000100:00100000:3.0:1746155577.339303:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124031232 00002000:00100000:3.0:1746155577.339339:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880137122680 x1830976124031232/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.339347:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137122680 with x1830976124031232 ext(1048576->2097151) 00002000:00010000:3.0:1746155577.339352:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137122680 00000100:00100000:3.0:1746155577.339382:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4976 00000100:00100000:3.0:1746155577.339389:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976124031232:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155577.351566:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.351619:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124031360 00000100:00100000:2.0:1746155577.351626:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124031360 00000100:00100000:2.0:1746155577.351672:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12696 00000100:00100000:2.0:1746155577.351680:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976124031360:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155577.351697:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.351711:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1400/0x844e5faceb5ed270 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e7a expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.351730:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.351732:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.351739:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1400/0x844e5faceb5ed270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e7a expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155577.351751:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1400/0x844e5faceb5ed270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e7a expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155577.351761:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc1400, rc 0) 00000100:00100000:2.0:1746155577.351808:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976124031360:12345-192.168.202.51@tcp:101:cat.0 Request processed in 128us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.351813:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12696 00000100:00100000:3.0:1746155577.352206:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976124031232:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12815us (13116us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155577.352213:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4976 00002000:00100000:3.0:1746155577.352221:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff880137122680 x1830976124031232/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.352229:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137122680 with x1830976124031232 ext(1048576->2097151) 00002000:00010000:3.0:1746155577.352232:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137122680 00000100:00100000:1.0:1746155577.352297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.352330:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124031488 00000100:00100000:3.0:1746155577.352334:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124031488 00000100:00100000:3.0:1746155577.352355:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12697 00000100:00100000:3.0:1746155577.352360:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976124031488:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.352366:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.352374:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5ed277 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e81 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.352384:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.352386:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.352390:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5ed277 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e81 expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.352399:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5ed277 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e81 expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.352406:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c4d000, rc 0) 00000100:00100000:3.0:1746155577.352435:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976124031488:12345-192.168.202.51@tcp:101:cat.0 Request processed in 75us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.352440:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12697 00000100:00100000:0.0:1746155577.355900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.355951:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124031616 00000100:00100000:2.0:1746155577.355957:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124031616 00000100:00100000:2.0:1746155577.357280:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12698 00000100:00100000:2.0:1746155577.357289:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29492:x1830976124031616:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155577.357304:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.357317:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e88 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.357338:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.357349:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155577.357351:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155577.357354:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e88 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.357377:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.357387:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 15 pid: 1625 timeout: 806 lvb_type: 0 00000100:00100000:2.0:1746155577.357396:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124686208:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.358053:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155577.359985:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b880000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124686208:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.360008:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e88 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.360019:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ffc1200, rc 0) 00000100:00100000:2.0:1746155577.360085:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29492:x1830976124031616:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2796us (4188us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.360091:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12698 00000100:00100000:0.0:1746155577.361409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.361872:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124031744 00000100:00100000:3.0:1746155577.361878:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124031744 00002000:00100000:3.0:1746155577.361910:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1863680->2035711) req@ffff880137120000 x1830976124031744/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.361918:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120000 with x1830976124031744 ext(1863680->2035711) 00010000:00010000:3.0:1746155577.361925:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 16 pid: 1625 timeout: 806 lvb_type: 0 00010000:00010000:3.0:1746155577.361935:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 16 pid: 1625 timeout: 806 lvb_type: 0 00002000:00010000:3.0:1746155577.361940:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880137120000 00000100:00100000:3.0:1746155577.361967:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 824 00000100:00100000:3.0:1746155577.361973:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976124031744:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155577.362373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.362391:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124032000 00000100:00100000:1.0:1746155577.362394:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124032000 00002000:00100000:1.0:1746155577.362408:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009fb78a80 x1830976124032000/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.362415:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb78a80 with x1830976124032000 ext(2097152->3145727) 00002000:00010000:1.0:1746155577.362418:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb78a80 00000100:00100000:1.0:1746155577.362429:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4977 00000100:00100000:1.0:1746155577.362435:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976124032000:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155577.366638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.367458:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124032256 00000100:00100000:3.0:1746155577.367465:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124032256 00002000:00100000:3.0:1746155577.367539:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880137121f80 x1830976124032256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.367548:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121f80 with x1830976124032256 ext(3145728->4194303) 00002000:00010000:3.0:1746155577.367552:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137121f80 00000100:00100000:3.0:1746155577.367578:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4978 00000100:00100000:3.0:1746155577.367586:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976124032256:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155577.370559:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976124031744:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8578us (9144us total) trans 21474840699 rc 0/0 00000100:00100000:3.0:1746155577.370568:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 824 00002000:00100000:3.0:1746155577.370577:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1863680->2035711) req@ffff880137120000 x1830976124031744/t21474840699(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/448 e 0 to 0 dl 1746155588 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.370591:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120000 with x1830976124031744 ext(1863680->2035711) 00010000:00010000:3.0:1746155577.370600:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 22 pid: 1625 timeout: 806 lvb_type: 0 00010000:00010000:3.0:1746155577.370612:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 22 pid: 1625 timeout: 806 lvb_type: 0 00002000:00010000:3.0:1746155577.370619:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880137120000 00000100:00100000:1.0:1746155577.370723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.370766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.371213:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124032512 00000100:00100000:2.0:1746155577.371219:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124032512 00002000:00100000:2.0:1746155577.371244:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009fb79880 x1830976124032512/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.371256:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb79880 with x1830976124032512 ext(2097152->3145727) 00002000:00010000:2.0:1746155577.371259:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb79880 00000100:00100000:2.0:1746155577.371271:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124032768 00000100:00100000:2.0:1746155577.371274:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124032768 00002000:00100000:2.0:1746155577.371285:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009fb7b480 x1830976124032768/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.371290:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb7b480 with x1830976124032768 ext(3145728->4194303) 00002000:00010000:2.0:1746155577.371293:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb7b480 00000100:00100000:2.0:1746155577.371309:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4979 00000100:00100000:2.0:1746155577.371316:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976124032512:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155577.371604:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976124032000:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9168us (9230us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155577.371610:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4977 00002000:00100000:1.0:1746155577.371615:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009fb78a80 x1830976124032000/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.371622:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb78a80 with x1830976124032000 ext(2097152->3145727) 00002000:00010000:1.0:1746155577.371625:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb78a80 00000100:00100000:1.0:1746155577.371636:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4980 00000100:00100000:1.0:1746155577.371642:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976124032768:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155577.382361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.383432:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976124032256:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15845us (16799us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155577.383443:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4978 00002000:00100000:3.0:1746155577.383453:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880137121f80 x1830976124032256/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.383462:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121f80 with x1830976124032256 ext(3145728->4194303) 00002000:00010000:3.0:1746155577.383467:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137121f80 00000100:00100000:1.0:1746155577.384222:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124032896 00000100:00100000:1.0:1746155577.384229:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124032896 00010000:00010000:1.0:1746155577.384250:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 18 pid: 1625 timeout: 806 lvb_type: 0 00000100:00100000:1.0:1746155577.384285:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6438 00000100:00100000:1.0:1746155577.384292:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124032896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.384303:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.384318:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 18 pid: 1625 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.384328:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 18 pid: 1625 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.384346:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc0000/0x844e5faceb5ed24d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2035711) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e57 expref: 18 pid: 1625 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.384378:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.384380:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.384385:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e88 expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.384392:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e88 expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.384416:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e88 expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.384425:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124686336:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155577.384471:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3320c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155577.389308:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976124032768:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17657us (18532us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155577.389318:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4980 00002000:00100000:1.0:1746155577.389327:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff88009fb7b480 x1830976124032768/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.389335:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb7b480 with x1830976124032768 ext(3145728->4194303) 00002000:00010000:1.0:1746155577.389340:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb7b480 00000100:00100000:1.0:1746155577.395301:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124686336:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155577.395318:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.395368:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976124032896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 11076us (13013us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.395379:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6438 00000100:00100000:2.0:1746155577.395698:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976124032512:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24381us (24975us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155577.395704:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4979 00002000:00100000:2.0:1746155577.395712:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009fb79880 x1830976124032512/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.395720:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb79880 with x1830976124032512 ext(2097152->3145727) 00002000:00010000:2.0:1746155577.395724:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb79880 00000100:00100000:0.0:1746155577.398115:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.399009:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124033152 00000100:00100000:2.0:1746155577.399017:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124033152 00002000:00100000:2.0:1746155577.399054:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880137120a80 x1830976124033152/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.399063:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120a80 with x1830976124033152 ext(1048576->2097151) 00002000:00010000:2.0:1746155577.399067:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120a80 00000100:00100000:2.0:1746155577.399098:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4981 00000100:00100000:2.0:1746155577.399105:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976124033152:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155577.410366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.410548:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124033280 00000100:00100000:2.0:1746155577.410555:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124033280 00000100:00100000:2.0:1746155577.410603:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12699 00000100:00100000:2.0:1746155577.410609:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976124033280:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155577.410625:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.410640:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed285 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e8f expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.410659:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.410660:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.410667:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed285 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e8f expref: 18 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155577.410680:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed285 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e8f expref: 18 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155577.410690:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4fd8800, rc 0) 00000100:00100000:2.0:1746155577.410725:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976124033280:12345-192.168.202.51@tcp:101:cat.0 Request processed in 116us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.410730:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12699 00000100:00100000:0.0:1746155577.411633:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.411707:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124033536 00000100:00100000:2.0:1746155577.411712:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124033536 00000100:00100000:2.0:1746155577.412284:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10145 00000100:00100000:2.0:1746155577.412291:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29500:x1830976124033536:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155577.412305:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.412318:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0e200/0x844e5faceb5ed28c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e96 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.412397:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505e400/0x844e5faceb5ed293 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412407:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505e400/0x844e5faceb5ed293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412414:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505e400/0x844e5faceb5ed293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412425:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed29a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412429:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed29a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412434:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed29a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412551:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ed2a1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412558:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ed2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412564:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ed2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155577.412570:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155577.412635:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505e400/0x844e5faceb5ed293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412641:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505e400/0x844e5faceb5ed293 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412646:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505e400/0x844e5faceb5ed293 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412651:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a505e400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155577.412654:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505e400/0x844e5faceb5ed293 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412660:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505e400/0x844e5faceb5ed293 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412668:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155577.412671:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155577.412674:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505e400/0x844e5faceb5ed293 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.412678:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a505e400/0x844e5faceb5ed293 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.413959:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed29a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.413966:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed29a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.413971:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed29a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.413975:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53e0a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155577.413977:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed29a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.413981:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed29a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.413992:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fff0100) 00010000:00010000:2.0:1746155577.413995:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746155577.415048:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976124033152:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 15937us (16934us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155577.415057:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4981 00002000:00100000:3.0:1746155577.415065:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff880137120a80 x1830976124033152/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.415074:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120a80 with x1830976124033152 ext(1048576->2097151) 00002000:00010000:3.0:1746155577.415078:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137120a80 00010000:00010000:2.0:1746155577.415286:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed29a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.415292:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed29a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.415332:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0e200/0x844e5faceb5ed28c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e96 expref: 291 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.415342:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ed2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e96 expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.415348:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155577.415350:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155577.415352:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53e1200, rc 0) 00000100:00100000:2.0:1746155577.415372:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29500:x1830976124033536:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3083us (3742us total) trans 8589944123 rc 0/0 00000100:00100000:2.0:1746155577.415377:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10145 00000100:00100000:2.0:1746155577.420144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.420174:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124033792 00000100:00100000:2.0:1746155577.420181:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124033792 00002000:00100000:2.0:1746155577.420399:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009b880000 x1830976124033792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.420408:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880000 with x1830976124033792 ext(4194304->4956159) 00002000:00010000:2.0:1746155577.420413:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b880000 00000100:00100000:2.0:1746155577.420441:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4982 00000100:00100000:2.0:1746155577.420448:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124033792:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155577.425896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.425936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.426269:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124033920 00000100:00100000:3.0:1746155577.426277:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124033920 00000100:00100000:3.0:1746155577.426303:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124034048 00000100:00100000:3.0:1746155577.426305:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124034048 00000100:00100000:3.0:1746155577.428636:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12700 00000100:00100000:3.0:1746155577.428648:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976124033920:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.428664:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.428678:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5ed2af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11e9d expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.428697:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.428699:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.428706:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5ed2af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e9d expref: 23 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.428719:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5ed2af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e9d expref: 23 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.428728:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd50c00, rc 0) 00000100:00100000:3.0:1746155577.428770:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976124033920:12345-192.168.202.51@tcp:101:cat.0 Request processed in 125us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.428776:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12700 00000100:00100000:3.0:1746155577.428793:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12701 00000100:00100000:3.0:1746155577.428798:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976124034048:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.428805:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.428814:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd50400/0x844e5faceb5ed2b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ea4 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.428823:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.428825:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.428829:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd50400/0x844e5faceb5ed2b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ea4 expref: 28 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.428839:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd50400/0x844e5faceb5ed2b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ea4 expref: 28 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.428845:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd50400, rc 0) 00000100:00100000:3.0:1746155577.428860:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976124034048:12345-192.168.202.51@tcp:101:cat.0 Request processed in 62us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.428864:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12701 00000100:00100000:3.0:1746155577.436217:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.436244:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124034304 00000100:00100000:0.0:1746155577.436252:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124034304 00000100:00100000:2.0:1746155577.439199:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124033792:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18741us (19051us total) trans 0 rc 761856/761856 00000100:00100000:2.0:1746155577.439209:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4982 00002000:00100000:2.0:1746155577.439221:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009b880000 x1830976124033792/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.439230:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880000 with x1830976124033792 ext(4194304->4956159) 00002000:00010000:2.0:1746155577.439235:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b880000 00000100:00100000:0.0:1746155577.439747:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10146 00000100:00100000:0.0:1746155577.439757:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29498:x1830976124034304:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155577.439775:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155577.439789:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed2bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11eab expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.439871:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094128e00/0x844e5faceb5ed2c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.439880:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094128e00/0x844e5faceb5ed2c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.439887:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094128e00/0x844e5faceb5ed2c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.439896:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094129400/0x844e5faceb5ed2cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.439901:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094129400/0x844e5faceb5ed2cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.439905:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094129400/0x844e5faceb5ed2cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.439990:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed2d2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.439997:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440002:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155577.440009:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:0.0:1746155577.440068:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094128e00/0x844e5faceb5ed2c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440074:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094128e00/0x844e5faceb5ed2c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440079:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094128e00/0x844e5faceb5ed2c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440083:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094128e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155577.440086:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094128e00/0x844e5faceb5ed2c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440091:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094128e00/0x844e5faceb5ed2c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440100:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155577.440103:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155577.440105:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094128e00/0x844e5faceb5ed2c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440109:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128e00/0x844e5faceb5ed2c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440139:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094129400/0x844e5faceb5ed2cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440143:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094129400/0x844e5faceb5ed2cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440147:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094129400/0x844e5faceb5ed2cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440150:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094129400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155577.440152:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094129400/0x844e5faceb5ed2cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440156:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094129400/0x844e5faceb5ed2cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440161:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012d55a100) 00010000:00010000:0.0:1746155577.440163:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155577.440165:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094129400/0x844e5faceb5ed2cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440169:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094129400/0x844e5faceb5ed2cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.440197:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094128c00/0x844e5faceb5ed2bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eab expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.440205:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eab expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.440210:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:0.0:1746155577.440213:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155577.440214:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094129e00, rc 0) 00000100:00100000:0.0:1746155577.440254:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29498:x1830976124034304:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 499us (4044us total) trans 8589944124 rc 0/0 00000100:00100000:0.0:1746155577.440259:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10146 00000100:00100000:0.0:1746155577.443271:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.443306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.443331:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.443364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.443642:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124034688 00000100:00100000:3.0:1746155577.443651:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124034688 00000100:00100000:2.0:1746155577.443656:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124034816 00000100:00100000:2.0:1746155577.443660:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124034816 00002000:00100000:3.0:1746155577.443683:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009486a300 x1830976124034688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.443683:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094869c00 x1830976124034816/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.443692:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486a300 with x1830976124034688 ext(2097152->3145727) 00002000:00100000:2.0:1746155577.443692:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094869c00 with x1830976124034816 ext(3145728->4194303) 00002000:00010000:3.0:1746155577.443695:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486a300 00002000:00010000:2.0:1746155577.443696:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094869c00 00000100:00100000:2.0:1746155577.443746:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124035072 00000100:00100000:1.0:1746155577.443747:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124035200 00000100:00100000:2.0:1746155577.443749:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124035072 00000100:00100000:1.0:1746155577.443750:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124035200 00002000:00100000:2.0:1746155577.443762:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009486bb80 x1830976124035072/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.443762:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880094868380 x1830976124035200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.443769:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486bb80 with x1830976124035072 ext(2097152->3145727) 00002000:00100000:1.0:1746155577.443769:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094868380 with x1830976124035200 ext(3145728->4194303) 00002000:00010000:2.0:1746155577.443772:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486bb80 00002000:00010000:1.0:1746155577.443772:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094868380 00000100:00100000:1.0:1746155577.443782:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4983 00000100:00100000:2.0:1746155577.443788:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4984 00000100:00100000:1.0:1746155577.443788:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976124034688:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155577.443792:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976124034816:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155577.443801:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4985 00000100:00100000:2.0:1746155577.443804:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976124035200:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155577.444861:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4986 00000100:00100000:2.0:1746155577.444867:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976124035072:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155577.454679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.455368:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124035584 00000100:00100000:2.0:1746155577.455376:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124035584 00000100:00100000:2.0:1746155577.455411:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4129 00000100:00100000:2.0:1746155577.455418:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29493:x1830976124035584:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155577.455618:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29493:x1830976124035584:12345-192.168.202.51@tcp:35:cat.0 Request processed in 199us (948us total) trans 8589944125 rc 0/0 00000100:00100000:2.0:1746155577.455623:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4129 00000100:00100000:1.0:1746155577.470768:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976124034816:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26964us (27450us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155577.470779:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4984 00002000:00100000:1.0:1746155577.470789:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff880094869c00 x1830976124034816/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155577.470790:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976124035200:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26983us (27423us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155577.470797:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4985 00002000:00100000:1.0:1746155577.470799:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094869c00 with x1830976124034816 ext(3145728->4194303) 00002000:00100000:3.0:1746155577.470802:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff880094868380 x1830976124035200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746155577.470804:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094869c00 00002000:00100000:3.0:1746155577.470808:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094868380 with x1830976124035200 ext(3145728->4194303) 00002000:00010000:3.0:1746155577.470812:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094868380 00000100:00100000:2.0:1746155577.476013:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976124035072:12345-192.168.202.51@tcp:3:cat.0 Request processed in 31138us (32672us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155577.476023:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4986 00002000:00100000:2.0:1746155577.476033:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009486bb80 x1830976124035072/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.476041:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486bb80 with x1830976124035072 ext(2097152->3145727) 00002000:00010000:2.0:1746155577.476046:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486bb80 00000100:00100000:2.0:1746155577.477042:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976124034688:12345-192.168.202.51@tcp:3:cat.0 Request processed in 33252us (33775us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155577.477048:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4983 00002000:00100000:2.0:1746155577.477053:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88009486a300 x1830976124034688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.477060:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486a300 with x1830976124034688 ext(2097152->3145727) 00002000:00010000:2.0:1746155577.477062:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486a300 00000100:00100000:0.0:1746155577.487643:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.488956:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124035712 00000100:00100000:2.0:1746155577.488966:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124035712 00000100:00100000:2.0:1746155577.489018:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12702 00000100:00100000:2.0:1746155577.489026:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:29500:x1830976124035712:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155577.489043:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.489058:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11eb2 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.489081:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5ed120 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd2 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155577.489087:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5ed262 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e6c expref: 29 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.489094:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ed23f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e49 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.489099:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.489101:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.489104:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [1081344->1597439] (req 1081344->1597439) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 29 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.489131:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ed23f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e49 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.489141:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ed23f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e49 expref: 17 pid: 19959 timeout: 806 lvb_type: 0 00000100:00100000:2.0:1746155577.489155:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b880380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124686464:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.489234:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5ed262 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e6c expref: 29 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.489243:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5ed262 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e6c expref: 29 pid: 20796 timeout: 806 lvb_type: 0 00000100:00100000:2.0:1746155577.489252:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124686592:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.489277:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5ed120 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd2 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155577.489284:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5ed120 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd2 expref: 9 pid: 8437 timeout: 806 lvb_type: 1 00000100:00100000:2.0:1746155577.489292:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124686720:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.489309:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155577.495358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.495432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.495534:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124036096 00000100:00100000:1.0:1746155577.495541:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124036096 00010000:00010000:1.0:1746155577.495571:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5ed120 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd2 expref: 10 pid: 8437 timeout: 806 lvb_type: 1 00000100:00100000:1.0:1746155577.495597:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6439 00000100:00100000:1.0:1746155577.495605:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124036096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.495617:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.495638:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5ed120 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd2 expref: 10 pid: 8437 timeout: 806 lvb_type: 1 00010000:00010000:1.0:1746155577.495648:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5ed120 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd2 expref: 10 pid: 8437 timeout: 806 lvb_type: 1 00010000:00010000:1.0:1746155577.495668:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.495701:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124036096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.495707:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6439 00000100:00100000:3.0:1746155577.495742:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b880380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124686464:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.495757:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124686592:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.495768:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe8000/0x844e5faceb5ed120 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dd2 expref: 9 pid: 8437 timeout: 806 lvb_type: 1 00000100:00100000:3.0:1746155577.495797:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124686720:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.495827:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1081344->1597439] (req 1081344->1597439) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 29 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.495840:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e28a00, rc 0) 00000100:00100000:2.0:1746155577.495905:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124035968 00000100:00100000:2.0:1746155577.495909:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124035968 00000100:00100000:3.0:1746155577.495910:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:29500:x1830976124035712:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6883us (8270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.495917:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12702 00002000:00100000:2.0:1746155577.495931:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009486a680 x1830976124035968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.495939:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486a680 with x1830976124035968 ext(4194304->4956159) 00002000:00010000:2.0:1746155577.495943:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486a680 00000100:00100000:2.0:1746155577.495955:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4987 00000100:00100000:2.0:1746155577.495961:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976124035968:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155577.503926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.503967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.504060:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124036224 00000100:00100000:0.0:1746155577.504069:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124036224 00010000:00010000:0.0:1746155577.504096:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5ed262 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e6c expref: 29 pid: 20796 timeout: 806 lvb_type: 0 00000100:00100000:0.0:1746155577.504118:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124036352 00000100:00100000:0.0:1746155577.504120:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124036352 00010000:00010000:0.0:1746155577.504128:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ed23f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e49 expref: 18 pid: 19959 timeout: 806 lvb_type: 0 00000100:00100000:0.0:1746155577.504143:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6440 00000100:00100000:0.0:1746155577.504149:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976124036224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155577.504160:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155577.504178:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5ed262 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e6c expref: 29 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.504193:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5ed262 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e6c expref: 29 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.504213:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5ed262 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e6c expref: 29 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.504228:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155577.504263:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976124036224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 114us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.504269:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6440 00000100:00100000:0.0:1746155577.504281:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6441 00000100:00100000:0.0:1746155577.504286:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976124036352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155577.504292:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155577.504299:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ed23f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e49 expref: 18 pid: 19959 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.504307:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ed23f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e49 expref: 18 pid: 19959 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.504317:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094128600/0x844e5faceb5ed23f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e49 expref: 18 pid: 19959 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.504325:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.504326:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.504332:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.504339:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155577.504363:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976124035968:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8400us (9011us total) trans 0 rc 761856/761856 00010000:00010000:0.0:1746155577.504365:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155577.504371:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4987 00000100:00100000:0.0:1746155577.504376:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094868a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124686848:192.168.202.51@tcp:105: 00002000:00100000:3.0:1746155577.504378:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88009486a680 x1830976124035968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.504385:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486a680 with x1830976124035968 ext(4194304->4956159) 00002000:00010000:3.0:1746155577.504389:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486a680 00000100:00100000:0.0:1746155577.504421:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825780 going to sleep for 11 seconds 00000100:00100000:2.0:1746155577.506002:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094868a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976124686848:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155577.506013:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155577.506041:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976124036352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1755us (2074us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.506047:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6441 00000100:00100000:0.0:1746155577.507068:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.508205:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124036608 00000100:00100000:3.0:1746155577.508211:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124036608 00002000:00100000:3.0:1746155577.508238:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1081344->1085439) req@ffff88009486b480 x1830976124036608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.508246:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b480 with x1830976124036608 ext(1081344->1085439) 00002000:00010000:3.0:1746155577.508250:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486b480 00000100:00100000:3.0:1746155577.508264:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4988 00000100:00100000:3.0:1746155577.508270:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976124036608:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155577.508404:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976124036608:12345-192.168.202.51@tcp:3:cat.0 Request processed in 133us (1337us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155577.508410:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4988 00002000:00100000:3.0:1746155577.508415:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1081344->1085439) req@ffff88009486b480 x1830976124036608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/4536 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.508425:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b480 with x1830976124036608 ext(1081344->1085439) 00002000:00010000:3.0:1746155577.508429:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486b480 00000100:00100000:0.0:1746155577.514734:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.514789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.515038:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124037120 00000100:00100000:1.0:1746155577.515046:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124037120 00002000:00100000:1.0:1746155577.515076:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1593344->1597439) req@ffff88009486b100 x1830976124037120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.515085:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b100 with x1830976124037120 ext(1593344->1597439) 00002000:00010000:1.0:1746155577.515089:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486b100 00000100:00100000:1.0:1746155577.515116:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4989 00000100:00100000:1.0:1746155577.515128:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976124037120:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155577.515251:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976124037120:12345-192.168.202.51@tcp:3:cat.0 Request processed in 129us (461us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155577.515257:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4989 00002000:00100000:1.0:1746155577.515261:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1593344->1597439) req@ffff88009486b100 x1830976124037120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/4536 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.515268:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486b100 with x1830976124037120 ext(1593344->1597439) 00002000:00010000:1.0:1746155577.515271:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009486b100 00000100:00100000:2.0:1746155577.515328:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124036864 00000100:00100000:2.0:1746155577.515331:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124036864 00000100:00100000:2.0:1746155577.515352:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4130 00000100:00100000:2.0:1746155577.515356:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29492:x1830976124036864:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155577.515472:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29492:x1830976124036864:12345-192.168.202.51@tcp:35:cat.0 Request processed in 115us (746us total) trans 8589944126 rc 0/0 00000100:00100000:2.0:1746155577.515477:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4130 00000100:00100000:0.0:1746155577.517602:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.517678:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124037376 00000100:00100000:2.0:1746155577.517683:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124037376 00000100:00100000:2.0:1746155577.518087:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4131 00000100:00100000:2.0:1746155577.518094:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29500:x1830976124037376:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155577.518245:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:29500:x1830976124037376:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 151us (646us total) trans 8589944127 rc 0/0 00000100:00100000:2.0:1746155577.518251:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4131 00000100:00100000:0.0:1746155577.559638:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.559753:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124037504 00000100:00100000:3.0:1746155577.559759:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124037504 00000100:00100000:3.0:1746155577.560655:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12703 00000100:00100000:3.0:1746155577.560665:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29498:x1830976124037504:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155577.560681:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.560696:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11eb9 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.560724:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7800/0x844e5faceb5ed119 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dcb expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.560732:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ed22a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e34 expref: 22 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.560739:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cda5200/0x844e5faceb5ed1d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e0a expref: 19 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.560746:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.560747:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.560750:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [278528->991231] (req 278528->991231) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.560774:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cda5200/0x844e5faceb5ed1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e0a expref: 19 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.560783:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cda5200/0x844e5faceb5ed1d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e0a expref: 19 pid: 19959 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.560794:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124686976:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.560883:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ed22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e34 expref: 22 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.560891:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ed22a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e34 expref: 22 pid: 19959 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.560899:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124687104:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.560923:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7800/0x844e5faceb5ed119 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dcb expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.560931:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7800/0x844e5faceb5ed119 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dcb expref: 10 pid: 20796 timeout: 806 lvb_type: 1 00000100:00100000:3.0:1746155577.560944:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124687232:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.560959:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155577.567846:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.567877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.567912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.567946:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124037760 00000100:00100000:0.0:1746155577.567952:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124037760 00010000:00010000:0.0:1746155577.567979:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7800/0x844e5faceb5ed119 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dcb expref: 11 pid: 20796 timeout: 806 lvb_type: 1 00000100:00100000:0.0:1746155577.568000:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124037632 00000100:00100000:0.0:1746155577.568002:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124037632 00010000:00010000:0.0:1746155577.568011:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cda5200/0x844e5faceb5ed1d6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e0a expref: 20 pid: 19959 timeout: 806 lvb_type: 0 00000100:00100000:0.0:1746155577.568032:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124037888 00000100:00100000:0.0:1746155577.568035:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124037888 00010000:00010000:0.0:1746155577.568044:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ed22a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e34 expref: 23 pid: 19959 timeout: 806 lvb_type: 0 00000100:00100000:0.0:1746155577.568058:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6442 00000100:00100000:0.0:1746155577.568065:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976124037760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155577.568076:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155577.568093:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7800/0x844e5faceb5ed119 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dcb expref: 11 pid: 20796 timeout: 806 lvb_type: 1 00010000:00010000:0.0:1746155577.568102:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7800/0x844e5faceb5ed119 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dcb expref: 11 pid: 20796 timeout: 806 lvb_type: 1 00010000:00010000:0.0:1746155577.568120:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155577.568151:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976124037760:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 86us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.568156:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6442 00000100:00100000:0.0:1746155577.568169:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6443 00000100:00100000:0.0:1746155577.568173:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976124037632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155577.568179:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155577.568186:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cda5200/0x844e5faceb5ed1d6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e0a expref: 20 pid: 19959 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.568193:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cda5200/0x844e5faceb5ed1d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e0a expref: 20 pid: 19959 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.568203:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155577.568216:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976124037632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 42us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.568222:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6443 00000100:00100000:0.0:1746155577.568231:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6444 00000100:00100000:0.0:1746155577.568235:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976124037888:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155577.568242:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155577.568248:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ed22a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e34 expref: 23 pid: 19959 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.568256:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ed22a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e34 expref: 23 pid: 19959 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.568266:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.568268:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.568274:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.568281:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.568307:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155577.568317:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124687360:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155577.568370:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746155577.568941:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cda5200/0x844e5faceb5ed1d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e0a expref: 19 pid: 19959 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.568955:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124686976:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.569049:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc02200/0x844e5faceb5ed22a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e34 expref: 23 pid: 19959 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.569060:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124687104:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.569071:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7800/0x844e5faceb5ed119 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dcb expref: 10 pid: 20796 timeout: 806 lvb_type: 1 00000100:00100000:3.0:1746155577.569078:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124687232:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.569100:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.569107:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd51e00, rc 0) 00000100:00100000:3.0:1746155577.569387:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29498:x1830976124037504:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8724us (9754us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.569398:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12703 00000100:00100000:1.0:1746155577.573309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.573381:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976124687360:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155577.573398:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155577.573434:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976124037888:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5197us (5519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.573445:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6444 00000100:00100000:3.0:1746155577.573762:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124038144 00000100:00100000:3.0:1746155577.573768:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124038144 00002000:00100000:3.0:1746155577.573797:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (278528->282623) req@ffff88009fb7a680 x1830976124038144/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.573805:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb7a680 with x1830976124038144 ext(278528->282623) 00002000:00010000:3.0:1746155577.573809:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb7a680 00000100:00100000:3.0:1746155577.575901:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4990 00000100:00100000:3.0:1746155577.575911:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124038144:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155577.576051:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124038144:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 142us (2748us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155577.576057:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4990 00002000:00100000:3.0:1746155577.576062:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (278528->282623) req@ffff88009fb7a680 x1830976124038144/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/4536 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.576069:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb7a680 with x1830976124038144 ext(278528->282623) 00002000:00010000:3.0:1746155577.576073:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb7a680 00000100:00100000:0.0:1746155577.592421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.593202:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124038400 00000100:00100000:2.0:1746155577.593210:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124038400 00002000:00100000:2.0:1746155577.593247:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d6:0x0] (987136->991231) req@ffff8800944ad500 x1830976124038400/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.593255:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ad500 with x1830976124038400 ext(987136->991231) 00002000:00010000:2.0:1746155577.593260:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ad500 00000100:00100000:2.0:1746155577.593289:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4991 00000100:00100000:2.0:1746155577.593296:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124038400:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155577.593427:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124038400:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 131us (1014us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155577.593433:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4991 00002000:00100000:2.0:1746155577.593438:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d6:0x0] (987136->991231) req@ffff8800944ad500 x1830976124038400/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/4536 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.593445:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ad500 with x1830976124038400 ext(987136->991231) 00002000:00010000:2.0:1746155577.593448:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ad500 00000100:00100000:0.0:1746155577.596691:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.597309:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124038656 00000100:00100000:2.0:1746155577.597318:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124038656 00000100:00100000:2.0:1746155577.597415:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4132 00000100:00100000:2.0:1746155577.597423:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+11:29498:x1830976124038656:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155577.599587:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29498:x1830976124038656:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 2159us (2898us total) trans 8589944128 rc 0/0 00000100:00100000:2.0:1746155577.599595:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4132 00000100:00100000:2.0:1746155577.608663:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.608815:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124038912 00000100:00100000:1.0:1746155577.608824:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124038912 00000100:00100000:1.0:1746155577.608876:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10147 00000100:00100000:1.0:1746155577.608884:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29507:x1830976124038912:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155577.608906:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155577.608922:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed2ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ec0 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.608996:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed2f5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.609008:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155577.609017:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed2f5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155577.609025:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155577.609109:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed2ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ec0 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.609139:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ec0 expref: 14 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.609145:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:1.0:1746155577.609147:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746155577.609150:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b188000, rc 0) 00000100:00100000:1.0:1746155577.609186:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29507:x1830976124038912:12345-192.168.202.51@tcp:101:cat.0 Request processed in 303us (531us total) trans 8589944129 rc 0/0 00000100:00100000:1.0:1746155577.609192:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10147 00000100:00100000:0.0:1746155577.612583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.612663:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124039040 00000100:00100000:3.0:1746155577.612669:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124039040 00000100:00100000:3.0:1746155577.612707:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12704 00000100:00100000:3.0:1746155577.612713:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976124039040:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.612727:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.612741:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd50800/0x844e5faceb5ed303 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ec7 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155577.612782:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124687488:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155577.612847:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155577.617421:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124687488:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155577.617452:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd50800/0x844e5faceb5ed303 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ec7 expref: 18 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.617465:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50800/0x844e5faceb5ed303 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ec7 expref: 18 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.617478:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd50800, rc 0) 00000100:00100000:3.0:1746155577.617552:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976124039040:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4837us (4975us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155577.617559:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12704 00000100:00100000:0.0:1746155577.625835:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.628910:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124039296 00000100:00100000:3.0:1746155577.628922:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124039296 00002000:00100000:3.0:1746155577.628966:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800944ae300 x1830976124039296/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 504/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.628975:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ae300 with x1830976124039296 ext(0->1048575) 00002000:00010000:3.0:1746155577.628979:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ae300 00000100:00100000:3.0:1746155577.629013:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4992 00000100:00100000:3.0:1746155577.629020:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976124039296:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155577.640549:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976124039296:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11521us (14713us total) trans 0 rc 335872/335872 00000100:00100000:3.0:1746155577.640558:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4992 00002000:00100000:3.0:1746155577.640567:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800944ae300 x1830976124039296/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 504/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 335872/335872 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.640576:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ae300 with x1830976124039296 ext(0->1048575) 00002000:00010000:3.0:1746155577.640581:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ae300 00000100:00100000:0.0:1746155577.660590:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.660646:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124039424 00000100:00100000:3.0:1746155577.660654:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124039424 00000100:00100000:3.0:1746155577.660689:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12705 00000100:00100000:3.0:1746155577.660696:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29507:x1830976124039424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.660711:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.660725:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ece expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.660749:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.660756:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155577.660758:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155577.660761:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ece expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.660783:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.660793:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 27 pid: 20796 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.660804:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124687616:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.661101:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155577.663575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.664297:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124687616:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.664320:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ece expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.664340:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd51800, rc 0) 00000100:00100000:2.0:1746155577.664598:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124039552 00000100:00100000:2.0:1746155577.664604:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124039552 00002000:00100000:2.0:1746155577.664636:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1081344->1597439) req@ffff8800944aea00 x1830976124039552/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.664644:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944aea00 with x1830976124039552 ext(1081344->1597439) 00010000:00010000:2.0:1746155577.664650:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 28 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.664661:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 28 pid: 20796 timeout: 806 lvb_type: 0 00002000:00010000:2.0:1746155577.664667:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800944aea00 00000100:00100000:2.0:1746155577.664683:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 825 00000100:00100000:2.0:1746155577.664689:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976124039552:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155577.664893:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29507:x1830976124039424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4195us (4308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.664900:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12705 00000100:00100000:2.0:1746155577.677339:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976124039552:12345-192.168.202.51@tcp:4:cat.0 Request processed in 12643us (13763us total) trans 17179873303 rc 0/0 00000100:00100000:2.0:1746155577.677348:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 825 00002000:00100000:2.0:1746155577.677357:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1081344->1597439) req@ffff8800944aea00 x1830976124039552/t17179873303(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/448 e 0 to 0 dl 1746155588 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.677364:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944aea00 with x1830976124039552 ext(1081344->1597439) 00010000:00010000:2.0:1746155577.677372:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 30 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.677384:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 30 pid: 20796 timeout: 806 lvb_type: 0 00002000:00010000:2.0:1746155577.677390:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800944aea00 00000100:00100000:0.0:1746155577.679936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.681732:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124039680 00000100:00100000:2.0:1746155577.681741:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124039680 00010000:00010000:2.0:1746155577.681771:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 30 pid: 20796 timeout: 806 lvb_type: 0 00000100:00100000:2.0:1746155577.681810:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6445 00000100:00100000:2.0:1746155577.681817:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976124039680:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155577.681829:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155577.681847:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 30 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.681856:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 30 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.681873:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed2e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->1597439) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb2 expref: 30 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.681906:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.681908:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.681913:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ece expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.681919:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ece expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.681953:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ece expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155577.681963:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b881f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124687744:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155577.682031:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155577.683571:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b881f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976124687744:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155577.683584:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155577.683646:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976124039680:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1828us (3714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.683653:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6445 00000100:00100000:0.0:1746155577.692027:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.692067:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.692317:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124040064 00000100:00100000:3.0:1746155577.692328:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124040064 00002000:00100000:3.0:1746155577.692367:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800944ae680 x1830976124040064/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.692375:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ae680 with x1830976124040064 ext(1048576->2097151) 00002000:00010000:3.0:1746155577.692379:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ae680 00000100:00100000:3.0:1746155577.692419:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124040192 00000100:00100000:3.0:1746155577.692421:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124040192 00000100:00100000:2.0:1746155577.692426:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4993 00002000:00100000:3.0:1746155577.692432:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800944ace00 x1830976124040192/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746155577.692435:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124040064:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:3.0:1746155577.692439:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ace00 with x1830976124040192 ext(1048576->2097151) 00002000:00010000:3.0:1746155577.692441:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944ace00 00000100:00100000:3.0:1746155577.692456:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4994 00000100:00100000:3.0:1746155577.692460:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124040192:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155577.705181:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124040192:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12710us (13102us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155577.705192:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4994 00002000:00100000:3.0:1746155577.705201:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff8800944ace00 x1830976124040192/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.705217:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ace00 with x1830976124040192 ext(1048576->2097151) 00002000:00010000:3.0:1746155577.705221:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944ace00 00000100:00100000:2.0:1746155577.714379:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124040064:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21934us (22347us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155577.714389:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4993 00002000:00100000:2.0:1746155577.714401:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800944ae680 x1830976124040064/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.714410:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ae680 with x1830976124040064 ext(1048576->2097151) 00002000:00010000:2.0:1746155577.714415:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ae680 00000100:00100000:0.0:1746155577.724261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.724535:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124040448 00000100:00100000:2.0:1746155577.724543:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124040448 00000100:00100000:2.0:1746155577.724590:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10148 00000100:00100000:2.0:1746155577.724596:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+14:29510:x1830976124040448:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155577.724618:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.724633:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06400/0x844e5faceb5ed311 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ed5 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.724711:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.724724:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ed2a1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e96 expref: 291 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.724731:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed2d2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eab expref: 15 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.724737:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.724761:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eab expref: 15 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.724770:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed2d2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eab expref: 15 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:2.0:1746155577.724780:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b881f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124687872:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.726498:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ed2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e96 expref: 291 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.726521:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ed2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e96 expref: 291 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:2.0:1746155577.726535:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124688000:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.726578:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ecea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155577.739923:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.740461:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b881f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124687872:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.740471:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124688000:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.740498:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155577.740968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.742114:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124040704 00000100:00100000:3.0:1746155577.742122:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124040704 00010000:00010000:3.0:1746155577.742148:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ed2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e96 expref: 292 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.742174:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124040576 00000100:00100000:3.0:1746155577.742176:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124040576 00010000:00010000:3.0:1746155577.742184:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed2d2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eab expref: 16 pid: 20364 timeout: 806 lvb_type: 0 00000100:00100000:3.0:1746155577.742196:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6446 00000100:00100000:3.0:1746155577.742201:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:1961:x1830976124040704:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155577.742212:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155577.742215:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ed2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e96 expref: 292 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:3.0:1746155577.742222:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ed2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e96 expref: 292 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:3.0:1746155577.742238:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1200/0x844e5faceb5ed2a1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e96 expref: 292 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:3.0:1746155577.742261:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.742265:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.742274:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.742278:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155577.742310:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1961:x1830976124040704:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 109us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.742315:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6446 00000100:00100000:3.0:1746155577.742326:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6447 00000100:00100000:3.0:1746155577.742330:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976124040576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155577.742337:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155577.742340:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed2d2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eab expref: 16 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:3.0:1746155577.742347:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eab expref: 16 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:3.0:1746155577.742355:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed2d2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eab expref: 16 pid: 20364 timeout: 806 lvb_type: 0 00010000:00010000:3.0:1746155577.742362:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.742364:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.742369:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.742375:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.742389:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155577.742399:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+15:1961:x1830976124040576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 68us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.742403:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6447 00010000:00010000:3.0:1746155577.742493:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.742499:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155577.742529:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155577.742643:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06400/0x844e5faceb5ed311 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ed5 expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.743972:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ed5 expref: 15 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.743979:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.743982:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155577.743984:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090d06000, rc 0) 00000100:00100000:3.0:1746155577.744406:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29510:x1830976124040448:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 19808us (20150us total) trans 8589944130 rc 0/0 00000100:00100000:3.0:1746155577.744413:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10148 00000100:00100000:0.0:1746155577.765018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.765087:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124040960 00000100:00100000:3.0:1746155577.765098:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124040960 00000100:00100000:3.0:1746155577.765144:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10149 00000100:00100000:3.0:1746155577.765150:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29516:x1830976124040960:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.765171:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.765187:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd51c00/0x844e5faceb5ed326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11edc expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.765265:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50e00/0x844e5faceb5ed32d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765275:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50e00/0x844e5faceb5ed32d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765283:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50e00/0x844e5faceb5ed32d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765292:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd51600/0x844e5faceb5ed334 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765297:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd51600/0x844e5faceb5ed334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765302:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd51600/0x844e5faceb5ed334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765373:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed33b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765379:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed33b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765384:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed33b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155577.765391:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155577.765458:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50e00/0x844e5faceb5ed32d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765463:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50e00/0x844e5faceb5ed32d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765468:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50e00/0x844e5faceb5ed32d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765472:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd50e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155577.765475:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50e00/0x844e5faceb5ed32d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765481:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50e00/0x844e5faceb5ed32d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765530:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155577.765533:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155577.765536:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50e00/0x844e5faceb5ed32d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765541:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50e00/0x844e5faceb5ed32d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765559:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd51600/0x844e5faceb5ed334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765563:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd51600/0x844e5faceb5ed334 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765567:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd51600/0x844e5faceb5ed334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765571:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd51600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155577.765572:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd51600/0x844e5faceb5ed334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765576:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd51600/0x844e5faceb5ed334 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765584:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9900) 00010000:00010000:3.0:1746155577.765585:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155577.765587:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd51600/0x844e5faceb5ed334 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765590:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd51600/0x844e5faceb5ed334 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.765618:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd51c00/0x844e5faceb5ed326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11edc expref: 294 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.765628:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed33b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11edc expref: 293 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.765633:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.765635:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155577.765637:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd50800, rc 0) 00000100:00100000:3.0:1746155577.765689:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:29516:x1830976124040960:12345-192.168.202.51@tcp:101:cat.0 Request processed in 537us (677us total) trans 8589944131 rc 0/0 00000100:00100000:3.0:1746155577.765694:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10149 00000100:00100000:0.0:1746155577.767616:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.767649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.767708:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124041088 00000100:00100000:3.0:1746155577.767713:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124041088 00000100:00100000:3.0:1746155577.767743:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124041216 00000100:00100000:3.0:1746155577.767745:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124041216 00000100:00100000:3.0:1746155577.767878:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12706 00000100:00100000:3.0:1746155577.767885:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976124041088:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.767896:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.767906:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd50600/0x844e5faceb5ed349 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ee3 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155577.767945:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124688128:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155577.767992:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155577.768118:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12707 00000100:00100000:1.0:1746155577.768125:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976124041216:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155577.768132:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155577.768142:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed350 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11eea expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.768152:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.768154:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.768160:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed350 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eea expref: 30 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155577.768171:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed350 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eea expref: 30 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155577.768179:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53e1200, rc 0) 00000100:00100000:1.0:1746155577.768215:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976124041216:12345-192.168.202.51@tcp:101:cat.0 Request processed in 91us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.768220:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12707 00002000:00010000:2.0:1746155577.770475:0:20796:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime: 1746155577 -> 1746155578 00002000:00010000:2.0:1746155577.770481:0:20796:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime: 1746155577 -> 1746155578 00002000:00010000:2.0:1746155577.770483:0:20796:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime: 1746155577 -> 1746155578 00000100:00100000:2.0:1746155577.770525:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124688128:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155577.770547:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd50600/0x844e5faceb5ed349 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ee3 expref: 23 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155577.770558:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd50600/0x844e5faceb5ed349 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ee3 expref: 23 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155577.770580:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd50600, rc 0) 00000100:00100000:2.0:1746155577.770611:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976124041088:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2726us (2996us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155577.770617:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12706 00000100:00100000:0.0:1746155577.774913:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.774955:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.775016:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124041600 00000100:00100000:3.0:1746155577.775024:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124041600 00000100:00100000:3.0:1746155577.775068:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10150 00000100:00100000:3.0:1746155577.775075:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:29515:x1830976124041600:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155577.775094:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155577.775103:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124041344 00000100:00100000:1.0:1746155577.775107:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124041344 00010000:00010000:3.0:1746155577.775108:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06400/0x844e5faceb5ed357 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ef8 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.775124:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12708 00000100:00100000:1.0:1746155577.775128:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29516:x1830976124041344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155577.775134:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155577.775142:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ef1 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.775162:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.775168:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155577.775169:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155577.775172:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef1 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.775190:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed365 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.775193:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.775199:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.775202:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 17 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:3.0:1746155577.775207:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155577.775211:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124688256:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.775216:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28600/0x844e5faceb5ed36c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775221:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28600/0x844e5faceb5ed36c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775225:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28600/0x844e5faceb5ed36c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155577.775266:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00010000:00010000:3.0:1746155577.775302:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed373 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775312:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed373 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775318:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed373 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155577.775325:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155577.775389:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775395:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed365 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775400:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775405:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e28a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155577.775408:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775413:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed365 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775422:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155577.775424:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155577.775427:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775431:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28a00/0x844e5faceb5ed365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775442:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28600/0x844e5faceb5ed36c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775450:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28600/0x844e5faceb5ed36c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775454:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28600/0x844e5faceb5ed36c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775458:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e28600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155577.775460:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28600/0x844e5faceb5ed36c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775464:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28600/0x844e5faceb5ed36c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775470:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9200) 00010000:00010000:3.0:1746155577.775472:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155577.775473:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28600/0x844e5faceb5ed36c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775477:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e28600/0x844e5faceb5ed36c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.775537:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06400/0x844e5faceb5ed357 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef8 expref: 296 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.775545:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed373 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef8 expref: 295 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.775550:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.775551:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155577.775553:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dee3e00, rc 0) 00000100:00100000:3.0:1746155577.775576:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:29515:x1830976124041600:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 502us (621us total) trans 8589944132 rc 0/0 00000100:00100000:3.0:1746155577.775581:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10150 00000100:00100000:1.0:1746155577.778237:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976124688256:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155577.778266:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef1 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.778281:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53e0a00, rc 0) 00000100:00100000:1.0:1746155577.778323:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29516:x1830976124041344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3191us (3414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.778330:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12708 00000100:00100000:0.0:1746155577.785770:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.785848:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.785966:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124041728 00000100:00100000:1.0:1746155577.785976:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124041728 00000100:00100000:1.0:1746155577.786046:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 615 00000100:00100000:1.0:1746155577.786054:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1960:x1830976124041728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.786066:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.786090:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed373 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef8 expref: 295 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.786111:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:1.0:1746155577.786116:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.786178:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1960:x1830976124041728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 122us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.786184:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 615 00000100:00100000:2.0:1746155577.786431:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124041856 00000100:00100000:2.0:1746155577.786437:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124041856 00002000:00100000:2.0:1746155577.786470:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (278528->991231) req@ffff8800910c8e00 x1830976124041856/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.786483:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8e00 with x1830976124041856 ext(278528->991231) 00010000:00010000:2.0:1746155577.786529:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 18 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.786543:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 18 pid: 20796 timeout: 806 lvb_type: 0 00002000:00010000:2.0:1746155577.786549:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800910c8e00 00000100:00100000:2.0:1746155577.786569:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 826 00000100:00100000:2.0:1746155577.786577:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976124041856:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155577.794451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.794546:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124041984 00000100:00100000:1.0:1746155577.794553:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124041984 00000100:00100000:1.0:1746155577.794684:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12709 00000100:00100000:1.0:1746155577.794694:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29515:x1830976124041984:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155577.794709:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155577.794724:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11eff expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.794748:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ece expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.794756:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed350 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eea expref: 31 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155577.794761:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.794763:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.794766:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1540096->1662975] (req 1540096->1662975) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.794789:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed350 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eea expref: 31 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155577.794798:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed350 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eea expref: 31 pid: 29728 timeout: 806 lvb_type: 1 00000100:00100000:1.0:1746155577.794808:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124688384:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155577.794878:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ece expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.794885:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ece expref: 17 pid: 20796 timeout: 806 lvb_type: 0 00000100:00100000:1.0:1746155577.794892:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124688512:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155577.794910:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155577.804328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.804351:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124042112 00000100:00100000:0.0:1746155577.804358:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124042112 00010000:00010000:0.0:1746155577.804385:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ece expref: 18 pid: 20796 timeout: 806 lvb_type: 0 00000100:00100000:0.0:1746155577.804409:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6448 00000100:00100000:0.0:1746155577.804416:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976124042112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155577.804427:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155577.804445:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ece expref: 18 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.804455:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ece expref: 18 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.804474:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155577.804535:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1963:x1830976124042112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 118us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.804540:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6448 00000100:00100000:0.0:1746155577.804630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.804641:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124042240 00000100:00100000:0.0:1746155577.804643:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124042240 00010000:00010000:0.0:1746155577.804654:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed350 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eea expref: 32 pid: 29728 timeout: 806 lvb_type: 1 00000100:00100000:0.0:1746155577.804675:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6449 00000100:00100000:0.0:1746155577.804680:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976124042240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155577.804685:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155577.804692:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed350 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eea expref: 32 pid: 29728 timeout: 806 lvb_type: 1 00010000:00010000:0.0:1746155577.804699:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed350 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eea expref: 32 pid: 29728 timeout: 806 lvb_type: 1 00010000:00010000:0.0:1746155577.804714:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.804716:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.804722:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.804729:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.804753:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155577.804763:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124688640:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155577.804805:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746155577.804973:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed350 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eea expref: 32 pid: 29728 timeout: 806 lvb_type: 1 00000100:00100000:1.0:1746155577.804987:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124688384:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155577.804996:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd51800/0x844e5faceb5ed30a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ece expref: 17 pid: 20796 timeout: 806 lvb_type: 0 00000100:00100000:1.0:1746155577.805006:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124688512:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155577.805023:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.805030:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd50600, rc 0) 00000100:00100000:1.0:1746155577.805061:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29515:x1830976124041984:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 10370us (10617us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.805067:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12709 00000100:00100000:2.0:1746155577.815839:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976124041856:12345-192.168.202.51@tcp:4:cat.0 Request processed in 29252us (29980us total) trans 21474840700 rc 0/0 00000100:00100000:2.0:1746155577.815850:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 826 00002000:00100000:2.0:1746155577.815861:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (278528->991231) req@ffff8800910c8e00 x1830976124041856/t21474840700(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/448 e 0 to 0 dl 1746155588 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.815870:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8e00 with x1830976124041856 ext(278528->991231) 00010000:00010000:2.0:1746155577.815879:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 20 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:2.0:1746155577.815892:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 20 pid: 20796 timeout: 806 lvb_type: 0 00002000:00010000:2.0:1746155577.815899:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800910c8e00 00000100:00100000:0.0:1746155577.823252:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124688640:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155577.823271:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155577.823304:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976124042240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 18622us (18672us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.823313:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6449 00000100:00100000:1.0:1746155577.823433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.823827:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.823846:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124042624 00000100:00100000:1.0:1746155577.823851:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124042624 00010000:00010000:1.0:1746155577.823877:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 20 pid: 20796 timeout: 806 lvb_type: 0 00000100:00100000:1.0:1746155577.823898:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6450 00000100:00100000:1.0:1746155577.823904:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976124042624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.823914:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.823932:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 20 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.823941:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 20 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.823972:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed2e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 278528->991231) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eb9 expref: 20 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:1.0:1746155577.823983:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746155577.824118:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124042496 00000100:00100000:2.0:1746155577.824122:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124042496 00002000:00100000:2.0:1746155577.824148:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1540096->1544191) req@ffff88009fb7b800 x1830976124042496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.824156:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb7b800 with x1830976124042496 ext(1540096->1544191) 00002000:00010000:2.0:1746155577.824159:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb7b800 00000100:00100000:2.0:1746155577.824178:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4995 00000100:00100000:2.0:1746155577.824183:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976124042496:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155577.824317:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976124042496:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 132us (883us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155577.824322:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4995 00002000:00100000:2.0:1746155577.824327:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1540096->1544191) req@ffff88009fb7b800 x1830976124042496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/4536 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.824333:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb7b800 with x1830976124042496 ext(1540096->1544191) 00002000:00010000:2.0:1746155577.824336:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb7b800 00010000:00010000:1.0:1746155577.825001:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.825009:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef1 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.825017:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef1 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.825044:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef1 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.825053:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124688768:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155577.825923:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155577.827394:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.827683:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124042880 00000100:00100000:2.0:1746155577.827688:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124042880 00002000:00100000:2.0:1746155577.827715:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1658880->1662975) req@ffff8800910cad80 x1830976124042880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.827723:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cad80 with x1830976124042880 ext(1658880->1662975) 00002000:00010000:2.0:1746155577.827727:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910cad80 00000100:00100000:2.0:1746155577.827742:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4996 00000100:00100000:2.0:1746155577.827747:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976124042880:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155577.828939:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976124042880:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1189us (1546us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155577.828950:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4996 00002000:00100000:2.0:1746155577.828956:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1658880->1662975) req@ffff8800910cad80 x1830976124042880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/4536 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.828963:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cad80 with x1830976124042880 ext(1658880->1662975) 00002000:00010000:2.0:1746155577.828966:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910cad80 00000100:00100000:1.0:1746155577.830044:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124688768:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155577.830058:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.830083:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976124042624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6179us (6256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.830089:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6450 00000100:00100000:0.0:1746155577.832095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.833719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.834001:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124043264 00000100:00100000:2.0:1746155577.834008:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124043264 00000100:00100000:2.0:1746155577.834046:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4133 00000100:00100000:2.0:1746155577.834052:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:29515:x1830976124043264:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155577.834666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.834930:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124043008 00000100:00100000:1.0:1746155577.834934:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124043008 00000100:00100000:1.0:1746155577.835030:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12710 00000100:00100000:1.0:1746155577.835037:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29510:x1830976124043008:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155577.835050:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155577.835062:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f06 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.835082:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 29 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.835089:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155577.835090:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155577.835093:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1196032->1875967] (req 1196032->1875967) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.835128:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 29 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.835138:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 29 pid: 20796 timeout: 806 lvb_type: 0 00000100:00100000:1.0:1746155577.835147:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124688896:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155577.835334:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155577.835570:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124043520 00000100:00100000:3.0:1746155577.835574:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124043520 00002000:00100000:3.0:1746155577.835596:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800910c8700 x1830976124043520/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.835605:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8700 with x1830976124043520 ext(0->1048575) 00002000:00010000:3.0:1746155577.835609:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c8700 00000100:00100000:3.0:1746155577.835620:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4997 00000100:00100000:3.0:1746155577.835625:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976124043520:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155577.836563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.836608:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124043776 00000100:00100000:0.0:1746155577.836611:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124043776 00002000:00100000:0.0:1746155577.836630:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009fb78700 x1830976124043776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 504/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155577.836643:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb78700 with x1830976124043776 ext(1048576->2097151) 00010000:00010000:0.0:1746155577.836649:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 30 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.836660:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 30 pid: 20796 timeout: 806 lvb_type: 0 00002000:00010000:0.0:1746155577.836665:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb78700 00000100:00100000:0.0:1746155577.836676:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 827 00000100:00100000:0.0:1746155577.836681:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976124043776:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155577.838905:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:29515:x1830976124043264:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 4845us (5181us total) trans 8589944133 rc 0/0 00000100:00100000:2.0:1746155577.838916:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4133 00000100:00100000:0.0:1746155577.841557:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976124688896:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155577.841580:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1196032->1875967] (req 1196032->1875967) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.841594:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd50a00, rc 0) 00000100:00100000:0.0:1746155577.841624:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29510:x1830976124043008:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6588us (9533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.841631:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12710 00000100:00100000:1.0:1746155577.841803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.843825:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124043904 00000100:00100000:0.0:1746155577.843832:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124043904 00002000:00100000:0.0:1746155577.843863:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1540096->1662975) req@ffff88009fb79f80 x1830976124043904/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155577.843871:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb79f80 with x1830976124043904 ext(1540096->1662975) 00010000:00010000:0.0:1746155577.843878:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 32 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.843890:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 32 pid: 20796 timeout: 806 lvb_type: 0 00002000:00010000:0.0:1746155577.843896:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb79f80 00000100:00100000:0.0:1746155577.844194:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 828 00000100:00100000:0.0:1746155577.844201:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976124043904:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155577.854568:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976124043776:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 17878us (17998us total) trans 0 rc 925696/925696 00000100:00100000:0.0:1746155577.854578:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 827 00002000:00100000:0.0:1746155577.854588:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009fb78700 x1830976124043776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 504/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:H/200/0 rc 925696/925696 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155577.854597:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb78700 with x1830976124043776 ext(1048576->2097151) 00010000:00010000:0.0:1746155577.854605:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 32 pid: 20796 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746155577.854619:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 32 pid: 20796 timeout: 807 lvb_type: 0 00002000:00010000:0.0:1746155577.854626:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb78700 00000100:00100000:3.0:1746155577.854822:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976124043520:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 19195us (20155us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155577.854828:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4997 00002000:00100000:3.0:1746155577.854834:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800910c8700 x1830976124043520/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.854841:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8700 with x1830976124043520 ext(0->1048575) 00002000:00010000:3.0:1746155577.854844:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c8700 00000100:00100000:1.0:1746155577.855643:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976124043904:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 11441us (13839us total) trans 17179873304 rc 0/0 00000100:00100000:1.0:1746155577.855650:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 828 00002000:00100000:1.0:1746155577.855655:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1540096->1662975) req@ffff88009fb79f80 x1830976124043904/t17179873304(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/448 e 0 to 0 dl 1746155588 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.855667:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb79f80 with x1830976124043904 ext(1540096->1662975) 00010000:00010000:1.0:1746155577.855672:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 32 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.855681:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 32 pid: 20796 timeout: 807 lvb_type: 0 00002000:00010000:1.0:1746155577.855686:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb79f80 00000100:00100000:2.0:1746155577.861572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.861572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.861617:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.861659:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124044416 00000100:00100000:0.0:1746155577.861666:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124044416 00000100:00100000:3.0:1746155577.861686:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124044288 00000100:00100000:3.0:1746155577.861690:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124044288 00000100:00100000:0.0:1746155577.861699:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12711 00000100:00100000:0.0:1746155577.861705:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:29516:x1830976124044416:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155577.861720:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155577.861734:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f14 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.861756:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746155577.861759:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124044032 00010000:00010000:0.0:1746155577.861760:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1196032->1875967] (req 1196032->1875967) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.861762:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124044032 00010000:00010000:0.0:1746155577.861765:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746155577.861768:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f14 expref: 34 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.861776:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 34 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155577.861791:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6451 00010000:00010000:0.0:1746155577.861794:0:20796:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1196032->1875967] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.861796:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976124044032:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.861804:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155577.861805:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f14 expref: 34 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.861812:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbace00, rc 0) 00002000:00010000:1.0:1746155577.861817:0:9789:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155577 -> 1746155578 00002000:00010000:1.0:1746155577.861819:0:9789:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155577 -> 1746155578 00010000:00010000:1.0:1746155577.861823:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 34 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.861831:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 34 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746155577.861842:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:29516:x1830976124044416:12345-192.168.202.51@tcp:101:cat.0 Request processed in 138us (225us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155577.861845:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50600/0x844e5faceb5ed381 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1540096->1662975) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11eff expref: 34 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746155577.861847:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12711 00000100:00100000:3.0:1746155577.861879:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10151 00000100:00100000:3.0:1746155577.861884:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+15:29520:x1830976124044288:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155577.861896:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.861905:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5ed396 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f0d expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.862054:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.862056:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.862062:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.862069:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.862089:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.862098:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 17 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155577.862107:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124689152:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155577.862165:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00010000:00010000:3.0:1746155577.862166:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5ed39d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.862175:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5ed39d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.862183:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5ed39d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.862193:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed3a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.862198:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.862203:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.862284:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5ed3ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.862291:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5ed3ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.862297:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5ed3ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155577.862304:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:3.0:1746155577.862994:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5ed39d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863001:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5ed39d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863009:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5ed39d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863014:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dee3000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155577.863017:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5ed39d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863022:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5ed39d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863030:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:3.0:1746155577.863125:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155577.863129:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5ed39d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863134:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5ed39d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863157:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863162:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed3a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863166:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863170:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dee3e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155577.863173:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863177:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863187:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9a00) 00010000:00010000:3.0:1746155577.863189:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155577.863191:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed3a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863195:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed3a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.863226:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5ed396 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f0d expref: 18 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.863234:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5ed3ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f0d expref: 17 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.863239:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.863241:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155577.863243:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dee2200, rc 0) 00000100:00100000:3.0:1746155577.863272:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29520:x1830976124044288:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1387us (1701us total) trans 8589944134 rc 0/0 00000100:00100000:3.0:1746155577.863277:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10151 00000100:00100000:1.0:1746155577.864651:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124689152:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155577.864665:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155577.864689:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.864693:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976124044032:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2897us (3129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.864700:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6451 00000100:00100000:1.0:1746155577.864720:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124044672 00000100:00100000:1.0:1746155577.864725:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124044672 00002000:00100000:1.0:1746155577.864745:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1196032->1200127) req@ffff8800910cb800 x1830976124044672/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.864758:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb800 with x1830976124044672 ext(1196032->1200127) 00010000:00010000:1.0:1746155577.864764:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.864774:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00002000:00010000:1.0:1746155577.864779:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910cb800 00000100:00100000:1.0:1746155577.864807:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 829 00000100:00100000:1.0:1746155577.864813:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124044672:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155577.864984:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124044672:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 170us (295us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155577.864991:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 829 00002000:00100000:1.0:1746155577.864996:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3da:0x0] (1196032->1200127) req@ffff8800910cb800 x1830976124044672/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/4536 e 0 to 0 dl 1746155588 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.865002:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb800 with x1830976124044672 ext(1196032->1200127) 00010000:00010000:1.0:1746155577.865006:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.865015:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00002000:00010000:1.0:1746155577.865025:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910cb800 00000100:00100000:2.0:1746155577.865108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.865123:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124044928 00000100:00100000:2.0:1746155577.865126:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124044928 00000100:00100000:2.0:1746155577.865144:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4134 00000100:00100000:2.0:1746155577.865149:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a653c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29520:x1830976124044928:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155577.865402:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a653c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29520:x1830976124044928:12345-192.168.202.51@tcp:35:cat.0 Request processed in 252us (293us total) trans 8589944135 rc 0/0 00000100:00100000:2.0:1746155577.865529:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4134 00000100:00100000:0.0:1746155577.867141:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.867277:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124045056 00000100:00100000:1.0:1746155577.867283:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124045056 00000100:00100000:1.0:1746155577.867317:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12712 00000100:00100000:1.0:1746155577.867323:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1961:x1830976124045056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155577.867335:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155577.867348:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cda4e00/0x844e5faceb5ed3b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f1b expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.867365:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.867367:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.867373:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cda4e00/0x844e5faceb5ed3b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f1b expref: 20 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155577.867387:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cda4e00/0x844e5faceb5ed3b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f1b expref: 20 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155577.867396:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cda4e00, rc 0) 00000100:00100000:1.0:1746155577.867435:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976124045056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 111us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.867440:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12712 00000100:00100000:0.0:1746155577.871669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.871825:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124045312 00000100:00100000:3.0:1746155577.871832:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124045312 00002000:00100000:3.0:1746155577.871864:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1871872->1875967) req@ffff8800910c9f80 x1830976124045312/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.871872:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c9f80 with x1830976124045312 ext(1871872->1875967) 00010000:00010000:3.0:1746155577.871879:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.871895:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00002000:00010000:3.0:1746155577.871901:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910c9f80 00000100:00100000:3.0:1746155577.871946:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 830 00000100:00100000:3.0:1746155577.871953:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124045312:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155577.872099:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124045312:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 146us (436us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155577.872105:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 830 00002000:00100000:3.0:1746155577.872110:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1871872->1875967) req@ffff8800910c9f80 x1830976124045312/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/4536 e 0 to 0 dl 1746155588 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.872117:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c9f80 with x1830976124045312 ext(1871872->1875967) 00010000:00010000:3.0:1746155577.872121:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.872129:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00002000:00010000:3.0:1746155577.872134:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910c9f80 00000100:00100000:0.0:1746155577.873584:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.873689:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124045568 00000100:00100000:1.0:1746155577.873694:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124045568 00002000:00100000:1.0:1746155577.873714:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800910cbb80 x1830976124045568/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155577.873721:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cbb80 with x1830976124045568 ext(0->1048575) 00002000:00010000:1.0:1746155577.873724:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910cbb80 00000100:00100000:1.0:1746155577.874206:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4998 00000100:00100000:1.0:1746155577.874213:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976124045568:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155577.880440:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.880479:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.880756:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124045824 00000100:00100000:3.0:1746155577.880764:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124045824 00002000:00100000:3.0:1746155577.880799:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1196031) req@ffff88009b880380 x1830976124045824/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.880808:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880380 with x1830976124045824 ext(1048576->1196031) 00010000:00010000:3.0:1746155577.880816:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.880828:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00002000:00010000:3.0:1746155577.880835:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b880380 00000100:00100000:3.0:1746155577.880848:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124045952 00000100:00100000:3.0:1746155577.880850:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124045952 00002000:00100000:3.0:1746155577.880859:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1196032->1875967) req@ffff880137123800 x1830976124045952/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.880865:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123800 with x1830976124045952 ext(1196032->1875967) 00010000:00010000:3.0:1746155577.880869:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 19 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.880877:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 19 pid: 20796 timeout: 807 lvb_type: 0 00002000:00010000:3.0:1746155577.880882:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880137123800 00000100:00100000:3.0:1746155577.880897:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 831 00000100:00100000:3.0:1746155577.880903:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976124045824:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155577.881148:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 832 00000100:00100000:0.0:1746155577.882091:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976124045568:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7877us (8508us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155577.882099:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4998 00002000:00100000:0.0:1746155577.882105:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff8800910cbb80 x1830976124045568/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155577.882112:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cbb80 with x1830976124045568 ext(0->1048575) 00002000:00010000:0.0:1746155577.882115:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910cbb80 00000100:00100000:3.0:1746155577.882653:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976124045952:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155577.884883:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976124045824:12345-192.168.202.51@tcp:3:cat.0 Request processed in 3974us (4445us total) trans 0 rc 147456/147456 00000100:00100000:3.0:1746155577.884894:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 831 00002000:00100000:3.0:1746155577.884901:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->1196031) req@ffff88009b880380 x1830976124045824/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:H/200/0 rc 147456/147456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.884908:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880380 with x1830976124045824 ext(1048576->1196031) 00010000:00010000:3.0:1746155577.884916:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 20 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.884927:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 20 pid: 20796 timeout: 807 lvb_type: 0 00002000:00010000:3.0:1746155577.885014:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b880380 00000100:00100000:3.0:1746155577.892020:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976124045952:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10859us (11532us total) trans 17179873305 rc 0/0 00000100:00100000:3.0:1746155577.892030:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 832 00002000:00100000:3.0:1746155577.892039:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1196032->1875967) req@ffff880137123800 x1830976124045952/t17179873305(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/448 e 0 to 0 dl 1746155588 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.892047:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123800 with x1830976124045952 ext(1196032->1875967) 00010000:00010000:3.0:1746155577.892056:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 20 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.892070:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 20 pid: 20796 timeout: 807 lvb_type: 0 00002000:00010000:3.0:1746155577.892077:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880137123800 00000100:00100000:0.0:1746155577.896474:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.897555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.897596:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124046208 00000100:00100000:1.0:1746155577.897604:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124046208 00010000:00010000:1.0:1746155577.897635:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 20 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155577.897670:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6452 00000100:00100000:1.0:1746155577.897677:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976124046208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.897689:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.897708:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 20 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.897718:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 20 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.897737:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50a00/0x844e5faceb5ed388 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1875967) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f06 expref: 20 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.897752:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.897753:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.897759:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f14 expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.897766:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f14 expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.897792:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f14 expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.897806:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124689280:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155577.897873:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3320c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155577.899402:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094869f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124689280:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155577.899419:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.899457:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976124046208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1781us (2990us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.899465:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6452 00000100:00100000:2.0:1746155577.900631:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124046336 00000100:00100000:2.0:1746155577.900637:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124046336 00000100:00100000:2.0:1746155577.900664:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12713 00000100:00100000:2.0:1746155577.900669:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29520:x1830976124046336:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155577.900683:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.900695:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6800/0x844e5faceb5ed3c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f22 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.900712:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.900714:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.900719:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6800/0x844e5faceb5ed3c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f22 expref: 20 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.900731:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6800/0x844e5faceb5ed3c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f22 expref: 20 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.900740:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6800, rc 0) 00000100:00100000:2.0:1746155577.900764:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29520:x1830976124046336:12345-192.168.202.51@tcp:101:cat.0 Request processed in 95us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.900769:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12713 00000100:00100000:0.0:1746155577.901688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.901764:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124046592 00000100:00100000:3.0:1746155577.901768:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124046592 00002000:00100000:3.0:1746155577.901793:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094087800 x1830976124046592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.901802:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087800 with x1830976124046592 ext(1048576->2097151) 00002000:00010000:3.0:1746155577.901805:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094087800 00000100:00100000:3.0:1746155577.901818:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4999 00000100:00100000:3.0:1746155577.901823:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976124046592:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155577.906276:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.906333:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124046848 00000100:00100000:2.0:1746155577.906340:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124046848 00002000:00100000:2.0:1746155577.906376:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094084700 x1830976124046848/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/0 e 0 to 0 dl 1746155588 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.906384:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094084700 with x1830976124046848 ext(1048576->2097151) 00002000:00010000:2.0:1746155577.906388:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094084700 00000100:00100000:2.0:1746155577.906422:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5000 00000100:00100000:2.0:1746155577.906430:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976124046848:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155577.908156:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976124046592:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 6328us (6465us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155577.908164:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4999 00002000:00100000:3.0:1746155577.908171:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094087800 x1830976124046592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155577.908178:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094087800 with x1830976124046592 ext(1048576->2097151) 00002000:00010000:3.0:1746155577.908182:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094087800 00000100:00100000:2.0:1746155577.912316:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976124046848:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5879us (6039us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155577.912327:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5000 00002000:00100000:2.0:1746155577.912337:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff880094084700 x1830976124046848/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:648/0 lens 488/440 e 0 to 0 dl 1746155588 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155577.912345:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094084700 with x1830976124046848 ext(1048576->2097151) 00002000:00010000:2.0:1746155577.912350:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094084700 00000100:00100000:0.0:1746155577.924063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.924250:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124047104 00000100:00100000:2.0:1746155577.924258:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124047104 00000100:00100000:2.0:1746155577.924328:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4135 00000100:00100000:2.0:1746155577.924529:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:29516:x1830976124047104:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155577.924727:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:29516:x1830976124047104:12345-192.168.202.51@tcp:35:cat.0 Request processed in 391us (1228us total) trans 8589944136 rc 0/0 00000100:00100000:2.0:1746155577.924735:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4135 00000100:00100000:0.0:1746155577.936784:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.937779:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124047232 00000100:00100000:3.0:1746155577.937788:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124047232 00000100:00100000:3.0:1746155577.937835:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10152 00000100:00100000:3.0:1746155577.937842:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:29525:x1830976124047232:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155577.937860:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155577.937877:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed3c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f29 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.937927:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946bcc00/0x844e5faceb5ed3ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.937941:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800946bcc00/0x844e5faceb5ed3ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.937949:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800946bcc00/0x844e5faceb5ed3ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.937961:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed3d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.937966:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.937970:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.938054:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.938063:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ed5 expref: 17 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.938069:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.938224:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ed5 expref: 17 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.938234:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ed5 expref: 17 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:3.0:1746155577.938245:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124689408:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.938953:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155577.941100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.941155:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124047488 00000100:00100000:2.0:1746155577.941162:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124047488 00000100:00100000:3.0:1746155577.941188:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124689408:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.941193:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4136 00000100:00100000:2.0:1746155577.941198:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:27129:x1830976124047488:12345-192.168.202.51@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746155577.941205:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155577.941427:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:27129:x1830976124047488:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 227us (330us total) trans 8589944137 rc 0/0 00000100:00100000:2.0:1746155577.941434:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4136 00000100:00100000:0.0:1746155577.942924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.943050:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124047616 00000100:00100000:1.0:1746155577.943056:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124047616 00010000:00010000:1.0:1746155577.943076:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ed5 expref: 19 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155577.943105:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6453 00000100:00100000:1.0:1746155577.943110:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976124047616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.943118:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.943122:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ed5 expref: 19 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.943131:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ed5 expref: 19 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.943148:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090d06000/0x844e5faceb5ed318 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ed5 expref: 19 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.943171:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:1.0:1746155577.943176:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.943184:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.943190:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.943215:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.943238:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124047616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 127us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.943244:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6453 00010000:00010000:2.0:1746155577.943305:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943320:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155577.943346:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155577.943350:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155577.943361:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943369:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943377:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800946bcc00/0x844e5faceb5ed3ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943382:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800946bcc00/0x844e5faceb5ed3ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943387:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800946bcc00/0x844e5faceb5ed3ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943391:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946bcc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155577.943394:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946bcc00/0x844e5faceb5ed3ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943399:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800946bcc00/0x844e5faceb5ed3ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943406:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155577.943408:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155577.943410:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800946bcc00/0x844e5faceb5ed3ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943414:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800946bcc00/0x844e5faceb5ed3ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943424:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943428:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed3d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943432:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943435:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129c85800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155577.943437:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943446:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed3d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943452:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fab9200) 00010000:00010000:2.0:1746155577.943454:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155577.943456:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed3d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943460:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed3d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.943495:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5ed3c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f29 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.943532:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f29 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.943538:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155577.943540:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155577.943542:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094129e00, rc 0) 00000100:00100000:2.0:1746155577.943564:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29525:x1830976124047232:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5722us (6788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.943569:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10152 00000100:00100000:0.0:1746155577.945438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.945465:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.945497:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.945529:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124047744 00000100:00100000:0.0:1746155577.945534:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124047744 00000100:00100000:0.0:1746155577.945556:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124047872 00000100:00100000:0.0:1746155577.945558:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124047872 00000100:00100000:0.0:1746155577.945570:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124048000 00000100:00100000:0.0:1746155577.945571:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124048000 00000100:00100000:0.0:1746155577.945583:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12714 00000100:00100000:0.0:1746155577.945589:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976124047744:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155577.945602:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155577.945614:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cbada00/0x844e5faceb5ed3e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f30 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.945629:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.945631:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.945638:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbada00/0x844e5faceb5ed3e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f30 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.945650:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cbada00/0x844e5faceb5ed3e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f30 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.945658:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbada00, rc 0) 00000100:00100000:0.0:1746155577.945685:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976124047744:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 95us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.945690:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12714 00000100:00100000:0.0:1746155577.945701:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12715 00000100:00100000:0.0:1746155577.945706:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976124047872:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155577.945712:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155577.945720:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cbad600/0x844e5faceb5ed3ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f37 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.945730:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.945731:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.945735:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbad600/0x844e5faceb5ed3ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f37 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.945744:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cbad600/0x844e5faceb5ed3ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f37 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.945756:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbad600, rc 0) 00000100:00100000:0.0:1746155577.945771:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976124047872:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 65us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.945776:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12715 00000100:00100000:0.0:1746155577.945786:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12716 00000100:00100000:0.0:1746155577.945791:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1963:x1830976124048000:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155577.945796:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155577.945801:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cbac000/0x844e5faceb5ed3f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f3e expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.945811:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.945813:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.945817:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbac000/0x844e5faceb5ed3f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f3e expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.945824:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cbac000/0x844e5faceb5ed3f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f3e expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.945830:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbac000, rc 0) 00000100:00100000:0.0:1746155577.945844:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976124048000:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 53us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.945849:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12716 00000100:00100000:0.0:1746155577.945881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.945906:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124048128 00000100:00100000:2.0:1746155577.945909:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124048128 00000100:00100000:2.0:1746155577.945928:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12717 00000100:00100000:2.0:1746155577.945932:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976124048128:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155577.945938:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.945944:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ed3f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f45 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.945954:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.945955:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155577.945960:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ed3f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f45 expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155577.945968:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ed3f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f45 expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155577.945974:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6200, rc 0) 00000100:00100000:2.0:1746155577.945990:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976124048128:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 57us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.946011:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12717 00000100:00100000:0.0:1746155577.948551:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.948697:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124048384 00000100:00100000:2.0:1746155577.948704:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124048384 00000100:00100000:2.0:1746155577.948745:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10153 00000100:00100000:2.0:1746155577.948752:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29525:x1830976124048384:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155577.948764:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.948797:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ed3ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f4c expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.948867:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.948878:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f29 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.948889:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.948912:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f29 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.948922:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f29 expref: 8 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.948932:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137120380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124689536:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.949200:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155577.950126:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137120380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124689536:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.950140:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155577.950374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.950635:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124048512 00000100:00100000:3.0:1746155577.950639:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124048512 00010000:00010000:3.0:1746155577.950660:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f29 expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:3.0:1746155577.950690:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6454 00000100:00100000:3.0:1746155577.950696:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976124048512:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155577.950705:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155577.950709:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f29 expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.950719:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f29 expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.950733:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094129e00/0x844e5faceb5ed3dc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f29 expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.950747:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.950751:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.950757:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.950762:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.950776:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155577.950788:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.950794:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155577.950807:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000100:00100000:3.0:1746155577.950810:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1961:x1830976124048512:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 113us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.950816:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6454 00010000:00010000:0.0:1746155577.950941:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6400/0x844e5faceb5ed3ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f4c expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.951018:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f4c expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.951024:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:0.0:1746155577.951142:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155577.951145:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6000, rc 0) 00000100:00100000:0.0:1746155577.951172:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29525:x1830976124048384:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2420us (2626us total) trans 8589944138 rc 0/0 00000100:00100000:0.0:1746155577.951177:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10153 00000100:00100000:0.0:1746155577.952572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.952683:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124048640 00000100:00100000:2.0:1746155577.952688:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124048640 00000100:00100000:2.0:1746155577.952746:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10154 00000100:00100000:2.0:1746155577.952752:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29525:x1830976124048640:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155577.952771:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.952786:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7e00/0x844e5faceb5ed414 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f53 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.952833:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7400/0x844e5faceb5ed41b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.952842:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f4c expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.952847:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7400/0x844e5faceb5ed41b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.952867:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f4c expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.952876:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f4c expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.952885:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137120380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124689664:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.952954:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155577.954261:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137120380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124689664:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.954277:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7400/0x844e5faceb5ed41b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155577.954630:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.954681:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124048768 00000100:00100000:3.0:1746155577.954685:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124048768 00010000:00010000:3.0:1746155577.954704:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f4c expref: 10 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:3.0:1746155577.954739:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6455 00000100:00100000:3.0:1746155577.954744:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976124048768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155577.954752:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155577.954756:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f4c expref: 10 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.954765:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f4c expref: 10 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.954779:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6000/0x844e5faceb5ed406 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f4c expref: 10 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.954824:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.954828:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7400/0x844e5faceb5ed41b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.954835:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7400/0x844e5faceb5ed41b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.954878:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7400/0x844e5faceb5ed41b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.954902:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155577.954928:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976124048768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 183us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.954934:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6455 00010000:00010000:2.0:1746155577.955138:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7400/0x844e5faceb5ed41b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.955146:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7400/0x844e5faceb5ed41b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155577.955180:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155577.955184:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155577.955195:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7400/0x844e5faceb5ed41b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.955219:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7e00/0x844e5faceb5ed414 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f53 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.955243:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7400/0x844e5faceb5ed41b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f53 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.955249:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155577.955251:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155577.955253:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e7400, rc 0) 00000100:00100000:2.0:1746155577.955321:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29525:x1830976124048640:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2568us (2752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.955330:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10154 00000100:00100000:0.0:1746155577.957957:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.958025:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124049024 00000100:00100000:2.0:1746155577.958032:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124049024 00000100:00100000:2.0:1746155577.958063:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10155 00000100:00100000:2.0:1746155577.958068:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29525:x1830976124049024:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155577.958083:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155577.958097:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6a00/0x844e5faceb5ed422 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f5a expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.958171:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6e00/0x844e5faceb5ed429 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.958188:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6e00/0x844e5faceb5ed429 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.958197:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6e00/0x844e5faceb5ed429 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155577.958208:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155577.958312:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6a00/0x844e5faceb5ed422 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f5a expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.958325:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6e00/0x844e5faceb5ed429 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f5a expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.958332:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155577.958335:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155577.958337:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3e6e00, rc 0) 00000100:00100000:2.0:1746155577.958896:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29525:x1830976124049024:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 826us (944us total) trans 8589944139 rc 0/0 00000100:00100000:2.0:1746155577.958902:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10155 00000100:00100000:0.0:1746155577.962691:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.962724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.962749:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.962762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.962775:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.962797:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.962817:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124049152 00000100:00100000:0.0:1746155577.962825:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124049152 00000100:00100000:0.0:1746155577.962856:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124049280 00000100:00100000:0.0:1746155577.962858:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124049280 00000100:00100000:0.0:1746155577.962867:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124049408 00000100:00100000:0.0:1746155577.962869:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124049408 00000100:00100000:0.0:1746155577.962888:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124049536 00000100:00100000:0.0:1746155577.962890:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124049536 00000100:00100000:0.0:1746155577.962899:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124049664 00000100:00100000:0.0:1746155577.962900:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124049664 00000100:00100000:0.0:1746155577.962907:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124049792 00000100:00100000:0.0:1746155577.962909:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124049792 00000100:00100000:0.0:1746155577.962920:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12718 00000100:00100000:0.0:1746155577.962926:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976124049152:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155577.962959:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.962975:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef1 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.962982:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cbada00/0x844e5faceb5ed3e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f30 expref: 14 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.962988:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cda4e00/0x844e5faceb5ed3b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f1b expref: 19 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.962994:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.962995:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155577.962997:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12719 00010000:00010000:0.0:1746155577.962998:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155577.963003:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976124049280:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155577.963020:0:19959:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.963026:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cda4e00/0x844e5faceb5ed3b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f1b expref: 19 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.963029:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f14 expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.963035:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cbad600/0x844e5faceb5ed3ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f37 expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.963037:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cda4e00/0x844e5faceb5ed3b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f1b expref: 19 pid: 1625 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.963042:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6800/0x844e5faceb5ed3c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f22 expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.963046:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.963046:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.963048:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155577.963049:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124689792:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.963061:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6800/0x844e5faceb5ed3c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f22 expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.963068:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6800/0x844e5faceb5ed3c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f22 expref: 19 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:3.0:1746155577.963075:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124689920:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.963102:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12720 00000100:00100000:3.0:1746155577.963107:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976124049408:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155577.963120:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.963120:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cbada00/0x844e5faceb5ed3e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f30 expref: 14 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.963127:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cbada00/0x844e5faceb5ed3e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f30 expref: 14 pid: 9235 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.963128:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e65 expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.963135:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cbac000/0x844e5faceb5ed3f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f3e expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155577.963135:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124690048:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.963142:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed269 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e73 expref: 31 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.963146:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.963148:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.963149:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.963155:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef1 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.963162:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef1 expref: 22 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.963167:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e73 expref: 31 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155577.963168:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124690176:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.963179:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed269 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e73 expref: 31 pid: 1625 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746155577.963182:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155577.963185:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124690304:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155577.963199:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12721 00000100:00100000:0.0:1746155577.963204:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976124049536:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155577.963206:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cbac000/0x844e5faceb5ed3f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f3e expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.963213:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cbac000/0x844e5faceb5ed3f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f3e expref: 13 pid: 9235 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746155577.963217:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155577.963220:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124690432:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155577.963225:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e88 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.963231:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ed3f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f45 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.963236:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e65 expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.963237:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed285 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e8f expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.963243:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e65 expref: 19 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746155577.963243:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.963244:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.963246:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155577.963249:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124690560:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155577.963258:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed285 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e8f expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155577.963261:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b40c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746155577.963264:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed285 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e8f expref: 19 pid: 20796 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746155577.963271:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124690688:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.963273:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12722 00000100:00100000:3.0:1746155577.963277:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976124049664:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155577.963289:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.963291:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ed3f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f45 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.963302:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ed3f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f45 expref: 14 pid: 20796 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746155577.963308:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124690816:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155577.963327:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e88 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.963334:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e88 expref: 22 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746155577.963341:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124690944:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155577.963350:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155577.963362:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12723 00000100:00100000:0.0:1746155577.963367:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976124049792:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155577.963380:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.963388:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090344200/0x844e5faceb5ed13c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dee expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.963395:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50400/0x844e5faceb5ed2b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ea4 expref: 31 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.963402:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5ed277 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e81 expref: 19 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.963408:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.963409:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.963411:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.963423:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5ed277 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e81 expref: 19 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.963429:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5ed277 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e81 expref: 19 pid: 1625 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746155577.963436:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124691072:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155577.963452:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd50400/0x844e5faceb5ed2b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ea4 expref: 31 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.963459:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd50400/0x844e5faceb5ed2b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ea4 expref: 31 pid: 20796 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746155577.963466:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124691200:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155577.963479:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090344200/0x844e5faceb5ed13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dee expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155577.963496:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090344200/0x844e5faceb5ed13c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dee expref: 13 pid: 8437 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746155577.963536:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124691328:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155577.963558:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746155577.963984:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ed135 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de7 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.963990:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5ed2af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e9d expref: 22 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.963996:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1400/0x844e5faceb5ed270 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e7a expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.964002:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.964003:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.964005:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.964024:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1400/0x844e5faceb5ed270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e7a expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.964031:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1400/0x844e5faceb5ed270 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e7a expref: 19 pid: 20796 timeout: 807 lvb_type: 1 00000100:00100000:3.0:1746155577.964038:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124691456:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.964068:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5ed2af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e9d expref: 22 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.964075:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5ed2af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e9d expref: 22 pid: 20796 timeout: 807 lvb_type: 1 00000100:00100000:3.0:1746155577.964086:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124691584:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.964106:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ed135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de7 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.964113:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ed135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de7 expref: 14 pid: 8437 timeout: 807 lvb_type: 1 00000100:00100000:3.0:1746155577.964120:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124691712:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.964131:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746155577.964147:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cbad600/0x844e5faceb5ed3ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f37 expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155577.964154:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cbad600/0x844e5faceb5ed3ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f37 expref: 13 pid: 9235 timeout: 807 lvb_type: 1 00000100:00100000:3.0:1746155577.964161:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124691840:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.964180:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f14 expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.964187:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f14 expref: 31 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:3.0:1746155577.964195:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124691968:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.964210:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155577.977773:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124689792:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.977925:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124690048:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.977933:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124690176:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.977956:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155577.977979:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124691072:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155577.978011:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124691200:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155577.978035:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976124691328:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155577.978050:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155577.978122:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.978135:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.978150:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124049920 00000100:00100000:0.0:1746155577.978154:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124049920 00010000:00010000:0.0:1746155577.978179:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cda4e00/0x844e5faceb5ed3b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f1b expref: 20 pid: 1625 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746155577.978197:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124050176 00000100:00100000:0.0:1746155577.978198:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124050176 00010000:00010000:0.0:1746155577.978205:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbada00/0x844e5faceb5ed3e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f30 expref: 15 pid: 9235 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746155577.978217:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6456 00000100:00100000:0.0:1746155577.978223:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976124049920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155577.978234:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155577.978250:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cda4e00/0x844e5faceb5ed3b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f1b expref: 20 pid: 1625 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746155577.978260:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cda4e00/0x844e5faceb5ed3b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f1b expref: 20 pid: 1625 timeout: 807 lvb_type: 1 00000100:00100000:2.0:1746155577.978261:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6457 00000100:00100000:2.0:1746155577.978268:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1962:x1830976124050176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155577.978276:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155577.978278:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cda4e00/0x844e5faceb5ed3b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f1b expref: 20 pid: 1625 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746155577.978285:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cbada00/0x844e5faceb5ed3e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f30 expref: 15 pid: 9235 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746155577.978291:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155577.978294:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cbada00/0x844e5faceb5ed3e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f30 expref: 15 pid: 9235 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746155577.978305:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cbada00/0x844e5faceb5ed3e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f30 expref: 15 pid: 9235 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746155577.978316:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155577.978320:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976124049920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 97us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.978326:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6456 00000100:00100000:2.0:1746155577.978333:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1962:x1830976124050176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.978339:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6457 00000100:00100000:2.0:1746155577.978360:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124691456:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155577.978366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.978368:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124691584:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.978374:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976124691712:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.978388:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155577.978400:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124050048 00000100:00100000:2.0:1746155577.978402:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124050048 00010000:00010000:2.0:1746155577.978413:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6800/0x844e5faceb5ed3c0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f22 expref: 20 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746155577.978414:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.978423:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124050304 00000100:00100000:0.0:1746155577.978426:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124050304 00000100:00100000:2.0:1746155577.978432:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6458 00010000:00010000:0.0:1746155577.978435:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef1 expref: 23 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.978437:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976124050048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155577.978444:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155577.978449:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6459 00000100:00100000:0.0:1746155577.978453:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976124050304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155577.978455:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6800/0x844e5faceb5ed3c0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f22 expref: 20 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746155577.978460:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155577.978462:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6800/0x844e5faceb5ed3c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f22 expref: 20 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746155577.978466:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef1 expref: 23 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155577.978473:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155577.978475:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef1 expref: 23 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.978499:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1962:x1830976124050048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 60us (131us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155577.978517:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53e0a00/0x844e5faceb5ed35e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ef1 expref: 23 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.978518:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6458 00010000:00010000:0.0:1746155577.978525:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.978527:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155577.978531:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.978538:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.978586:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124690688:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155577.978595:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124690816:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155577.978601:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124690944:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155577.978614:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155577.978685:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124690304:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.978692:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124690432:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.978698:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976124690560:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.978711:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.978729:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e6800/0x844e5faceb5ed3c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f22 expref: 19 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:3.0:1746155577.978741:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124689920:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.978748:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124691840:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155577.978754:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976124691968:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155577.978764:0:19959:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.978947:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155577.978963:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976124050304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 509us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.978969:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6459 00010000:00010000:3.0:1746155577.983194:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.983209:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.983237:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.983249:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.983256:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.983262:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cbac200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155577.983265:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.983271:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.983286:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.983292:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cbac200/0x844e5faceb5ed437 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155577.983363:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976124049152:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 20432us (20673us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.983371:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12718 00000100:00100000:0.0:1746155577.984604:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.984654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.985308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.985417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.985873:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124050432 00000100:00100000:2.0:1746155577.985881:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124050432 00010000:00010000:2.0:1746155577.985910:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbac000/0x844e5faceb5ed3f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f3e expref: 14 pid: 9235 timeout: 807 lvb_type: 1 00000100:00100000:2.0:1746155577.985930:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124050688 00000100:00100000:2.0:1746155577.985933:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124050688 00010000:00010000:2.0:1746155577.985942:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed285 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e8f expref: 19 pid: 20796 timeout: 807 lvb_type: 1 00000100:00100000:2.0:1746155577.985952:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124050944 00000100:00100000:2.0:1746155577.985954:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124050944 00010000:00010000:2.0:1746155577.985962:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5ed277 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e81 expref: 19 pid: 1625 timeout: 807 lvb_type: 1 00000100:00100000:2.0:1746155577.985975:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6460 00000100:00100000:2.0:1746155577.985982:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976124050432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155577.985992:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155577.986010:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cbac000/0x844e5faceb5ed3f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f3e expref: 14 pid: 9235 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746155577.986020:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cbac000/0x844e5faceb5ed3f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f3e expref: 14 pid: 9235 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746155577.986037:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cbac000/0x844e5faceb5ed3f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f3e expref: 14 pid: 9235 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746155577.986050:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155577.986084:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976124050432:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 102us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.986090:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6460 00000100:00100000:2.0:1746155577.986105:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6461 00000100:00100000:2.0:1746155577.986109:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976124050688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155577.986117:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155577.986136:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed285 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e8f expref: 19 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746155577.986145:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed285 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e8f expref: 19 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746155577.986162:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed285 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e8f expref: 19 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746155577.986170:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155577.986185:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124050688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 75us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.986189:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6461 00000100:00100000:2.0:1746155577.986224:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6462 00000100:00100000:2.0:1746155577.986229:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1960:x1830976124050944:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155577.986235:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155577.986243:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5ed277 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e81 expref: 19 pid: 1625 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746155577.986250:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5ed277 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e81 expref: 19 pid: 1625 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746155577.986260:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5ed277 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e81 expref: 19 pid: 1625 timeout: 807 lvb_type: 1 00010000:00010000:2.0:1746155577.986266:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155577.986276:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124050944:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 47us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.986280:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6462 00000100:00100000:0.0:1746155577.986736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.986758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.986774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.986785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.987174:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155577.987339:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124050560 00000100:00100000:3.0:1746155577.987343:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124050560 00010000:00010000:3.0:1746155577.987358:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e65 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:3.0:1746155577.987374:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124050816 00000100:00100000:3.0:1746155577.987376:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124050816 00010000:00010000:3.0:1746155577.987383:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ed3f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f45 expref: 13 pid: 20796 timeout: 807 lvb_type: 1 00000100:00100000:3.0:1746155577.987390:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124051200 00000100:00100000:3.0:1746155577.987391:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124051200 00010000:00010000:3.0:1746155577.987397:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e88 expref: 22 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:3.0:1746155577.987404:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124051072 00000100:00100000:3.0:1746155577.987405:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124051072 00010000:00010000:3.0:1746155577.987412:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090344200/0x844e5faceb5ed13c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dee expref: 13 pid: 8437 timeout: 807 lvb_type: 1 00000100:00100000:3.0:1746155577.987418:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124051456 00000100:00100000:3.0:1746155577.987419:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124051456 00010000:00010000:3.0:1746155577.987425:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ed135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de7 expref: 14 pid: 8437 timeout: 807 lvb_type: 1 00000100:00100000:3.0:1746155577.987431:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124051712 00000100:00100000:3.0:1746155577.987433:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124051712 00010000:00010000:3.0:1746155577.987438:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1400/0x844e5faceb5ed270 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e7a expref: 18 pid: 20796 timeout: 807 lvb_type: 1 00000100:00100000:3.0:1746155577.987447:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6463 00000100:00100000:3.0:1746155577.987451:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124050560:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155577.987460:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155577.987468:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e65 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.987475:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e65 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.987495:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d800/0x844e5faceb5ed25b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e65 expref: 18 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.987516:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155577.987539:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1960:x1830976124050560:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 88us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.987544:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6463 00000100:00100000:3.0:1746155577.987555:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6464 00000100:00100000:3.0:1746155577.987560:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976124050816:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155577.987566:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155577.987574:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ed3f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f45 expref: 14 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.987581:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ed3f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f45 expref: 14 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.987590:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3e6200/0x844e5faceb5ed3f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f45 expref: 14 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.987601:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155577.987615:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976124050816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.987619:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6464 00000100:00100000:3.0:1746155577.987631:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6465 00000100:00100000:3.0:1746155577.987635:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976124051200:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155577.987641:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155577.987647:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e88 expref: 22 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.987655:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e88 expref: 22 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.987666:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1200/0x844e5faceb5ed27e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e88 expref: 22 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.987673:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.987675:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155577.987679:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.987686:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.987702:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155577.987716:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976124051200:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.987720:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6465 00000100:00100000:3.0:1746155577.987730:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6466 00000100:00100000:3.0:1746155577.987734:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1962:x1830976124051072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155577.987740:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155577.987746:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090344200/0x844e5faceb5ed13c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dee expref: 13 pid: 8437 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.987753:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090344200/0x844e5faceb5ed13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dee expref: 13 pid: 8437 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.987762:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090344200/0x844e5faceb5ed13c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11dee expref: 13 pid: 8437 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.987768:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155577.987778:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976124051072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 44us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.987782:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6466 00000100:00100000:3.0:1746155577.987790:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6467 00000100:00100000:3.0:1746155577.987794:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976124051456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155577.987798:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155577.987806:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ed135 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de7 expref: 12 pid: 8437 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.987813:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ed135 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de7 expref: 12 pid: 8437 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.987822:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ed135 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11de7 expref: 12 pid: 8437 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.987829:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155577.987841:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976124051456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 46us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.987845:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6467 00000100:00100000:3.0:1746155577.987853:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6468 00000100:00100000:3.0:1746155577.987857:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124051712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155577.987862:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155577.987867:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1400/0x844e5faceb5ed270 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e7a expref: 18 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.987873:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1400/0x844e5faceb5ed270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e7a expref: 18 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.987881:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffc1400/0x844e5faceb5ed270 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e7a expref: 18 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155577.987888:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155577.987901:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976124051712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 44us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.987906:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6468 00010000:00010000:3.0:1746155577.987933:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.987945:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.987960:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.987966:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.987973:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.987978:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cda5600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155577.987981:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.987988:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.987996:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155577.988002:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cda5600/0x844e5faceb5ed44c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155577.988034:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124049536:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 24829us (25270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.988040:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12721 00000100:00100000:1.0:1746155577.988143:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.988156:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124051328 00000100:00100000:1.0:1746155577.988159:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124051328 00010000:00010000:1.0:1746155577.988172:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed269 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e73 expref: 32 pid: 1625 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155577.988199:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6469 00000100:00100000:1.0:1746155577.988204:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976124051328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.988209:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.988218:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed269 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e73 expref: 32 pid: 1625 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.988225:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed269 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e73 expref: 32 pid: 1625 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.988236:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed269 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e73 expref: 32 pid: 1625 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.988247:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.988248:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.988251:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988257:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988269:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.988285:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976124051328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 81us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.988290:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6469 00000100:00100000:1.0:1746155577.988330:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.988341:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124051584 00000100:00100000:1.0:1746155577.988343:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124051584 00010000:00010000:1.0:1746155577.988354:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbad600/0x844e5faceb5ed3ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f37 expref: 12 pid: 9235 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746155577.988365:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6470 00000100:00100000:1.0:1746155577.988369:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976124051584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.988375:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.988382:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cbad600/0x844e5faceb5ed3ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f37 expref: 12 pid: 9235 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746155577.988389:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cbad600/0x844e5faceb5ed3ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f37 expref: 12 pid: 9235 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746155577.988398:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cbad600/0x844e5faceb5ed3ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f37 expref: 12 pid: 9235 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746155577.988406:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.988418:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976124051584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.988424:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6470 00000100:00100000:1.0:1746155577.988454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.988464:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124051840 00000100:00100000:1.0:1746155577.988466:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124051840 00010000:00010000:1.0:1746155577.988475:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5ed2af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e9d expref: 21 pid: 20796 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746155577.988494:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6471 00000100:00100000:1.0:1746155577.988499:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976124051840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.988519:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.988526:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5ed2af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e9d expref: 21 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746155577.988536:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5ed2af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e9d expref: 21 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746155577.988545:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd50c00/0x844e5faceb5ed2af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e9d expref: 21 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746155577.988551:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.988552:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.988555:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988560:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988572:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.988582:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976124051840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 83us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.988587:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6471 00010000:00010000:1.0:1746155577.988600:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988606:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988617:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988627:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988632:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988637:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdc9e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155577.988639:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988644:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988652:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988657:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9e00/0x844e5faceb5ed453 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.988679:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976124049664:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 25401us (25903us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.988684:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12722 00000100:00100000:1.0:1746155577.988720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.988729:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124052096 00000100:00100000:1.0:1746155577.988731:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124052096 00010000:00010000:1.0:1746155577.988740:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd50400/0x844e5faceb5ed2b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ea4 expref: 31 pid: 20796 timeout: 807 lvb_type: 1 00000100:00100000:1.0:1746155577.988750:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6472 00000100:00100000:1.0:1746155577.988754:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976124052096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.988759:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.988765:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd50400/0x844e5faceb5ed2b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ea4 expref: 31 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746155577.988771:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd50400/0x844e5faceb5ed2b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ea4 expref: 31 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746155577.988781:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50400/0x844e5faceb5ed2b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ea4 expref: 31 pid: 20796 timeout: 807 lvb_type: 1 00010000:00010000:1.0:1746155577.988789:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.988790:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.988792:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988797:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988809:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.988819:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976124052096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 65us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.988824:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6472 00010000:00010000:1.0:1746155577.988837:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988843:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988854:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988859:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988864:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988868:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53e1200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155577.988870:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988876:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988883:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.988889:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5ed45a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.988912:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124049792:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 25545us (26114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.988917:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12723 00000100:00100000:1.0:1746155577.988963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155577.988973:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124051968 00000100:00100000:1.0:1746155577.988975:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124051968 00010000:00010000:1.0:1746155577.988984:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f14 expref: 30 pid: 20796 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155577.988994:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6473 00000100:00100000:1.0:1746155577.988998:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976124051968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.989003:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.989009:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f14 expref: 30 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.989016:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f14 expref: 30 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.989026:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5ed38f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f14 expref: 30 pid: 20796 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.989033:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.989034:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155577.989037:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.989042:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.989057:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155577.989067:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976124051968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 69us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.989071:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6473 00010000:00010000:1.0:1746155577.989618:0:19959:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.989627:0:19959:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.989639:0:19959:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.989645:0:19959:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.989651:0:19959:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.989656:0:19959:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094128200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155577.989659:0:19959:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.989664:0:19959:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.989677:0:19959:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155577.989683:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094128200/0x844e5faceb5ed43e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155577.989721:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1960:x1830976124049280:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 26718us (26996us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.989727:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12719 00010000:00010000:0.0:1746155577.989789:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.989800:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.989813:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.989819:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.989825:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.989830:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094129000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155577.989832:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.989838:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.989846:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155577.989856:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed445 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155577.989882:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1960:x1830976124049408:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 26774us (27132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.989888:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12720 00000100:00100000:0.0:1746155577.994190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.994249:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124052352 00000100:00100000:2.0:1746155577.994257:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124052352 00000100:00100000:2.0:1746155577.994288:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10156 00000100:00100000:2.0:1746155577.994294:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29525:x1830976124052352:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155577.994335:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155577.994353:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e7400/0x844e5faceb5ed41b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f53 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994380:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155577.994384:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155577.994405:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.994415:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e2d expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994422:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994428:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 295 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994433:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed2f5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ec0 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994439:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed33b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11edc expref: 295 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994445:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5ed3ab lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f0d expref: 17 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994455:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.994477:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5ed3ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f0d expref: 17 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994496:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5ed3ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f0d expref: 17 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.994524:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137120380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124692096:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.994596:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed33b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11edc expref: 295 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994604:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed33b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11edc expref: 295 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.994611:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124692224:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.994629:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ec0 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994636:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed2f5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ec0 expref: 17 pid: 27374 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.994643:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124692352:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.994658:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 295 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994668:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 295 pid: 15474 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.994675:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124692480:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.994690:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994696:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 17 pid: 15474 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.994702:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124692608:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155577.994720:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e2d expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155577.994726:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e2d expref: 295 pid: 27374 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.994733:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124692736:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.994745:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfda80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155577.996850:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137120380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124692096:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155577.996852:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.996860:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124692224:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.996867:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124692352:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.996873:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124692480:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155577.996876:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.996880:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124692608:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155577.996886:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124692736:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155577.996893:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.996904:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155577.996913:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155577.996917:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155577.996930:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124052480 00000100:00100000:2.0:1746155577.996931:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124052608 00000100:00100000:2.0:1746155577.996934:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124052608 00000100:00100000:0.0:1746155577.996934:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124052480 00010000:00010000:2.0:1746155577.996953:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed33b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11edc expref: 296 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746155577.996953:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5ed3ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f0d expref: 18 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.996968:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124052864 00000100:00100000:0.0:1746155577.996968:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124052736 00000100:00100000:0.0:1746155577.996969:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124052736 00000100:00100000:2.0:1746155577.996970:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124052864 00010000:00010000:0.0:1746155577.996976:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 297 pid: 15474 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155577.996978:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 19 pid: 15474 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746155577.996983:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124052992 00000100:00100000:0.0:1746155577.996985:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124052992 00000100:00100000:2.0:1746155577.996988:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6474 00010000:00010000:0.0:1746155577.996991:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e2d expref: 298 pid: 27374 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.996993:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976124052480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155577.996999:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6475 00000100:00100000:0.0:1746155577.997003:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1962:x1830976124052608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155577.997004:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155577.997009:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5ed3ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f0d expref: 19 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746155577.997009:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155577.997012:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed33b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11edc expref: 298 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155577.997017:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5ed3ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f0d expref: 19 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746155577.997024:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed33b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11edc expref: 298 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:3.0:1746155577.997059:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6476 00000100:00100000:3.0:1746155577.997065:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1962:x1830976124052736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155577.997071:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155577.997075:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 298 pid: 15474 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155577.997109:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6477 00000100:00100000:1.0:1746155577.997115:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976124052864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155577.997121:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155577.997124:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 19 pid: 15474 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155577.997797:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5ed3ab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f0d expref: 19 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155577.997809:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155577.997813:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.997820:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155577.997850:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1962:x1830976124052480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 857us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.997856:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6474 00000100:00100000:2.0:1746155577.997871:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6478 00000100:00100000:2.0:1746155577.997876:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1962:x1830976124052992:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155577.997881:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155577.997885:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e2d expref: 298 pid: 27374 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155577.997892:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e2d expref: 298 pid: 27374 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155577.997902:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed223 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e2d expref: 298 pid: 27374 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155577.997909:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155577.997912:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155577.997917:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155577.997927:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1962:x1830976124052992:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155577.997931:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6478 00000100:00100000:2.0:1746155577.998101:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.998118:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124053248 00000100:00100000:2.0:1746155577.998121:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124053248 00000100:00100000:2.0:1746155577.998138:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4137 00000100:00100000:2.0:1746155577.998143:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+18:27128:x1830976124053248:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746155577.998263:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+19:27128:x1830976124053248:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 119us (162us total) trans 8589944140 rc 0/0 00000100:00100000:2.0:1746155577.998268:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4137 00010000:00010000:3.0:1746155577.999081:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 296 pid: 15474 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.999106:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e123600/0x844e5faceb5ed238 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e42 expref: 296 pid: 15474 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.999113:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 18 pid: 15474 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155577.999124:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e122400/0x844e5faceb5ed231 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11e3b expref: 18 pid: 15474 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155577.999127:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155577.999131:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155577.999137:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155577.999138:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:1.0:1746155577.999141:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155577.999145:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155577.999161:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1962:x1830976124052736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2096us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155577.999163:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1962:x1830976124052864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2049us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155577.999168:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6476 00000100:00100000:1.0:1746155577.999178:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6477 00010000:00010000:0.0:1746155577.999394:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed33b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11edc expref: 294 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746155577.999405:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:0.0:1746155577.999408:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155577.999413:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155577.999434:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1962:x1830976124052608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2430us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155577.999439:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6475 00000100:00100000:0.0:1746155577.999898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155577.999940:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124053376 00000100:00100000:2.0:1746155577.999944:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124053376 00010000:00010000:2.0:1746155577.999958:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed2f5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ec0 expref: 17 pid: 27374 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155577.999980:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6479 00000100:00100000:2.0:1746155577.999986:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+17:1961:x1830976124053376:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155577.999993:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155577.999997:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed2f5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ec0 expref: 17 pid: 27374 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.000005:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed2f5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ec0 expref: 17 pid: 27374 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.000015:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed2f5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ec0 expref: 17 pid: 27374 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.000023:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155578.000027:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.000036:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.000042:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.000168:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155578.000210:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155578.000216:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155578.000579:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+16:1961:x1830976124053376:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 591us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.000584:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6479 00000040:00080000:3.0:1746155578.001094:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2972, 88 off248928 00000004:00080000:3.0:1746155578.001103:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707150599903ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.001782:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2906, 88 off242848 00000004:00080000:3.0:1746155578.001788:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707151285183ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.001811:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2907, 88 off242936 00000004:00080000:3.0:1746155578.001814:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707151311277ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.001823:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2973, 88 off249016 00000004:00080000:3.0:1746155578.001825:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707151322572ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.001831:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2974, 88 off249104 00000004:00080000:3.0:1746155578.001834:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707151331378ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.001844:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2908, 88 off243024 00000004:00080000:3.0:1746155578.001846:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707151343247ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.002121:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2909, 88 off243112 00000004:00080000:3.0:1746155578.002126:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707151623022ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.003181:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2910, 88 off243200 00000004:00080000:3.0:1746155578.003185:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707152682320ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.003632:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2975, 88 off249192 00000004:00080000:3.0:1746155578.003637:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707153133659ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.003803:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2911, 88 off243288 00000004:00080000:3.0:1746155578.003807:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707153303718ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.003817:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2976, 88 off249280 00000004:00080000:3.0:1746155578.003819:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707153316518ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.003826:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2912, 88 off243376 00000004:00080000:3.0:1746155578.003829:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707153325684ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.003835:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2977, 88 off249368 00000004:00080000:3.0:1746155578.003837:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707153334394ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.003844:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2978, 88 off249456 00000004:00080000:3.0:1746155578.003846:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707153342768ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.003852:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2979, 88 off249544 00000004:00080000:3.0:1746155578.003854:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707153351026ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.003860:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2980, 88 off249632 00000004:00080000:3.0:1746155578.003862:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707153359113ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.003869:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2913, 88 off243464 00000004:00080000:3.0:1746155578.003871:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707153368336ns, next at 645866785986ns, rc = 0 00000004:00010000:2.0:1746155578.036428:0:20364:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095268700 reply state ffff88009f239400 transno 8589944141 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155578.036442:0:20364:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746155578.036556:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:29525:x1830976124052352:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 42258us (42369us total) trans 8589944141 rc 0/0 00000100:00100000:2.0:1746155578.036564:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10156 00000001:00080000:1.0:1746155578.037053:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944138 is committed 00000001:00080000:1.0:1746155578.037061:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944124 is committed 00000001:00080000:1.0:1746155578.037066:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944129 is committed 00000001:00080000:1.0:1746155578.037071:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944140 is committed 00000001:00080000:1.0:1746155578.037074:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944139 is committed 00000001:00080000:1.0:1746155578.037079:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944136 is committed 00010000:00010000:2.0:1746155578.040176:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.040189:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.040195:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.040200:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3e6c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155578.040205:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.040211:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.040226:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155578.040228:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155578.040231:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.040235:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6c00/0x844e5faceb5ed461 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00000001:00080000:1.0:1746155578.040314:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944141 is committed 00000004:00080000:1.0:1746155578.040321:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2105 committed 00000004:00080000:1.0:1746155578.040329:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2178 committed 00000100:00100000:0.0:1746155578.040981:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.041276:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124053504 00000100:00100000:2.0:1746155578.041282:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124053504 00000100:00100000:2.0:1746155578.041315:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10157 00000100:00100000:2.0:1746155578.041321:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29525:x1830976124053504:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155578.041337:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155578.041349:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5ed468 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f61 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.041391:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5ed468 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f61 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.041402:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5ed468 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f61 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.041415:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155578.041417:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155578.041420:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136ac9800, rc 0) 00000100:00100000:2.0:1746155578.041455:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29525:x1830976124053504:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 134us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.041461:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10157 00000100:00100000:2.0:1746155578.041482:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124693248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.041542:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.041570:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124693760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.041585:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.041599:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746155578.041603:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124692864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.041614:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.041623:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124693376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.041634:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.041649:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124692992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.041663:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.042325:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124694272:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155578.042429:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2177 committed 00000004:00080000:1.0:1746155578.042431:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2176 committed 00000004:00080000:1.0:1746155578.042433:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2175 committed 00000004:00080000:1.0:1746155578.042434:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2104 committed 00000004:00080000:1.0:1746155578.042435:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2174 committed 00000004:00080000:1.0:1746155578.042436:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2103 committed 00000004:00080000:1.0:1746155578.042438:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2173 committed 00000004:00080000:1.0:1746155578.042439:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2102 committed 00000004:00080000:1.0:1746155578.042440:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2101 committed 00000004:00080000:1.0:1746155578.042441:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2100 committed 00000004:00080000:1.0:1746155578.042442:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2172 committed 00000004:00080000:1.0:1746155578.042443:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2171 committed 00000004:00080000:1.0:1746155578.042445:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2099 committed 00000004:00080000:1.0:1746155578.042446:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2098 committed 00000100:00100000:2.0:1746155578.043447:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124693504:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155578.043607:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2170 committed 00000100:00100000:1.0:1746155578.043650:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124693120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.043713:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124693248 00000100:00100000:3.0:1746155578.043718:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124693248 00000100:00100000:3.0:1746155578.043740:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124693760 00000100:00100000:3.0:1746155578.043742:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124693760 00000100:00100000:2.0:1746155578.043743:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.043751:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124692864 00000100:00100000:3.0:1746155578.043753:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124692864 00000100:00100000:3.0:1746155578.043761:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124693376 00000100:00100000:3.0:1746155578.043763:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124693376 00000100:00100000:2.0:1746155578.043766:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124694016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155578.043771:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124692992 00000100:00100000:3.0:1746155578.043773:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124692992 00000100:00100000:3.0:1746155578.043780:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124693504 00000100:00100000:3.0:1746155578.043781:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124693504 00000100:00100000:2.0:1746155578.043783:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.043787:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124694016 00000100:00100000:3.0:1746155578.043789:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124694016 00000100:00100000:2.0:1746155578.043791:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124694528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155578.043798:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12724 00000100:00100000:2.0:1746155578.043802:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.043804:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3297:x1830976124693248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.043898:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124694528 00000100:00100000:2.0:1746155578.043901:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124694528 00000100:00100000:2.0:1746155578.043913:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12725 00000100:00100000:2.0:1746155578.043917:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3297:x1830976124693760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.043928:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12726 00000100:00100000:2.0:1746155578.043932:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976124692864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.043966:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976124693248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (2423us total) trans 17179873306 rc 0/0 00000100:00100000:3.0:1746155578.043972:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12724 00000100:00100000:3.0:1746155578.043983:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12727 00000100:00100000:3.0:1746155578.043987:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3297:x1830976124693376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.043998:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12728 00000100:00100000:3.0:1746155578.044002:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3295:x1830976124692992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.044018:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976124692864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (2403us total) trans 17179873307 rc 0/0 00000100:00100000:2.0:1746155578.044023:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12726 00000100:00100000:2.0:1746155578.044032:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12729 00000100:00100000:2.0:1746155578.044036:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3295:x1830976124693504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.044078:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3295:x1830976124692992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (2414us total) trans 17179873308 rc 0/0 00000100:00100000:3.0:1746155578.044083:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12728 00000100:00100000:3.0:1746155578.044094:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12730 00000100:00100000:3.0:1746155578.044098:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3295:x1830976124694016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.044099:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3295:x1830976124693504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (632us total) trans 17179873309 rc 0/0 00000100:00100000:2.0:1746155578.044104:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12729 00000100:00100000:2.0:1746155578.044112:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12731 00000100:00100000:2.0:1746155578.044115:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3295:x1830976124694528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155578.044192:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3295:x1830976124694016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (407us total) trans 21474840701 rc 0/0 00000100:00100000:3.0:1746155578.044197:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12730 00000100:00100000:2.0:1746155578.044206:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976124693760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 288us (2619us total) trans 17179873310 rc 0/0 00000100:00100000:2.0:1746155578.044210:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12725 00000100:00100000:3.0:1746155578.044212:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.044218:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124694272 00000100:00100000:2.0:1746155578.044221:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124694272 00000100:00100000:3.0:1746155578.044224:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124694784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.044233:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12732 00000100:00100000:2.0:1746155578.044236:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3297:x1830976124694272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155578.044237:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746155578.044257:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9d880/2, rc 0, transno 17179873307 00000100:00100000:3.0:1746155578.044261:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124692864:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155578.044268:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9ce00/2, rc 0, transno 17179873306 00000100:00100000:2.0:1746155578.044268:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124694784 00000100:00100000:3.0:1746155578.044270:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124693248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.044270:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124694784 00000004:00080000:3.0:1746155578.044276:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094085500/2, rc 0, transno 17179873310 00000100:00100000:3.0:1746155578.044278:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124693760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.044281:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12733 00000100:00100000:3.0:1746155578.044285:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746155578.044285:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976124694784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155578.044289:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124693888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155578.044302:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.044309:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124694400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155578.044320:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.044332:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124693888 00000100:00100000:3.0:1746155578.044334:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124693888 00000100:00100000:3.0:1746155578.044343:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124694400 00000100:00100000:3.0:1746155578.044344:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124694400 00000100:00100000:3.0:1746155578.044350:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12734 00000100:00100000:3.0:1746155578.044354:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3297:x1830976124693888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.044354:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3295:x1830976124694528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 238us (551us total) trans 21474840702 rc 0/0 00000100:00100000:2.0:1746155578.044359:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12731 00000100:00100000:2.0:1746155578.044367:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12735 00000100:00100000:2.0:1746155578.044370:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3297:x1830976124694400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155578.044430:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3297:x1830976124693888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (126us total) trans 21474840703 rc 0/0 00000100:00100000:3.0:1746155578.044434:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12734 00000100:00100000:2.0:1746155578.044571:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3297:x1830976124694400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 198us (248us total) trans 21474840704 rc 0/0 00000100:00100000:2.0:1746155578.044576:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12735 00002000:00010000:2.0:1746155578.044634:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:2.0:1746155578.044636:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155578.044638:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155578.044640:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155578.044642:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:2.0:1746155578.044660:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3297:x1830976124694272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 423us (447us total) trans 21474840705 rc 0/0 00000100:00100000:2.0:1746155578.044664:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12732 00000100:00100000:2.0:1746155578.044722:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3297:x1830976124694784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 436us (483us total) trans 21474840706 rc 0/0 00000100:00100000:2.0:1746155578.044727:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12733 00000100:00100000:1.0:1746155578.044753:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155578.044788:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124693632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155578.044806:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.044810:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976124693376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 823us (3174us total) trans 17179873311 rc 0/0 00000100:00100000:2.0:1746155578.044814:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12727 00000100:00100000:1.0:1746155578.044816:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124694144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155578.044828:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155578.044836:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124694656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155578.044846:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155578.044860:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124693120 00000100:00100000:1.0:1746155578.044862:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124693120 00000100:00100000:1.0:1746155578.044874:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124693632 00000100:00100000:1.0:1746155578.044875:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124693632 00000100:00100000:1.0:1746155578.044881:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124694144 00000100:00100000:1.0:1746155578.044882:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124694144 00000100:00100000:1.0:1746155578.044889:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124694656 00000100:00100000:1.0:1746155578.044890:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124694656 00000100:00100000:1.0:1746155578.044899:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12736 00000100:00100000:1.0:1746155578.044903:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3296:x1830976124693120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.044908:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12737 00000100:00100000:2.0:1746155578.044912:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3296:x1830976124693632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.044929:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12738 00000100:00100000:2.0:1746155578.044933:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3296:x1830976124694144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155578.044991:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3296:x1830976124693120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (236us total) trans 17179873312 rc 0/0 00000100:00100000:2.0:1746155578.044994:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976124694144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (165us total) trans 21474840707 rc 0/0 00000100:00100000:1.0:1746155578.044995:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12736 00000100:00100000:2.0:1746155578.044998:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12738 00000100:00100000:1.0:1746155578.045004:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12739 00000100:00100000:1.0:1746155578.045007:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3296:x1830976124694656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.045066:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3296:x1830976124693632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (258us total) trans 17179873313 rc 0/0 00000100:00100000:1.0:1746155578.045067:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976124694656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (220us total) trans 21474840708 rc 0/0 00000100:00100000:2.0:1746155578.045071:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12737 00000004:00080000:2.0:1746155578.045096:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b882d80/2, rc 0, transno 21474840701 00000100:00100000:2.0:1746155578.045100:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124694016:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155578.045106:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf6d80/2, rc 0, transno 21474840702 00000100:00100000:2.0:1746155578.045109:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124694528:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155578.045115:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9f800/2, rc 0, transno 17179873308 00000100:00100000:2.0:1746155578.045117:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124692992:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155578.045122:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9df80/2, rc 0, transno 17179873309 00000100:00100000:2.0:1746155578.045124:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124693504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155578.045136:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12739 00000004:00080000:1.0:1746155578.045159:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9f480/2, rc 0, transno 17179873312 00000100:00100000:1.0:1746155578.045162:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124693120:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155578.045168:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9c380/2, rc 0, transno 17179873313 00000100:00100000:1.0:1746155578.045170:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124693632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155578.045180:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910c8380/2, rc 0, transno 21474840707 00000100:00100000:1.0:1746155578.045183:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124694144:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155578.045188:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf5f80/2, rc 0, transno 21474840708 00000100:00100000:1.0:1746155578.045190:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124694656:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155578.045215:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb7b100/2, rc 0, transno 21474840703 00000100:00100000:3.0:1746155578.045219:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124693888:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155578.045226:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910caa00/2, rc 0, transno 21474840704 00000100:00100000:3.0:1746155578.045229:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124694400:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155578.045234:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910cb100/2, rc 0, transno 21474840705 00000100:00100000:3.0:1746155578.045236:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124694272:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155578.045241:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf6300/2, rc 0, transno 21474840706 00000100:00100000:3.0:1746155578.045243:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124694784:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155578.045248:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9c000/2, rc 0, transno 17179873311 00000100:00100000:3.0:1746155578.045250:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124693376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.045415:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124694912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.045437:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155578.045527:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124694912 00000100:00100000:1.0:1746155578.045530:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124694912 00000100:00100000:1.0:1746155578.045543:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12740 00000100:00100000:1.0:1746155578.045547:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3298:x1830976124694912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155578.045618:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3298:x1830976124694912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (180us total) trans 21474840709 rc 0/0 00000100:00100000:1.0:1746155578.045622:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12740 00000004:00080000:0.0:1746155578.045670:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3edf80/2, rc 0, transno 21474840709 00000100:00100000:0.0:1746155578.045673:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124694912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.047323:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.047396:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124053632 00000100:00100000:2.0:1746155578.047400:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124053632 00000100:00100000:2.0:1746155578.047426:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10158 00000100:00100000:2.0:1746155578.047431:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29525:x1830976124053632:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155578.047442:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155578.047456:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed46f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f68 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.047543:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed476 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155578.047554:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed476 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155578.047562:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed476 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155578.047582:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:2.0:1746155578.047586:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155578.047597:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed476 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155578.047615:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed46f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f68 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.047630:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed476 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f68 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.047636:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155578.047852:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155578.047855:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b188000, rc 0) 00000100:00100000:2.0:1746155578.048445:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29525:x1830976124053632:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1012us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.048451:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10158 00000100:00100000:0.0:1746155578.050675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.050704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.050716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.050727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.050738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.050791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.050808:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124053760 00000100:00100000:0.0:1746155578.050813:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124053760 00000100:00100000:0.0:1746155578.050845:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124053888 00000100:00100000:0.0:1746155578.050847:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124053888 00000100:00100000:0.0:1746155578.050857:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124054144 00000100:00100000:0.0:1746155578.050858:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124054144 00000100:00100000:0.0:1746155578.050866:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124054400 00000100:00100000:0.0:1746155578.050867:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124054400 00000100:00100000:0.0:1746155578.050875:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124054016 00000100:00100000:0.0:1746155578.050877:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124054016 00000100:00100000:0.0:1746155578.050884:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124054272 00000100:00100000:0.0:1746155578.050885:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124054272 00000100:00100000:0.0:1746155578.050895:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12741 00000100:00100000:0.0:1746155578.050900:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1961:x1830976124053760:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155578.050912:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155578.050925:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed47d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f6f expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155578.050943:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x6814383a, atime: 0x6814383a, ctime: 0x6814383a, blocks: 0x765 00010000:00010000:0.0:1746155578.050956:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.050958:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.050966:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed47d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f6f expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155578.050979:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed47d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f6f expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155578.050986:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd51e00, rc 0) 00000100:00100000:0.0:1746155578.051016:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1961:x1830976124053760:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 115us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155578.051021:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12741 00000100:00100000:0.0:1746155578.051032:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12742 00000100:00100000:0.0:1746155578.051036:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124053888:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155578.051042:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155578.051051:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd51c00/0x844e5faceb5ed484 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f76 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155578.051062:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3da:0x0] initial LVB size: 2097152, mtime: 0x6814383a, atime: 0x68143839, ctime: 0x6814383a, blocks: 0x821 00010000:00010000:0.0:1746155578.051070:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.051071:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.051075:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd51c00/0x844e5faceb5ed484 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f76 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155578.051082:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12743 00010000:00010000:0.0:1746155578.051084:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd51c00/0x844e5faceb5ed484 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f76 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155578.051090:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd51c00, rc 0) 00000100:00100000:1.0:1746155578.051091:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124054144:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155578.051098:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155578.051103:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124053888:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 66us (398us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155578.051106:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed48b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f84 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155578.051108:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12742 00000100:00100000:0.0:1746155578.051116:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12744 00002000:00010000:1.0:1746155578.051118:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x68143839, atime: 0x68143839, ctime: 0x68143839, blocks: 0x821 00000100:00100000:0.0:1746155578.051121:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124054400:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155578.051125:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.051125:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155578.051127:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.051130:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd51600/0x844e5faceb5ed492 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f92 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.051131:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed48b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f84 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155578.051141:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed48b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f84 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746155578.051143:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3dc:0x0] initial LVB size: 4194304, mtime: 0x68143839, atime: 0x68143839, ctime: 0x68143839, blocks: 0x1029 00010000:00010000:0.0:1746155578.051149:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.051150:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155578.051153:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cc9600, rc 0) 00010000:00010000:0.0:1746155578.051153:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd51600/0x844e5faceb5ed492 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f92 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155578.051161:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd51600/0x844e5faceb5ed492 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f92 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155578.051167:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd51600, rc 0) 00000100:00100000:1.0:1746155578.051171:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976124054144:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 83us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155578.051176:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12743 00000100:00100000:0.0:1746155578.051180:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124054400:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 59us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155578.051184:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12744 00000100:00100000:1.0:1746155578.051188:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12745 00000100:00100000:1.0:1746155578.051192:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1960:x1830976124054016:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:0.0:1746155578.051193:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12746 00010000:00010000:1.0:1746155578.051197:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155578.051197:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124054272:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155578.051202:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155578.051204:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed499 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f7d expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.051208:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed4a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f8b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155578.051213:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3db:0x0] initial LVB size: 2097152, mtime: 0x68143839, atime: 0x68143839, ctime: 0x68143839, blocks: 0x821 00002000:00010000:0.0:1746155578.051216:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d9:0x0] initial LVB size: 4954272, mtime: 0x68143839, atime: 0x68143839, ctime: 0x68143839, blocks: 0x1613 00010000:00010000:1.0:1746155578.051219:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155578.051220:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.051223:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155578.051224:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed499 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f7d expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155578.051224:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.051227:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed4a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f8b expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155578.051231:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed499 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f7d expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155578.051236:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5cc9e00, rc 0) 00010000:00010000:0.0:1746155578.051239:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed4a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f8b expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155578.051246:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd50800, rc 0) 00000100:00100000:1.0:1746155578.051251:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1960:x1830976124054016:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 58us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155578.051255:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12745 00000100:00100000:0.0:1746155578.051258:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1960:x1830976124054272:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 61us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155578.051262:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12746 00000100:00080000:0.0:1746155578.051275:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746155578.051277:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155578.063163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.064636:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.064766:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124054656 00000100:00100000:2.0:1746155578.064773:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124054656 00000100:00100000:2.0:1746155578.064812:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124054912 00000100:00100000:2.0:1746155578.064814:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124054912 00000100:00100000:2.0:1746155578.064829:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5001 00000100:00100000:2.0:1746155578.064835:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1963:x1830976124054656:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155578.064861:0:10888:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136ac8600/0x844e5faceb5ed4a7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.064872:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.064873:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.064877:0:10888:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136ac8600/0x844e5faceb5ed4a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.064889:0:10888:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136ac8600/0x844e5faceb5ed4a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155578.065944:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5002 00000100:00100000:2.0:1746155578.065950:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1963:x1830976124054912:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155578.065967:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800946bcc00/0x844e5faceb5ed4ae lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.065974:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.065975:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.065977:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800946bcc00/0x844e5faceb5ed4ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.065985:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800946bcc00/0x844e5faceb5ed4ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155578.066979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.067767:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.067788:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124055168 00000100:00100000:1.0:1746155578.067792:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124055168 00000100:00100000:1.0:1746155578.067822:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124055424 00000100:00100000:1.0:1746155578.067823:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124055424 00000100:00100000:1.0:1746155578.067836:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5003 00000100:00100000:1.0:1746155578.067841:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1963:x1830976124055168:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155578.067857:0:25391:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e7a00/0x844e5faceb5ed4b5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.067866:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155578.067867:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155578.067870:0:25391:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e7a00/0x844e5faceb5ed4b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.067878:0:25391:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3e7a00/0x844e5faceb5ed4b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155578.069364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.069382:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124055680 00000100:00100000:1.0:1746155578.069386:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124055680 00000100:00100000:1.0:1746155578.069408:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5004 00000100:00100000:1.0:1746155578.069413:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1962:x1830976124055424:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155578.069431:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dc40c00/0x844e5faceb5ed4bc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.069440:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155578.069442:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155578.069444:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc40c00/0x844e5faceb5ed4bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.069457:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc40c00/0x844e5faceb5ed4bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155578.071331:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5005 00000100:00100000:3.0:1746155578.071341:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1962:x1830976124055680:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155578.071364:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ed4c3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.071373:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.071374:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.071378:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ed4c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.071387:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ed4c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155578.072558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.072576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.072610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.072621:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124055936 00000100:00100000:0.0:1746155578.072626:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124055936 00000100:00100000:0.0:1746155578.072653:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124056192 00000100:00100000:0.0:1746155578.072654:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124056192 00000100:00100000:0.0:1746155578.072670:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124056448 00000100:00100000:0.0:1746155578.072671:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124056448 00000100:00100000:0.0:1746155578.072682:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5006 00000100:00100000:0.0:1746155578.072686:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1962:x1830976124055936:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155578.072700:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd51a00/0x844e5faceb5ed4ca lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.072708:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.072709:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.072712:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd51a00/0x844e5faceb5ed4ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.072720:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd51a00/0x844e5faceb5ed4ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155578.073968:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5007 00000100:00100000:3.0:1746155578.073976:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1962:x1830976124056192:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155578.073995:0:2798:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094129600/0x844e5faceb5ed4d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.074002:0:2798:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.074004:0:2798:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.074007:0:2798:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094129600/0x844e5faceb5ed4d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.074016:0:2798:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094129600/0x844e5faceb5ed4d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155578.074932:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5008 00000100:00100000:3.0:1746155578.074939:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1962:x1830976124056448:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155578.074954:0:31253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed4d8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.074960:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.074962:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.074964:0:31253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed4d8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.074976:0:31253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed4d8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.076914:0:10888:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136ac8600/0x844e5faceb5ed4a7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.076924:0:10888:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136ac8600/0x844e5faceb5ed4a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.076930:0:10888:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136ac8600/0x844e5faceb5ed4a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.076935:0:10888:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136ac8600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155578.076939:0:10888:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136ac8600/0x844e5faceb5ed4a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.076945:0:10888:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136ac8600/0x844e5faceb5ed4a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.076957:0:10888:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136ac8600/0x844e5faceb5ed4a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.076962:0:10888:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136ac8600/0x844e5faceb5ed4a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155578.080706:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:834818df-1a1e-4d15-9e1d-5cedb28f094a+18:1963:x1830976124054656:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 15862us (17541us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155578.080722:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5001 00010000:00010000:2.0:1746155578.090283:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800946bcc00/0x844e5faceb5ed4ae lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.090299:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800946bcc00/0x844e5faceb5ed4ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.090306:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800946bcc00/0x844e5faceb5ed4ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.090312:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800946bcc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155578.090316:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800946bcc00/0x844e5faceb5ed4ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.090324:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800946bcc00/0x844e5faceb5ed4ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.090340:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800946bcc00/0x844e5faceb5ed4ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.090346:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946bcc00/0x844e5faceb5ed4ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155578.090421:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:834818df-1a1e-4d15-9e1d-5cedb28f094a+17:1963:x1830976124054912:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 24467us (25783us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155578.090430:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5002 00010000:00010000:1.0:1746155578.097326:0:25391:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f3e7a00/0x844e5faceb5ed4b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.097342:0:25391:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3e7a00/0x844e5faceb5ed4b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.097349:0:25391:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f3e7a00/0x844e5faceb5ed4b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.097356:0:25391:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3e7a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155578.097359:0:25391:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f3e7a00/0x844e5faceb5ed4b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.097365:0:25391:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f3e7a00/0x844e5faceb5ed4b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.097382:0:25391:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f3e7a00/0x844e5faceb5ed4b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.097388:0:25391:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3e7a00/0x844e5faceb5ed4b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155578.097921:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1963:x1830976124055168:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 30075us (30940us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155578.097933:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5003 00010000:00010000:1.0:1746155578.103062:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012dc40c00/0x844e5faceb5ed4bc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.103077:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc40c00/0x844e5faceb5ed4bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.103085:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dc40c00/0x844e5faceb5ed4bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.103091:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc40c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155578.103094:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dc40c00/0x844e5faceb5ed4bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.103101:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dc40c00/0x844e5faceb5ed4bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.103115:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dc40c00/0x844e5faceb5ed4bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.103121:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc40c00/0x844e5faceb5ed4bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155578.109910:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:834818df-1a1e-4d15-9e1d-5cedb28f094a+16:1962:x1830976124055424:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 40487us (42134us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155578.109920:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5004 00010000:00010000:3.0:1746155578.110380:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ed4c3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.110392:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ed4c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.110398:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ed4c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.110403:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094129800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155578.110407:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ed4c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.110413:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ed4c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.110427:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ed4c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.110432:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094129800/0x844e5faceb5ed4c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155578.110520:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1962:x1830976124055680:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 39181us (41159us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155578.110526:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5005 00010000:00010000:0.0:1746155578.113398:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd51a00/0x844e5faceb5ed4ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.113411:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd51a00/0x844e5faceb5ed4ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.113418:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd51a00/0x844e5faceb5ed4ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.113424:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd51a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155578.113427:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd51a00/0x844e5faceb5ed4ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.113434:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd51a00/0x844e5faceb5ed4ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.113446:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd51a00/0x844e5faceb5ed4ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.113452:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd51a00/0x844e5faceb5ed4ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155578.113561:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1962:x1830976124055936:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 40870us (41001us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155578.113570:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5006 00010000:00010000:3.0:1746155578.116004:0:2798:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094129600/0x844e5faceb5ed4d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.116017:0:2798:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094129600/0x844e5faceb5ed4d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.116024:0:2798:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094129600/0x844e5faceb5ed4d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.116029:0:2798:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094129600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155578.116032:0:2798:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094129600/0x844e5faceb5ed4d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.116037:0:2798:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094129600/0x844e5faceb5ed4d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.116049:0:2798:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094129600/0x844e5faceb5ed4d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.116053:0:2798:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094129600/0x844e5faceb5ed4d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155578.116115:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:834818df-1a1e-4d15-9e1d-5cedb28f094a+12:1962:x1830976124056192:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 42136us (43533us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155578.116123:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5007 00010000:00010000:3.0:1746155578.117448:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed4d8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.117459:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed4d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.117471:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed4d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.117476:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094129000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155578.117479:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed4d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.117495:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed4d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.117530:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed4d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.117535:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094129000/0x844e5faceb5ed4d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155578.117576:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+11:1962:x1830976124056448:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 42636us (44963us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155578.117583:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5008 00000100:00100000:3.0:1746155578.125270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.125517:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124056704 00000100:00100000:2.0:1746155578.125525:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124056704 00000100:00100000:2.0:1746155578.125835:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10159 00000100:00100000:2.0:1746155578.125843:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29525:x1830976124056704:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155578.125882:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155578.125903:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b188000/0x844e5faceb5ed476 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f68 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.125934:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155578.125938:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155578.125967:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9200/0x844e5faceb5ed4df lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155578.125977:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9200/0x844e5faceb5ed4df lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155578.125988:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9200/0x844e5faceb5ed4df lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00010000:2.0:1746155578.126135:0:27374:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f3ed180 reply state ffff88009a214000 transno 8589944142 ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9200/0x844e5faceb5ed4df lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155578.126142:0:27374:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746155578.126713:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:29525:x1830976124056704:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 869us (1449us total) trans 8589944142 rc 0/0 00000100:00100000:2.0:1746155578.126718:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10159 00010000:00010000:2.0:1746155578.129165:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9200/0x844e5faceb5ed4df lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155578.129176:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9200/0x844e5faceb5ed4df lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155578.129182:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9200/0x844e5faceb5ed4df lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155578.129187:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136ac9200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155578.129191:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9200/0x844e5faceb5ed4df lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155578.129196:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9200/0x844e5faceb5ed4df lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155578.129208:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155578.129211:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155578.129213:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9200/0x844e5faceb5ed4df lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155578.129218:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9200/0x844e5faceb5ed4df lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155578.129557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.129572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.129598:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.129610:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.129621:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.129669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.129730:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124056832 00000100:00100000:3.0:1746155578.129736:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124056832 00000100:00100000:3.0:1746155578.129760:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124056960 00000100:00100000:3.0:1746155578.129762:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124056960 00000100:00100000:3.0:1746155578.129782:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124057088 00000100:00100000:3.0:1746155578.129784:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124057088 00000100:00100000:3.0:1746155578.129792:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124057216 00000100:00100000:3.0:1746155578.129794:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124057216 00000100:00100000:3.0:1746155578.129802:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124057344 00000100:00100000:3.0:1746155578.129803:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124057344 00000100:00100000:3.0:1746155578.129809:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124057472 00000100:00100000:3.0:1746155578.129811:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124057472 00000100:00100000:3.0:1746155578.129821:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12747 00000100:00100000:3.0:1746155578.129826:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976124056832:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155578.129949:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746155578.129951:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.129953:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.129955:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.129957:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1893 -> 1893 00000100:00100000:3.0:1746155578.129987:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976124056832:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 160us (432us total) trans 21474840710 rc 0/0 00000100:00100000:3.0:1746155578.129992:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12747 00000100:00100000:3.0:1746155578.130003:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12748 00000100:00100000:3.0:1746155578.130007:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976124056960:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155578.130082:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155578.130085:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.130086:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155577 -> 1746155578 00002000:00010000:3.0:1746155578.130088:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.130089:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155578.130103:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976124056960:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 95us (530us total) trans 17179873314 rc 0/0 00000100:00100000:3.0:1746155578.130107:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12748 00000100:00100000:3.0:1746155578.130115:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12749 00000100:00100000:3.0:1746155578.130120:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976124057088:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155578.130165:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155578.130168:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155577 -> 1746155578 00002000:00010000:3.0:1746155578.130169:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155577 -> 1746155578 00002000:00010000:3.0:1746155578.130171:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155577 -> 1746155578 00002000:00010000:3.0:1746155578.130173:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155578.130184:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976124057088:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 64us (586us total) trans 17179873315 rc 0/0 00000100:00100000:3.0:1746155578.130189:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12749 00000100:00100000:3.0:1746155578.130197:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12750 00000100:00100000:1.0:1746155578.130245:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12751 00000100:00100000:1.0:1746155578.130253:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976124057344:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155578.130327:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:1.0:1746155578.130329:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155577 -> 1746155578 00002000:00010000:1.0:1746155578.130331:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155577 -> 1746155578 00002000:00010000:1.0:1746155578.130333:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155577 -> 1746155578 00002000:00010000:1.0:1746155578.130334:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:1.0:1746155578.130353:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1960:x1830976124057344:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 100us (730us total) trans 21474840711 rc 0/0 00000100:00100000:1.0:1746155578.130358:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12751 00000100:00100000:1.0:1746155578.130368:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12752 00000100:00100000:1.0:1746155578.130372:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1960:x1830976124057472:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155578.130427:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155578.130429:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155577 -> 1746155578 00002000:00010000:1.0:1746155578.130430:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155577 -> 1746155578 00002000:00010000:1.0:1746155578.130432:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155577 -> 1746155578 00002000:00010000:1.0:1746155578.130433:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746155578.130863:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976124057472:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 488us (1192us total) trans 17179873316 rc 0/0 00000100:00100000:1.0:1746155578.130869:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12752 00000100:00100000:3.0:1746155578.131087:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1960:x1830976124057216:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155578.131148:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155578.131151:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155577 -> 1746155578 00002000:00010000:3.0:1746155578.131152:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155577 -> 1746155578 00002000:00010000:3.0:1746155578.131154:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155577 -> 1746155578 00002000:00010000:3.0:1746155578.131156:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155578.131660:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1960:x1830976124057216:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 1256us (1847us total) trans 21474840712 rc 0/0 00000100:00100000:3.0:1746155578.132119:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12750 00010000:00010000:2.0:1746155578.138753:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155578.143210:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.143294:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124057728 00000100:00100000:2.0:1746155578.143301:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124057728 00000100:00100000:2.0:1746155578.143334:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4138 00000100:00100000:2.0:1746155578.143341:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:29525:x1830976124057728:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:2.0:1746155578.143389:0:16336:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x35b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6e00/0x844e5faceb5ed429 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f5a expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.143431:0:16336:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155578.143441:0:16336:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5ed468 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f61 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.143446:0:16336:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155578.143468:0:16336:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5ed468 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f61 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.143478:0:16336:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5ed468 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f61 expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155578.143498:0:16336:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16336:1830976124695040:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155578.143594:0:16336:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfda80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155578.145970:0:16336:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16336:1830976124695040:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155578.145987:0:16336:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:0.0:1746155578.148274:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.148349:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124057856 00000100:00100000:2.0:1746155578.148356:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124057856 00010000:00010000:2.0:1746155578.148383:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5ed468 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f61 expref: 10 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155578.148416:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6480 00000100:00100000:2.0:1746155578.148423:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+10:1961:x1830976124057856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155578.148433:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155578.148438:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5ed468 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f61 expref: 10 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.148448:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5ed468 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f61 expref: 10 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.148464:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136ac9800/0x844e5faceb5ed468 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f61 expref: 10 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.148491:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:2.0:1746155578.148496:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155578.148525:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155578.148531:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155578.148563:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155578.148595:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+9:1961:x1830976124057856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 172us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.148601:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6480 00010000:00010000:3.0:1746155578.148661:0:16336:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155578.148667:0:16336:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000040:00080000:3.0:1746155578.149173:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2981, 88 off249720 00000004:00080000:3.0:1746155578.149178:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707298675199ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.149210:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2914, 88 off243552 00000004:00080000:3.0:1746155578.149213:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707298709989ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.149223:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2915, 88 off243640 00000004:00080000:3.0:1746155578.149225:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707298722111ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.149231:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2982, 88 off249808 00000004:00080000:3.0:1746155578.149236:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707298732964ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.149242:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2983, 88 off249896 00000004:00080000:3.0:1746155578.149245:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707298742041ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.149251:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2916, 88 off243728 00000004:00080000:3.0:1746155578.149253:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707298750554ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.149259:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2917, 88 off243816 00000004:00080000:3.0:1746155578.149261:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707298758389ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.149267:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2918, 88 off243904 00000004:00080000:3.0:1746155578.149269:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707298766501ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.149275:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2984, 88 off249984 00000004:00080000:3.0:1746155578.149278:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707298774609ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.149283:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2919, 88 off243992 00000004:00080000:3.0:1746155578.149286:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707298782719ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.149291:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2985, 88 off250072 00000004:00080000:3.0:1746155578.149294:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707298790704ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.149300:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2920, 88 off244080 00000004:00080000:3.0:1746155578.149302:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707298799154ns, next at 645866785986ns, rc = 0 00000040:00080000:3.0:1746155578.149308:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2986, 88 off250160 00000004:00080000:3.0:1746155578.149311:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707298807721ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.149317:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2987, 88 off250248 00000004:00080000:3.0:1746155578.149319:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707298815989ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.149325:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2988, 88 off250336 00000004:00080000:3.0:1746155578.149327:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707298824224ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.149333:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2989, 88 off250424 00000004:00080000:3.0:1746155578.149336:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707298833521ns, next at 645865692772ns, rc = 0 00000040:00080000:3.0:1746155578.149343:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2921, 88 off244168 00000004:00080000:3.0:1746155578.149345:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707298842137ns, next at 645866785986ns, rc = 0 00000001:00080000:0.0:1746155578.174091:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944142 is committed 00000001:00080000:0.0:1746155578.174103:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944143 is committed 00000004:00080000:0.0:1746155578.174106:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2113 committed 00000004:00010000:3.0:1746155578.174162:0:16336:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009018a300 reply state ffff8800945ccc00 transno 8589944143 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:3.0:1746155578.174172:0:16336:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746155578.174179:0:16336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:3.0:1746155578.174182:0:16336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155578.174189:0:16336:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3e6e00/0x844e5faceb5ed429 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f5a expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746155578.174274:0:16336:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746155578.174284:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29525:x1830976124057728:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 30942us (31079us total) trans 8589944143 rc 0/0 00000100:00100000:3.0:1746155578.174293:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4138 00010000:00010000:1.0:1746155578.174539:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16336 initiator: MDT0 00010000:00010000:1.0:1746155578.174546:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16336 initiator: MDT0 00010000:00010000:1.0:1746155578.174552:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16336 initiator: MDT0 00010000:00010000:1.0:1746155578.174558:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53e1a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155578.174561:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16336 initiator: MDT0 00010000:00010000:1.0:1746155578.174568:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16336 initiator: MDT0 00010000:00010000:1.0:1746155578.174578:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a000) 00010000:00010000:1.0:1746155578.174580:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155578.174583:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16336 initiator: MDT0 00010000:00010000:1.0:1746155578.174587:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53e1a00/0x844e5faceb5ed4e6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16336 initiator: MDT0 00000004:00080000:0.0:1746155578.174671:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2187 committed 00000004:00080000:0.0:1746155578.174676:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2186 committed 00000004:00080000:0.0:1746155578.174679:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2185 committed 00000004:00080000:0.0:1746155578.174681:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2184 committed 00000004:00080000:0.0:1746155578.174682:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2112 committed 00000004:00080000:0.0:1746155578.174683:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2183 committed 00000004:00080000:0.0:1746155578.174684:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2111 committed 00000004:00080000:0.0:1746155578.174686:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2182 committed 00000004:00080000:0.0:1746155578.174687:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2110 committed 00000004:00080000:0.0:1746155578.174688:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2109 committed 00000004:00080000:0.0:1746155578.174689:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2108 committed 00000004:00080000:0.0:1746155578.174691:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2181 committed 00000004:00080000:0.0:1746155578.174692:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2180 committed 00000004:00080000:0.0:1746155578.174694:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2107 committed 00000004:00080000:0.0:1746155578.174699:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2106 committed 00000004:00080000:0.0:1746155578.174701:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2179 committed 00000100:00100000:2.0:1746155578.174805:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124695424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.174840:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.174862:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124695936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.174875:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.174888:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746155578.174892:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124695552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.174904:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.174913:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124696064:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.174923:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.174939:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124695424 00000100:00100000:2.0:1746155578.174944:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124695424 00000100:00100000:2.0:1746155578.174967:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124695936 00000100:00100000:2.0:1746155578.174969:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124695936 00000100:00100000:2.0:1746155578.174979:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124695552 00000100:00100000:2.0:1746155578.174981:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124695552 00000100:00100000:2.0:1746155578.174989:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124696064 00000100:00100000:2.0:1746155578.174990:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124696064 00000100:00100000:2.0:1746155578.175000:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12753 00000100:00100000:2.0:1746155578.175006:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3297:x1830976124695424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155578.175144:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:2.0:1746155578.175147:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.175149:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.175151:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.175153:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:2.0:1746155578.175174:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3297:x1830976124695424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (333us total) trans 21474840713 rc 0/0 00000100:00100000:2.0:1746155578.175180:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12753 00000100:00100000:2.0:1746155578.175189:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12754 00000100:00100000:2.0:1746155578.175194:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3297:x1830976124695936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.175270:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3297:x1830976124695936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (394us total) trans 21474840714 rc 0/0 00000100:00100000:2.0:1746155578.175275:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12754 00000100:00100000:2.0:1746155578.175283:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12755 00000100:00100000:2.0:1746155578.175287:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3297:x1830976124695552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155578.175345:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:2.0:1746155578.175347:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155578.175349:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155578.175350:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155578.175352:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:2.0:1746155578.175370:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3297:x1830976124695552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (465us total) trans 21474840715 rc 0/0 00000100:00100000:2.0:1746155578.175374:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12755 00000100:00100000:2.0:1746155578.175383:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12756 00000100:00100000:2.0:1746155578.175386:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3297:x1830976124696064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.175456:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3297:x1830976124696064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (531us total) trans 21474840716 rc 0/0 00000100:00100000:2.0:1746155578.175460:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12756 00000004:00080000:2.0:1746155578.175534:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c213b80/2, rc 0, transno 21474840715 00000100:00100000:2.0:1746155578.175542:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124695552:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155578.175550:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c213800/2, rc 0, transno 21474840716 00000100:00100000:2.0:1746155578.175553:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124696064:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155578.175559:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c210a80/2, rc 0, transno 21474840713 00000100:00100000:2.0:1746155578.175561:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124695424:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155578.175566:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c212680/2, rc 0, transno 21474840714 00000100:00100000:2.0:1746155578.175568:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124695936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155578.175741:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124695296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155578.175761:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155578.175780:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124695808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155578.175791:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155578.175801:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1746155578.175805:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124695168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155578.175816:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155578.175823:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124695680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155578.175833:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155578.175840:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124696192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155578.175850:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155578.175865:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124695296 00000100:00100000:1.0:1746155578.175868:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124695296 00000100:00100000:1.0:1746155578.175882:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124695808 00000100:00100000:1.0:1746155578.175884:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124695808 00000100:00100000:1.0:1746155578.175892:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124695168 00000100:00100000:1.0:1746155578.175894:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124695168 00000100:00100000:1.0:1746155578.175901:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124695680 00000100:00100000:1.0:1746155578.175902:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124695680 00000100:00100000:1.0:1746155578.175907:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124696192 00000100:00100000:1.0:1746155578.175909:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124696192 00000100:00100000:1.0:1746155578.175915:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12757 00000100:00100000:1.0:1746155578.175920:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3296:x1830976124695296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155578.175993:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155578.175996:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:1.0:1746155578.175997:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:1.0:1746155578.175999:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:1.0:1746155578.176001:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155578.176123:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12758 00000100:00100000:0.0:1746155578.176130:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3296:x1830976124695808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.176210:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3296:x1830976124695808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (417us total) trans 21474840718 rc 0/0 00000100:00100000:0.0:1746155578.176215:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12758 00000100:00100000:0.0:1746155578.176223:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12759 00000100:00100000:0.0:1746155578.176228:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3296:x1830976124695168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155578.176285:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155578.176287:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.176289:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.176291:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.176293:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1893 -> 1893 00000100:00100000:0.0:1746155578.176309:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3296:x1830976124695168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (491us total) trans 21474840719 rc 0/0 00000100:00100000:0.0:1746155578.176314:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12759 00000100:00100000:0.0:1746155578.176322:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12760 00000100:00100000:0.0:1746155578.176326:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3296:x1830976124695680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.176393:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3296:x1830976124695680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (558us total) trans 21474840720 rc 0/0 00000100:00100000:0.0:1746155578.176398:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12760 00000100:00100000:0.0:1746155578.176405:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12761 00000100:00100000:0.0:1746155578.176409:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3296:x1830976124696192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.176470:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3296:x1830976124696192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (619us total) trans 21474840721 rc 0/0 00000100:00100000:0.0:1746155578.176474:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12761 00000100:00100000:1.0:1746155578.176843:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3296:x1830976124695296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 922us (1080us total) trans 21474840717 rc 0/0 00000100:00100000:1.0:1746155578.176848:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12757 00000004:00080000:1.0:1746155578.176875:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c211880/2, rc 0, transno 21474840719 00000100:00100000:1.0:1746155578.176878:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124695168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155578.176884:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c211f80/2, rc 0, transno 21474840720 00000100:00100000:1.0:1746155578.176886:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124695680:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155578.176890:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9f100/2, rc 0, transno 21474840721 00000100:00100000:1.0:1746155578.176892:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124696192:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155578.176897:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c212300/2, rc 0, transno 21474840717 00000100:00100000:1.0:1746155578.176898:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124695296:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155578.176902:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c210e00/2, rc 0, transno 21474840718 00000100:00100000:1.0:1746155578.176905:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124695808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155578.177084:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124696448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.177104:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.177120:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124696960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.177132:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.177142:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746155578.177146:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124696576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.177160:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.177168:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124697088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.177182:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.177196:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124696448 00000100:00100000:3.0:1746155578.177199:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124696448 00000100:00100000:3.0:1746155578.177213:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124696960 00000100:00100000:3.0:1746155578.177214:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124696960 00000100:00100000:3.0:1746155578.177221:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124696576 00000100:00100000:3.0:1746155578.177223:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124696576 00000100:00100000:3.0:1746155578.177229:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124697088 00000100:00100000:3.0:1746155578.177230:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124697088 00000100:00100000:3.0:1746155578.177238:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12762 00000100:00100000:3.0:1746155578.177242:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3297:x1830976124696448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155578.177328:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155578.177331:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.177332:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.177334:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.177335:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155578.177356:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3297:x1830976124696448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (251us total) trans 17179873317 rc 0/0 00000100:00100000:3.0:1746155578.177360:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12762 00000100:00100000:3.0:1746155578.177372:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12763 00000100:00100000:3.0:1746155578.177377:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3297:x1830976124696960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.177442:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3297:x1830976124696960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (308us total) trans 17179873318 rc 0/0 00000100:00100000:3.0:1746155578.177447:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12763 00000100:00100000:3.0:1746155578.177455:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12764 00000100:00100000:3.0:1746155578.177459:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3297:x1830976124696576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155578.177546:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746155578.177549:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.177551:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.177552:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.177554:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746155578.177571:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3297:x1830976124696576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (410us total) trans 17179873319 rc 0/0 00000100:00100000:3.0:1746155578.177575:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12764 00000100:00100000:3.0:1746155578.177649:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12765 00000100:00100000:3.0:1746155578.177654:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3297:x1830976124697088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.177714:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3297:x1830976124697088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (530us total) trans 17179873320 rc 0/0 00000100:00100000:3.0:1746155578.177718:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12765 00000004:00080000:3.0:1746155578.177736:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ec380/2, rc 0, transno 17179873319 00000100:00100000:3.0:1746155578.177739:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124696576:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155578.177743:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130898380/2, rc 0, transno 17179873320 00000100:00100000:3.0:1746155578.177745:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124697088:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155578.177749:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ed880/2, rc 0, transno 17179873317 00000100:00100000:3.0:1746155578.177751:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124696448:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155578.177755:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013089aa00/2, rc 0, transno 17179873318 00000100:00100000:3.0:1746155578.177757:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124696960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.177983:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124696320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.178000:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.178016:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124696832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.178026:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.178033:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746155578.178036:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124696704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.178044:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.178051:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124697216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.178059:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.178069:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124696320 00000100:00100000:0.0:1746155578.178071:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124696320 00000100:00100000:0.0:1746155578.178082:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124696832 00000100:00100000:0.0:1746155578.178083:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124696832 00000100:00100000:0.0:1746155578.178090:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124696704 00000100:00100000:0.0:1746155578.178092:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124696704 00000100:00100000:0.0:1746155578.178097:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124697216 00000100:00100000:0.0:1746155578.178098:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124697216 00000100:00100000:0.0:1746155578.178105:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12766 00000100:00100000:0.0:1746155578.178110:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3296:x1830976124696320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155578.178176:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155578.178179:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.178180:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.178182:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.178183:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155578.178203:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3296:x1830976124696320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (201us total) trans 17179873321 rc 0/0 00000100:00100000:0.0:1746155578.178207:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12766 00000100:00100000:0.0:1746155578.178218:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12767 00000100:00100000:0.0:1746155578.178222:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3296:x1830976124696832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.178289:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3296:x1830976124696832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (261us total) trans 17179873322 rc 0/0 00000100:00100000:0.0:1746155578.178293:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12767 00000100:00100000:0.0:1746155578.178301:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12768 00000100:00100000:0.0:1746155578.178305:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3296:x1830976124696704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.178375:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3296:x1830976124696704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (328us total) trans 17179873323 rc 0/0 00000100:00100000:0.0:1746155578.178380:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12768 00000100:00100000:0.0:1746155578.178388:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12769 00000100:00100000:0.0:1746155578.178392:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3296:x1830976124697216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.178460:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3296:x1830976124697216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (398us total) trans 17179873324 rc 0/0 00000100:00100000:0.0:1746155578.178464:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12769 00000004:00080000:0.0:1746155578.178492:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3eca80/2, rc 0, transno 17179873323 00000100:00100000:0.0:1746155578.178495:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124696704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155578.178516:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130898700/2, rc 0, transno 17179873324 00000100:00100000:0.0:1746155578.178519:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124697216:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155578.178526:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ece00/2, rc 0, transno 17179873321 00000100:00100000:0.0:1746155578.178528:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124696320:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155578.178534:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130898a80/2, rc 0, transno 17179873322 00000100:00100000:0.0:1746155578.178536:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124696832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155578.178654:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.179122:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124057984 00000100:00100000:0.0:1746155578.179125:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124057984 00000100:00100000:0.0:1746155578.179403:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10160 00000100:00100000:0.0:1746155578.179408:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:29525:x1830976124057984:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155578.179421:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155578.179435:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41600/0x844e5faceb5ed4ed lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11f99 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.179470:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41600/0x844e5faceb5ed4ed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f99 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.179480:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41600/0x844e5faceb5ed4ed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f99 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.179664:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:0.0:1746155578.179668:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155578.179671:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc41600, rc 0) 00000100:00100000:1.0:1746155578.179985:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29525:x1830976124057984:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 575us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155578.179990:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10160 00000100:00100000:0.0:1746155578.183032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.183088:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124058240 00000100:00100000:3.0:1746155578.183094:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124058240 00000100:00100000:3.0:1746155578.183121:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4139 00000100:00100000:3.0:1746155578.183127:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a652c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:29525:x1830976124058240:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155578.183999:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a652c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:29525:x1830976124058240:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 870us (970us total) trans 8589944144 rc 0/0 00000100:00100000:3.0:1746155578.184006:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4139 00000100:00100000:0.0:1746155578.209047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.209430:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124058496 00000100:00100000:1.0:1746155578.209439:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124058496 00000100:00100000:1.0:1746155578.209501:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10161 00000100:00100000:1.0:1746155578.209531:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+285:29537:x1830976124058496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155578.209551:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155578.209567:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d200/0x844e5faceb5ed4f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11fa0 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.209650:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d000/0x844e5faceb5ed4fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209661:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d000/0x844e5faceb5ed4fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209669:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d000/0x844e5faceb5ed4fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209679:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed502 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209684:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209689:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209778:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed509 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209784:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed509 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209790:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed509 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155578.209796:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155578.209860:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d000/0x844e5faceb5ed4fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209866:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d000/0x844e5faceb5ed4fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209870:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d000/0x844e5faceb5ed4fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209874:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c94d000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155578.209877:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d000/0x844e5faceb5ed4fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209882:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d000/0x844e5faceb5ed4fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209890:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155578.209893:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155578.209896:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d000/0x844e5faceb5ed4fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209900:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d000/0x844e5faceb5ed4fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209915:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209919:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed502 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209923:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed502 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209926:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c94dc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155578.209928:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed502 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209932:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed502 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209937:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51600) 00010000:00010000:1.0:1746155578.209939:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155578.209940:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed502 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209944:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed502 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.209972:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d200/0x844e5faceb5ed4f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa0 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.209981:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed509 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa0 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.209987:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155578.209989:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155578.209991:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94c400, rc 0) 00000100:00100000:1.0:1746155578.210029:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29537:x1830976124058496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 498us (989us total) trans 8589944145 rc 0/0 00000100:00100000:1.0:1746155578.210034:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10161 00000100:00080000:0.0:1746155578.212341:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155578.217210:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.217270:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124058752 00000100:00100000:2.0:1746155578.217277:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124058752 00000100:00100000:2.0:1746155578.217316:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10162 00000100:00100000:2.0:1746155578.217322:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+6:29536:x1830976124058752:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155578.217347:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155578.217362:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f600/0x844e5faceb5ed517 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11fa7 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.217451:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed51e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217461:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed51e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217470:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed51e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217480:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed525 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217495:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217500:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217609:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed52c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217617:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed52c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217627:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed52c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155578.217634:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155578.217697:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed51e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217702:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed51e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217707:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed51e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217710:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132b0fa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155578.217713:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed51e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217718:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed51e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217727:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155578.217729:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155578.217732:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed51e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217737:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed51e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217752:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217756:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed525 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217760:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed525 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217764:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4fd8800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155578.217766:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed525 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217770:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed525 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217774:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fff0400) 00010000:00010000:2.0:1746155578.217776:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155578.217778:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed525 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217781:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fd8800/0x844e5faceb5ed525 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.217808:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f600/0x844e5faceb5ed517 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa7 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.217817:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed52c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa7 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.217822:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:2.0:1746155578.217825:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155578.217827:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c85800, rc 0) 00000100:00100000:2.0:1746155578.217861:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29536:x1830976124058752:12345-192.168.202.51@tcp:101:cat.0 Request processed in 539us (658us total) trans 8589944146 rc 0/0 00000100:00100000:2.0:1746155578.217866:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10162 00000100:00100000:0.0:1746155578.225002:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.225046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.225117:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124059008 00000100:00100000:1.0:1746155578.225124:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124059008 00000100:00100000:1.0:1746155578.225155:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10163 00000100:00100000:1.0:1746155578.225161:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29534:x1830976124059008:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155578.225179:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155578.225194:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c200/0x844e5faceb5ed53a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11fae expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.225266:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.225276:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed509 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa0 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.225283:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed52c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa7 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.225288:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.225311:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed52c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa7 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.225320:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed52c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa7 expref: 7 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155578.225333:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124697344:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155578.225403:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed509 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa0 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.225409:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed509 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa0 expref: 288 pid: 27374 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155578.225415:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124697472:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155578.225427:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155578.225581:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124059136 00000100:00100000:3.0:1746155578.225585:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124059136 00000100:00100000:3.0:1746155578.225609:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12770 00000100:00100000:3.0:1746155578.225614:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29537:x1830976124059136:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155578.225620:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155578.225628:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cbad200/0x844e5faceb5ed548 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11fb5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.225641:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.225642:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.225647:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbad200/0x844e5faceb5ed548 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fb5 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.225656:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cbad200/0x844e5faceb5ed548 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fb5 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.225663:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbad200, rc 0) 00000100:00100000:3.0:1746155578.225683:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29537:x1830976124059136:12345-192.168.202.51@tcp:101:cat.0 Request processed in 69us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155578.225688:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12770 00000100:00080000:1.0:1746155578.225896:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155578.229470:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.229551:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.229662:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124059520 00000100:00100000:1.0:1746155578.229670:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124059520 00000100:00100000:1.0:1746155578.229701:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10164 00000100:00100000:1.0:1746155578.229707:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29533:x1830976124059520:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155578.229725:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155578.229739:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ca00/0x844e5faceb5ed54f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11fc3 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.229813:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5ed556 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155578.229822:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5ed556 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155578.229829:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5ed556 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155578.230086:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124059264 00000100:00100000:3.0:1746155578.230089:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124059264 00000100:00100000:3.0:1746155578.230109:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12771 00000100:00100000:3.0:1746155578.230114:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29536:x1830976124059264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155578.230121:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155578.230130:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f089600/0x844e5faceb5ed55d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11fbc expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.230144:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.230145:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.230150:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f089600/0x844e5faceb5ed55d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fbc expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.230161:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f089600/0x844e5faceb5ed55d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fbc expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.230168:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f089600, rc 0) 00000100:00100000:3.0:1746155578.230199:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29536:x1830976124059264:12345-192.168.202.51@tcp:101:cat.0 Request processed in 85us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155578.230204:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12771 00000100:00100000:0.0:1746155578.230388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.230405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.230611:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124059648 00000100:00100000:1.0:1746155578.230615:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124059648 00010000:00010000:1.0:1746155578.230627:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed52c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa7 expref: 10 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155578.230640:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124059776 00000100:00100000:1.0:1746155578.230641:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124059776 00010000:00010000:1.0:1746155578.230648:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed509 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa0 expref: 289 pid: 27374 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155578.230658:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6481 00000100:00100000:1.0:1746155578.230662:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976124059648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155578.230669:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155578.230672:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed52c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa7 expref: 10 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155578.230679:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed52c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa7 expref: 10 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155578.230692:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155578.230695:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.230700:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.230704:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155578.230723:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976124059648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 60us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155578.230727:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6481 00000100:00100000:1.0:1746155578.230737:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6482 00000100:00100000:1.0:1746155578.230742:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d759850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1963:x1830976124059776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155578.230747:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155578.230750:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed509 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa0 expref: 289 pid: 27374 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155578.230757:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed509 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa0 expref: 289 pid: 27374 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155578.230767:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155578.230769:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.230775:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.230779:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.230785:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5ed556 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155578.230788:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5ed556 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155578.230792:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5ed556 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155578.230807:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155578.230820:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d759850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1963:x1830976124059776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155578.230825:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6482 00010000:00010000:1.0:1746155578.230901:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5ed556 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155578.230907:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5ed556 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155578.230916:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155578.231006:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94ca00/0x844e5faceb5ed54f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fc3 expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.231020:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5ed556 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fc3 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.231026:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155578.231028:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155578.231030:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94d600, rc 0) 00000100:00100000:1.0:1746155578.231046:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29533:x1830976124059520:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1339us (1496us total) trans 8589944147 rc 0/0 00000100:00100000:1.0:1746155578.231051:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10164 00010000:00010000:1.0:1746155578.231079:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c85800/0x844e5faceb5ed52c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa7 expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155578.231087:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124697344:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155578.231095:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed509 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fa0 expref: 288 pid: 27374 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155578.231101:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976124697472:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155578.231111:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.231119:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155578.231123:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155578.231132:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155578.231174:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94c200/0x844e5faceb5ed53a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fae expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.231184:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fae expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.231188:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155578.231190:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155578.231192:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94d400, rc 0) 00000100:00100000:1.0:1746155578.231206:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29534:x1830976124059008:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6045us (6212us total) trans 8589944148 rc 0/0 00000100:00100000:1.0:1746155578.231210:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10163 00000100:00100000:1.0:1746155578.236795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.236967:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124059904 00000100:00100000:0.0:1746155578.236975:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124059904 00000100:00100000:0.0:1746155578.242899:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10165 00000100:00100000:0.0:1746155578.242914:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29537:x1830976124059904:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155578.242932:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155578.242949:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41200/0x844e5faceb5ed572 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11fca expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.242994:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41200/0x844e5faceb5ed572 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fca expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.243004:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41200/0x844e5faceb5ed572 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fca expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.243015:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:0.0:1746155578.243017:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155578.243020:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc41200, rc 0) 00000100:00100000:0.0:1746155578.243061:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29537:x1830976124059904:12345-192.168.202.51@tcp:101:cat.0 Request processed in 154us (6274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155578.243066:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10165 00000100:00100000:0.0:1746155578.243168:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.243206:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124060032 00000100:00100000:0.0:1746155578.243212:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124060032 00000100:00100000:0.0:1746155578.243233:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10166 00000100:00100000:0.0:1746155578.243237:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29536:x1830976124060032:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155578.243247:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155578.243252:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41c00/0x844e5faceb5ed579 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11fd1 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.243270:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41c00/0x844e5faceb5ed579 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fd1 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.243280:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41c00/0x844e5faceb5ed579 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fd1 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.243288:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:0.0:1746155578.243290:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155578.243291:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc41c00, rc 0) 00000100:00100000:0.0:1746155578.243757:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29536:x1830976124060032:12345-192.168.202.51@tcp:101:cat.0 Request processed in 517us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155578.243762:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10166 00000100:00100000:0.0:1746155578.248825:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.248859:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.248889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.248952:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124060416 00000100:00100000:3.0:1746155578.248960:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124060416 00002000:00100000:3.0:1746155578.248994:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012fef1880 x1830976124060416/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.249003:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef1880 with x1830976124060416 ext(0->1048575) 00002000:00010000:3.0:1746155578.249007:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef1880 00000100:00100000:3.0:1746155578.249029:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124060672 00000100:00100000:3.0:1746155578.249031:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124060672 00002000:00100000:3.0:1746155578.249041:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012fef3480 x1830976124060672/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.249047:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef3480 with x1830976124060672 ext(0->1048575) 00002000:00010000:3.0:1746155578.249050:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef3480 00000100:00100000:3.0:1746155578.249059:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5009 00000100:00100000:3.0:1746155578.249065:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976124060416:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155578.250152:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5010 00000100:00100000:3.0:1746155578.250158:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976124060672:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155578.252082:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124060288 00000100:00100000:2.0:1746155578.252090:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124060288 00000100:00100000:2.0:1746155578.252125:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10167 00000100:00100000:2.0:1746155578.252131:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29534:x1830976124060288:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155578.252147:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155578.252162:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f000/0x844e5faceb5ed580 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11fd8 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.252206:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f000/0x844e5faceb5ed580 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fd8 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.252216:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f000/0x844e5faceb5ed580 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fd8 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.252229:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:2.0:1746155578.252232:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155578.252235:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b0f000, rc 0) 00000100:00100000:2.0:1746155578.252265:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29534:x1830976124060288:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 134us (3446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.252270:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10167 00000100:00100000:2.0:1746155578.271567:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1961:x1830976124060672:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21399us (22666us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155578.271579:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5010 00002000:00100000:2.0:1746155578.271590:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012fef3480 x1830976124060672/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155578.271598:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef3480 with x1830976124060672 ext(0->1048575) 00002000:00010000:2.0:1746155578.271603:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef3480 00000100:00100000:3.0:1746155578.273499:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976124060416:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 24427us (24631us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155578.273517:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5009 00002000:00100000:3.0:1746155578.273524:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d6:0x0] (0->1048575) req@ffff88012fef1880 x1830976124060416/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.273532:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef1880 with x1830976124060416 ext(0->1048575) 00002000:00010000:3.0:1746155578.273536:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef1880 00000100:00100000:0.0:1746155578.277104:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.277265:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.277342:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124060928 00000100:00100000:2.0:1746155578.277348:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124060928 00000100:00100000:2.0:1746155578.277386:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124061184 00000100:00100000:2.0:1746155578.277387:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124061184 00000100:00100000:2.0:1746155578.277405:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10168 00000100:00100000:2.0:1746155578.277411:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29534:x1830976124060928:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:1.0:1746155578.277425:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10169 00010000:00010000:2.0:1746155578.277427:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155578.277429:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00000100:00100000:1.0:1746155578.277433:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29533:x1830976124061184:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155578.277441:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155578.277442:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746155578.277448:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f000/0x844e5faceb5ed580 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fd8 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.277454:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41c00/0x844e5faceb5ed579 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fd1 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.277466:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41200/0x844e5faceb5ed572 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fca expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.277473:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155578.277476:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155578.277531:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d200/0x844e5faceb5ed587 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11fe6 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.277548:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:2.0:1746155578.277551:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155578.277557:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ed58e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11fdf expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.277573:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.277576:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155578.277582:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41600/0x844e5faceb5ed4ed lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f99 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.277592:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.277630:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.277638:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155578.277647:0:14234:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.277654:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155578.277701:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41600/0x844e5faceb5ed4ed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f99 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.277711:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41600/0x844e5faceb5ed4ed lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f99 expref: 7 pid: 27374 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155578.277722:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124697600:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155578.277799:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155578.282967:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.283428:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124697600:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155578.283449:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155578.283566:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124061312 00000100:00100000:2.0:1746155578.283573:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124061312 00010000:00010000:2.0:1746155578.283605:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41600/0x844e5faceb5ed4ed lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f99 expref: 8 pid: 27374 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155578.283640:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6483 00000100:00100000:2.0:1746155578.283647:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1963:x1830976124061312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155578.283660:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155578.283666:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41600/0x844e5faceb5ed4ed lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f99 expref: 8 pid: 27374 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.283675:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41600/0x844e5faceb5ed4ed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f99 expref: 8 pid: 27374 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.283695:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc41600/0x844e5faceb5ed4ed lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f99 expref: 8 pid: 27374 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.283716:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:2.0:1746155578.283720:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.283731:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.283736:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155578.283742:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155578.283745:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155578.283756:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155578.283851:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155578.283860:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00000004:02000000:1.0:1746155578.283893:0:20364:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000100:00100000:3.0:1746155578.284585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.284655:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.284670:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124061440 00000100:00100000:3.0:1746155578.284674:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124061440 00000100:00100000:3.0:1746155578.284693:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124061568 00000100:00100000:3.0:1746155578.284695:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124061568 00000100:00100000:3.0:1746155578.284715:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12772 00000100:00100000:3.0:1746155578.284720:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+17:29536:x1830976124061440:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155578.284732:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155578.284744:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009417e800/0x844e5faceb5ed5a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11fed expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.284760:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.284763:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.284768:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009417e800/0x844e5faceb5ed5a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fed expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.284779:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009417e800/0x844e5faceb5ed5a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fed expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.284787:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009417e800, rc 0) 00000100:00100000:3.0:1746155578.284808:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29536:x1830976124061440:12345-192.168.202.51@tcp:101:cat.0 Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155578.284812:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12772 00000100:00100000:3.0:1746155578.284826:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12773 00000100:00100000:3.0:1746155578.284831:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:29537:x1830976124061568:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155578.284837:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155578.284842:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009417e400/0x844e5faceb5ed5aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ff4 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.284851:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.284853:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.284856:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009417e400/0x844e5faceb5ed5aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ff4 expref: 30 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.284863:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009417e400/0x844e5faceb5ed5aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ff4 expref: 30 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.284869:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009417e400, rc 0) 00000100:00100000:3.0:1746155578.284883:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29537:x1830976124061568:12345-192.168.202.51@tcp:101:cat.0 Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155578.284890:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12773 00000100:00080000:0.0:1746155578.285111:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155578.285148:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1963:x1830976124061312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1500us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.285155:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6483 00000040:00080000:1.0:1746155578.285244:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2990, 88 off250512 00000004:00080000:1.0:1746155578.285250:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707434746523ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.285668:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2922, 88 off244256 00000004:00080000:1.0:1746155578.285672:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707435169194ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.285692:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2923, 88 off244344 00000004:00080000:1.0:1746155578.285695:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707435192055ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.285701:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2991, 88 off250600 00000004:00080000:1.0:1746155578.285704:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707435201188ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.285710:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2992, 88 off250688 00000004:00080000:1.0:1746155578.285712:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707435209546ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.285719:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2924, 88 off244432 00000004:00080000:1.0:1746155578.285721:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707435217760ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.285727:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2925, 88 off244520 00000004:00080000:1.0:1746155578.285729:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707435226084ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.285735:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2926, 88 off244608 00000004:00080000:1.0:1746155578.285737:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707435234466ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.285743:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2993, 88 off250776 00000004:00080000:1.0:1746155578.285746:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707435242736ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.285751:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2927, 88 off244696 00000004:00080000:1.0:1746155578.285753:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707435250311ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.285759:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2994, 88 off250864 00000004:00080000:1.0:1746155578.285762:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707435258874ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.285768:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2928, 88 off244784 00000004:00080000:1.0:1746155578.285770:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707435267488ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.285776:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2995, 88 off250952 00000004:00080000:1.0:1746155578.285779:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707435275756ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.285784:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2996, 88 off251040 00000004:00080000:1.0:1746155578.285786:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707435283455ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.285792:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2997, 88 off251128 00000004:00080000:1.0:1746155578.285794:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707435291490ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.285800:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2998, 88 off251216 00000004:00080000:1.0:1746155578.285802:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707435298788ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.285807:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2929, 88 off244872 00000004:00080000:1.0:1746155578.285809:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707435306374ns, next at 645866785986ns, rc = 0 00000100:00100000:0.0:1746155578.287637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.287662:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.287678:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124061824 00000100:00100000:0.0:1746155578.287683:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124061824 00000100:00100000:0.0:1746155578.287705:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124061696 00000100:00100000:0.0:1746155578.287707:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124061696 00000100:00100000:0.0:1746155578.287719:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10170 00000100:00100000:0.0:1746155578.287725:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+12:29536:x1830976124061824:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155578.287738:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155578.287752:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40e00/0x844e5faceb5ed5b1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12002 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.287792:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155578.287799:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40e00/0x844e5faceb5ed5b1 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12002 expref: 13 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.287811:0:19870:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155578.287821:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40e00/0x844e5faceb5ed5b1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12002 expref: 13 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.287831:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:0.0:1746155578.287833:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155578.287835:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155578.287840:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc40e00, rc 0) 00000100:00100000:0.0:1746155578.287868:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+13:29536:x1830976124061824:12345-192.168.202.51@tcp:101:cat.0 Request processed in 142us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155578.287873:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10170 00000100:00100000:0.0:1746155578.287885:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10171 00000100:00100000:0.0:1746155578.287889:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29537:x1830976124061696:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155578.287895:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155578.287900:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40200/0x844e5faceb5ed5b8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f11ffb expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.287917:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40200/0x844e5faceb5ed5b8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ffb expref: 291 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.287924:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40200/0x844e5faceb5ed5b8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ffb expref: 291 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.287929:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:0.0:1746155578.287931:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155578.287933:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155578.287937:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc40200, rc 0) 00000100:00100000:0.0:1746155578.287951:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29537:x1830976124061696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 61us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155578.287955:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10171 00000001:00080000:0.0:1746155578.311990:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944149 is committed 00000004:00080000:0.0:1746155578.311996:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2121 committed 00000004:00080000:0.0:1746155578.312008:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2196 committed 00000004:00080000:0.0:1746155578.312013:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2195 committed 00000004:00080000:0.0:1746155578.312015:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2194 committed 00000004:00080000:0.0:1746155578.312016:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2193 committed 00000004:00080000:0.0:1746155578.312018:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2120 committed 00000004:00080000:0.0:1746155578.312019:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2192 committed 00000004:00080000:0.0:1746155578.312021:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2119 committed 00000004:00080000:0.0:1746155578.312022:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2191 committed 00000004:00080000:0.0:1746155578.312023:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2118 committed 00000004:00080000:0.0:1746155578.312025:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2117 committed 00000004:00080000:0.0:1746155578.312026:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2116 committed 00000004:00080000:0.0:1746155578.312027:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2190 committed 00000004:00080000:0.0:1746155578.312029:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2189 committed 00000004:00080000:0.0:1746155578.312030:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2115 committed 00000004:00080000:0.0:1746155578.312032:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2114 committed 00000004:00080000:0.0:1746155578.312033:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2188 committed 00000001:00080000:0.0:1746155578.312038:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944148 is committed 00000001:00080000:0.0:1746155578.312048:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944144 is committed 00000100:00100000:0.0:1746155578.312137:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124697728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.312186:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.312216:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124698240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.312229:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.312242:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746155578.312246:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124698112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.312255:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.312261:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124698624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.312270:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.312284:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124697984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.312293:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.312301:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124698496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.312312:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.312319:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746155578.312322:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124697856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.312331:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.312338:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009451ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124698368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.312347:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.312362:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124697728 00000100:00100000:0.0:1746155578.312366:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124697728 00000100:00100000:0.0:1746155578.312388:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124698240 00000100:00100000:0.0:1746155578.312389:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124698240 00000100:00100000:0.0:1746155578.312397:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124698112 00000100:00100000:0.0:1746155578.312398:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124698112 00000100:00100000:0.0:1746155578.312405:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124698624 00000100:00100000:0.0:1746155578.312407:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124698624 00000100:00100000:0.0:1746155578.312413:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124697984 00000100:00100000:0.0:1746155578.312414:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124697984 00000100:00100000:0.0:1746155578.312419:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124698496 00000100:00100000:0.0:1746155578.312420:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124698496 00000100:00100000:0.0:1746155578.312424:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124697856 00000100:00100000:0.0:1746155578.312425:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124697856 00000100:00100000:0.0:1746155578.312430:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124698368 00000100:00100000:0.0:1746155578.312431:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124698368 00000100:00100000:0.0:1746155578.312439:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12774 00000100:00100000:0.0:1746155578.312444:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3296:x1830976124697728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155578.312601:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155578.312604:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.312605:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.312607:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.312609:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1893 -> 1893 00000100:00100000:0.0:1746155578.312631:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976124697728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 186us (445us total) trans 21474840722 rc 0/0 00000100:00100000:0.0:1746155578.312636:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12774 00000100:00100000:0.0:1746155578.312647:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12775 00000100:00100000:0.0:1746155578.312650:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3296:x1830976124698240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.312720:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976124698240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (488us total) trans 21474840723 rc 0/0 00000100:00100000:0.0:1746155578.312725:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12775 00000100:00100000:0.0:1746155578.312735:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12776 00000100:00100000:0.0:1746155578.312739:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3296:x1830976124698112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155578.312799:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:0.0:1746155578.312802:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155578.312803:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155578.312805:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:0.0:1746155578.312806:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:0.0:1746155578.312823:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976124698112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (566us total) trans 21474840724 rc 0/0 00000100:00100000:0.0:1746155578.312827:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12776 00000100:00100000:0.0:1746155578.312836:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12777 00000100:00100000:0.0:1746155578.312839:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3296:x1830976124698624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.312907:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976124698624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (635us total) trans 21474840725 rc 0/0 00000100:00100000:0.0:1746155578.312911:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12777 00000100:00100000:0.0:1746155578.312920:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12778 00000100:00100000:0.0:1746155578.312924:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3298:x1830976124697984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155578.312984:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:0.0:1746155578.312986:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.312988:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.312989:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.312991:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:0.0:1746155578.313009:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3298:x1830976124697984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (714us total) trans 21474840726 rc 0/0 00000100:00100000:0.0:1746155578.313013:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12778 00000100:00100000:0.0:1746155578.313025:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12779 00000100:00100000:0.0:1746155578.313028:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3298:x1830976124698496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.313100:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3298:x1830976124698496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (787us total) trans 21474840727 rc 0/0 00000100:00100000:0.0:1746155578.313105:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12779 00000100:00100000:0.0:1746155578.313113:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12780 00000100:00100000:0.0:1746155578.313117:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3298:x1830976124697856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155578.313176:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155578.313178:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.313180:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.313181:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.313183:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155578.313197:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3298:x1830976124697856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (864us total) trans 21474840728 rc 0/0 00000100:00100000:0.0:1746155578.313201:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12780 00000100:00100000:0.0:1746155578.313209:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12781 00000100:00100000:0.0:1746155578.313213:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3298:x1830976124698368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.313270:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3298:x1830976124698368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (921us total) trans 21474840729 rc 0/0 00000100:00100000:0.0:1746155578.313274:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12781 00000004:00080000:0.0:1746155578.313315:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451c700/2, rc 0, transno 21474840728 00000100:00100000:0.0:1746155578.313321:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124697856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155578.313327:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451ea00/2, rc 0, transno 21474840729 00000100:00100000:0.0:1746155578.313330:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124698368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155578.313334:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451c380/2, rc 0, transno 21474840726 00000100:00100000:0.0:1746155578.313337:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124697984:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155578.313342:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451e680/2, rc 0, transno 21474840727 00000100:00100000:0.0:1746155578.313344:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124698496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.313366:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746155578.313371:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124698752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.313386:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.313401:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124698752 00000100:00100000:0.0:1746155578.313403:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124698752 00000100:00100000:0.0:1746155578.313415:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12782 00000100:00100000:0.0:1746155578.313418:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976124698752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.313515:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3295:x1830976124698752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (113us total) trans 21474840730 rc 0/0 00000100:00100000:0.0:1746155578.313520:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12782 00000004:00080000:0.0:1746155578.313540:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ae2680/2, rc 0, transno 21474840730 00000100:00100000:0.0:1746155578.313543:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124698752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155578.313554:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451fb80/2, rc 0, transno 21474840724 00000100:00100000:0.0:1746155578.313556:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124698112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155578.313562:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451ed80/2, rc 0, transno 21474840725 00000100:00100000:0.0:1746155578.313564:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124698624:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155578.313569:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fef3800/2, rc 0, transno 21474840722 00000100:00100000:0.0:1746155578.313571:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124697728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155578.313576:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009451ca80/2, rc 0, transno 21474840723 00000100:00100000:0.0:1746155578.313579:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009451ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124698240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155578.313697:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124698880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.313717:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.313740:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124699392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.313754:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.313766:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746155578.313769:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124699008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.313780:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.313788:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124699520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.313799:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.313814:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124698880 00000100:00100000:3.0:1746155578.313816:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124698880 00000100:00100000:3.0:1746155578.313830:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124699392 00000100:00100000:3.0:1746155578.313832:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124699392 00000100:00100000:3.0:1746155578.313839:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124699008 00000100:00100000:3.0:1746155578.313840:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124699008 00000100:00100000:3.0:1746155578.313847:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124699520 00000100:00100000:3.0:1746155578.313848:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124699520 00000100:00100000:3.0:1746155578.313855:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12783 00000100:00100000:3.0:1746155578.313859:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3297:x1830976124698880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155578.313961:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155578.313963:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.313964:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.313966:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.313968:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155578.313988:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976124698880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 129us (270us total) trans 17179873325 rc 0/0 00000100:00100000:3.0:1746155578.313994:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12783 00000100:00100000:3.0:1746155578.314004:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12784 00000100:00100000:3.0:1746155578.314008:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3297:x1830976124699392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.314083:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976124699392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (327us total) trans 17179873326 rc 0/0 00000100:00100000:3.0:1746155578.314088:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12784 00000100:00100000:3.0:1746155578.314097:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12785 00000100:00100000:3.0:1746155578.314101:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3297:x1830976124699008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155578.314165:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155578.314167:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.314169:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.314170:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155578.314172:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155578.314188:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976124699008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (407us total) trans 17179873327 rc 0/0 00000100:00100000:3.0:1746155578.314193:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12785 00000100:00100000:3.0:1746155578.314202:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12786 00000100:00100000:3.0:1746155578.314206:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3297:x1830976124699520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155578.314279:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976124699520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (478us total) trans 17179873328 rc 0/0 00000100:00100000:3.0:1746155578.314283:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12786 00000004:00080000:3.0:1746155578.314312:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013089bb80/2, rc 0, transno 17179873327 00000100:00100000:3.0:1746155578.314315:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124699008:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155578.314320:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf7b80/2, rc 0, transno 17179873328 00000100:00100000:3.0:1746155578.314323:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124699520:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155578.314328:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013089b100/2, rc 0, transno 17179873325 00000100:00100000:3.0:1746155578.314330:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124698880:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155578.314335:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf7800/2, rc 0, transno 17179873326 00000100:00100000:3.0:1746155578.314337:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124699392:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746155578.314469:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fe6 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.314491:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155578.314494:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746155578.314497:0:20364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155578.314515:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fe6 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.314520:0:20364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155578.314540:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fe6 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.314549:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fe6 expref: 10 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155578.314558:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124699904:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155578.314602:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155578.315155:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124699136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.315179:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.318323:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124699136 00000100:00100000:2.0:1746155578.318333:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124699136 00000100:00100000:2.0:1746155578.318794:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12787 00000100:00100000:2.0:1746155578.318802:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3295:x1830976124699136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155578.318961:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746155578.318964:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.318966:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.318968:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.318969:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746155578.319017:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3295:x1830976124699136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 215us (3836us total) trans 17179873329 rc 0/0 00000100:00100000:2.0:1746155578.319022:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12787 00000004:00080000:0.0:1746155578.319213:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ee680/2, rc 0, transno 17179873329 00000100:00100000:0.0:1746155578.319219:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124699136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.319227:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124699648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.319249:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.319275:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746155578.319280:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124699264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.319294:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.319303:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124699776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.319314:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.319338:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124699648 00000100:00100000:0.0:1746155578.319341:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124699648 00000100:00100000:0.0:1746155578.319357:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124699264 00000100:00100000:0.0:1746155578.319358:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124699264 00000100:00100000:0.0:1746155578.319367:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124699776 00000100:00100000:0.0:1746155578.319368:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124699776 00000100:00100000:0.0:1746155578.319377:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12788 00000100:00100000:0.0:1746155578.319380:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3295:x1830976124699648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.319461:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3295:x1830976124699648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (211us total) trans 17179873330 rc 0/0 00000100:00100000:0.0:1746155578.319466:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12788 00000100:00100000:0.0:1746155578.319476:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12789 00000100:00100000:0.0:1746155578.319491:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3295:x1830976124699264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.319584:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3295:x1830976124699264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (288us total) trans 17179873331 rc 0/0 00000100:00100000:0.0:1746155578.319589:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12789 00000100:00100000:0.0:1746155578.319598:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12790 00000100:00100000:0.0:1746155578.319602:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3295:x1830976124699776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.319671:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3295:x1830976124699776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (355us total) trans 17179873332 rc 0/0 00000100:00100000:0.0:1746155578.319676:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12790 00000004:00080000:0.0:1746155578.319694:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf4380/2, rc 0, transno 17179873331 00000100:00100000:0.0:1746155578.319697:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124699264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155578.319703:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526a300/2, rc 0, transno 17179873332 00000100:00100000:0.0:1746155578.319705:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124699776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155578.319710:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095268a80/2, rc 0, transno 17179873330 00000100:00100000:0.0:1746155578.319712:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124699648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.320055:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976124699904:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155578.320082:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d200/0x844e5faceb5ed587 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fe6 expref: 10 pid: 20364 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746155578.320098:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fe6 expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746155578.320105:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fe6 expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746155578.320127:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94dc00, rc 0) 00000100:00100000:0.0:1746155578.320194:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29533:x1830976124061184:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 42761us (42927us total) trans 8589944149 rc 0/0 00000100:00100000:0.0:1746155578.320199:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10169 00000100:00100000:0.0:1746155578.322684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.322840:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124061952 00000100:00100000:2.0:1746155578.322848:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124061952 00010000:00010000:2.0:1746155578.322876:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fe6 expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155578.323205:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6484 00000100:00100000:2.0:1746155578.323213:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1963:x1830976124061952:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155578.323224:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155578.323229:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fe6 expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.323240:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fe6 expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.323256:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94dc00/0x844e5faceb5ed595 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fe6 expref: 9 pid: 20364 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.323268:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:2.0:1746155578.323273:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155578.323281:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155578.323287:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155578.323293:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40e00/0x844e5faceb5ed5b1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12002 expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.323450:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155578.323495:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1963:x1830976124061952:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 283us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.323501:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6484 00010000:00010000:0.0:1746155578.323653:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155578.323659:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00000040:00080000:0.0:1746155578.324198:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2999, 88 off251304 00000004:00080000:0.0:1746155578.324203:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707473699691ns, next at 645865692772ns, rc = 0 00000040:00080000:0.0:1746155578.324240:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2930, 88 off244960 00000004:00080000:0.0:1746155578.324243:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707473740191ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.325769:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2931, 88 off245048 00000004:00080000:1.0:1746155578.325777:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707475274137ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.325792:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3000, 88 off251392 00000004:00080000:1.0:1746155578.325795:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707475291853ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.325804:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3001, 88 off251480 00000004:00080000:1.0:1746155578.325807:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707475303902ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.325813:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2932, 88 off245136 00000004:00080000:1.0:1746155578.325816:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707475312755ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.325821:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2933, 88 off245224 00000004:00080000:1.0:1746155578.325824:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707475321063ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.325831:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2934, 88 off245312 00000004:00080000:1.0:1746155578.325836:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707475332613ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.325842:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3002, 88 off251568 00000004:00080000:1.0:1746155578.325845:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707475341938ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.325851:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2935, 88 off245400 00000004:00080000:1.0:1746155578.325853:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707475350557ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.325860:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3003, 88 off251656 00000004:00080000:1.0:1746155578.325862:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707475359363ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.325868:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2936, 88 off245488 00000004:00080000:1.0:1746155578.325871:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707475367805ns, next at 645866785986ns, rc = 0 00000040:00080000:1.0:1746155578.325877:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3004, 88 off251744 00000004:00080000:1.0:1746155578.325879:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707475376078ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.325885:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3005, 88 off251832 00000004:00080000:1.0:1746155578.325888:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707475384970ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.325894:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3006, 88 off251920 00000004:00080000:1.0:1746155578.325896:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707475393125ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.325902:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3007, 88 off252008 00000004:00080000:1.0:1746155578.325904:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 707475401355ns, next at 645865692772ns, rc = 0 00000040:00080000:1.0:1746155578.325911:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2937, 88 off245576 00000004:00080000:1.0:1746155578.325913:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 707475409943ns, next at 645866785986ns, rc = 0 00000001:00080000:0.0:1746155578.372105:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944150 is committed 00000004:00080000:0.0:1746155578.372113:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2129 committed 00000004:00080000:0.0:1746155578.372118:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2205 committed 00000004:00080000:0.0:1746155578.372122:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2204 committed 00000004:00080000:0.0:1746155578.372123:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2203 committed 00000004:00080000:0.0:1746155578.372125:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2202 committed 00000004:00080000:0.0:1746155578.372126:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2128 committed 00000004:00080000:0.0:1746155578.372127:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2201 committed 00000004:00080000:0.0:1746155578.372129:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2127 committed 00000004:00080000:0.0:1746155578.372130:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2200 committed 00000004:00080000:0.0:1746155578.372132:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2126 committed 00000004:00080000:0.0:1746155578.372133:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2125 committed 00000004:00080000:0.0:1746155578.372135:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2124 committed 00000004:00080000:0.0:1746155578.372136:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2199 committed 00000004:00080000:0.0:1746155578.372137:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2198 committed 00000004:00080000:0.0:1746155578.372138:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2123 committed 00000004:00080000:0.0:1746155578.372140:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2122 committed 00000004:00080000:0.0:1746155578.372141:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2197 committed 00000100:00100000:0.0:1746155578.372270:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124700160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.372317:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.372491:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124700032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155578.372525:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.372583:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124700160 00000100:00100000:2.0:1746155578.372590:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124700160 00000100:00100000:2.0:1746155578.372619:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124700032 00000100:00100000:2.0:1746155578.372621:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124700032 00000100:00100000:2.0:1746155578.372632:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12791 00000100:00100000:2.0:1746155578.372638:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3298:x1830976124700160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155578.372776:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155578.372779:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.372781:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.372782:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.372784:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155578.372812:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3298:x1830976124700160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (494us total) trans 21474840731 rc 0/0 00000100:00100000:2.0:1746155578.372817:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12791 00000100:00100000:2.0:1746155578.372830:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12792 00000100:00100000:2.0:1746155578.372834:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3297:x1830976124700032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155578.372900:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155578.372902:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.372904:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.372906:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.372907:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1893 -> 1893 00000100:00100000:2.0:1746155578.372929:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3297:x1830976124700032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (403us total) trans 21474840732 rc 0/0 00000100:00100000:2.0:1746155578.372936:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12792 00000004:00080000:0.0:1746155578.374455:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366f800/2, rc 0, transno 21474840731 00000100:00100000:0.0:1746155578.374467:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124700160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.374479:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124700672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.374528:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746155578.375061:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366d880/2, rc 0, transno 21474840732 00000100:00100000:2.0:1746155578.375066:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124700032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.375071:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124700544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.375741:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124700416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.375963:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124701184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.375982:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155578.376053:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124700672 00000100:00100000:3.0:1746155578.376059:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124700672 00000100:00100000:3.0:1746155578.376089:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12793 00000100:00100000:3.0:1746155578.376095:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3298:x1830976124700672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155578.376248:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3298:x1830976124700672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (1719us total) trans 21474840733 rc 0/0 00000100:00100000:3.0:1746155578.376254:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12793 00000100:00100000:0.0:1746155578.376397:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124701696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.376413:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155578.376430:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366ca80/2, rc 0, transno 21474840733 00000100:00100000:0.0:1746155578.376434:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124700672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.376439:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746155578.376443:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124702080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.376456:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.376471:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124700288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.376497:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.376522:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124700800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.376537:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.376547:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124701312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.376559:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.376569:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124701824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.376582:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155578.376602:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124701184 00000100:00100000:0.0:1746155578.376605:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124701184 00000100:00100000:0.0:1746155578.376620:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124701696 00000100:00100000:0.0:1746155578.376622:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124701696 00000100:00100000:0.0:1746155578.376632:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124702080 00000100:00100000:0.0:1746155578.376633:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124702080 00000100:00100000:0.0:1746155578.376641:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124700288 00000100:00100000:0.0:1746155578.376642:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124700288 00000100:00100000:0.0:1746155578.376648:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124700800 00000100:00100000:0.0:1746155578.376649:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124700800 00000100:00100000:0.0:1746155578.376655:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124701312 00000100:00100000:0.0:1746155578.376656:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124701312 00000100:00100000:0.0:1746155578.376661:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124701824 00000100:00100000:0.0:1746155578.376663:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124701824 00000100:00100000:0.0:1746155578.376669:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12794 00000100:00100000:0.0:1746155578.376673:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3298:x1830976124701184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155578.376767:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155578.376770:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.376771:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.376773:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.376775:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155578.376793:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3298:x1830976124701184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (810us total) trans 17179873333 rc 0/0 00000100:00100000:0.0:1746155578.376797:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12794 00000100:00100000:0.0:1746155578.376806:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12795 00000100:00100000:0.0:1746155578.376810:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3298:x1830976124701696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.376869:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3298:x1830976124701696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (455us total) trans 17179873334 rc 0/0 00000100:00100000:0.0:1746155578.376874:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12795 00000100:00100000:0.0:1746155578.376881:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12796 00000100:00100000:0.0:1746155578.376884:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+64:3298:x1830976124702080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.376942:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+65:3298:x1830976124702080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (485us total) trans 21474840734 rc 0/0 00000100:00100000:0.0:1746155578.376947:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12796 00000100:00100000:0.0:1746155578.376954:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12797 00000100:00100000:0.0:1746155578.376957:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+64:3295:x1830976124700288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155578.377009:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:0.0:1746155578.377011:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.377013:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.377015:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.377016:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:0.0:1746155578.377031:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+65:3295:x1830976124700288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (534us total) trans 21474840735 rc 0/0 00000100:00100000:0.0:1746155578.377035:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12797 00000100:00100000:0.0:1746155578.377042:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12798 00000100:00100000:0.0:1746155578.377045:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+64:3295:x1830976124700800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155578.377103:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+65:3295:x1830976124700800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (566us total) trans 21474840736 rc 0/0 00000100:00100000:0.0:1746155578.377108:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12798 00000100:00100000:0.0:1746155578.377120:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12799 00000100:00100000:0.0:1746155578.377125:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3295:x1830976124701312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155578.377182:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155578.377185:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.377186:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.377188:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155578.377190:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155578.377204:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3295:x1830976124701312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (644us total) trans 17179873335 rc 0/0 00000100:00100000:0.0:1746155578.377209:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12799 00000100:00100000:0.0:1746155578.377216:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12800 00000100:00100000:0.0:1746155578.377220:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3295:x1830976124701824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155578.377277:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3295:x1830976124701824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (694us total) trans 17179873336 rc 0/0 00000100:00100000:0.0:1746155578.377281:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12800 00000004:00080000:0.0:1746155578.377320:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366d180/2, rc 0, transno 21474840735 00000100:00100000:0.0:1746155578.377323:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124700288:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155578.377327:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1f1c00/2, rc 0, transno 21474840736 00000100:00100000:0.0:1746155578.377330:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124700800:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155578.377347:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095269c00/2, rc 0, transno 17179873335 00000100:00100000:0.0:1746155578.377350:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124701312:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155578.377355:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c210700/2, rc 0, transno 17179873336 00000100:00100000:0.0:1746155578.377357:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124701824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155578.377366:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9d180/2, rc 0, transno 21474840734 00000100:00100000:0.0:1746155578.377368:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124702080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155578.377373:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095268380/2, rc 0, transno 17179873333 00000100:00100000:0.0:1746155578.377375:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124701184:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155578.377380:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c212a00/2, rc 0, transno 17179873334 00000100:00100000:0.0:1746155578.377381:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124701696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.377626:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.377647:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124700928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.377665:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.377676:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124701440:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.377689:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.377697:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124701952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.377707:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.377725:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124700416 00000100:00100000:2.0:1746155578.377728:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124700416 00000100:00100000:2.0:1746155578.377741:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124700928 00000100:00100000:2.0:1746155578.377742:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124700928 00000100:00100000:2.0:1746155578.377749:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124701440 00000100:00100000:2.0:1746155578.377750:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124701440 00000100:00100000:2.0:1746155578.377756:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124701952 00000100:00100000:2.0:1746155578.377757:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124701952 00000100:00100000:2.0:1746155578.377764:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12801 00000100:00100000:2.0:1746155578.377768:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3296:x1830976124700416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155578.377842:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb size from disk: 2080768 -> 2080768 00002000:00010000:2.0:1746155578.377844:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb mtime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155578.377846:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155578.377848:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb ctime from disk: 1746155520 -> 1746155520 00002000:00010000:2.0:1746155578.377850:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3da:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:2.0:1746155578.377869:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3296:x1830976124700416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (243us total) trans 21474840737 rc 0/0 00000100:00100000:2.0:1746155578.377874:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12801 00000100:00100000:2.0:1746155578.377882:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12802 00000100:00100000:2.0:1746155578.377886:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3296:x1830976124700928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.377944:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3296:x1830976124700928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (278us total) trans 21474840738 rc 0/0 00000100:00100000:2.0:1746155578.377949:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12802 00000100:00100000:2.0:1746155578.377955:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12803 00000100:00100000:2.0:1746155578.377958:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976124701440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.378021:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3296:x1830976124701440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (331us total) trans 17179873337 rc 0/0 00000100:00100000:2.0:1746155578.378025:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12803 00000100:00100000:2.0:1746155578.378032:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12804 00000100:00100000:2.0:1746155578.378035:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976124701952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.378090:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3296:x1830976124701952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (381us total) trans 17179873338 rc 0/0 00000100:00100000:2.0:1746155578.378094:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12804 00000004:00080000:2.0:1746155578.378114:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366c000/2, rc 0, transno 21474840737 00000100:00100000:2.0:1746155578.378116:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124700416:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155578.378120:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1f1f80/2, rc 0, transno 21474840738 00000100:00100000:2.0:1746155578.378123:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124700928:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155578.378127:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526bb80/2, rc 0, transno 17179873337 00000100:00100000:2.0:1746155578.378130:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124701440:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155578.378134:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c211c00/2, rc 0, transno 17179873338 00000100:00100000:2.0:1746155578.378136:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124701952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.378144:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.378155:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124701056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.378167:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.378173:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124701568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.378182:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155578.378194:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124700544 00000100:00100000:2.0:1746155578.378196:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124700544 00000100:00100000:2.0:1746155578.378204:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124701056 00000100:00100000:2.0:1746155578.378206:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124701056 00000100:00100000:2.0:1746155578.378211:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124701568 00000100:00100000:2.0:1746155578.378213:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124701568 00000100:00100000:2.0:1746155578.378219:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12805 00000100:00100000:2.0:1746155578.378223:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3297:x1830976124700544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155578.378284:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3297:x1830976124700544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (138us total) trans 21474840739 rc 0/0 00000100:00100000:2.0:1746155578.378288:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12805 00000100:00100000:2.0:1746155578.378368:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12806 00000100:00100000:2.0:1746155578.378372:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3297:x1830976124701056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155578.378429:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155578.378431:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.378432:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.378434:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155578.378436:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155578.378451:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3297:x1830976124701056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (283us total) trans 17179873339 rc 0/0 00000100:00100000:2.0:1746155578.378455:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12806 00000100:00100000:2.0:1746155578.378462:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12807 00000100:00100000:2.0:1746155578.378466:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3297:x1830976124701568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155578.378577:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3297:x1830976124701568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (392us total) trans 17179873340 rc 0/0 00000100:00100000:2.0:1746155578.378581:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12807 00000004:00080000:2.0:1746155578.378602:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366df80/2, rc 0, transno 21474840739 00000100:00100000:2.0:1746155578.378604:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124700544:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155578.378609:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526a680/2, rc 0, transno 17179873339 00000100:00100000:2.0:1746155578.378612:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124701056:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155578.378616:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526b480/2, rc 0, transno 17179873340 00000100:00100000:2.0:1746155578.378618:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124701568:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746155578.378699:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fdf expref: 289 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.378708:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155578.378711:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746155578.378715:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40e00/0x844e5faceb5ed5b1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12002 expref: 7 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.378723:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40e00/0x844e5faceb5ed5b1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12002 expref: 7 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.378730:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40e00/0x844e5faceb5ed5b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12002 expref: 7 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.378737:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40200/0x844e5faceb5ed5b8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ffb expref: 289 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.378742:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40200/0x844e5faceb5ed5b8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ffb expref: 289 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.378748:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40200/0x844e5faceb5ed5b8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ffb expref: 289 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.378773:0:14234:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40200/0x844e5faceb5ed5b8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ffb expref: 289 pid: 19870 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155578.378781:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124702208:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155578.378823:0:14234:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40e00/0x844e5faceb5ed5b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12002 expref: 7 pid: 19870 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155578.378830:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124702336:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155578.378841:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155578.381816:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.381945:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124702208:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155578.381955:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124702336:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155578.381987:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad800/0x844e5faceb5ed58e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fdf expref: 289 pid: 14234 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746155578.382002:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fdf expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.382028:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090344200, rc 0) 00000100:00100000:1.0:1746155578.382065:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29534:x1830976124060928:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 104653us (104966us total) trans 8589944150 rc 0/0 00000100:00100000:1.0:1746155578.382072:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10168 00000100:00100000:0.0:1746155578.383010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.383066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.383087:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124062080 00000100:00100000:0.0:1746155578.383092:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124062080 00000100:00100000:0.0:1746155578.383117:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124062336 00000100:00100000:0.0:1746155578.383119:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124062336 00000100:00100000:0.0:1746155578.383130:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4140 00000100:00100000:0.0:1746155578.383136:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29536:x1830976124062080:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:0.0:1746155578.383203:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29536:x1830976124062080:12345-192.168.202.51@tcp:49:cat.0 Request processed in 67us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155578.383208:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4140 00000100:00100000:0.0:1746155578.383219:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4141 00000100:00100000:0.0:1746155578.383223:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29537:x1830976124062336:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:0.0:1746155578.383252:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29537:x1830976124062336:12345-192.168.202.51@tcp:49:cat.0 Request processed in 29us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155578.383257:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4141 00000100:00100000:1.0:1746155578.383313:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124062208 00000100:00100000:1.0:1746155578.383316:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124062208 00000100:00100000:1.0:1746155578.383333:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10172 00000100:00100000:1.0:1746155578.383338:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29533:x1830976124062208:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155578.383346:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155578.383358:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009417e600/0x844e5faceb5ed5bf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12009 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.383387:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009417e600/0x844e5faceb5ed5bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12009 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.383397:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009417e600/0x844e5faceb5ed5bf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12009 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.383407:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155578.383410:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155578.383412:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009417e600, rc 0) 00000100:00100000:1.0:1746155578.383426:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29533:x1830976124062208:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 88us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155578.383430:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10172 00000100:00100000:1.0:1746155578.386161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.386230:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124062464 00000100:00100000:2.0:1746155578.386236:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124062464 00000100:00100000:2.0:1746155578.386298:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4142 00000100:00100000:2.0:1746155578.386304:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29534:x1830976124062464:12345-192.168.202.51@tcp:49:multiop.0 00000100:00100000:1.0:1746155578.386615:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.386641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.386846:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29534:x1830976124062464:12345-192.168.202.51@tcp:49:multiop.0 Request processed in 541us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.386852:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4142 00000100:00100000:3.0:1746155578.386880:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124062720 00000100:00100000:3.0:1746155578.386884:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124062720 00000100:00100000:3.0:1746155578.386909:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 616 00000100:00100000:3.0:1746155578.386913:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1963:x1830976124062720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155578.386921:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155578.386940:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009417e600/0x844e5faceb5ed5bf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12009 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.386952:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:3.0:1746155578.386955:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155578.386983:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1963:x1830976124062720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 69us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155578.386988:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 616 00000100:00100000:0.0:1746155578.387198:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124062592 00000100:00100000:0.0:1746155578.387202:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124062592 00000100:00100000:0.0:1746155578.387229:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4143 00000100:00100000:0.0:1746155578.387233:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29533:x1830976124062592:12345-192.168.202.51@tcp:49:multiop.0 00000100:00100000:0.0:1746155578.387274:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29533:x1830976124062592:12345-192.168.202.51@tcp:49:multiop.0 Request processed in 41us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155578.387279:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4143 00000100:00100000:0.0:1746155578.390862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.390921:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124062848 00000100:00100000:2.0:1746155578.390928:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124062848 00000100:00100000:2.0:1746155578.390973:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12808 00000100:00100000:2.0:1746155578.390981:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29533:x1830976124062848:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155578.390998:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155578.391012:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12010 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.391036:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed48b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f84 expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155578.391138:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.391140:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.391144:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [2035712->2097151] (req 2035712->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.391172:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed48b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f84 expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155578.391183:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed48b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f84 expref: 14 pid: 18270 timeout: 807 lvb_type: 1 00000100:00100000:2.0:1746155578.391195:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124702464:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155578.392298:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfde40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155578.394275:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.396122:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124062976 00000100:00100000:0.0:1746155578.396131:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124062976 00000100:00100000:0.0:1746155578.396170:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12809 00000100:00100000:0.0:1746155578.396176:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29534:x1830976124062976:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155578.396191:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155578.396195:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155578.396205:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12017 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.396225:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.396227:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.396231:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.396241:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.396249:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd51a00, rc 0) 00000100:00100000:0.0:1746155578.396280:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29534:x1830976124062976:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 105us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155578.396284:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124063232 00000100:00100000:0.0:1746155578.396286:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12809 00000100:00100000:3.0:1746155578.396288:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124063232 00002000:00100000:3.0:1746155578.396313:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88013089a300 x1830976124063232/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.396327:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089a300 with x1830976124063232 ext(1048576->2097151) 00002000:00010000:3.0:1746155578.396402:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013089a300 00000100:00100000:3.0:1746155578.396418:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5011 00000100:00100000:3.0:1746155578.396424:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124063232:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155578.401854:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.401889:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.401910:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124063616 00000100:00100000:3.0:1746155578.401917:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124063616 00010000:00010000:3.0:1746155578.401943:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed48b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f84 expref: 15 pid: 18270 timeout: 807 lvb_type: 1 00000100:00100000:3.0:1746155578.401965:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6485 00000100:00100000:3.0:1746155578.401972:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+15:1961:x1830976124063616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155578.401982:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155578.401999:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed48b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f84 expref: 15 pid: 18270 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155578.402010:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed48b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f84 expref: 15 pid: 18270 timeout: 807 lvb_type: 1 00010000:00010000:3.0:1746155578.402033:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.402035:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.402041:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.402048:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.402054:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.402055:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.402058:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.402063:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.402084:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155578.402093:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009486b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124702592:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155578.402171:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155578.402178:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009486aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124702720:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155578.402194:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851900 going to sleep for 11 seconds 00010000:00010000:2.0:1746155578.402314:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc9600/0x844e5faceb5ed48b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f84 expref: 15 pid: 18270 timeout: 807 lvb_type: 1 00000100:00100000:2.0:1746155578.402327:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124702464:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155578.402345:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.402353:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f874800, rc 0) 00000100:00100000:2.0:1746155578.402375:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29533:x1830976124062848:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 11395us (11519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.402381:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12808 00000100:00100000:0.0:1746155578.402449:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124063488 00000100:00100000:0.0:1746155578.402454:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124063488 00002000:00100000:0.0:1746155578.402477:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009c213480 x1830976124063488/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155578.402496:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213480 with x1830976124063488 ext(1048576->2097151) 00002000:00010000:0.0:1746155578.402500:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c213480 00000100:00100000:0.0:1746155578.402537:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5012 00000100:00100000:0.0:1746155578.402543:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976124063488:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155578.414909:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009486b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124702592:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155578.415746:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+18:1960:x1830976124063232:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 19318us (19548us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155578.415756:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5011 00002000:00100000:3.0:1746155578.415767:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88013089a300 x1830976124063232/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.415776:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089a300 with x1830976124063232 ext(1048576->2097151) 00002000:00010000:3.0:1746155578.415781:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013089a300 00000100:00100000:2.0:1746155578.416625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.416744:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009486aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124702720:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155578.416764:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155578.418728:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124063872 00000100:00100000:3.0:1746155578.418740:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124063872 00002000:00100000:3.0:1746155578.418782:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (2035712->2039807) req@ffff880130899c00 x1830976124063872/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.418791:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899c00 with x1830976124063872 ext(2035712->2039807) 00002000:00010000:3.0:1746155578.418796:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130899c00 00000100:00100000:3.0:1746155578.418822:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5013 00000100:00100000:3.0:1746155578.418829:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976124063872:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155578.419192:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1961:x1830976124063616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 17217us (17299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155578.419199:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976124063872:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 369us (2574us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155578.419200:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6485 00000100:00100000:3.0:1746155578.419205:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5013 00002000:00100000:3.0:1746155578.419210:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (2035712->2039807) req@ffff880130899c00 x1830976124063872/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/4536 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.419216:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899c00 with x1830976124063872 ext(2035712->2039807) 00002000:00010000:3.0:1746155578.419219:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130899c00 00000100:00100000:3.0:1746155578.420241:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.420294:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124064128 00000100:00100000:2.0:1746155578.420299:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124064128 00002000:00100000:2.0:1746155578.420319:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1232896->1236991) req@ffff880094869f80 x1830976124064128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155578.420327:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094869f80 with x1830976124064128 ext(1232896->1236991) 00002000:00010000:2.0:1746155578.420330:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094869f80 00000100:00100000:2.0:1746155578.420353:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5014 00000100:00100000:2.0:1746155578.420358:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976124064128:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155578.420442:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976124064128:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 83us (203us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155578.420448:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5014 00002000:00100000:2.0:1746155578.420453:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1232896->1236991) req@ffff880094869f80 x1830976124064128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/4536 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155578.420459:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094869f80 with x1830976124064128 ext(1232896->1236991) 00002000:00010000:2.0:1746155578.420462:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094869f80 00000100:00100000:0.0:1746155578.420936:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976124063488:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 18393us (19089us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155578.420942:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5012 00002000:00100000:0.0:1746155578.420948:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3da:0x0] (1048576->2097151) req@ffff88009c213480 x1830976124063488/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155578.420954:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213480 with x1830976124063488 ext(1048576->2097151) 00002000:00010000:0.0:1746155578.420957:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c213480 00000100:00100000:2.0:1746155578.421271:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.422332:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124064256 00000100:00100000:0.0:1746155578.422338:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124064256 00000100:00100000:0.0:1746155578.422375:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12810 00000100:00100000:0.0:1746155578.422381:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+18:29536:x1830976124064256:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155578.422393:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155578.422407:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd50000/0x844e5faceb5ed5d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1201e expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.422425:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.422427:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.422433:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd50000/0x844e5faceb5ed5d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1201e expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.422446:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd50000/0x844e5faceb5ed5d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1201e expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.422454:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd50000, rc 0) 00000100:00100000:0.0:1746155578.422494:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29536:x1830976124064256:12345-192.168.202.51@tcp:101:cat.0 Request processed in 112us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155578.422499:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12810 00000100:00100000:0.0:1746155578.428214:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.428264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.428331:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.428458:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124064640 00000100:00100000:1.0:1746155578.428465:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124064640 00002000:00100000:1.0:1746155578.428566:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1368064->1372159) req@ffff88012f1f2a00 x1830976124064640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155578.428576:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2a00 with x1830976124064640 ext(1368064->1372159) 00002000:00010000:1.0:1746155578.428581:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f2a00 00000100:00100000:1.0:1746155578.428608:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124064896 00000100:00100000:1.0:1746155578.428611:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124064896 00002000:00100000:1.0:1746155578.428625:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88012f1f0000 x1830976124064896/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155578.428631:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0000 with x1830976124064896 ext(1048576->2097151) 00002000:00010000:1.0:1746155578.428633:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f0000 00000100:00100000:1.0:1746155578.428644:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5015 00000100:00100000:1.0:1746155578.428650:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976124064640:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155578.428784:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976124064640:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 133us (518us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155578.428790:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5015 00000100:00100000:0.0:1746155578.428795:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5016 00002000:00100000:1.0:1746155578.428801:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3d8:0x0] (1368064->1372159) req@ffff88012f1f2a00 x1830976124064640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/4536 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746155578.428803:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976124064896:12345-192.168.202.51@tcp:3:multiop.0 00002000:00100000:1.0:1746155578.428807:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2a00 with x1830976124064640 ext(1368064->1372159) 00002000:00010000:1.0:1746155578.428810:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f2a00 00000100:00100000:2.0:1746155578.428876:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124064384 00000100:00100000:2.0:1746155578.428880:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124064384 00000100:00100000:2.0:1746155578.428902:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12811 00000100:00100000:2.0:1746155578.428906:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29533:x1830976124064384:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155578.428914:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155578.428928:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12025 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.428948:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed4a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f8b expref: 13 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155578.428956:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.428957:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.428960:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->2527231] (req 2097152->2527231) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.428983:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed4a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f8b expref: 13 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155578.428993:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed4a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f8b expref: 13 pid: 8438 timeout: 807 lvb_type: 1 00000100:00100000:2.0:1746155578.429002:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124702848:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155578.429048:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155578.440089:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.441892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.441981:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124702848:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155578.442005:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->2527231] (req 2097152->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.442020:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f875c00, rc 0) 00000100:00100000:2.0:1746155578.442103:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124065024 00000100:00100000:2.0:1746155578.442109:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124065024 00000100:00100000:2.0:1746155578.442147:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12812 00000100:00100000:2.0:1746155578.442153:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:29537:x1830976124065024:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155578.442167:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155578.442178:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f875600/0x844e5faceb5ed5e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1202c expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.442196:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.442197:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.442204:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f875600/0x844e5faceb5ed5e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1202c expref: 31 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.442214:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f875600/0x844e5faceb5ed5e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1202c expref: 31 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.442221:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f875600, rc 0) 00000100:00100000:3.0:1746155578.442259:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29533:x1830976124064384:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 13351us (14050us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155578.442266:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12811 00000100:00100000:0.0:1746155578.442324:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124065152 00000100:00100000:0.0:1746155578.442328:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124065152 00010000:00010000:0.0:1746155578.442344:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed4a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f8b expref: 14 pid: 8438 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746155578.442361:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6486 00000100:00100000:0.0:1746155578.442366:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+14:1963:x1830976124065152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155578.442373:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155578.442390:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed4a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f8b expref: 14 pid: 8438 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746155578.442400:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed4a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f8b expref: 14 pid: 8438 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746155578.442415:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd50800/0x844e5faceb5ed4a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f8b expref: 14 pid: 8438 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746155578.442431:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.442433:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155578.442437:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.442444:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155578.442467:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155578.442477:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca97480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124702976:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155578.443011:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:29537:x1830976124065024:12345-192.168.202.51@tcp:101:cat.0 Request processed in 856us (2929us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.443017:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12812 00000100:00100000:1.0:1746155578.445597:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155578.446576:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+19:1962:x1830976124064896:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 17769us (18240us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155578.446586:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5016 00002000:00100000:2.0:1746155578.446594:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88012f1f0000 x1830976124064896/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155578.446601:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0000 with x1830976124064896 ext(1048576->2097151) 00002000:00010000:2.0:1746155578.446605:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f0000 00000100:00100000:1.0:1746155578.447030:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca97480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976124702976:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155578.447048:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155578.447080:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+13:1963:x1830976124065152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4713us (5190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155578.447088:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6486 00000100:00100000:0.0:1746155578.447958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.448017:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124065408 00000100:00100000:2.0:1746155578.448022:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124065408 00002000:00100000:2.0:1746155578.448749:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009ca94000 x1830976124065408/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155578.448759:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94000 with x1830976124065408 ext(1048576->2097151) 00002000:00010000:2.0:1746155578.448763:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca94000 00000100:00100000:2.0:1746155578.448791:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5017 00000100:00100000:2.0:1746155578.448799:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976124065408:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155578.452546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.453006:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124065664 00000100:00100000:3.0:1746155578.453014:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124065664 00002000:00100000:3.0:1746155578.453050:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (2523136->2527231) req@ffff88009ca94380 x1830976124065664/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.453060:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94380 with x1830976124065664 ext(2523136->2527231) 00002000:00010000:3.0:1746155578.453064:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca94380 00000100:00100000:3.0:1746155578.453083:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5018 00000100:00100000:3.0:1746155578.453089:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976124065664:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155578.453637:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1960:x1830976124065664:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 546us (1095us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155578.453643:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5018 00002000:00100000:3.0:1746155578.453649:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (2523136->2527231) req@ffff88009ca94380 x1830976124065664/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/4536 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.453656:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94380 with x1830976124065664 ext(2523136->2527231) 00002000:00010000:3.0:1746155578.453659:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca94380 00000100:00100000:0.0:1746155578.455858:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976124065408:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7053us (7894us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155578.455867:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5017 00002000:00100000:0.0:1746155578.455876:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3db:0x0] (1048576->2097151) req@ffff88009ca94000 x1830976124065408/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155578.455885:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94000 with x1830976124065408 ext(1048576->2097151) 00002000:00010000:0.0:1746155578.455889:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca94000 00000100:00100000:1.0:1746155578.456138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.456199:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124065792 00000100:00100000:2.0:1746155578.456205:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124065792 00000100:00100000:2.0:1746155578.456230:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12813 00000100:00100000:2.0:1746155578.456237:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29536:x1830976124065792:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155578.456248:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155578.456262:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f874a00/0x844e5faceb5ed5e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12033 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.456283:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.456290:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.456296:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746155578.456297:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746155578.456300:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f874a00/0x844e5faceb5ed5e9 lrc: 5/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12033 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.456329:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.456344:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 21 pid: 18270 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155578.456353:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124703104:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155578.456823:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.456831:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 21 pid: 9235 timeout: 807 lvb_type: 0 00000100:00100000:3.0:1746155578.456840:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094868a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124703232:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155578.456864:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155578.459350:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.459391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.459463:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124066048 00000100:00100000:1.0:1746155578.459470:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124066048 00000100:00100000:3.0:1746155578.459610:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124703104:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155578.459610:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12814 00000100:00100000:1.0:1746155578.459617:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29537:x1830976124066048:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155578.459630:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155578.459642:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1203a expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.459661:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746155578.459665:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1203a expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155578.459665:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124065920 00000100:00100000:0.0:1746155578.459668:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124065920 00010000:00010000:1.0:1746155578.459675:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1203a expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.459684:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c94c400, rc 0) 00002000:00100000:0.0:1746155578.459690:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (2035712->2097151) req@ffff88009ca95c00 x1830976124065920/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155578.459697:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95c00 with x1830976124065920 ext(2035712->2097151) 00010000:00010000:0.0:1746155578.459701:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 22 pid: 18270 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746155578.459709:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 22 pid: 18270 timeout: 807 lvb_type: 0 00002000:00010000:0.0:1746155578.459715:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca95c00 00000100:00100000:1.0:1746155578.460093:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:29537:x1830976124066048:12345-192.168.202.51@tcp:101:cat.0 Request processed in 475us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155578.460098:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12814 00000100:00100000:0.0:1746155578.460229:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 833 00000100:00100000:0.0:1746155578.460236:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976124065920:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155578.461952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.462109:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124066176 00000100:00100000:3.0:1746155578.462113:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124066176 00002000:00100000:3.0:1746155578.462134:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1232896->1372159) req@ffff88009ca95180 x1830976124066176/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.462142:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95180 with x1830976124066176 ext(1232896->1372159) 00010000:00010000:3.0:1746155578.462148:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 23 pid: 9235 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155578.462157:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 23 pid: 9235 timeout: 807 lvb_type: 0 00002000:00010000:3.0:1746155578.462163:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca95180 00000100:00100000:3.0:1746155578.462176:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 834 00000100:00100000:3.0:1746155578.462181:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976124066176:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155578.462444:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094868a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976124703232:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155578.462466:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f874a00/0x844e5faceb5ed5e9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12033 expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.462478:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f874a00, rc 0) 00000100:00100000:2.0:1746155578.462526:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29536:x1830976124065792:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6289us (6388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.462531:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12813 00000100:00100000:1.0:1746155578.463190:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1963:x1830976124065920:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 2953us (3846us total) trans 21474840740 rc 0/0 00000100:00100000:1.0:1746155578.463196:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 833 00002000:00100000:1.0:1746155578.463201:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3d8:0x0] (2035712->2097151) req@ffff88009ca95c00 x1830976124065920/t21474840740(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/448 e 0 to 0 dl 1746155589 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155578.463208:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95c00 with x1830976124065920 ext(2035712->2097151) 00010000:00010000:1.0:1746155578.463212:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 23 pid: 18270 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155578.463219:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 23 pid: 18270 timeout: 807 lvb_type: 0 00002000:00010000:1.0:1746155578.463230:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca95c00 00000100:00100000:0.0:1746155578.466371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.466736:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124066304 00000100:00100000:1.0:1746155578.466743:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124066304 00010000:00010000:1.0:1746155578.466767:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 23 pid: 18270 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155578.466796:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6487 00000100:00100000:1.0:1746155578.466802:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1962:x1830976124066304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155578.466811:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155578.466825:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 23 pid: 18270 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155578.466834:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 23 pid: 18270 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155578.466850:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f874800/0x844e5faceb5ed5c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 6 type: EXT [1372160->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12010 expref: 23 pid: 18270 timeout: 807 lvb_type: 0 00010000:00010000:1.0:1746155578.466864:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155578.466889:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1962:x1830976124066304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155578.466894:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6487 00000100:00100000:3.0:1746155578.468498:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976124066176:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 6312us (6544us total) trans 21474840741 rc 0/0 00000100:00100000:3.0:1746155578.468519:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 834 00002000:00100000:3.0:1746155578.468527:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1232896->1372159) req@ffff88009ca95180 x1830976124066176/t21474840741(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/448 e 0 to 0 dl 1746155589 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.468535:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95180 with x1830976124066176 ext(1232896->1372159) 00010000:00010000:3.0:1746155578.468542:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 25 pid: 9235 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155578.468552:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 25 pid: 9235 timeout: 807 lvb_type: 0 00002000:00010000:3.0:1746155578.468558:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca95180 00000100:00100000:0.0:1746155578.470722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.470811:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124066432 00000100:00100000:2.0:1746155578.470818:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124066432 00010000:00010000:2.0:1746155578.470842:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 25 pid: 9235 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155578.470977:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6488 00000100:00100000:2.0:1746155578.470984:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d75a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976124066432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155578.470994:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155578.471008:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 25 pid: 9235 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.471018:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 25 pid: 9235 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.471036:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd51a00/0x844e5faceb5ed5cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 5 type: EXT [1232896->1372159] (req 1232896->1372159) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12017 expref: 25 pid: 9235 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.471147:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.471149:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.471155:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f874a00/0x844e5faceb5ed5e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12033 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.471163:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f874a00/0x844e5faceb5ed5e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12033 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.471170:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.471171:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.471174:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1203a expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.471180:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1203a expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.471203:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1203a expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155578.471213:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935be300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124703360:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155578.471574:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f874a00/0x844e5faceb5ed5e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12033 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155578.471587:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124703488:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155578.471939:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155578.475273:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.475415:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935be300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124703360:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155578.475424:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124703488:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155578.475438:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155578.475468:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d75a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976124066432:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4484us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.475477:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6488 00000100:00100000:1.0:1746155578.476192:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.476213:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124066688 00000100:00100000:3.0:1746155578.476218:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124066688 00002000:00100000:3.0:1746155578.476247:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009ca96d80 x1830976124066688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.476255:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96d80 with x1830976124066688 ext(1048576->2097151) 00002000:00010000:3.0:1746155578.476258:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca96d80 00000100:00100000:3.0:1746155578.476273:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5019 00000100:00100000:3.0:1746155578.476279:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976124066688:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155578.478646:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124066944 00000100:00100000:2.0:1746155578.478653:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124066944 00002000:00100000:2.0:1746155578.478678:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800944ac000 x1830976124066944/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155578.478686:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ac000 with x1830976124066944 ext(1048576->2097151) 00002000:00010000:2.0:1746155578.478690:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ac000 00000100:00100000:2.0:1746155578.478704:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5020 00000100:00100000:2.0:1746155578.478710:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976124066944:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155578.484563:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976124066688:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8274us (9287us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155578.484574:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5019 00002000:00100000:3.0:1746155578.484583:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff88009ca96d80 x1830976124066688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.484591:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96d80 with x1830976124066688 ext(1048576->2097151) 00002000:00010000:3.0:1746155578.484596:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca96d80 00000100:00100000:2.0:1746155578.489263:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976124066944:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10545us (13064us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155578.489273:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5020 00002000:00100000:2.0:1746155578.489282:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d8:0x0] (1048576->2097151) req@ffff8800944ac000 x1830976124066944/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155578.489290:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944ac000 with x1830976124066944 ext(1048576->2097151) 00002000:00010000:2.0:1746155578.489296:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800944ac000 00000100:00100000:0.0:1746155578.494203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.494251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.494309:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124067072 00000100:00100000:1.0:1746155578.494317:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124067072 00000100:00100000:3.0:1746155578.495549:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124067200 00000100:00100000:3.0:1746155578.495554:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124067200 00000100:00100000:3.0:1746155578.495589:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12815 00000100:00100000:3.0:1746155578.495597:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976124067072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155578.495616:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155578.495629:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a065c000/0x844e5faceb5ed5f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12041 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155578.495672:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009486ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124703616:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155578.495687:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12816 00000100:00100000:2.0:1746155578.495694:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976124067200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155578.495700:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155578.495708:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f874800/0x844e5faceb5ed5fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12048 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.495719:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.495720:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155578.495726:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00010000:00010000:2.0:1746155578.495727:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f874800/0x844e5faceb5ed5fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12048 expref: 32 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155578.495739:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f874800/0x844e5faceb5ed5fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12048 expref: 32 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155578.495748:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f874800, rc 0) 00000100:00100000:2.0:1746155578.495767:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976124067200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 74us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.495772:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12816 00000100:00100000:3.0:1746155578.503149:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009486ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976124703616:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155578.503180:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a065c000/0x844e5faceb5ed5f7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12041 expref: 25 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155578.503192:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a065c000/0x844e5faceb5ed5f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12041 expref: 25 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155578.503217:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a065c000, rc 0) 00000100:00100000:3.0:1746155578.503264:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976124067072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7667us (9065us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155578.503272:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12815 00000100:00100000:3.0:1746155578.506768:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.506834:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124067456 00000100:00100000:2.0:1746155578.506842:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124067456 00002000:00100000:2.0:1746155578.506873:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2527232->3145727) req@ffff88009486ad80 x1830976124067456/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155578.506881:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486ad80 with x1830976124067456 ext(2527232->3145727) 00002000:00010000:2.0:1746155578.506885:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486ad80 00000100:00100000:2.0:1746155578.506897:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5021 00000100:00100000:2.0:1746155578.506903:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976124067456:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155578.511315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.511435:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124067584 00000100:00100000:3.0:1746155578.511442:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124067584 00000100:00100000:2.0:1746155578.511799:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009486ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1961:x1830976124067456:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4894us (5039us total) trans 0 rc 618496/618496 00000100:00100000:2.0:1746155578.511807:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5021 00002000:00100000:2.0:1746155578.511816:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2527232->3145727) req@ffff88009486ad80 x1830976124067456/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 618496/618496 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155578.511824:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009486ad80 with x1830976124067456 ext(2527232->3145727) 00002000:00010000:2.0:1746155578.511828:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009486ad80 00000100:00100000:1.0:1746155578.512907:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12817 00000100:00100000:1.0:1746155578.512916:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:29537:x1830976124067584:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155578.512928:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155578.512941:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1204f expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.512962:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.512969:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155578.512970:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155578.512973:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1204f expref: 25 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.512995:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.513005:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 21 pid: 9235 timeout: 807 lvb_type: 0 00000100:00100000:1.0:1746155578.513014:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124703744:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155578.513072:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155578.514345:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124703744:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155578.514360:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1204f expref: 25 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.514371:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fe2a00, rc 0) 00000100:00100000:1.0:1746155578.514400:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:29537:x1830976124067584:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1486us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155578.514405:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12817 00000100:00100000:0.0:1746155578.514965:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.515058:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124067712 00000100:00100000:2.0:1746155578.515062:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124067712 00002000:00100000:2.0:1746155578.515084:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2527231) req@ffff88009ca96300 x1830976124067712/t0(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155578.515091:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96300 with x1830976124067712 ext(2097152->2527231) 00010000:00010000:2.0:1746155578.515096:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 22 pid: 9235 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.515105:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 22 pid: 9235 timeout: 807 lvb_type: 0 00002000:00010000:2.0:1746155578.515110:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca96300 00000100:00100000:2.0:1746155578.515130:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 835 00000100:00100000:2.0:1746155578.515135:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976124067712:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155578.517982:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.519702:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124067840 00000100:00100000:1.0:1746155578.519710:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124067840 00000100:00100000:1.0:1746155578.522816:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12818 00000100:00100000:1.0:1746155578.522827:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+19:29536:x1830976124067840:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155578.522841:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155578.522854:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135fe2e00/0x844e5faceb5ed60c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12056 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.522874:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155578.522876:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155578.522882:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135fe2e00/0x844e5faceb5ed60c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12056 expref: 20 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.522894:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135fe2e00/0x844e5faceb5ed60c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12056 expref: 20 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155578.522903:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fe2e00, rc 0) 00000100:00100000:1.0:1746155578.524238:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+20:29536:x1830976124067840:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1411us (6259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155578.524245:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12818 00000100:00100000:3.0:1746155578.524409:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976124067712:12345-192.168.202.51@tcp:4:cat.0 Request processed in 9271us (9442us total) trans 21474840742 rc 0/0 00000100:00100000:3.0:1746155578.524416:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 835 00002000:00100000:3.0:1746155578.524424:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->2527231) req@ffff88009ca96300 x1830976124067712/t21474840742(0) o4->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/448 e 0 to 0 dl 1746155589 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.524438:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96300 with x1830976124067712 ext(2097152->2527231) 00010000:00010000:3.0:1746155578.524445:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 24 pid: 9235 timeout: 807 lvb_type: 0 00010000:00010000:3.0:1746155578.524456:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 24 pid: 9235 timeout: 807 lvb_type: 0 00002000:00010000:3.0:1746155578.524462:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca96300 00000100:00100000:0.0:1746155578.533437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.533492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.533637:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124068096 00000100:00100000:3.0:1746155578.533644:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124068096 00002000:00100000:3.0:1746155578.533683:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009ca95f80 x1830976124068096/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746155578.533689:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124068224 00002000:00100000:3.0:1746155578.533691:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95f80 with x1830976124068096 ext(2097152->3145727) 00000100:00100000:2.0:1746155578.533692:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124068224 00002000:00010000:3.0:1746155578.533695:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca95f80 00010000:00010000:2.0:1746155578.533710:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 24 pid: 9235 timeout: 807 lvb_type: 0 00000100:00100000:2.0:1746155578.533743:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6489 00000100:00100000:2.0:1746155578.533750:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1961:x1830976124068224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155578.533761:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155578.533778:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 24 pid: 9235 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.533787:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 24 pid: 9235 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.533805:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f875c00/0x844e5faceb5ed5db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12025 expref: 24 pid: 9235 timeout: 807 lvb_type: 0 00010000:00010000:2.0:1746155578.533826:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.533828:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155578.533834:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1204f expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.533841:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1204f expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155578.533866:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1204f expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155578.533874:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124703872:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155578.533933:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfde40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155578.534324:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5022 00000100:00100000:3.0:1746155578.534330:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976124068096:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155578.539267:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976124703872:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155578.539285:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155578.539319:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+23:1961:x1830976124068224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5568us (5826us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155578.539329:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6489 00000100:00100000:3.0:1746155578.541951:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1961:x1830976124068096:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7615us (8515us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155578.541960:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5022 00002000:00100000:3.0:1746155578.541969:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88009ca95f80 x1830976124068096/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.541977:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95f80 with x1830976124068096 ext(2097152->3145727) 00002000:00010000:3.0:1746155578.541981:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca95f80 00000100:00100000:0.0:1746155578.547085:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.547828:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124068480 00000100:00100000:3.0:1746155578.547836:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124068480 00002000:00100000:3.0:1746155578.547873:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012cdce300 x1830976124068480/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.547882:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdce300 with x1830976124068480 ext(2097152->3145727) 00002000:00010000:3.0:1746155578.547887:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdce300 00000100:00100000:3.0:1746155578.547906:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5023 00000100:00100000:3.0:1746155578.547913:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976124068480:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155578.550875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.550917:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124068736 00000100:00100000:2.0:1746155578.550918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155578.550924:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124068736 00002000:00100000:0.0:1746155578.550954:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800935bea00 x1830976124068736/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155578.550963:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bea00 with x1830976124068736 ext(3145728->4194303) 00002000:00010000:0.0:1746155578.550967:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bea00 00000100:00100000:0.0:1746155578.550994:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5024 00000100:00100000:0.0:1746155578.551000:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976124068736:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155578.551033:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124068992 00000100:00100000:3.0:1746155578.551037:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124068992 00000100:00100000:3.0:1746155578.551057:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12819 00000100:00100000:3.0:1746155578.551061:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+23:29536:x1830976124068992:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155578.551070:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155578.551082:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135ff5600/0x844e5faceb5ed613 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1205d expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.551097:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.551098:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155578.551104:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135ff5600/0x844e5faceb5ed613 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1205d expref: 24 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.551114:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135ff5600/0x844e5faceb5ed613 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1205d expref: 24 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155578.551122:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ff5600, rc 0) 00000100:00100000:3.0:1746155578.551163:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+24:29536:x1830976124068992:12345-192.168.202.51@tcp:101:cat.0 Request processed in 97us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155578.551168:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12819 00000100:00100000:0.0:1746155578.559611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.559642:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124069120 00000100:00100000:1.0:1746155578.559649:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124069120 00002000:00100000:1.0:1746155578.559684:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012cdcce00 x1830976124069120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155578.559699:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcce00 with x1830976124069120 ext(2097152->3145727) 00002000:00010000:1.0:1746155578.559704:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdcce00 00000100:00100000:1.0:1746155578.559735:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5025 00000100:00100000:1.0:1746155578.559742:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976124069120:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155578.561068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.561102:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124069248 00000100:00100000:2.0:1746155578.561106:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124069248 00002000:00100000:2.0:1746155578.561254:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800944afb80 x1830976124069248/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155578.561261:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944afb80 with x1830976124069248 ext(3145728->4194303) 00002000:00010000:2.0:1746155578.561265:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944afb80 00000100:00100000:2.0:1746155578.561283:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5026 00000100:00100000:2.0:1746155578.561288:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976124069248:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155578.562628:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976124068480:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14710us (15544us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155578.562637:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5023 00002000:00100000:3.0:1746155578.562645:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (2097152->3145727) req@ffff88012cdce300 x1830976124068480/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.562653:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdce300 with x1830976124068480 ext(2097152->3145727) 00002000:00010000:3.0:1746155578.562657:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdce300 00000100:00100000:0.0:1746155578.567793:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155578.569530:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124069632 00000100:00100000:3.0:1746155578.569541:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124069632 00000100:00100000:1.0:1746155578.569570:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:3.0:1746155578.569580:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012cdcc380 x1830976124069632/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.569589:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcc380 with x1830976124069632 ext(3145728->4194303) 00002000:00010000:3.0:1746155578.569594:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcc380 00000100:00100000:3.0:1746155578.569616:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124069888 00000100:00100000:3.0:1746155578.569619:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124069888 00002000:00100000:3.0:1746155578.569629:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800944adf80 x1830976124069888/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155578.569630:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5027 00002000:00100000:3.0:1746155578.569635:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944adf80 with x1830976124069888 ext(3145728->4194303) 00000100:00100000:1.0:1746155578.569637:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976124069632:12345-192.168.202.51@tcp:3:cat.0 00002000:00010000:3.0:1746155578.569638:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944adf80 00000100:00100000:3.0:1746155578.569661:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5028 00000100:00100000:3.0:1746155578.569666:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976124069888:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155578.571262:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976124068736:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20258us (20388us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155578.571269:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5024 00002000:00100000:3.0:1746155578.571275:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff8800935bea00 x1830976124068736/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.571283:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935bea00 with x1830976124068736 ext(3145728->4194303) 00002000:00010000:3.0:1746155578.571286:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935bea00 00000100:00100000:1.0:1746155578.575615:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976124069120:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15864us (16002us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155578.575625:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5025 00002000:00100000:1.0:1746155578.575635:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3dc:0x0] (2097152->3145727) req@ffff88012cdcce00 x1830976124069120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155578.575643:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcce00 with x1830976124069120 ext(2097152->3145727) 00002000:00010000:1.0:1746155578.575648:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdcce00 00000100:00100000:2.0:1746155578.580757:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976124069248:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19460us (19683us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155578.580767:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5026 00002000:00100000:2.0:1746155578.580776:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800944afb80 x1830976124069248/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155578.580784:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944afb80 with x1830976124069248 ext(3145728->4194303) 00002000:00010000:2.0:1746155578.580789:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944afb80 00000100:00100000:3.0:1746155578.580806:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+20:1963:x1830976124069888:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11138us (11237us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155578.580813:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5028 00002000:00100000:3.0:1746155578.580819:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3dc:0x0] (3145728->4194303) req@ffff8800944adf80 x1830976124069888/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.580825:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800944adf80 with x1830976124069888 ext(3145728->4194303) 00002000:00010000:3.0:1746155578.580828:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800944adf80 00000100:00100000:1.0:1746155578.588171:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976124069632:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18526us (20377us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155578.588181:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5027 00002000:00100000:1.0:1746155578.588189:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (3145728->4194303) req@ffff88012cdcc380 x1830976124069632/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155578.588197:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcc380 with x1830976124069632 ext(3145728->4194303) 00002000:00010000:1.0:1746155578.588202:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcc380 00000100:00100000:0.0:1746155578.590552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.590619:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124070144 00000100:00100000:1.0:1746155578.590625:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124070144 00002000:00100000:1.0:1746155578.590655:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012cdcea00 x1830976124070144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155578.590663:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcea00 with x1830976124070144 ext(4194304->4956159) 00002000:00010000:1.0:1746155578.590668:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcea00 00000100:00100000:1.0:1746155578.590792:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5029 00000100:00100000:1.0:1746155578.590799:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976124070144:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155578.596332:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155578.597904:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976124070144:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7101us (7353us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746155578.597915:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5029 00002000:00100000:1.0:1746155578.597924:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012cdcea00 x1830976124070144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155578.597933:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcea00 with x1830976124070144 ext(4194304->4956159) 00002000:00010000:1.0:1746155578.597938:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcea00 00000100:00100000:1.0:1746155578.597956:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124070400 00000100:00100000:1.0:1746155578.597962:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124070400 00002000:00100000:1.0:1746155578.597983:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012cdcc000 x1830976124070400/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/0 e 0 to 0 dl 1746155589 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155578.597989:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcc000 with x1830976124070400 ext(4194304->4956159) 00002000:00010000:1.0:1746155578.597992:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcc000 00000100:00100000:3.0:1746155578.598220:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5030 00000100:00100000:3.0:1746155578.598229:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976124070400:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155578.608532:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1962:x1830976124070400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10297us (12198us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746155578.608541:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5030 00002000:00100000:3.0:1746155578.608551:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3d9:0x0] (4194304->4956159) req@ffff88012cdcc000 x1830976124070400/t0(0) o3->3d945b30-7920-46f6-8969-58d0dfd965e1@192.168.202.51@tcp:649/0 lens 488/440 e 0 to 0 dl 1746155589 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155578.608559:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdcc000 with x1830976124070400 ext(4194304->4956159) 00002000:00010000:3.0:1746155578.608564:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdcc000 00000100:00100000:1.0:1746155578.608826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.609259:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124070656 00000100:00100000:2.0:1746155578.609266:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124070656 00000100:00100000:2.0:1746155578.610302:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4144 00000100:00100000:2.0:1746155578.610313:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a1abc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29537:x1830976124070656:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155578.610571:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a1abc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29537:x1830976124070656:12345-192.168.202.51@tcp:35:cat.0 Request processed in 260us (1744us total) trans 8589944151 rc 0/0 00000100:00100000:2.0:1746155578.610577:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4144 00000100:00100000:0.0:1746155578.614422:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155578.614494:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124070912 00000100:00100000:2.0:1746155578.614519:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124070912 00000100:00100000:2.0:1746155578.614552:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4145 00000100:00100000:2.0:1746155578.614559:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+8:29536:x1830976124070912:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155578.614741:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29536:x1830976124070912:12345-192.168.202.51@tcp:35:cat.0 Request processed in 182us (325us total) trans 8589944152 rc 0/0 00000100:00100000:2.0:1746155578.614748:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4145 00010000:00010000:2.0:1746155579.141905:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155579.506385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155579.506412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155579.506434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155579.506454:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124071040 00000100:00100000:3.0:1746155579.506459:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124071168 00000100:00100000:0.0:1746155579.506461:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124071040 00000100:00100000:3.0:1746155579.506462:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124071168 00000100:00080000:2.0:1746155579.506531:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746155579.506535:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746155579.506539:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124071424 00000100:00100000:3.0:1746155579.506542:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124071424 00000100:00100000:3.0:1746155579.510016:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12820 00000100:00100000:0.0:1746155579.510077:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12821 00000100:00100000:0.0:1746155579.510087:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1962:x1830976124071040:12345-192.168.202.51@tcp:16:kworker.0 00000100:00100000:1.0:1746155579.510121:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12822 00000100:00100000:1.0:1746155579.510129:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976124071424:12345-192.168.202.51@tcp:16:kworker.0 00000100:00100000:0.0:1746155579.510203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155579.510271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155579.510296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155579.510306:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124071680 00000100:00100000:0.0:1746155579.510311:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124071680 00000100:00100000:0.0:1746155579.510329:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124071296 00000100:00100000:0.0:1746155579.510331:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124071296 00000100:00100000:0.0:1746155579.510339:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124071552 00000100:00100000:0.0:1746155579.510341:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124071552 00000100:00100000:0.0:1746155579.510351:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12823 00000100:00100000:0.0:1746155579.510355:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976124071680:12345-192.168.202.51@tcp:16:kworker.0 00000100:00100000:0.0:1746155579.510384:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12824 00000100:00100000:0.0:1746155579.510388:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976124071296:12345-192.168.202.51@tcp:16:kworker.0 00000100:00100000:2.0:1746155579.510455:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12825 00000100:00100000:2.0:1746155579.510461:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1963:x1830976124071552:12345-192.168.202.51@tcp:16:kworker.0 00000100:00100000:3.0:1746155579.513300:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+22:1963:x1830976124071168:12345-192.168.202.51@tcp:16:kworker.0 00000001:00080000:3.0:1746155579.615041:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873336 is committed 00000001:00080000:3.0:1746155579.615068:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873284 is committed 00000001:00080000:3.0:1746155579.615075:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873269 is committed 00000001:00080000:3.0:1746155579.615080:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873316 is committed 00000001:00080000:3.0:1746155579.615085:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873304 is committed 00000001:00080000:3.0:1746155579.615098:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873274 is committed 00000001:00080000:3.0:1746155579.615105:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873340 is committed 00000001:00080000:3.0:1746155579.615166:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873305 is committed 00000100:00100000:3.0:1746155579.615254:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1963:x1830976124071168:12345-192.168.202.51@tcp:16:kworker.0 Request processed in 105225us (108836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155579.615264:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12820 00000100:00100000:0.0:1746155579.615744:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1963:x1830976124071296:12345-192.168.202.51@tcp:16:kworker.0 Request processed in 105354us (105470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155579.615751:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12824 00000100:00100000:1.0:1746155579.615870:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1963:x1830976124071680:12345-192.168.202.51@tcp:16:kworker.0 Request processed in 105513us (105665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155579.615877:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12823 00000100:00100000:0.0:1746155579.616939:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+26:1962:x1830976124071040:12345-192.168.202.51@tcp:16:kworker.0 Request processed in 106854us (110560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155579.616946:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12821 00000100:00100000:2.0:1746155579.617016:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:3d945b30-7920-46f6-8969-58d0dfd965e1+25:1963:x1830976124071424:12345-192.168.202.51@tcp:16:kworker.0 Request processed in 106887us (110579us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155579.617023:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12822 00000100:00100000:2.0:1746155579.617063:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+24:1963:x1830976124071552:12345-192.168.202.51@tcp:16:kworker.0 Request processed in 106602us (106766us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155579.617068:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12825 00000001:00080000:2.0:1746155579.617084:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840736 is committed 00000001:00080000:2.0:1746155579.617113:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840679 is committed 00000001:00080000:2.0:1746155579.617119:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840665 is committed 00000001:00080000:2.0:1746155579.617126:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840740 is committed 00000001:00080000:2.0:1746155579.617131:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840711 is committed 00000001:00080000:2.0:1746155579.617144:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840668 is committed 00000001:00080000:2.0:1746155579.617148:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840739 is committed 00000001:00080000:2.0:1746155579.617197:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840742 is committed 00000001:00080000:2.0:1746155579.617205:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840741 is committed 00000001:00080000:2.0:1746155579.617212:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840712 is committed 00000100:00100000:0.0:1746155579.633120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155579.633190:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124071936 00000100:00100000:2.0:1746155579.633198:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124071936 00000100:00100000:2.0:1746155579.633255:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4146 00000100:00100000:2.0:1746155579.633262:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+9:29562:x1830976124071936:12345-192.168.202.51@tcp:35:umount.0 00000100:00100000:2.0:1746155579.633463:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d945b30-7920-46f6-8969-58d0dfd965e1+10:29562:x1830976124071936:12345-192.168.202.51@tcp:35:umount.0 Request processed in 201us (349us total) trans 8589944153 rc 0/0 00000100:00100000:2.0:1746155579.633479:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4146 00000100:00080000:0.0:1746155579.633575:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155579.637869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155579.637902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155579.637926:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124072064 00000100:00100000:2.0:1746155579.637935:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124072064 00000100:00100000:0.0:1746155579.637936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155579.639032:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124072320 00000100:00100000:2.0:1746155579.639037:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124072320 00000100:00100000:2.0:1746155579.639055:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124072192 00000100:00100000:2.0:1746155579.639057:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124072192 00000100:00100000:2.0:1746155579.639069:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 617 00000100:00100000:2.0:1746155579.639076:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:06793f43-a06c-4add-b66d-476e36bacde6+17:1962:x1830976124072064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155579.639088:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155579.639104:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009a27c400/0x844e5faceb5e0c5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0a94f expref: 17 pid: 14230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155579.639119:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155579.639143:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 618 00000100:00100000:1.0:1746155579.639150:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:06793f43-a06c-4add-b66d-476e36bacde6+16:1962:x1830976124072320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155579.639153:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:06793f43-a06c-4add-b66d-476e36bacde6+16:1962:x1830976124072064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 77us (1291us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155579.639158:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155579.639160:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 617 00010000:00010000:1.0:1746155579.639165:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009bddae00/0x844e5faceb5e0c6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0a980 expref: 16 pid: 14230 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155579.639172:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 619 00010000:00010000:1.0:1746155579.639175:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155579.639176:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:06793f43-a06c-4add-b66d-476e36bacde6+14:1962:x1830976124072192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155579.639182:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155579.639187:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009bdda000/0x844e5faceb5e0c63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0a979 expref: 14 pid: 14230 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155579.639188:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:06793f43-a06c-4add-b66d-476e36bacde6+14:1962:x1830976124072320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 40us (1286us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155579.639193:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155579.639193:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 618 00000100:00100000:2.0:1746155579.639203:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:06793f43-a06c-4add-b66d-476e36bacde6+12:1962:x1830976124072192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 26us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155579.639207:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 619 00000100:00100000:0.0:1746155579.640243:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155579.640522:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124072832 00000100:00100000:2.0:1746155579.640526:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124072832 00000100:00100000:2.0:1746155579.640549:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12826 00000100:00100000:2.0:1746155579.640555:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1959:x1830976124072832:12345-192.168.202.51@tcp:9:umount.0 00000020:00000080:2.0:1746155579.640576:0:8437:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x844e5faceb5e0c7f 00000020:00010000:2.0:1746155579.640583:0:8437:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a6476800: total 0 00000100:00080000:2.0:1746155579.640586:0:8437:0:(import.c:66:import_set_state_nolock()) ffff8800a646e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746155579.640622:0:8437:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873340 00000100:00100000:2.0:1746155579.640810:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+6:1959:x1830976124072832:12345-192.168.202.51@tcp:9:umount.0 Request processed in 254us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155579.640816:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12826 00000020:00010000:3.0:1746155579.640866:0:7066:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a6476800: total 0 00010000:00010000:3.0:1746155579.640892:0:7066:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a6476800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746155579.640927:0:7066:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135fe2e00/0x844e5faceb5ed60c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12056 expref: 5 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155579.640962:0:7066:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd50000/0x844e5faceb5ed5d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1201e expref: 4 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155579.640977:0:7066:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009417e800/0x844e5faceb5ed5a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fed expref: 3 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155579.640991:0:7066:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a6476800, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746155579.641002:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746155579.641004:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746155579.641005:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155579.657660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155579.657721:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124073344 00000100:00100000:2.0:1746155579.657729:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124073344 00000100:00100000:2.0:1746155579.657769:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12827 00000100:00100000:2.0:1746155579.657775:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+8:1959:x1830976124073344:12345-192.168.202.51@tcp:9:umount.0 00000020:00000080:2.0:1746155579.657797:0:8437:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x844e5faceb5e0c78 00000020:00010000:2.0:1746155579.657803:0:8437:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a6470800: total 0 00000100:00080000:2.0:1746155579.657805:0:8437:0:(import.c:66:import_set_state_nolock()) ffff8800a6475000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746155579.657835:0:8437:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840742 00000020:00010000:3.0:1746155579.658179:0:7065:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a6470800: total 0 00010000:00010000:3.0:1746155579.658208:0:7065:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a6470800, canceled 0 locks, left on hash table 3. 00002000:00010000:3.0:1746155579.658229:0:7065:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1893 -> 1895 00010000:00010000:3.0:1746155579.658247:0:7065:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f089600/0x844e5faceb5ed55d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fbc expref: 6 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155579.658281:0:7065:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f874a00/0x844e5faceb5ed5e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12033 expref: 5 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155579.658295:0:7065:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135ff5600/0x844e5faceb5ed613 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1205d expref: 4 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155579.658303:0:7065:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a6470800, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746155579.658311:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746155579.658313:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746155579.658314:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746155579.658349:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d945b30-7920-46f6-8969-58d0dfd965e1+2:1959:x1830976124073344:12345-192.168.202.51@tcp:9:umount.0 Request processed in 572us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155579.658355:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12827 00000100:00100000:0.0:1746155579.663464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155579.663589:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124073728 00000100:00100000:2.0:1746155579.663596:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124073728 00000100:00100000:2.0:1746155579.663641:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10173 00000100:00100000:2.0:1746155579.663648:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+10:1959:x1830976124073728:12345-192.168.202.51@tcp:39:umount.0 00000020:00000080:2.0:1746155579.665808:0:20364:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x844e5faceb5e0c71 00000020:00010000:2.0:1746155579.665826:0:20364:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a6475800: total 0 00000100:00080000:2.0:1746155579.665829:0:20364:0:(import.c:66:import_set_state_nolock()) ffff8800a6474000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746155579.665856:0:20364:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589944153 00000100:00100000:2.0:1746155579.666116:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3d945b30-7920-46f6-8969-58d0dfd965e1+9:1959:x1830976124073728:12345-192.168.202.51@tcp:39:umount.0 Request processed in 2465us (2655us total) trans 8589944154 rc 0/0 00000100:00100000:2.0:1746155579.666124:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10173 00000020:00010000:0.0:1746155579.666216:0:884:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a6475800: total 0 00010000:00010000:0.0:1746155579.666254:0:884:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a6475800, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1746155579.666285:0:884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:0.0:1746155579.666288:0:884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746155579.666293:0:884:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800986f8200/0x844e5faceb5e0d35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0aa28 expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155579.666316:0:884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:0.0:1746155579.666319:0:884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155579.666322:0:884:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d600/0x844e5faceb5ed556 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fc3 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155579.666330:0:884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:0.0:1746155579.666332:0:884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155579.666334:0:884:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40e00/0x844e5faceb5ed5b1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12002 expref: 6 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155579.666342:0:884:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a6475800, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1746155579.666350:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746155579.666352:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746155579.666353:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746155580.142815:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155580.183882:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.183917:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.183941:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124073984 00000100:00100000:3.0:1746155580.183949:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124073984 00000100:00100000:0.0:1746155580.183956:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.183984:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124073856 00000100:00100000:3.0:1746155580.183985:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124073856 00000100:00100000:0.0:1746155580.183987:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124074112 00000100:00100000:0.0:1746155580.183990:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124074112 00000100:00100000:3.0:1746155580.184012:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 620 00000100:00100000:3.0:1746155580.184386:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06793f43-a06c-4add-b66d-476e36bacde6+14:1962:x1830976124073984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155580.184400:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155580.184416:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880129f87c00/0x844e5faceb5e0c8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0a9d4 expref: 14 pid: 14230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.184432:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155580.184473:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06793f43-a06c-4add-b66d-476e36bacde6+13:1962:x1830976124073984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 445us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155580.186109:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 621 00000100:00100000:0.0:1746155580.186121:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06793f43-a06c-4add-b66d-476e36bacde6+13:1962:x1830976124073856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155580.186131:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155580.186145:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880129f87e00/0x844e5faceb5e0c86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0a9aa expref: 13 pid: 14231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.186159:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155580.186183:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06793f43-a06c-4add-b66d-476e36bacde6+12:1962:x1830976124073856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 66us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155580.186189:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 621 00000100:00100000:0.0:1746155580.186212:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 622 00000100:00100000:0.0:1746155580.186219:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d759450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06793f43-a06c-4add-b66d-476e36bacde6+11:1962:x1830976124074112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155580.186224:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155580.186231:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880129f86000/0x844e5faceb5e0c94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0a9db expref: 11 pid: 14231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.186238:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155580.186346:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155580.186432:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124074624 00000100:00100000:1.0:1746155580.186437:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124074624 00000100:00100000:1.0:1746155580.186476:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12828 00000100:00100000:1.0:1746155580.186482:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+8:1959:x1830976124074624:12345-192.168.202.51@tcp:9:umount.0 00000020:00000080:1.0:1746155580.186499:0:8437:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x844e5faceb5e0ca9 00000020:00010000:1.0:1746155580.186516:0:8437:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800b52aa800: total 0 00000100:00080000:1.0:1746155580.186519:0:8437:0:(import.c:66:import_set_state_nolock()) ffff88009be0a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746155580.186543:0:8437:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873340 00000100:00100000:1.0:1746155580.186656:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1959:x1830976124074624:12345-192.168.202.51@tcp:9:umount.0 Request processed in 175us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155580.186662:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12828 00000100:00080000:1.0:1746155580.186698:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:1.0:1746155580.186707:0:7066:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800b52aa800: total 0 00010000:00010000:1.0:1746155580.186709:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746155580.186724:0:7066:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800b52aa800, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1746155580.186755:0:7066:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc9e00/0x844e5faceb5ed499 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f7d expref: 5 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155580.186773:0:7066:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd51c00/0x844e5faceb5ed484 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f76 expref: 4 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155580.186784:0:7066:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd51600/0x844e5faceb5ed492 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f92 expref: 3 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155580.186791:0:7066:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800b52aa800, canceled 3 locks, left on hash table 0. 00010000:00010000:1.0:1746155580.186797:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746155580.186798:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746155580.186799:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746155580.187078:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 620 00000100:00100000:0.0:1746155580.189310:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d759450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06793f43-a06c-4add-b66d-476e36bacde6+9:1962:x1830976124074112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3084us (5347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155580.189320:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 622 00000100:00100000:0.0:1746155580.192381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155580.193267:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124075008 00000100:00100000:1.0:1746155580.193276:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124075008 00000100:00100000:1.0:1746155580.193331:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12829 00000100:00100000:1.0:1746155580.193338:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+7:1959:x1830976124075008:12345-192.168.202.51@tcp:9:umount.0 00000020:00000080:1.0:1746155580.193362:0:29728:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x844e5faceb5e0ca2 00000020:00010000:1.0:1746155580.193368:0:29728:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a646f800: total 0 00000100:00080000:1.0:1746155580.193372:0:29728:0:(import.c:66:import_set_state_nolock()) ffff880129d8a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746155580.193411:0:29728:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840742 00000020:00010000:3.0:1746155580.193422:0:7065:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a646f800: total 0 00010000:00010000:3.0:1746155580.193452:0:7065:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a646f800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1746155580.193497:0:7065:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b44fc00/0x844e5faceb5e12d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0ad23 expref: 6 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.193546:0:7065:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd51e00/0x844e5faceb5ed47d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11f6f expref: 5 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155580.193553:0:7065:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a646f800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1746155580.193561:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746155580.193562:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746155580.193564:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1746155580.193592:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746155580.194086:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:834818df-1a1e-4d15-9e1d-5cedb28f094a+2:1959:x1830976124075008:12345-192.168.202.51@tcp:9:umount.0 Request processed in 747us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155580.194092:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12829 00000100:00100000:0.0:1746155580.199438:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.199538:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124075264 00000100:00100000:2.0:1746155580.199546:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124075264 00000100:00100000:2.0:1746155580.199600:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10174 00000100:00100000:2.0:1746155580.199608:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+6:1959:x1830976124075264:12345-192.168.202.51@tcp:39:umount.0 00000020:00000080:2.0:1746155580.199634:0:20364:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x844e5faceb5e0c9b 00000020:00010000:2.0:1746155580.199639:0:20364:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800b52af000: total 0 00000100:00080000:2.0:1746155580.199642:0:20364:0:(import.c:66:import_set_state_nolock()) ffff8800b52a8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746155580.199655:0:20364:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589944154 00000100:00100000:2.0:1746155580.199824:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:834818df-1a1e-4d15-9e1d-5cedb28f094a+5:1959:x1830976124075264:12345-192.168.202.51@tcp:39:umount.0 Request processed in 217us (393us total) trans 8589944155 rc 0/0 00000100:00100000:2.0:1746155580.199830:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10174 00000020:00010000:2.0:1746155580.199855:0:884:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800b52af000: total 0 00010000:00010000:2.0:1746155580.199881:0:884:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800b52af000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1746155580.199903:0:884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:2.0:1746155580.199906:0:884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746155580.199912:0:884:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f400/0x844e5faceb5e0cb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f0aa05 expref: 4 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.199927:0:884:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800b52af000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1746155580.199934:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746155580.199936:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746155580.199937:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1746155580.200277:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155580.222035:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155580.222454:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124075392 00000100:00100000:1.0:1746155580.222462:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124075392 00000100:00100000:1.0:1746155580.222685:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10175 00000100:00100000:1.0:1746155580.222692:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29584:x1830976124075392:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155580.222709:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155580.222723:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009286f800/0x844e5faceb5ed61a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12064 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.222767:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fe00/0x844e5faceb5ed621 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.222776:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fe00/0x844e5faceb5ed621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.222784:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fe00/0x844e5faceb5ed621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.222794:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009286e600/0x844e5faceb5ed628 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.222799:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009286e600/0x844e5faceb5ed628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.222804:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009286e600/0x844e5faceb5ed628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.223005:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.223013:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fae expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.223019:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.223043:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fae expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.223052:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fae expref: 290 pid: 27374 timeout: 809 lvb_type: 0 00000100:00100000:1.0:1746155580.223061:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124704000:192.168.202.51@tcp:104: 00000100:00080000:0.0:1746155580.223188:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155580.223868:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155580.225387:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155580.226035:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124704000:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155580.226052:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:3.0:1746155580.226113:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124075648 00000100:00100000:3.0:1746155580.226118:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124075648 00000100:00100000:3.0:1746155580.226151:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4147 00000100:00100000:3.0:1746155580.226158:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:7660:x1830976124075648:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155580.226302:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:7660:x1830976124075648:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 144us (917us total) trans 8589944156 rc 0/0 00000100:00100000:3.0:1746155580.226309:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4147 00000100:00100000:0.0:1746155580.228026:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.228237:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124075776 00000100:00100000:2.0:1746155580.228242:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124075776 00010000:00010000:2.0:1746155580.228268:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fae expref: 292 pid: 27374 timeout: 809 lvb_type: 0 00000100:00100000:2.0:1746155580.228302:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6490 00000100:00100000:2.0:1746155580.228308:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:1960:x1830976124075776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155580.228318:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155580.228324:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fae expref: 292 pid: 27374 timeout: 809 lvb_type: 0 00010000:00010000:2.0:1746155580.228333:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fae expref: 292 pid: 27374 timeout: 809 lvb_type: 0 00010000:00010000:2.0:1746155580.228350:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c94d400/0x844e5faceb5ed541 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fae expref: 292 pid: 27374 timeout: 809 lvb_type: 0 00010000:00010000:2.0:1746155580.228379:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:2.0:1746155580.228383:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.228389:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.228395:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.228408:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155580.228417:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228424:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155580.228431:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1960:x1830976124075776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 123us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.228436:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6490 00000004:00200000:1.0:1746155580.228450:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:1.0:1746155580.228458:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155580.228479:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228489:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228496:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fe00/0x844e5faceb5ed621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228520:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fe00/0x844e5faceb5ed621 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228526:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fe00/0x844e5faceb5ed621 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228531:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009286fe00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155580.228534:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fe00/0x844e5faceb5ed621 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228539:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fe00/0x844e5faceb5ed621 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228546:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009c823c00) 00010000:00010000:1.0:1746155580.228548:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155580.228550:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fe00/0x844e5faceb5ed621 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228554:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fe00/0x844e5faceb5ed621 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228563:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009286e600/0x844e5faceb5ed628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228567:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009286e600/0x844e5faceb5ed628 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228571:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009286e600/0x844e5faceb5ed628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228575:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009286e600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155580.228577:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009286e600/0x844e5faceb5ed628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228580:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009286e600/0x844e5faceb5ed628 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228589:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fe51f00) 00010000:00010000:1.0:1746155580.228591:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155580.228593:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009286e600/0x844e5faceb5ed628 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228596:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009286e600/0x844e5faceb5ed628 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.228620:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009286f800/0x844e5faceb5ed61a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12064 expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.228629:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12064 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.228633:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155580.228635:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155580.228637:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009286fa00, rc 0) 00000100:00100000:1.0:1746155580.228672:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29584:x1830976124075392:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5980us (6645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155580.228677:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10175 00000100:00100000:0.0:1746155580.232592:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155580.233032:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124076032 00000100:00100000:1.0:1746155580.233039:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124076032 00000100:00100000:1.0:1746155580.233136:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10176 00000100:00100000:1.0:1746155580.233144:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:29584:x1830976124076032:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155580.233163:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155580.233177:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009286e000/0x844e5faceb5ed636 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1206b expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.233258:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.233269:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12064 expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.233275:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.233300:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12064 expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.233309:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12064 expref: 291 pid: 14234 timeout: 809 lvb_type: 0 00000100:00100000:1.0:1746155580.233320:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124704128:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155580.233885:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155580.235290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.235607:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124076160 00000100:00100000:2.0:1746155580.235614:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124076160 00010000:00010000:2.0:1746155580.235637:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12064 expref: 292 pid: 14234 timeout: 809 lvb_type: 0 00000100:00100000:2.0:1746155580.235659:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6491 00000100:00100000:2.0:1746155580.235671:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:1961:x1830976124076160:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155580.235681:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155580.235685:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12064 expref: 292 pid: 14234 timeout: 809 lvb_type: 0 00010000:00010000:2.0:1746155580.235693:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12064 expref: 292 pid: 14234 timeout: 809 lvb_type: 0 00000100:00100000:1.0:1746155580.235710:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124704128:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155580.235889:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fa00/0x844e5faceb5ed62f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12064 expref: 292 pid: 14234 timeout: 809 lvb_type: 0 00010000:00010000:1.0:1746155580.235889:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.235901:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:2.0:1746155580.235905:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.235912:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.235918:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.235948:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155580.235987:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1961:x1830976124076160:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 316us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.235993:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6491 00010000:00010000:1.0:1746155580.236203:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.236209:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155580.236224:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:1.0:1746155580.236333:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009286e000/0x844e5faceb5ed636 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1206b expref: 292 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.236348:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1206b expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.236354:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155580.236356:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155580.236358:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009286fc00, rc 0) 00000100:00100000:1.0:1746155580.236596:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29584:x1830976124076032:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3451us (4008us total) trans 8589944157 rc 0/0 00000100:00100000:1.0:1746155580.236601:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10176 00000100:00100000:0.0:1746155580.240272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155580.240382:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124076288 00000100:00100000:1.0:1746155580.240390:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124076288 00000100:00100000:1.0:1746155580.240434:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10177 00000100:00100000:1.0:1746155580.240442:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29584:x1830976124076288:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155580.240461:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155580.240485:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ce00/0x844e5faceb5ed64b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12072 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.240966:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ed652 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.240981:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1206b expref: 292 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.240987:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ed652 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.241012:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1206b expref: 292 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.241024:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1206b expref: 292 pid: 14234 timeout: 809 lvb_type: 0 00000100:00100000:1.0:1746155580.241034:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124704256:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155580.241110:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155580.243881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.243936:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124076416 00000100:00100000:2.0:1746155580.243943:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124076416 00000100:00100000:1.0:1746155580.243971:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976124704256:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155580.243972:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1206b expref: 293 pid: 14234 timeout: 809 lvb_type: 0 00010000:00010000:1.0:1746155580.243993:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ed652 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155580.244006:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6492 00000100:00100000:2.0:1746155580.244013:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1960:x1830976124076416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155580.244029:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155580.244033:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1206b expref: 293 pid: 14234 timeout: 809 lvb_type: 0 00010000:00010000:2.0:1746155580.244044:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1206b expref: 293 pid: 14234 timeout: 809 lvb_type: 0 00010000:00010000:2.0:1746155580.244060:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009286fc00/0x844e5faceb5ed63d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1206b expref: 293 pid: 14234 timeout: 809 lvb_type: 0 00010000:00010000:2.0:1746155580.244082:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:2.0:1746155580.244086:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ed652 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.244093:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ed652 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.244098:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ed652 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.244121:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155580.244143:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ed652 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155580.244150:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ed652 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155580.244153:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:1960:x1830976124076416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 140us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.244158:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6492 00000004:00200000:0.0:1746155580.244183:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:0.0:1746155580.244187:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155580.244200:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ed652 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155580.244227:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ce00/0x844e5faceb5ed64b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12072 expref: 292 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.245775:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ed652 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12072 expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.245784:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:0.0:1746155580.245787:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155580.245789:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b9ca00, rc 0) 00000100:00100000:0.0:1746155580.246012:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29584:x1830976124076288:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5570us (5747us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155580.246019:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10177 00000100:00100000:0.0:1746155580.248352:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.248478:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124076672 00000100:00100000:2.0:1746155580.248485:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124076672 00000100:00100000:2.0:1746155580.248535:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10178 00000100:00100000:2.0:1746155580.248541:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:29584:x1830976124076672:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155580.248557:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155580.248574:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047400/0x844e5faceb5ed659 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12079 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.248645:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046a00/0x844e5faceb5ed660 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.248656:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046a00/0x844e5faceb5ed660 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.248664:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046a00/0x844e5faceb5ed660 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155580.248673:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00010000:00010000:2.0:1746155580.248762:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047400/0x844e5faceb5ed659 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12079 expref: 294 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.248825:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046a00/0x844e5faceb5ed660 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12079 expref: 293 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.248832:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:2.0:1746155580.248835:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155580.248837:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c046a00, rc 0) 00000100:00100000:2.0:1746155580.248938:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:29584:x1830976124076672:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 395us (591us total) trans 8589944158 rc 0/0 00000100:00100000:2.0:1746155580.248943:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10178 00000100:00100000:0.0:1746155580.251575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.251610:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.251636:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.251652:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124076800 00000100:00100000:1.0:1746155580.251654:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124077056 00000100:00100000:1.0:1746155580.251658:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124077056 00000100:00100000:0.0:1746155580.251658:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124076800 00000100:00100000:0.0:1746155580.251698:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124077312 00000100:00100000:0.0:1746155580.251701:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124077312 00000100:00100000:2.0:1746155580.251703:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12830 00000100:00100000:2.0:1746155580.251712:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976124076800:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:0.0:1746155580.251712:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12831 00000100:00100000:0.0:1746155580.251716:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976124077312:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155580.251737:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.251737:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.251750:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cbad200/0x844e5faceb5ed548 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fb5 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.251750:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1204f expref: 14 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.251756:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155580.251756:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.251758:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155580.251758:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.251761:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.251761:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.251782:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cbad200/0x844e5faceb5ed548 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fb5 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.251782:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1204f expref: 14 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.251791:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cbad200/0x844e5faceb5ed548 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fb5 expref: 14 pid: 8436 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746155580.251791:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1204f expref: 14 pid: 29728 timeout: 809 lvb_type: 0 00000100:00100000:2.0:1746155580.251801:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124704384:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155580.251801:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124704512:192.168.202.51@tcp:104: 00000100:00080000:1.0:1746155580.251843:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746155580.251845:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155580.251858:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155580.251861:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12832 00000100:00100000:1.0:1746155580.251866:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976124077056:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155580.251882:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.251892:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f875600/0x844e5faceb5ed5e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1202c expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.252085:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.252087:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.252089:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.252104:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f875600/0x844e5faceb5ed5e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1202c expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.252112:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f875600/0x844e5faceb5ed5e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1202c expref: 20 pid: 18270 timeout: 809 lvb_type: 0 00000100:00100000:1.0:1746155580.252120:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124704640:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155580.252214:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155580.252218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.252253:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.252293:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124076928 00000100:00100000:3.0:1746155580.252298:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124076928 00000100:00100000:3.0:1746155580.252327:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124077184 00000100:00100000:3.0:1746155580.252329:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124077184 00000100:00100000:0.0:1746155580.252331:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.252341:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124077440 00000100:00100000:3.0:1746155580.252343:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124077440 00000100:00100000:0.0:1746155580.252349:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12833 00000100:00100000:0.0:1746155580.252354:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976124076928:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155580.252368:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.252377:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009417e400/0x844e5faceb5ed5aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ff4 expref: 22 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.252382:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155580.252384:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155580.252385:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.252397:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009417e400/0x844e5faceb5ed5aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ff4 expref: 22 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.252403:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009417e400/0x844e5faceb5ed5aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ff4 expref: 22 pid: 29728 timeout: 809 lvb_type: 0 00000100:00100000:0.0:1746155580.252410:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124704768:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155580.252430:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155580.252654:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155580.252900:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12834 00000100:00100000:1.0:1746155580.252906:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976124077184:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:3.0:1746155580.252907:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12835 00000100:00100000:3.0:1746155580.252915:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976124077440:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155580.252921:0:29728:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.252930:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1203a expref: 15 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.252932:0:9235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.252935:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.252936:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.252938:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.252943:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f874800/0x844e5faceb5ed5fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12048 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155580.252949:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.252951:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.252951:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1203a expref: 15 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.252953:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.252958:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1203a expref: 15 pid: 29728 timeout: 809 lvb_type: 0 00000100:00100000:1.0:1746155580.252965:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124704896:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155580.252969:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f874800/0x844e5faceb5ed5fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12048 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155580.252976:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f874800/0x844e5faceb5ed5fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12048 expref: 22 pid: 18270 timeout: 809 lvb_type: 1 00000100:00100000:3.0:1746155580.252984:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094869500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124705024:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155580.252987:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155580.253007:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155580.258693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.258703:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976124704512:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155580.258725:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.258792:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976124704384:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155580.258806:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155580.258811:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976124704896:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155580.258824:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124077568 00010000:00010000:0.0:1746155580.258826:0:29728:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.258828:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124077568 00010000:00010000:3.0:1746155580.258852:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cbad200/0x844e5faceb5ed548 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fb5 expref: 16 pid: 8436 timeout: 809 lvb_type: 0 00000100:00100000:3.0:1746155580.258873:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6493 00000100:00100000:3.0:1746155580.258881:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976124077568:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155580.258891:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155580.258909:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cbad200/0x844e5faceb5ed548 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fb5 expref: 16 pid: 8436 timeout: 809 lvb_type: 0 00010000:00010000:3.0:1746155580.258918:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cbad200/0x844e5faceb5ed548 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fb5 expref: 16 pid: 8436 timeout: 809 lvb_type: 0 00010000:00010000:3.0:1746155580.258936:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cbad200/0x844e5faceb5ed548 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fb5 expref: 16 pid: 8436 timeout: 809 lvb_type: 0 00010000:00010000:3.0:1746155580.258952:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.258954:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.258958:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.258965:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.258981:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155580.259013:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976124077568:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 131us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.259018:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6493 00000100:00100000:1.0:1746155580.259032:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976124704768:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155580.259043:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.259048:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.259054:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155580.259061:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976124704640:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155580.259069:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.259075:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.259081:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.259087:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.260491:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c046200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155580.260496:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.260519:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.260530:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.260536:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c046200/0x844e5faceb5ed675 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.260589:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976124076800:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 8878us (9019us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.260597:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12830 00000100:00100000:3.0:1746155580.260626:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094869500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976124705024:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155580.260639:0:9235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155580.262756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.262794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.262812:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.262865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.262939:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124077824 00000100:00100000:3.0:1746155580.262945:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124077824 00000100:00100000:1.0:1746155580.262966:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124077952 00010000:00010000:3.0:1746155580.262968:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f875600/0x844e5faceb5ed5e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1202c expref: 23 pid: 18270 timeout: 809 lvb_type: 0 00000100:00100000:1.0:1746155580.262970:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124077952 00010000:00010000:1.0:1746155580.262984:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1203a expref: 14 pid: 29728 timeout: 809 lvb_type: 0 00000100:00100000:3.0:1746155580.262987:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124077696 00000100:00100000:3.0:1746155580.262990:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124077696 00010000:00010000:3.0:1746155580.262997:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009417e400/0x844e5faceb5ed5aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ff4 expref: 24 pid: 29728 timeout: 809 lvb_type: 0 00000100:00100000:1.0:1746155580.263000:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124078080 00000100:00100000:1.0:1746155580.263002:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124078080 00000100:00100000:3.0:1746155580.263007:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6494 00010000:00010000:1.0:1746155580.263010:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1204f expref: 15 pid: 29728 timeout: 809 lvb_type: 0 00000100:00100000:3.0:1746155580.263013:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976124077824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155580.263021:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6495 00010000:00010000:3.0:1746155580.263022:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155580.263026:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976124077952:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155580.263033:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155580.263038:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f875600/0x844e5faceb5ed5e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1202c expref: 24 pid: 18270 timeout: 809 lvb_type: 0 00010000:00010000:1.0:1746155580.263044:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1203a expref: 15 pid: 29728 timeout: 809 lvb_type: 0 00010000:00010000:3.0:1746155580.263046:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f875600/0x844e5faceb5ed5e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1202c expref: 24 pid: 18270 timeout: 809 lvb_type: 0 00010000:00010000:1.0:1746155580.263053:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1203a expref: 15 pid: 29728 timeout: 809 lvb_type: 0 00010000:00010000:3.0:1746155580.263061:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f875600/0x844e5faceb5ed5e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1202c expref: 24 pid: 18270 timeout: 809 lvb_type: 0 00010000:00010000:1.0:1746155580.263065:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c94c400/0x844e5faceb5ed5f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1203a expref: 15 pid: 29728 timeout: 809 lvb_type: 0 00010000:00010000:3.0:1746155580.263070:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.263072:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.263075:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.263076:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263077:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.263079:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263082:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263085:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263096:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155580.263100:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155580.263120:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976124077824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 107us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155580.263120:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976124077952:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 94us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.263124:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6494 00000100:00100000:1.0:1746155580.263127:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6495 00000100:00100000:3.0:1746155580.263137:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6496 00000100:00100000:3.0:1746155580.263141:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d75a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976124077696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155580.263153:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155580.263160:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009417e400/0x844e5faceb5ed5aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ff4 expref: 22 pid: 29728 timeout: 809 lvb_type: 0 00010000:00010000:3.0:1746155580.263166:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009417e400/0x844e5faceb5ed5aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ff4 expref: 22 pid: 29728 timeout: 809 lvb_type: 0 00010000:00010000:3.0:1746155580.263174:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009417e400/0x844e5faceb5ed5aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ff4 expref: 22 pid: 29728 timeout: 809 lvb_type: 0 00010000:00010000:3.0:1746155580.263180:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.263181:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.263184:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263189:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263199:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155580.263209:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d75a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976124077696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 67us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155580.263211:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6497 00000100:00100000:3.0:1746155580.263215:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6496 00000100:00100000:1.0:1746155580.263218:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1962:x1830976124078080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155580.263225:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155580.263234:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1204f expref: 13 pid: 29728 timeout: 809 lvb_type: 0 00010000:00010000:1.0:1746155580.263241:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1204f expref: 13 pid: 29728 timeout: 809 lvb_type: 0 00010000:00010000:1.0:1746155580.263251:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135fe2a00/0x844e5faceb5ed605 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1204f expref: 13 pid: 29728 timeout: 809 lvb_type: 0 00010000:00010000:1.0:1746155580.263262:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.263263:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.263266:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263272:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263285:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155580.263301:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155580.263303:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1962:x1830976124078080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (438us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155580.263308:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155580.263308:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6497 00010000:00010000:3.0:1746155580.263323:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263325:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263328:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263330:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263334:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263339:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3d15c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155580.263341:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263342:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263346:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263348:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263353:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263358:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263362:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009460a800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155580.263363:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15c00/0x844e5faceb5ed66e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263364:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263370:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263377:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.263383:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5ed683 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.263389:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+11:1961:x1830976124077312:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 11672us (11752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.263395:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12831 00000100:00100000:1.0:1746155580.263412:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976124076928:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 11058us (11193us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155580.263418:0:29728:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155580.263418:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12833 00010000:00010000:3.0:1746155580.263423:0:29728:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263433:0:29728:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263437:0:29728:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263442:0:29728:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263447:0:29728:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b9de00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155580.263449:0:29728:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.263526:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.263534:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.263546:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.263552:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.263558:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.263562:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b9da00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155580.263565:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.263570:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.263579:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.263584:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9da00/0x844e5faceb5ed67c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155580.263625:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976124077056:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 11759us (12013us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.263630:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12832 00010000:00010000:3.0:1746155580.263962:0:29728:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263970:0:29728:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.263975:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9de00/0x844e5faceb5ed68a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.264224:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+10:1961:x1830976124077184:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 11317us (11969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.264229:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12834 00000100:00100000:0.0:1746155580.268590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155580.268738:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124078208 00000100:00100000:1.0:1746155580.268746:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124078208 00010000:00010000:1.0:1746155580.268772:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f874800/0x844e5faceb5ed5fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12048 expref: 19 pid: 18270 timeout: 809 lvb_type: 1 00000100:00100000:1.0:1746155580.268795:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6498 00000100:00100000:1.0:1746155580.268801:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976124078208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155580.268812:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155580.268829:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f874800/0x844e5faceb5ed5fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12048 expref: 19 pid: 18270 timeout: 809 lvb_type: 1 00010000:00010000:1.0:1746155580.268839:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f874800/0x844e5faceb5ed5fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12048 expref: 19 pid: 18270 timeout: 809 lvb_type: 1 00010000:00010000:1.0:1746155580.268857:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f874800/0x844e5faceb5ed5fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12048 expref: 19 pid: 18270 timeout: 809 lvb_type: 1 00010000:00010000:1.0:1746155580.268880:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.268882:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.268886:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.268893:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.268913:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155580.268945:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976124078208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 144us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155580.268949:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6498 00010000:00010000:3.0:1746155580.269015:0:9235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.269022:0:9235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.269037:0:9235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.269042:0:9235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.269048:0:9235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.269058:0:9235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca18800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155580.269060:0:9235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.269066:0:9235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.269074:0:9235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.269078:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5ed691 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.269112:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976124077440:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 16199us (16782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.269118:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12835 00000100:00100000:0.0:1746155580.271246:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.272495:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124078464 00000100:00100000:2.0:1746155580.272521:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124078464 00000100:00100000:2.0:1746155580.272585:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10179 00000100:00100000:2.0:1746155580.272593:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:29584:x1830976124078464:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155580.272639:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746155580.272659:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5ed652 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12072 expref: 293 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.272674:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090344200/0x844e5faceb5ed59c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11fdf expref: 292 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.272683:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc40200/0x844e5faceb5ed5b8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f11ffb expref: 291 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.272690:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:2.0:1746155580.272693:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155580.272716:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5ed698 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.272724:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5ed698 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.272731:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5ed698 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000040:00080000:2.0:1746155580.273873:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3008, 88 off252096 00000004:00080000:2.0:1746155580.273887:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709423383188ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.274097:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2938, 88 off245664 00000004:00080000:2.0:1746155580.274102:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709423598879ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.274389:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2940, 88 off245848 00000004:00080000:2.0:1746155580.274394:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709423891402ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.274408:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3009, 88 off252184 00000004:00080000:2.0:1746155580.274410:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709423907409ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.274432:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3010, 88 off252272 00000004:00080000:2.0:1746155580.274435:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709423932252ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.274614:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2941, 88 off245936 00000004:00080000:2.0:1746155580.274618:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709424115346ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.274638:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2942, 88 off246024 00000004:00080000:2.0:1746155580.274641:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709424137742ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.274647:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2943, 88 off246112 00000004:00080000:2.0:1746155580.274649:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709424146486ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.274657:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3011, 88 off252360 00000004:00080000:2.0:1746155580.274659:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709424155721ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.274667:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2944, 88 off246200 00000004:00080000:2.0:1746155580.274670:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709424166704ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.274676:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3012, 88 off252448 00000004:00080000:2.0:1746155580.274678:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709424175311ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.274685:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2945, 88 off246288 00000004:00080000:2.0:1746155580.274687:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709424183932ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.274693:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3013, 88 off252536 00000004:00080000:2.0:1746155580.274695:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709424192012ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.274701:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3014, 88 off252624 00000004:00080000:2.0:1746155580.274703:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709424199784ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.274709:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3015, 88 off252712 00000004:00080000:2.0:1746155580.274712:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709424208761ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.274718:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3016, 88 off252800 00000004:00080000:2.0:1746155580.274720:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709424217021ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.274726:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2946, 88 off246376 00000004:00080000:2.0:1746155580.274728:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709424225164ns, next at 645866785986ns, rc = 0 00000001:00080000:0.0:1746155580.304194:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944157 is committed 00000001:00080000:0.0:1746155580.304206:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944159 is committed 00000004:00080000:0.0:1746155580.304209:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2137 committed 00000004:00010000:3.0:1746155580.304283:0:14234:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008e26c700 reply state ffff88009fa21800 transno 8589944159 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5ed698 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:3.0:1746155580.304293:0:14234:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746155580.304375:0:14234:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000004:00080000:0.0:1746155580.304396:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2214 committed 00000004:00080000:0.0:1746155580.304401:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2213 committed 00000004:00080000:0.0:1746155580.304402:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2212 committed 00000004:00080000:0.0:1746155580.304404:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2211 committed 00000004:00080000:0.0:1746155580.304405:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2136 committed 00000004:00080000:0.0:1746155580.304407:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2210 committed 00000004:00080000:0.0:1746155580.304408:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2135 committed 00000004:00080000:0.0:1746155580.304410:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2209 committed 00000004:00080000:0.0:1746155580.304412:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2134 committed 00000004:00080000:0.0:1746155580.304413:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2133 committed 00000004:00080000:0.0:1746155580.304414:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2132 committed 00000004:00080000:0.0:1746155580.304416:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2208 committed 00000004:00080000:0.0:1746155580.304417:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2207 committed 00000004:00080000:0.0:1746155580.304418:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2131 committed 00000004:00080000:0.0:1746155580.304420:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2130 committed 00000004:00080000:0.0:1746155580.304421:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2206 committed 00000001:00100000:0.0:1746155580.304427:0:14318:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 834818df-1a1e-4d15-9e1d-5cedb28f094a 00000001:00080000:0.0:1746155580.304431:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944155 is committed 00000020:00000080:0.0:1746155580.304433:0:14318:0:(genops.c:904:class_export_put()) final put ffff8800b52af000/834818df-1a1e-4d15-9e1d-5cedb28f094a 00000001:00100000:0.0:1746155580.304443:0:14318:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3d945b30-7920-46f6-8969-58d0dfd965e1 00000001:00080000:0.0:1746155580.304446:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944154 is committed 00000020:00000080:0.0:1746155580.304451:0:14318:0:(genops.c:904:class_export_put()) final put ffff8800a6475800/3d945b30-7920-46f6-8969-58d0dfd965e1 00000100:00100000:2.0:1746155580.304713:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124705152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.304751:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.304782:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124705664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.304797:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.304813:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746155580.304817:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124705536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.304829:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.304838:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124706048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.304847:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155580.305268:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29584:x1830976124078464:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 32673us (34022us total) trans 8589944159 rc 0/0 00000100:00100000:3.0:1746155580.305276:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10179 00000020:00000080:3.0:1746155580.305298:0:286:0:(genops.c:863:class_export_destroy()) destroying export ffff8800b52af000/834818df-1a1e-4d15-9e1d-5cedb28f094a for lustre-MDT0000 00000020:00000080:3.0:1746155580.305338:0:286:0:(genops.c:863:class_export_destroy()) destroying export ffff8800a6475800/3d945b30-7920-46f6-8969-58d0dfd965e1 for lustre-MDT0000 00000020:00000080:3.0:1746155580.305365:0:286:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800b52a8000 for lustre-MDT0000 00000020:00000080:3.0:1746155580.305370:0:286:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800a6474000 for lustre-MDT0000 00000100:00100000:0.0:1746155580.305764:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124705280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.305864:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124706560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155580.305885:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.306152:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124707072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155580.306167:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155580.306184:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124705152 00000100:00100000:3.0:1746155580.306190:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124705152 00000100:00100000:3.0:1746155580.306224:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124705664 00000100:00100000:3.0:1746155580.306226:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124705664 00000100:00100000:3.0:1746155580.306236:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124705536 00000100:00100000:3.0:1746155580.306238:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124705536 00000100:00100000:3.0:1746155580.306246:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124706048 00000100:00100000:3.0:1746155580.306248:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124706048 00000100:00100000:3.0:1746155580.306257:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124706560 00000100:00100000:3.0:1746155580.306259:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124706560 00000100:00100000:3.0:1746155580.306274:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12836 00000100:00100000:3.0:1746155580.306280:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3298:x1830976124705152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155580.306477:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976124705152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 185us (1713us total) trans 17179873341 rc 0/0 00000100:00100000:3.0:1746155580.306483:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12836 00000100:00100000:3.0:1746155580.306498:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12837 00000100:00100000:3.0:1746155580.306519:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3298:x1830976124705664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155580.306616:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976124705664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (1817us total) trans 17179873342 rc 0/0 00000100:00100000:3.0:1746155580.306621:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12837 00000100:00100000:3.0:1746155580.306632:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12838 00000100:00100000:3.0:1746155580.306636:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3298:x1830976124705536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155580.306722:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976124705536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (1891us total) trans 17179873343 rc 0/0 00000100:00100000:3.0:1746155580.306727:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12838 00000100:00100000:3.0:1746155580.306736:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12839 00000100:00100000:3.0:1746155580.306740:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3298:x1830976124706048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155580.306816:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976124706048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (1967us total) trans 17179873344 rc 0/0 00000100:00100000:3.0:1746155580.306821:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12839 00000100:00100000:3.0:1746155580.306831:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12840 00000100:00100000:3.0:1746155580.306835:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3297:x1830976124706560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155580.306947:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3297:x1830976124706560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (1061us total) trans 21474840743 rc 0/0 00000100:00100000:3.0:1746155580.306952:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12840 00000100:00080000:3.0:1746155580.306976:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746155580.306978:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155580.307208:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.307223:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155580.307244:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124705792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155580.307265:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124705280 00000100:00100000:0.0:1746155580.307268:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124705280 00000100:00100000:0.0:1746155580.307285:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12841 00000100:00100000:0.0:1746155580.307290:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3295:x1830976124705280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155580.307389:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3295:x1830976124705280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (164us total) trans 17179873345 rc 0/0 00000100:00100000:0.0:1746155580.307395:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12841 00000100:00100000:2.0:1746155580.307789:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840739 gen 2 00000004:00080000:2.0:1746155580.307793:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c33b80, transno 21474840669 00000004:00080000:2.0:1746155580.307799:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c31500, transno 21474840670 00000004:00080000:2.0:1746155580.307801:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f882300, transno 21474840671 00000004:00080000:2.0:1746155580.307803:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c30e00, transno 21474840672 00000004:00080000:2.0:1746155580.307805:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c33800, transno 21474840673 00000004:00080000:2.0:1746155580.307807:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c31180, transno 21474840674 00000004:00080000:2.0:1746155580.307809:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b881880, transno 21474840675 00000004:00080000:2.0:1746155580.307811:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c30000, transno 21474840676 00000004:00080000:2.0:1746155580.307813:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c33480, transno 21474840677 00000004:00080000:2.0:1746155580.307815:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0ac4380, transno 21474840681 00000004:00080000:2.0:1746155580.307817:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe92680, transno 21474840682 00000004:00080000:2.0:1746155580.307819:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe90a80, transno 21474840683 00000004:00080000:2.0:1746155580.307821:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe92300, transno 21474840684 00000004:00080000:2.0:1746155580.307824:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe90000, transno 21474840685 00000004:00080000:2.0:1746155580.307826:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0ac5500, transno 21474840686 00000004:00080000:2.0:1746155580.307827:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe91500, transno 21474840687 00000004:00080000:2.0:1746155580.307829:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130899880, transno 21474840688 00000004:00080000:2.0:1746155580.307831:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0ac4e00, transno 21474840689 00000004:00080000:2.0:1746155580.307833:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe91c00, transno 21474840690 00000004:00080000:2.0:1746155580.307835:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f700a80, transno 21474840691 00000004:00080000:2.0:1746155580.307837:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f703800, transno 21474840692 00000004:00080000:2.0:1746155580.307839:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c32d80, transno 21474840693 00000004:00080000:2.0:1746155580.307841:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f882d80, transno 21474840694 00000004:00080000:2.0:1746155580.307843:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b883480, transno 21474840695 00000004:00080000:2.0:1746155580.307845:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f881180, transno 21474840696 00000004:00080000:2.0:1746155580.307847:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f702d80, transno 21474840697 00000004:00080000:2.0:1746155580.307849:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c31c00, transno 21474840698 00000004:00080000:2.0:1746155580.307851:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b882d80, transno 21474840701 00000004:00080000:2.0:1746155580.307853:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf6d80, transno 21474840702 00000004:00080000:2.0:1746155580.307855:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb7b100, transno 21474840703 00000004:00080000:2.0:1746155580.307858:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910caa00, transno 21474840704 00000004:00080000:2.0:1746155580.307860:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910cb100, transno 21474840705 00000004:00080000:2.0:1746155580.307862:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf6300, transno 21474840706 00000004:00080000:2.0:1746155580.307864:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910c8380, transno 21474840707 00000004:00080000:2.0:1746155580.307866:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf5f80, transno 21474840708 00000004:00080000:2.0:1746155580.307868:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3edf80, transno 21474840709 00000004:00080000:2.0:1746155580.307870:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c210a80, transno 21474840713 00000004:00080000:2.0:1746155580.307872:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c212680, transno 21474840714 00000004:00080000:2.0:1746155580.307874:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c213b80, transno 21474840715 00000004:00080000:2.0:1746155580.307876:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c213800, transno 21474840716 00000004:00080000:2.0:1746155580.307878:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c212300, transno 21474840717 00000004:00080000:2.0:1746155580.307880:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c210e00, transno 21474840718 00000004:00080000:2.0:1746155580.307882:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c211880, transno 21474840719 00000004:00080000:2.0:1746155580.307884:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c211f80, transno 21474840720 00000004:00080000:2.0:1746155580.307886:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9f100, transno 21474840721 00000004:00080000:2.0:1746155580.307888:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fef3800, transno 21474840722 00000004:00080000:2.0:1746155580.307890:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451ca80, transno 21474840723 00000004:00080000:2.0:1746155580.307892:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451fb80, transno 21474840724 00000004:00080000:2.0:1746155580.307894:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451ed80, transno 21474840725 00000004:00080000:2.0:1746155580.307895:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451c380, transno 21474840726 00000004:00080000:2.0:1746155580.307897:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451e680, transno 21474840727 00000004:00080000:2.0:1746155580.307899:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451c700, transno 21474840728 00000004:00080000:2.0:1746155580.307901:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009451ea00, transno 21474840729 00000004:00080000:2.0:1746155580.307903:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5ae2680, transno 21474840730 00000004:00080000:2.0:1746155580.307905:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366f800, transno 21474840731 00000004:00080000:2.0:1746155580.307907:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366d880, transno 21474840732 00000004:00080000:2.0:1746155580.307909:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366ca80, transno 21474840733 00000004:00080000:2.0:1746155580.307911:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9d180, transno 21474840734 00000004:00080000:2.0:1746155580.307913:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366d180, transno 21474840735 00000004:00080000:2.0:1746155580.307915:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1f1c00, transno 21474840736 00000004:00080000:2.0:1746155580.307918:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366c000, transno 21474840737 00000004:00080000:2.0:1746155580.307920:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1f1f80, transno 21474840738 00000004:00080000:2.0:1746155580.307922:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366df80, transno 21474840739 00000100:00100000:2.0:1746155580.307927:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008e26d500 x1830976124706560/t21474840743(21474840743) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155596 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:2.0:1746155580.307936:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26d500/2, rc 0, transno 21474840743 00000100:00100000:2.0:1746155580.307940:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124706560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155580.307945:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746155580.307951:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124706176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155580.307969:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.307980:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124706688:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155580.307993:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.308010:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124705408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.308026:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.308037:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124705920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.308049:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.308056:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124706432:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155580.308068:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.308076:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124706944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155580.308097:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.308117:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124707072 00000100:00100000:2.0:1746155580.308120:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124707072 00000100:00100000:2.0:1746155580.308134:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124706176 00000100:00100000:2.0:1746155580.308136:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124706176 00000100:00100000:2.0:1746155580.308144:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124706688 00000100:00100000:2.0:1746155580.308145:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124706688 00000100:00100000:2.0:1746155580.308151:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124705408 00000100:00100000:2.0:1746155580.308152:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124705408 00000100:00100000:2.0:1746155580.308158:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124705920 00000100:00100000:2.0:1746155580.308160:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124705920 00000100:00100000:2.0:1746155580.308165:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124706432 00000100:00100000:2.0:1746155580.308167:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124706432 00000100:00100000:2.0:1746155580.308172:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124706944 00000100:00100000:2.0:1746155580.308174:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124706944 00000100:00100000:2.0:1746155580.308181:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12842 00000100:00100000:2.0:1746155580.308186:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3297:x1830976124707072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155580.308284:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3297:x1830976124707072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (2115us total) trans 21474840744 rc 0/0 00000100:00100000:2.0:1746155580.308289:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12842 00000100:00100000:2.0:1746155580.308299:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12843 00000100:00100000:2.0:1746155580.308303:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3297:x1830976124706176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155580.308385:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3297:x1830976124706176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (415us total) trans 21474840745 rc 0/0 00000100:00100000:2.0:1746155580.308390:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12843 00000100:00100000:2.0:1746155580.308399:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12844 00000100:00100000:2.0:1746155580.308403:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3297:x1830976124706688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155580.308485:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3297:x1830976124706688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (490us total) trans 21474840746 rc 0/0 00000100:00100000:2.0:1746155580.308490:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12844 00000100:00100000:2.0:1746155580.308499:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12845 00000100:00100000:2.0:1746155580.308521:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976124705408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155580.308558:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12846 00000100:00100000:3.0:1746155580.308565:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976124705920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.308618:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3296:x1830976124705408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (591us total) trans 17179873346 rc 0/0 00000100:00100000:2.0:1746155580.308623:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12845 00000100:00100000:2.0:1746155580.308632:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12847 00000100:00100000:2.0:1746155580.308636:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3296:x1830976124706432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155580.308711:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3296:x1830976124705920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (660us total) trans 17179873347 rc 0/0 00000100:00100000:2.0:1746155580.308716:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976124706432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (647us total) trans 21474840747 rc 0/0 00000100:00100000:3.0:1746155580.308717:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12846 00000100:00100000:2.0:1746155580.308721:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12847 00000100:00100000:3.0:1746155580.308728:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12848 00000100:00100000:3.0:1746155580.308733:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3296:x1830976124706944:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746155580.308745:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5ed698 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.308753:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5ed698 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.308758:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5ed698 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.308764:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c046400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155580.308767:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5ed698 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.308773:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5ed698 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.308784:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:2.0:1746155580.308786:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155580.308790:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5ed698 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.308794:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5ed698 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00000100:00100000:3.0:1746155580.308825:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976124706944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (726us total) trans 21474840748 rc 0/0 00000100:00100000:2.0:1746155580.308826:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873340 gen 2 00000004:00080000:2.0:1746155580.308829:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f881f80, transno 17179873275 00000100:00100000:3.0:1746155580.308830:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12848 00000004:00080000:2.0:1746155580.308835:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f883800, transno 17179873276 00000004:00080000:2.0:1746155580.308837:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f881c00, transno 17179873277 00000004:00080000:2.0:1746155580.308839:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f883480, transno 17179873278 00000004:00080000:2.0:1746155580.308841:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f883b80, transno 17179873279 00000004:00080000:2.0:1746155580.308843:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f882680, transno 17179873280 00000004:00080000:2.0:1746155580.308844:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f883100, transno 17179873281 00000004:00080000:2.0:1746155580.308846:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f882a00, transno 17179873282 00000004:00080000:2.0:1746155580.308848:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf4000, transno 17179873286 00000004:00080000:2.0:1746155580.308850:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf7480, transno 17179873287 00000004:00080000:2.0:1746155580.308852:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf7100, transno 17179873288 00000004:00080000:2.0:1746155580.308854:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf5180, transno 17179873289 00000004:00080000:2.0:1746155580.308856:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf4e00, transno 17179873290 00000004:00080000:2.0:1746155580.308857:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf4700, transno 17179873291 00000004:00080000:2.0:1746155580.308860:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf5880, transno 17179873292 00000004:00080000:2.0:1746155580.308862:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf5c00, transno 17179873293 00000004:00080000:2.0:1746155580.308863:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb78380, transno 17179873294 00000004:00080000:2.0:1746155580.308865:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb7bb80, transno 17179873295 00000004:00080000:2.0:1746155580.308867:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb7aa00, transno 17179873296 00000004:00080000:2.0:1746155580.308869:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb78e00, transno 17179873297 00000004:00080000:2.0:1746155580.308871:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb79180, transno 17179873298 00000004:00080000:2.0:1746155580.308873:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb79500, transno 17179873299 00000004:00080000:2.0:1746155580.308874:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb78000, transno 17179873300 00000004:00080000:2.0:1746155580.308876:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb7a300, transno 17179873301 00000004:00080000:2.0:1746155580.308877:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9ce00, transno 17179873306 00000004:00080000:2.0:1746155580.308879:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9d880, transno 17179873307 00000004:00080000:2.0:1746155580.308881:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9f800, transno 17179873308 00000004:00080000:2.0:1746155580.308882:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9df80, transno 17179873309 00000004:00080000:2.0:1746155580.308884:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094085500, transno 17179873310 00000004:00080000:2.0:1746155580.308886:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9c000, transno 17179873311 00000004:00080000:2.0:1746155580.308887:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9f480, transno 17179873312 00000004:00080000:2.0:1746155580.308889:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9c380, transno 17179873313 00000004:00080000:2.0:1746155580.308891:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ed880, transno 17179873317 00000004:00080000:2.0:1746155580.308893:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013089aa00, transno 17179873318 00000004:00080000:2.0:1746155580.308895:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ec380, transno 17179873319 00000004:00080000:2.0:1746155580.308896:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130898380, transno 17179873320 00000004:00080000:2.0:1746155580.308898:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ece00, transno 17179873321 00000004:00080000:2.0:1746155580.308900:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130898a80, transno 17179873322 00000004:00080000:2.0:1746155580.308901:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3eca80, transno 17179873323 00000004:00080000:2.0:1746155580.308903:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130898700, transno 17179873324 00000004:00080000:2.0:1746155580.308904:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013089b100, transno 17179873325 00000004:00080000:2.0:1746155580.308906:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf7800, transno 17179873326 00000004:00080000:2.0:1746155580.308908:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013089bb80, transno 17179873327 00000004:00080000:2.0:1746155580.308910:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf7b80, transno 17179873328 00000004:00080000:2.0:1746155580.308912:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ee680, transno 17179873329 00000004:00080000:2.0:1746155580.308914:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095268a80, transno 17179873330 00000004:00080000:2.0:1746155580.308916:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf4380, transno 17179873331 00000004:00080000:2.0:1746155580.308918:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526a300, transno 17179873332 00000004:00080000:2.0:1746155580.308919:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095268380, transno 17179873333 00000004:00080000:2.0:1746155580.308921:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c212a00, transno 17179873334 00000004:00080000:2.0:1746155580.308924:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095269c00, transno 17179873335 00000004:00080000:2.0:1746155580.308925:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c210700, transno 17179873336 00000004:00080000:2.0:1746155580.308927:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526bb80, transno 17179873337 00000004:00080000:2.0:1746155580.308929:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c211c00, transno 17179873338 00000004:00080000:2.0:1746155580.308931:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526a680, transno 17179873339 00000004:00080000:2.0:1746155580.308933:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526b480, transno 17179873340 00000100:00100000:2.0:1746155580.308937:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800935bf480 x1830976124705408/t17179873346(17179873346) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155596 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746155580.308944:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935bf480/2, rc 0, transno 17179873346 00000100:00100000:2.0:1746155580.308947:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124705408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155580.308951:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124078592 00000100:00100000:3.0:1746155580.308955:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124078592 00000004:00080000:2.0:1746155580.308955:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c211500/2, rc 0, transno 17179873347 00000100:00100000:2.0:1746155580.308958:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124705920:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155580.308964:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26fb80/2, rc 0, transno 21474840747 00000100:00100000:2.0:1746155580.308967:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124706432:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155580.308972:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26ea00/2, rc 0, transno 21474840748 00000100:00100000:3.0:1746155580.308975:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10180 00000100:00100000:2.0:1746155580.308975:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124706944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155580.308980:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29584:x1830976124078592:12345-192.168.202.51@tcp:101:lfs.0 00000004:00080000:2.0:1746155580.308992:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5ae1c00/2, rc 0, transno 17179873344 00010000:00010000:3.0:1746155580.308994:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155580.308995:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124706048:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155580.309002:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935bd180/2, rc 0, transno 17179873341 00010000:00010000:3.0:1746155580.309005:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fefce00/0x844e5faceb5ed69f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12080 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155580.309005:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124705152:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155580.309012:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1f0700/2, rc 0, transno 17179873342 00000100:00100000:2.0:1746155580.309014:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124705664:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155580.309020:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1f1180/2, rc 0, transno 17179873343 00000100:00100000:2.0:1746155580.309022:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124705536:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746155580.309039:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fefce00/0x844e5faceb5ed69f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12080 expref: 287 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.309049:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fefce00/0x844e5faceb5ed69f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12080 expref: 287 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.309061:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:3.0:1746155580.309063:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155580.309065:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fefce00, rc 0) 00000100:00100000:3.0:1746155580.309090:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29584:x1830976124078592:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 110us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.309095:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10180 00000004:00080000:2.0:1746155580.309274:0:14277:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 2 in flight, 56 done 00000004:00080000:2.0:1746155580.309291:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26df80/2, rc 0, transno 21474840745 00000100:00100000:2.0:1746155580.309294:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124706176:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155580.309299:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26c380/2, rc 0, transno 21474840746 00000100:00100000:2.0:1746155580.309301:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124706688:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155580.309307:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26f100/2, rc 0, transno 21474840744 00000100:00100000:2.0:1746155580.309309:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124707072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155580.309579:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155580.309610:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124706304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155580.309630:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155580.309642:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124706816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155580.309653:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155580.309669:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935bfb80/2, rc 0, transno 17179873345 00000100:00100000:0.0:1746155580.309672:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124705280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155580.309936:0:14274:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 2 in flight, 63 done 00000100:00100000:0.0:1746155580.309970:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124705792 00000100:00100000:0.0:1746155580.309973:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124705792 00000100:00100000:0.0:1746155580.309987:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124706304 00000100:00100000:0.0:1746155580.309988:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124706304 00000100:00100000:0.0:1746155580.309997:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124706816 00000100:00100000:0.0:1746155580.309998:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124706816 00000100:00100000:0.0:1746155580.310008:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12849 00000100:00100000:0.0:1746155580.310012:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976124705792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155580.310108:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976124705792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (529us total) trans 17179873348 rc 0/0 00000100:00100000:0.0:1746155580.310114:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12849 00000100:00100000:0.0:1746155580.310124:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12850 00000100:00100000:0.0:1746155580.310128:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976124706304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155580.310180:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12851 00000100:00100000:3.0:1746155580.310186:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976124706816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155580.310222:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976124706304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (590us total) trans 21474840749 rc 0/0 00000100:00100000:0.0:1746155580.310227:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12850 00000004:00080000:0.0:1746155580.310249:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fef1500/2, rc 0, transno 17179873348 00000100:00100000:0.0:1746155580.310252:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124705792:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155580.310258:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26ed80/2, rc 0, transno 21474840749 00000100:00100000:0.0:1746155580.310261:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124706304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155580.310292:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976124706816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (636us total) trans 21474840750 rc 0/0 00000100:00100000:3.0:1746155580.310297:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12851 00000004:00080000:0.0:1746155580.310298:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26ce00/2, rc 0, transno 21474840750 00000100:00100000:0.0:1746155580.310302:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124706816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155580.310417:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124707200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155580.310437:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155580.311866:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124707200 00000100:00100000:0.0:1746155580.311872:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124707200 00000100:00100000:3.0:1746155580.312623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.313039:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12852 00000100:00100000:0.0:1746155580.313048:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976124707200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155580.313214:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3298:x1830976124707200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 167us (2774us total) trans 21474840751 rc 0/0 00000100:00100000:0.0:1746155580.313219:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12852 00000004:00080000:2.0:1746155580.313280:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26c000/2, rc 0, transno 21474840751 00000100:00100000:2.0:1746155580.313285:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124707200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.313351:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124078720 00000100:00100000:1.0:1746155580.313355:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124078720 00000100:00100000:1.0:1746155580.313498:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10181 00000100:00100000:1.0:1746155580.313516:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29584:x1830976124078720:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155580.313526:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155580.313538:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9c800/0x844e5faceb5ed6a6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12087 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.313598:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ce00/0x844e5faceb5ed6ad lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155580.313608:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ce00/0x844e5faceb5ed6ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155580.313617:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ce00/0x844e5faceb5ed6ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155580.313636:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35b:0x0]: returning size 9148576 00000004:00200000:1.0:1746155580.313640:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155580.313651:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ce00/0x844e5faceb5ed6ad lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155580.313669:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9c800/0x844e5faceb5ed6a6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12087 expref: 289 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.313680:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ce00/0x844e5faceb5ed6ad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12087 expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.313686:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155580.313688:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155580.313691:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b9ce00, rc 0) 00000100:00100000:1.0:1746155580.313718:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29584:x1830976124078720:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 215us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155580.313723:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10181 00000100:00100000:0.0:1746155580.318481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.318530:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124078848 00000100:00100000:2.0:1746155580.318538:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124078848 00000100:00100000:0.0:1746155580.318547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.318564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.318794:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124078976 00000100:00100000:2.0:1746155580.318797:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124078976 00000100:00100000:2.0:1746155580.318812:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124079104 00000100:00100000:0.0:1746155580.318812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.318813:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124079104 00000100:00100000:2.0:1746155580.318822:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124079232 00000100:00100000:2.0:1746155580.318823:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124079232 00000100:00100000:0.0:1746155580.318825:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.318832:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124079360 00000100:00100000:2.0:1746155580.318833:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124079360 00000100:00100000:2.0:1746155580.318844:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12853 00000100:00100000:2.0:1746155580.318850:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1960:x1830976124078848:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155580.318862:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155580.318875:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093480800/0x844e5faceb5ed6b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1208e expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155580.318894:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d6:0x0] initial LVB size: 1048576, mtime: 0x6814383a, atime: 0x6814383a, ctime: 0x6814383a, blocks: 0x767 00010000:00010000:2.0:1746155580.318907:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.318909:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.318916:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093480800/0x844e5faceb5ed6b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1208e expref: 13 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.318927:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093480800/0x844e5faceb5ed6b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1208e expref: 13 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.318935:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093480800, rc 0) 00000100:00100000:2.0:1746155580.318968:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976124078848:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 118us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.318972:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12853 00000100:00100000:2.0:1746155580.318984:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12854 00000100:00100000:2.0:1746155580.318987:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976124078976:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155580.318992:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155580.319000:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093481400/0x844e5faceb5ed6bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f12095 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155580.319016:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3da:0x0] initial LVB size: 2097152, mtime: 0x6814383a, atime: 0x6814383a, ctime: 0x6814383a, blocks: 0x821 00010000:00010000:2.0:1746155580.319022:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.319024:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.319027:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093481400/0x844e5faceb5ed6bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12095 expref: 19 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.319034:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093481400/0x844e5faceb5ed6bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12095 expref: 19 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.319044:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093481400, rc 0) 00000100:00100000:2.0:1746155580.319055:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976124078976:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 68us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.319059:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12854 00000100:00100000:2.0:1746155580.319066:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12855 00000100:00100000:2.0:1746155580.319070:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976124079104:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155580.319074:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155580.319080:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ed6c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1209c expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155580.319087:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3db:0x0] initial LVB size: 2097152, mtime: 0x6814383a, atime: 0x6814383a, ctime: 0x6814383a, blocks: 0x81f 00010000:00010000:2.0:1746155580.319092:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.319093:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.319096:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ed6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1209c expref: 19 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.319102:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ed6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1209c expref: 19 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.319107:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093481000, rc 0) 00000100:00100000:2.0:1746155580.319118:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976124079104:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 47us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.319121:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12855 00000100:00100000:2.0:1746155580.319127:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12856 00000100:00100000:2.0:1746155580.319131:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1960:x1830976124079232:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155580.319134:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155580.319140:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093480600/0x844e5faceb5ed6c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f120a3 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155580.319148:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d8:0x0] initial LVB size: 2097152, mtime: 0x6814383a, atime: 0x6814383a, ctime: 0x6814383a, blocks: 0x81f 00010000:00010000:2.0:1746155580.319153:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.319153:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.319156:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093480600/0x844e5faceb5ed6c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120a3 expref: 13 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.319163:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093480600/0x844e5faceb5ed6c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120a3 expref: 13 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.319168:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093480600, rc 0) 00000100:00100000:2.0:1746155580.319178:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976124079232:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 47us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.319182:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12856 00000100:00100000:2.0:1746155580.319188:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12857 00000100:00100000:2.0:1746155580.319192:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1960:x1830976124079360:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155580.319196:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155580.319196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155580.319201:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093480000/0x844e5faceb5ed6d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f120aa expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155580.319209:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3d9:0x0] initial LVB size: 4954272, mtime: 0x6814383a, atime: 0x6814383a, ctime: 0x6814383a, blocks: 0x1613 00010000:00010000:2.0:1746155580.319219:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.319221:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.319225:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093480000/0x844e5faceb5ed6d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120aa expref: 13 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.319232:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093480000/0x844e5faceb5ed6d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120aa expref: 13 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.319237:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093480000, rc 0) 00000100:00100000:2.0:1746155580.319249:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976124079360:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 57us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.319253:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12857 00000100:00100000:2.0:1746155580.319259:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124079488 00000100:00100000:2.0:1746155580.319261:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124079488 00000100:00100000:2.0:1746155580.319273:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12858 00000100:00100000:2.0:1746155580.319276:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976124079488:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155580.319281:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155580.319288:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093480200/0x844e5faceb5ed6d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f120b1 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155580.320172:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3dc:0x0] initial LVB size: 4194304, mtime: 0x6814383a, atime: 0x6814383a, ctime: 0x6814383a, blocks: 0x1029 00010000:00010000:2.0:1746155580.320185:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.320186:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.320191:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093480200/0x844e5faceb5ed6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b1 expref: 20 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.320204:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093480200/0x844e5faceb5ed6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b1 expref: 20 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.320211:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093480200, rc 0) 00000100:00100000:2.0:1746155580.320245:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976124079488:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 966us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.320250:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12858 00000100:00100000:0.0:1746155580.326216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.326287:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124079744 00000100:00100000:3.0:1746155580.326295:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124079744 00000100:00100000:3.0:1746155580.326355:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5031 00000100:00100000:3.0:1746155580.326363:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1963:x1830976124079744:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155580.326392:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fefd400/0x844e5faceb5ed6de lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.326405:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.326406:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.326410:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fefd400/0x844e5faceb5ed6de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.326421:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fefd400/0x844e5faceb5ed6de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155580.327672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.327869:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124080000 00000100:00100000:2.0:1746155580.327874:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124080000 00000100:00100000:2.0:1746155580.327912:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5032 00000100:00100000:2.0:1746155580.327917:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976124080000:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155580.327934:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ed6e5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.327943:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.327945:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.327947:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ed6e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.327956:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ed6e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155580.329545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155580.329589:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124080256 00000100:00100000:1.0:1746155580.329594:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124080256 00000100:00100000:1.0:1746155580.329623:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5033 00000100:00100000:1.0:1746155580.329628:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976124080256:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155580.329646:0:25391:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c800/0x844e5faceb5ed6ec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.329655:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.329656:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.329659:0:25391:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c800/0x844e5faceb5ed6ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.329666:0:25391:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c800/0x844e5faceb5ed6ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155580.334532:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155580.334571:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124080512 00000100:00100000:2.0:1746155580.334572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155580.334579:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124080512 00000100:00100000:1.0:1746155580.334619:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124080640 00000100:00100000:1.0:1746155580.334621:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124080640 00000100:00100000:1.0:1746155580.334636:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5034 00000100:00100000:1.0:1746155580.334643:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976124080512:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155580.334670:0:2798:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5ed6f3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.334682:0:2798:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.334684:0:2798:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.334687:0:2798:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5ed6f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.334698:0:2798:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5ed6f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.334733:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5035 00000100:00100000:3.0:1746155580.334740:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976124080640:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155580.334753:0:31253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fefdc00/0x844e5faceb5ed6fa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.334760:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.334761:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.334763:0:31253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fefdc00/0x844e5faceb5ed6fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.334769:0:31253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fefdc00/0x844e5faceb5ed6fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155580.337789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.339840:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.339873:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.341224:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124081280 00000100:00100000:3.0:1746155580.341233:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124081280 00000100:00100000:3.0:1746155580.341288:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124081152 00000100:00100000:3.0:1746155580.341291:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124081152 00000100:00100000:3.0:1746155580.341307:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124081536 00000100:00100000:3.0:1746155580.341309:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124081536 00000100:00100000:1.0:1746155580.341314:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5036 00000100:00100000:3.0:1746155580.341323:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5037 00000100:00100000:1.0:1746155580.341323:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976124081280:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:3.0:1746155580.341327:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976124081152:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155580.341348:0:10888:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b5257c00/0x844e5faceb5ed701 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.341348:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15000/0x844e5faceb5ed708 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.341362:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.341362:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.341364:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155580.341364:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.341368:0:10888:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5257c00/0x844e5faceb5ed701 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.341368:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15000/0x844e5faceb5ed708 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.341381:0:10888:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5257c00/0x844e5faceb5ed701 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.341381:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15000/0x844e5faceb5ed708 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155580.341843:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 5038 00000100:00100000:0.0:1746155580.341851:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976124081536:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155580.341866:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ed70f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.341877:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155580.341879:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155580.341881:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ed70f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.341889:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ed70f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.343839:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ed6e5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.343856:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ed6e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.343863:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ed6e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.343870:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093480400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155580.343874:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ed6e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.343881:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ed6e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.343895:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ed6e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.343901:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093480400/0x844e5faceb5ed6e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155580.343966:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976124080000:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 16043us (16291us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155580.343974:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5032 00010000:00010000:3.0:1746155580.351607:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fefd400/0x844e5faceb5ed6de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.351621:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fefd400/0x844e5faceb5ed6de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.351629:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fefd400/0x844e5faceb5ed6de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.351635:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fefd400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155580.351639:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fefd400/0x844e5faceb5ed6de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.351645:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fefd400/0x844e5faceb5ed6de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.351659:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fefd400/0x844e5faceb5ed6de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.351670:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fefd400/0x844e5faceb5ed6de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.351745:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976124079744:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 25378us (25532us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155580.351753:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5031 00010000:00010000:1.0:1746155580.359330:0:25391:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c800/0x844e5faceb5ed6ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.359346:0:25391:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c800/0x844e5faceb5ed6ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.359354:0:25391:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c800/0x844e5faceb5ed6ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.359360:0:25391:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b9c800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155580.359364:0:25391:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c800/0x844e5faceb5ed6ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.359370:0:25391:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c800/0x844e5faceb5ed6ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.359385:0:25391:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c800/0x844e5faceb5ed6ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.359391:0:25391:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b9c800/0x844e5faceb5ed6ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155580.359473:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976124080256:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 29830us (29915us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155580.359482:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5033 00010000:00010000:2.0:1746155580.359944:0:2798:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5ed6f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.359952:0:2798:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5ed6f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.359961:0:2798:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5ed6f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.359966:0:2798:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3d15600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155580.359968:0:2798:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5ed6f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.359974:0:2798:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5ed6f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.360025:0:2798:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5ed6f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.360032:0:2798:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5ed6f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155580.360064:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976124080512:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 25421us (25540us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155580.360070:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5034 00010000:00010000:3.0:1746155580.369185:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fefdc00/0x844e5faceb5ed6fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.369200:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fefdc00/0x844e5faceb5ed6fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.369207:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fefdc00/0x844e5faceb5ed6fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.369214:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fefdc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155580.369217:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fefdc00/0x844e5faceb5ed6fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.369224:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fefdc00/0x844e5faceb5ed6fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.369240:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fefdc00/0x844e5faceb5ed6fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.369246:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fefdc00/0x844e5faceb5ed6fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.369893:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976124080640:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 35149us (35315us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155580.369901:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5035 00010000:00010000:3.0:1746155580.373213:0:10888:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b5257c00/0x844e5faceb5ed701 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.373228:0:10888:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5257c00/0x844e5faceb5ed701 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.373234:0:10888:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b5257c00/0x844e5faceb5ed701 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.373240:0:10888:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5257c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155580.373243:0:10888:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b5257c00/0x844e5faceb5ed701 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.373248:0:10888:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b5257c00/0x844e5faceb5ed701 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.373263:0:10888:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b5257c00/0x844e5faceb5ed701 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.373268:0:10888:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5257c00/0x844e5faceb5ed701 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.373327:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976124081152:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 31995us (33488us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155580.373336:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5037 00010000:00010000:3.0:1746155580.377147:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ed70f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.377161:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ed70f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.377167:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ed70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.377172:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c052400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155580.377176:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ed70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.377182:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ed70f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.377196:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ed70f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.377202:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c052400/0x844e5faceb5ed70f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.377268:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976124081536:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 35414us (37390us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155580.377277:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5038 00010000:00010000:2.0:1746155580.379459:0:31250:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15000/0x844e5faceb5ed708 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.379481:0:31250:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15000/0x844e5faceb5ed708 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.379487:0:31250:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15000/0x844e5faceb5ed708 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.379498:0:31250:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3d15000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155580.379514:0:31250:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15000/0x844e5faceb5ed708 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.379521:0:31250:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15000/0x844e5faceb5ed708 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.379532:0:31250:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15000/0x844e5faceb5ed708 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.379538:0:31250:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15000/0x844e5faceb5ed708 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155580.379590:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1963:x1830976124081280:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 38266us (41803us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155580.379598:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 5036 00000100:00100000:0.0:1746155580.385410:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.385603:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124081792 00000100:00100000:2.0:1746155580.385611:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124081792 00000100:00100000:2.0:1746155580.385655:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10182 00000100:00100000:2.0:1746155580.385662:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29584:x1830976124081792:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155580.385703:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155580.385724:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ce00/0x844e5faceb5ed6ad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12087 expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.385746:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:2.0:1746155580.385750:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155580.385862:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f400/0x844e5faceb5ed716 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.385873:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f400/0x844e5faceb5ed716 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155580.385891:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f400/0x844e5faceb5ed716 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00010000:2.0:1746155580.386030:0:14234:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093a45c00 reply state ffff88012fef8000 transno 8589944160 ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f400/0x844e5faceb5ed716 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155580.386036:0:14234:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746155580.386101:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:29584:x1830976124081792:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 439us (698us total) trans 8589944160 rc 0/0 00000100:00100000:2.0:1746155580.386106:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10182 00010000:00010000:1.0:1746155580.388877:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f400/0x844e5faceb5ed716 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.388888:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f400/0x844e5faceb5ed716 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.388893:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f400/0x844e5faceb5ed716 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.388898:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132b0f400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155580.388902:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f400/0x844e5faceb5ed716 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.388908:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f400/0x844e5faceb5ed716 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155580.388921:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:1.0:1746155580.388923:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155580.388926:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f400/0x844e5faceb5ed716 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155580.388927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155580.388930:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0f400/0x844e5faceb5ed716 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155580.388973:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124081920 00000100:00100000:2.0:1746155580.388982:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124081920 00000100:00100000:2.0:1746155580.389021:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12859 00000100:00100000:2.0:1746155580.389028:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:29584:x1830976124081920:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155580.389069:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155580.389081:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed71d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f120b8 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.389101:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093480800/0x844e5faceb5ed6b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1208e expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.389108:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.389110:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.389113:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed71d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b8 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.389142:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093480800/0x844e5faceb5ed6b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1208e expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.389153:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093480800/0x844e5faceb5ed6b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1208e expref: 14 pid: 19959 timeout: 809 lvb_type: 1 00000100:00100000:2.0:1746155580.389163:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124707328:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155580.389236:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43ce6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155580.390718:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.390792:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124082048 00000100:00100000:3.0:1746155580.390799:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124082048 00010000:00010000:3.0:1746155580.390820:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093480800/0x844e5faceb5ed6b4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1208e expref: 15 pid: 19959 timeout: 809 lvb_type: 1 00000100:00100000:3.0:1746155580.390887:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6499 00000100:00100000:3.0:1746155580.390893:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976124082048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155580.390903:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155580.390910:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124707328:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155580.390923:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093480800/0x844e5faceb5ed6b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1208e expref: 15 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:2.0:1746155580.390931:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed71d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b8 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.391080:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093480800/0x844e5faceb5ed6b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1208e expref: 15 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:3.0:1746155580.391285:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093480800/0x844e5faceb5ed6b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1208e expref: 15 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:2.0:1746155580.391286:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.391288:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.391294:0:1625:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed71d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b8 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.391302:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed71d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b8 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.391310:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155580.391322:0:1625:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132b0fa00/0x844e5faceb5ed71d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b8 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155580.391331:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124707456:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155580.391376:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976124082048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 483us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.391383:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6499 00000100:00100000:2.0:1746155580.391603:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155580.392709:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124707456:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155580.392718:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b0fa00, rc 0) 00000100:00100000:2.0:1746155580.392737:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:29584:x1830976124081920:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3711us (3813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.392742:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12859 00000100:00100000:0.0:1746155580.393650:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.393705:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124082176 00000100:00100000:2.0:1746155580.393710:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124082176 00000100:00100000:2.0:1746155580.393818:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12860 00000100:00100000:2.0:1746155580.393825:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29584:x1830976124082176:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155580.393838:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155580.393849:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132b0e000/0x844e5faceb5ed724 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f120bf expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.393868:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093481400/0x844e5faceb5ed6bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12095 expref: 21 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.393874:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.393875:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.393878:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132b0e000/0x844e5faceb5ed724 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120bf expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.393897:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093481400/0x844e5faceb5ed6bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12095 expref: 21 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.393907:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093481400/0x844e5faceb5ed6bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12095 expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00000100:00100000:2.0:1746155580.393920:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124707584:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155580.394320:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43ce6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155580.395953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.396026:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124707584:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155580.396045:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132b0e000/0x844e5faceb5ed724 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120bf expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.396062:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b0e000, rc 0) 00000100:00100000:3.0:1746155580.396148:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124082304 00000100:00100000:3.0:1746155580.396152:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124082304 00010000:00010000:3.0:1746155580.396169:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093481400/0x844e5faceb5ed6bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12095 expref: 22 pid: 19959 timeout: 809 lvb_type: 1 00000100:00100000:2.0:1746155580.396334:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:29584:x1830976124082176:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2508us (2684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.396340:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12860 00000100:00100000:3.0:1746155580.396541:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6500 00000100:00100000:3.0:1746155580.396548:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976124082304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155580.396561:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155580.396578:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093481400/0x844e5faceb5ed6bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12095 expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:3.0:1746155580.396588:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093481400/0x844e5faceb5ed6bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12095 expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:3.0:1746155580.396604:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093481400/0x844e5faceb5ed6bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12095 expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:3.0:1746155580.396614:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.396615:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.396620:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132b0e000/0x844e5faceb5ed724 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120bf expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.396628:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132b0e000/0x844e5faceb5ed724 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120bf expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.396649:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132b0e000/0x844e5faceb5ed724 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120bf expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.396659:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094868700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124707712:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155580.396712:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155580.398304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.398386:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124082432 00000100:00100000:2.0:1746155580.398392:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124082432 00000100:00100000:2.0:1746155580.398416:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12861 00000100:00100000:2.0:1746155580.398422:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29584:x1830976124082432:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155580.398433:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155580.398445:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132b0ec00/0x844e5faceb5ed72b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f120c6 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.398472:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ed6c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1209c expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.398479:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.398481:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.398486:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132b0ec00/0x844e5faceb5ed72b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120c6 expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.398524:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ed6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1209c expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.398533:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ed6c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1209c expref: 22 pid: 19959 timeout: 809 lvb_type: 1 00000100:00100000:3.0:1746155580.398537:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094868700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124707712:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155580.398542:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124707840:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155580.398550:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155580.399016:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976124082304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2466us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.399024:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6500 00000100:00100000:2.0:1746155580.399027:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155580.400910:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124707840:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155580.400930:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132b0ec00/0x844e5faceb5ed72b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120c6 expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.400942:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b0ec00, rc 0) 00000100:00100000:2.0:1746155580.400969:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29584:x1830976124082432:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2547us (2668us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.400975:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12861 00000100:00100000:0.0:1746155580.401848:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.401902:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124082560 00000100:00100000:3.0:1746155580.401908:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124082560 00010000:00010000:3.0:1746155580.401929:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ed6c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1209c expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00000100:00100000:3.0:1746155580.401967:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6501 00000100:00100000:3.0:1746155580.401974:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976124082560:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155580.401984:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155580.402002:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ed6c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1209c expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:3.0:1746155580.402012:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ed6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1209c expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:3.0:1746155580.402029:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093481000/0x844e5faceb5ed6c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1209c expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:3.0:1746155580.402039:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.402041:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.402046:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132b0ec00/0x844e5faceb5ed72b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120c6 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.402053:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132b0ec00/0x844e5faceb5ed72b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120c6 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.402077:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132b0ec00/0x844e5faceb5ed72b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120c6 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.402088:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094868700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124707968:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155580.402157:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155580.405948:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.406066:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124082688 00000100:00100000:2.0:1746155580.406075:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124082688 00000100:00100000:2.0:1746155580.406116:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12862 00000100:00100000:2.0:1746155580.406123:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:29584:x1830976124082688:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155580.406140:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155580.406153:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132b0f200/0x844e5faceb5ed732 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f120cd expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.406183:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093480600/0x844e5faceb5ed6c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120a3 expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.406190:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.406191:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.406194:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132b0f200/0x844e5faceb5ed732 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120cd expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.406219:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093480600/0x844e5faceb5ed6c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120a3 expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155580.406234:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093480600/0x844e5faceb5ed6c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120a3 expref: 14 pid: 19959 timeout: 809 lvb_type: 1 00000100:00100000:2.0:1746155580.406247:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124708096:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155580.406315:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43ce6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155580.406387:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094868700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124707968:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155580.406407:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155580.406431:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976124082560:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4458us (4584us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.406439:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6501 00000100:00100000:2.0:1746155580.409310:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.409408:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124708096:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155580.409433:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132b0f200/0x844e5faceb5ed732 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120cd expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.409447:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b0f200, rc 0) 00000100:00100000:3.0:1746155580.409499:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:29584:x1830976124082688:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3376us (3556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.409523:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12862 00000100:00100000:0.0:1746155580.409801:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124082816 00000100:00100000:0.0:1746155580.409807:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124082816 00010000:00010000:0.0:1746155580.409830:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093480600/0x844e5faceb5ed6c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120a3 expref: 14 pid: 19959 timeout: 809 lvb_type: 1 00000100:00100000:0.0:1746155580.409849:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6502 00000100:00100000:0.0:1746155580.409855:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976124082816:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155580.409865:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155580.409884:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093480600/0x844e5faceb5ed6c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120a3 expref: 14 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:0.0:1746155580.409898:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093480600/0x844e5faceb5ed6c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120a3 expref: 14 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:0.0:1746155580.409916:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093480600/0x844e5faceb5ed6c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120a3 expref: 14 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:0.0:1746155580.409930:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155580.409932:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155580.409937:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132b0f200/0x844e5faceb5ed732 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120cd expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.409943:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132b0f200/0x844e5faceb5ed732 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120cd expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155580.409967:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880132b0f200/0x844e5faceb5ed732 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120cd expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155580.409977:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124708224:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155580.410015:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155580.415657:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124708224:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155580.415675:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155580.415711:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976124082816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5856us (6407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.415721:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6502 00000100:00100000:0.0:1746155580.416590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.416978:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124082944 00000100:00100000:3.0:1746155580.416984:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124082944 00000100:00100000:3.0:1746155580.417018:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12863 00000100:00100000:3.0:1746155580.417024:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:29584:x1830976124082944:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155580.417045:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155580.417058:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9400/0x844e5faceb5ed739 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f120d4 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.417081:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093480000/0x844e5faceb5ed6d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120aa expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155580.417088:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.417090:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.417092:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9400/0x844e5faceb5ed739 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120d4 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.417115:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093480000/0x844e5faceb5ed6d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120aa expref: 14 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155580.417126:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093480000/0x844e5faceb5ed6d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120aa expref: 14 pid: 19959 timeout: 809 lvb_type: 1 00000100:00100000:3.0:1746155580.417135:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094868700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124708352:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155580.417197:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155580.418733:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094868700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976124708352:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155580.418753:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9400/0x844e5faceb5ed739 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120d4 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.418765:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc9400, rc 0) 00000100:00100000:3.0:1746155580.418793:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:29584:x1830976124082944:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1768us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.418800:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12863 00000100:00100000:0.0:1746155580.419232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.419396:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124083072 00000100:00100000:2.0:1746155580.419402:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124083072 00010000:00010000:2.0:1746155580.419423:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093480000/0x844e5faceb5ed6d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120aa expref: 14 pid: 19959 timeout: 809 lvb_type: 1 00000100:00100000:2.0:1746155580.419458:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6503 00000100:00100000:2.0:1746155580.419475:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d758450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976124083072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155580.419484:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155580.419525:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093480000/0x844e5faceb5ed6d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120aa expref: 14 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:2.0:1746155580.419536:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093480000/0x844e5faceb5ed6d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120aa expref: 14 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:2.0:1746155580.419554:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093480000/0x844e5faceb5ed6d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120aa expref: 14 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:2.0:1746155580.419572:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.419574:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.419579:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9400/0x844e5faceb5ed739 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120d4 expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.419586:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9400/0x844e5faceb5ed739 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120d4 expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.419608:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9400/0x844e5faceb5ed739 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120d4 expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155580.419617:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124708480:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155580.419668:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43ce6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155580.422376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.422424:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124083200 00000100:00100000:3.0:1746155580.422431:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124083200 00000100:00100000:3.0:1746155580.422458:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12864 00000100:00100000:2.0:1746155580.422459:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976124708480:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155580.422474:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:29584:x1830976124083200:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155580.422483:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155580.422487:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155580.422520:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed740 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f120db expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155580.422535:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d758450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976124083072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3071us (3304us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155580.422542:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093480200/0x844e5faceb5ed6d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b1 expref: 21 pid: 19959 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155580.422542:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6503 00010000:00010000:3.0:1746155580.422549:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.422550:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155580.422553:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed740 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120db expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.422572:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093480200/0x844e5faceb5ed6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b1 expref: 21 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155580.422581:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093480200/0x844e5faceb5ed6d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b1 expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00000100:00100000:3.0:1746155580.423030:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094868700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124708608:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155580.423294:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155580.425380:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094868700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976124708608:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155580.425397:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed740 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120db expref: 21 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155580.425409:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc8800, rc 0) 00000100:00100000:3.0:1746155580.425441:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:29584:x1830976124083200:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2976us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.425447:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12864 00000100:00100000:0.0:1746155580.426626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.427765:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124083328 00000100:00100000:2.0:1746155580.427772:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124083328 00010000:00010000:2.0:1746155580.427797:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093480200/0x844e5faceb5ed6d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b1 expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00000100:00100000:2.0:1746155580.427827:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6504 00000100:00100000:2.0:1746155580.427833:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976124083328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155580.427845:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155580.427862:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093480200/0x844e5faceb5ed6d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b1 expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:2.0:1746155580.427871:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093480200/0x844e5faceb5ed6d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b1 expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:2.0:1746155580.427888:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093480200/0x844e5faceb5ed6d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120b1 expref: 21 pid: 19959 timeout: 809 lvb_type: 1 00010000:00010000:2.0:1746155580.428536:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.428538:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155580.428544:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed740 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120db expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.428557:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed740 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120db expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.428587:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdc8800/0x844e5faceb5ed740 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120db expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155580.428598:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124708736:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155580.428671:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f1db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155580.431161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.431188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.431189:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976124708736:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155580.431206:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155580.431214:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.431265:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124083584 00000100:00100000:3.0:1746155580.431271:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124083584 00000100:00100000:3.0:1746155580.431303:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124083840 00000100:00100000:3.0:1746155580.431306:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124083840 00000100:00100000:3.0:1746155580.431318:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124084096 00000100:00100000:3.0:1746155580.431319:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124084096 00000100:00100000:3.0:1746155580.431331:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12865 00000100:00100000:3.0:1746155580.431338:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976124083584:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:1.0:1746155580.431414:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12866 00000100:00100000:1.0:1746155580.431422:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976124083840:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155580.431534:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155580.431537:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:3.0:1746155580.431539:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155578 -> 1746155579 00002000:00010000:3.0:1746155580.431540:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155578 -> 1746155580 00002000:00010000:3.0:1746155580.431542:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746155580.431547:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155580.431549:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:1.0:1746155580.431550:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155578 -> 1746155579 00002000:00010000:1.0:1746155580.431552:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155578 -> 1746155580 00002000:00010000:1.0:1746155580.431554:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155580.431727:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.431741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.431766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155580.431779:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124083456 00000100:00100000:0.0:1746155580.431781:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124083456 00000100:00100000:0.0:1746155580.431795:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124083712 00000100:00100000:0.0:1746155580.431797:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124083712 00000100:00100000:0.0:1746155580.431805:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124083968 00000100:00100000:0.0:1746155580.431807:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124083968 00000100:00100000:0.0:1746155580.431816:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12867 00000100:00100000:0.0:1746155580.431821:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976124084096:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:0.0:1746155580.431891:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155580.431893:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155580.431895:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155578 -> 1746155579 00002000:00010000:0.0:1746155580.431896:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155578 -> 1746155580 00002000:00010000:0.0:1746155580.431898:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155580.431921:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976124084096:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 99us (706us total) trans 17179873350 rc 0/0 00000100:00100000:0.0:1746155580.431927:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12867 00000100:00100000:0.0:1746155580.431940:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12868 00000100:00100000:0.0:1746155580.431945:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976124083456:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:0.0:1746155580.432005:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155580.432007:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155580.432008:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155578 -> 1746155579 00002000:00010000:0.0:1746155580.432010:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155578 -> 1746155580 00002000:00010000:0.0:1746155580.432011:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:0.0:1746155580.432025:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976124083456:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 80us (299us total) trans 21474840753 rc 0/0 00000100:00100000:0.0:1746155580.432029:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12868 00000100:00100000:0.0:1746155580.432037:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12869 00000100:00100000:0.0:1746155580.432053:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976124083712:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:0.0:1746155580.432102:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155580.432104:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155580.432106:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155578 -> 1746155579 00002000:00010000:0.0:1746155580.432108:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155578 -> 1746155580 00002000:00010000:0.0:1746155580.432109:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155580.432122:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976124083712:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 69us (380us total) trans 17179873351 rc 0/0 00000100:00100000:0.0:1746155580.432126:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12869 00000100:00100000:0.0:1746155580.432134:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 12870 00000100:00100000:0.0:1746155580.432138:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976124083968:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:2.0:1746155580.432153:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976124083328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4318us (5528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.432161:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6504 00002000:00010000:0.0:1746155580.432191:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:0.0:1746155580.432193:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:0.0:1746155580.432195:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155578 -> 1746155579 00002000:00010000:0.0:1746155580.432196:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155578 -> 1746155580 00002000:00010000:0.0:1746155580.432198:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:0.0:1746155580.432212:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976124083968:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 73us (446us total) trans 21474840754 rc 0/0 00000100:00100000:0.0:1746155580.432216:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12870 00000100:00100000:3.0:1746155580.432358:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976124083584:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 1020us (1204us total) trans 17179873349 rc 0/0 00000100:00100000:3.0:1746155580.432363:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12865 00000100:00100000:1.0:1746155580.432422:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976124083840:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 1000us (1232us total) trans 21474840752 rc 0/0 00000100:00100000:1.0:1746155580.432429:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 12866 00000100:00100000:0.0:1746155580.435370:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155580.435451:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124084352 00000100:00100000:2.0:1746155580.435459:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124084352 00000100:00100000:2.0:1746155580.435527:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4148 00000100:00100000:2.0:1746155580.435535:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29584:x1830976124084352:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:2.0:1746155580.435582:0:14235:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x35b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046a00/0x844e5faceb5ed660 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12079 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.435618:0:14235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155580.435628:0:14235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fefce00/0x844e5faceb5ed69f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12080 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.435637:0:14235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155580.435659:0:14235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fefce00/0x844e5faceb5ed69f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12080 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155580.435668:0:14235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fefce00/0x844e5faceb5ed69f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12080 expref: 288 pid: 14234 timeout: 809 lvb_type: 0 00000100:00100000:2.0:1746155580.435678:0:14235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14235:1830976124708864:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155580.436281:0:14235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f1db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155580.437338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.437534:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124084480 00000100:00100000:3.0:1746155580.437539:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124084480 00010000:00010000:3.0:1746155580.437583:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fefce00/0x844e5faceb5ed69f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12080 expref: 289 pid: 14234 timeout: 809 lvb_type: 0 00000100:00100000:2.0:1746155580.437597:0:14235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14235:1830976124708864:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155580.437612:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 6505 00000100:00100000:3.0:1746155580.437618:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1960:x1830976124084480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155580.437627:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155580.437631:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fefce00/0x844e5faceb5ed69f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12080 expref: 289 pid: 14234 timeout: 809 lvb_type: 0 00010000:00010000:3.0:1746155580.437640:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fefce00/0x844e5faceb5ed69f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12080 expref: 289 pid: 14234 timeout: 809 lvb_type: 0 00010000:00010000:3.0:1746155580.437655:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fefce00/0x844e5faceb5ed69f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12080 expref: 289 pid: 14234 timeout: 809 lvb_type: 0 00010000:00010000:3.0:1746155580.437677:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:3.0:1746155580.437680:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155580.437686:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155580.437691:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155580.437702:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155580.437727:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1960:x1830976124084480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 109us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155580.437732:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 6505 00010000:00010000:2.0:1746155580.437733:0:14235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155580.437739:0:14235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155580.437743:0:14235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00000040:00080000:2.0:1746155580.438391:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3017, 88 off252888 00000004:00080000:2.0:1746155580.438396:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709587892679ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.438419:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2947, 88 off246464 00000004:00080000:2.0:1746155580.438421:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709587918220ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.438430:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2948, 88 off246552 00000004:00080000:2.0:1746155580.438432:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709587929328ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.438438:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3018, 88 off252976 00000004:00080000:2.0:1746155580.438441:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709587937750ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.438446:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3019, 88 off253064 00000004:00080000:2.0:1746155580.438448:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709587945099ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.438454:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2949, 88 off246640 00000004:00080000:2.0:1746155580.438456:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709587953327ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.438476:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2950, 88 off246728 00000004:00080000:2.0:1746155580.438480:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709587976622ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.438487:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2951, 88 off246816 00000004:00080000:2.0:1746155580.438489:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709587986012ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.438495:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3020, 88 off253152 00000004:00080000:2.0:1746155580.438497:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709587994380ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.438525:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2952, 88 off246904 00000004:00080000:2.0:1746155580.438528:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709588025350ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.438536:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3021, 88 off253240 00000004:00080000:2.0:1746155580.438539:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709588035822ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.438545:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2953, 88 off246992 00000004:00080000:2.0:1746155580.438547:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709588044638ns, next at 645866785986ns, rc = 0 00000040:00080000:2.0:1746155580.438553:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3022, 88 off253328 00000004:00080000:2.0:1746155580.438555:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709588052422ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.438561:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3023, 88 off253416 00000004:00080000:2.0:1746155580.438563:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709588060380ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.438569:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3024, 88 off253504 00000004:00080000:2.0:1746155580.438571:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709588067805ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.438576:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3025, 88 off253592 00000004:00080000:2.0:1746155580.438578:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 709588075540ns, next at 645865692772ns, rc = 0 00000040:00080000:2.0:1746155580.438584:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2954, 88 off247080 00000004:00080000:2.0:1746155580.438586:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 709588083273ns, next at 645866785986ns, rc = 0 00000004:00010000:3.0:1746155580.460608:0:14235:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009a6dad80 reply state ffff88009f23b800 transno 8589944161 ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00000100:00100000:3.0:1746155580.460621:0:14235:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746155580.460629:0:14235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:3.0:1746155580.460632:0:14235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155580.460640:0:14235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046a00/0x844e5faceb5ed660 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12079 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155580.460734:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:29584:x1830976124084352:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 25199us (25371us total) trans 8589944161 rc 0/0 00000100:00100000:3.0:1746155580.460743:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4148 00000001:00080000:1.0:1746155580.460809:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944161 is committed 00000004:00080000:1.0:1746155580.460813:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2145 committed 00000004:00080000:1.0:1746155580.460818:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2223 committed 00000004:00080000:1.0:1746155580.460823:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2222 committed 00000004:00080000:1.0:1746155580.460824:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2221 committed 00000004:00080000:1.0:1746155580.460826:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2220 committed 00000004:00080000:1.0:1746155580.460827:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2144 committed 00000004:00080000:1.0:1746155580.460829:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2219 committed 00000004:00080000:1.0:1746155580.460831:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2143 committed 00000004:00080000:1.0:1746155580.460832:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2218 committed 00000004:00080000:1.0:1746155580.460834:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2142 committed 00000004:00080000:1.0:1746155580.460835:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2141 committed 00000004:00080000:1.0:1746155580.460836:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2140 committed 00000004:00080000:1.0:1746155580.460837:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2217 committed 00000004:00080000:1.0:1746155580.460839:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2216 committed 00000004:00080000:1.0:1746155580.460840:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2139 committed 00000004:00080000:1.0:1746155580.460841:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2138 committed 00000004:00080000:1.0:1746155580.460842:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2215 committed 00000100:00100000:1.0:1746155580.460928:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124708992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.460966:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155580.460988:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124709504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.460999:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155580.461011:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746155580.461015:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124709120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.461028:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155580.461036:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124709632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.461046:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155580.461060:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124709376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.461072:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155580.461082:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124709888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.461091:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155580.461099:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746155580.461102:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800944adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124709248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.461112:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155580.461121:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124709760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.461133:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155580.461148:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124708992 00000100:00100000:1.0:1746155580.461153:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124708992 00000100:00100000:1.0:1746155580.461174:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124709504 00000100:00100000:1.0:1746155580.461175:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124709504 00000100:00100000:1.0:1746155580.461183:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124709120 00000100:00100000:1.0:1746155580.461184:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124709120 00000100:00100000:1.0:1746155580.461191:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124709632 00000100:00100000:1.0:1746155580.461193:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124709632 00000100:00100000:1.0:1746155580.461201:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12871 00000100:00100000:1.0:1746155580.461206:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976124708992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155580.461342:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155580.461345:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:1.0:1746155580.461347:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb atime from disk: 1746155579 -> 1746155579 00002000:00010000:1.0:1746155580.461348:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb ctime from disk: 1746155580 -> 1746155580 00002000:00010000:1.0:1746155580.461350:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d6:0x0] updating lvb blocks from disk: 1895 -> 1895 00000100:00100000:1.0:1746155580.461369:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3295:x1830976124708992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (403us total) trans 21474840755 rc 0/0 00000100:00100000:1.0:1746155580.461373:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12871 00000100:00100000:1.0:1746155580.461380:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124709376 00000100:00100000:1.0:1746155580.461382:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124709376 00000100:00100000:1.0:1746155580.461389:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124709888 00000100:00100000:1.0:1746155580.461390:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124709888 00000100:00100000:1.0:1746155580.461395:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124709248 00000100:00100000:1.0:1746155580.461396:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124709248 00000100:00100000:1.0:1746155580.461401:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124709760 00000100:00100000:1.0:1746155580.461403:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124709760 00000100:00100000:1.0:1746155580.461409:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12872 00000100:00100000:1.0:1746155580.461413:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124709504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.461492:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124709504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (491us total) trans 21474840756 rc 0/0 00000100:00100000:1.0:1746155580.461497:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12872 00000100:00100000:1.0:1746155580.461525:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12873 00000100:00100000:1.0:1746155580.461530:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124709120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155580.461592:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155580.461595:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:1.0:1746155580.461596:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb atime from disk: 1746155579 -> 1746155579 00002000:00010000:1.0:1746155580.461598:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb ctime from disk: 1746155580 -> 1746155580 00002000:00010000:1.0:1746155580.461600:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d8:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746155580.461616:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124709120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (588us total) trans 21474840757 rc 0/0 00000100:00100000:1.0:1746155580.461621:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12873 00000100:00100000:1.0:1746155580.461629:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12874 00000100:00100000:1.0:1746155580.461633:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976124709632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.461699:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124709632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (650us total) trans 21474840758 rc 0/0 00000100:00100000:1.0:1746155580.461703:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12874 00000100:00100000:1.0:1746155580.461711:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12875 00000100:00100000:1.0:1746155580.461715:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976124709376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.461787:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976124709376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (714us total) trans 21474840759 rc 0/0 00000100:00100000:1.0:1746155580.461791:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12875 00000100:00100000:1.0:1746155580.461799:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12876 00000100:00100000:1.0:1746155580.461803:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976124709888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.461865:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976124709888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (772us total) trans 21474840760 rc 0/0 00000100:00100000:1.0:1746155580.461870:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12876 00000100:00100000:1.0:1746155580.461877:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12877 00000100:00100000:1.0:1746155580.461881:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976124709248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155580.461939:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb size from disk: 4954272 -> 4954272 00002000:00010000:1.0:1746155580.461941:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:1.0:1746155580.461943:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb atime from disk: 1746155579 -> 1746155579 00002000:00010000:1.0:1746155580.461945:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb ctime from disk: 1746155580 -> 1746155580 00002000:00010000:1.0:1746155580.461947:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3d9:0x0] updating lvb blocks from disk: 5651 -> 5651 00000100:00100000:1.0:1746155580.461964:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976124709248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (850us total) trans 21474840761 rc 0/0 00000100:00100000:1.0:1746155580.461969:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12877 00000100:00100000:1.0:1746155580.461976:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12878 00000100:00100000:1.0:1746155580.461980:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976124709760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.462051:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976124709760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (916us total) trans 21474840762 rc 0/0 00000100:00100000:1.0:1746155580.462056:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12878 00000004:00080000:1.0:1746155580.462176:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800944adc00/2, rc 0, transno 21474840761 00000100:00100000:1.0:1746155580.462184:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124709248:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155580.462190:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009018b480/2, rc 0, transno 21474840762 00000100:00100000:1.0:1746155580.462192:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009018b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124709760:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155580.462198:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800944aca80/2, rc 0, transno 21474840759 00000100:00100000:1.0:1746155580.462200:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124709376:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155580.462205:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090188700/2, rc 0, transno 21474840760 00000100:00100000:1.0:1746155580.462207:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124709888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.462237:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124710016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.462253:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746155580.462267:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800944ac380/2, rc 0, transno 21474840757 00000100:00100000:1.0:1746155580.462270:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124709120:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155580.462275:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090189c00/2, rc 0, transno 21474840758 00000100:00100000:1.0:1746155580.462278:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124709632:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155580.462283:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800944af800/2, rc 0, transno 21474840755 00000100:00100000:1.0:1746155580.462285:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800944af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124708992:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155580.462290:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009018b800/2, rc 0, transno 21474840756 00000100:00100000:1.0:1746155580.462293:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009018b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124709504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.462304:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124710016 00000100:00100000:1.0:1746155580.462306:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124710016 00000100:00100000:1.0:1746155580.462320:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12879 00000100:00100000:1.0:1746155580.462324:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976124710016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155580.462400:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976124710016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (145us total) trans 21474840763 rc 0/0 00000100:00100000:1.0:1746155580.462405:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12879 00000004:00080000:1.0:1746155580.462423:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f700a80/2, rc 0, transno 21474840763 00000100:00100000:1.0:1746155580.462425:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124710016:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746155580.462769:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155580.462779:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155580.462785:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155580.462790:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880132b0fc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155580.462794:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155580.462799:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155580.462813:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88012d55a700) 00010000:00010000:3.0:1746155580.462816:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155580.462819:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155580.462823:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fc00/0x844e5faceb5ed747 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14235 initiator: MDT0 00000100:00100000:2.0:1746155580.463048:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124710272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.463071:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.463083:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124710784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.463095:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.463104:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746155580.463107:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009486aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124710400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.463119:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.463128:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124710912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.463140:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.463156:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124710272 00000100:00100000:2.0:1746155580.463159:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124710272 00000100:00100000:2.0:1746155580.463174:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124710784 00000100:00100000:2.0:1746155580.463176:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124710784 00000100:00100000:2.0:1746155580.463183:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124710400 00000100:00100000:2.0:1746155580.463185:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124710400 00000100:00100000:2.0:1746155580.463191:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124710912 00000100:00100000:2.0:1746155580.463193:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124710912 00000100:00100000:2.0:1746155580.463201:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12880 00000100:00100000:2.0:1746155580.463206:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3297:x1830976124710272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155580.463302:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155580.463304:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155580.463306:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb atime from disk: 1746155579 -> 1746155579 00002000:00010000:2.0:1746155580.463308:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb ctime from disk: 1746155580 -> 1746155580 00002000:00010000:2.0:1746155580.463310:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3db:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746155580.463329:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3297:x1830976124710272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (257us total) trans 17179873352 rc 0/0 00000100:00100000:2.0:1746155580.463334:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12880 00000100:00100000:2.0:1746155580.463343:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12881 00000100:00100000:2.0:1746155580.463348:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3297:x1830976124710784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.463413:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3297:x1830976124710784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (317us total) trans 17179873353 rc 0/0 00000100:00100000:2.0:1746155580.463417:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12881 00000100:00100000:2.0:1746155580.463425:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12882 00000100:00100000:2.0:1746155580.463429:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3297:x1830976124710400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155580.463539:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746155580.463541:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155580.463543:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb atime from disk: 1746155579 -> 1746155579 00002000:00010000:2.0:1746155580.463545:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb ctime from disk: 1746155580 -> 1746155580 00002000:00010000:2.0:1746155580.463546:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3dc:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746155580.463562:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3297:x1830976124710400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 133us (442us total) trans 17179873354 rc 0/0 00000100:00100000:2.0:1746155580.463567:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12882 00000100:00100000:2.0:1746155580.463575:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12883 00000100:00100000:2.0:1746155580.463579:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3297:x1830976124710912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.463643:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3297:x1830976124710912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (501us total) trans 17179873355 rc 0/0 00000100:00100000:2.0:1746155580.463647:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12883 00000100:00100000:2.0:1746155580.463661:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124710144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.463675:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.463685:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124710656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.463696:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.463705:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746155580.463709:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009486b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124710528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.463720:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.463727:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124711040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.463737:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.463751:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124710144 00000100:00100000:2.0:1746155580.463753:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124710144 00000100:00100000:2.0:1746155580.463765:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124710656 00000100:00100000:2.0:1746155580.463767:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124710656 00000100:00100000:2.0:1746155580.463774:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124710528 00000100:00100000:2.0:1746155580.463775:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124710528 00000100:00100000:2.0:1746155580.463781:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124711040 00000100:00100000:2.0:1746155580.463782:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124711040 00000100:00100000:2.0:1746155580.463788:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12884 00000100:00100000:2.0:1746155580.463792:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976124710144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155580.463855:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155580.463857:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb mtime from disk: 1746155578 -> 1746155578 00002000:00010000:2.0:1746155580.463859:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb atime from disk: 1746155579 -> 1746155579 00002000:00010000:2.0:1746155580.463861:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb ctime from disk: 1746155580 -> 1746155580 00002000:00010000:2.0:1746155580.463863:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3da:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155580.463881:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976124710144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (204us total) trans 17179873356 rc 0/0 00000100:00100000:2.0:1746155580.463886:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12884 00000100:00100000:2.0:1746155580.463894:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12885 00000100:00100000:2.0:1746155580.463898:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976124710656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.463967:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976124710656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (269us total) trans 17179873357 rc 0/0 00000100:00100000:2.0:1746155580.463971:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12885 00000100:00100000:2.0:1746155580.463980:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12886 00000100:00100000:2.0:1746155580.463984:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976124710528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.464048:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976124710528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (325us total) trans 17179873358 rc 0/0 00000100:00100000:2.0:1746155580.464052:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12886 00000100:00100000:2.0:1746155580.464060:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12887 00000100:00100000:2.0:1746155580.464064:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976124711040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155580.464125:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976124711040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (386us total) trans 17179873359 rc 0/0 00000100:00100000:2.0:1746155580.464129:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12887 00000004:00080000:2.0:1746155580.464149:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009486b800/2, rc 0, transno 17179873358 00000100:00100000:2.0:1746155580.464152:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009486b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124710528:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155580.464158:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdec000/2, rc 0, transno 17179873359 00000100:00100000:2.0:1746155580.464160:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124711040:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155580.464164:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094868700/2, rc 0, transno 17179873356 00000100:00100000:2.0:1746155580.464166:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124710144:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155580.464171:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdeed80/2, rc 0, transno 17179873357 00000100:00100000:2.0:1746155580.464173:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976124710656:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155580.464183:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009486aa00/2, rc 0, transno 17179873354 00000100:00100000:2.0:1746155580.464186:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009486aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124710400:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155580.464190:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdeca80/2, rc 0, transno 17179873355 00000100:00100000:2.0:1746155580.464192:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124710912:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155580.464197:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094868a80/2, rc 0, transno 17179873352 00000100:00100000:2.0:1746155580.464199:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124710272:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155580.464204:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cded500/2, rc 0, transno 17179873353 00000100:00100000:2.0:1746155580.464206:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976124710784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155580.466354:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155580.466401:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124084608 00000100:00100000:1.0:1746155580.466408:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124084608 00000100:00100000:1.0:1746155580.466451:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10183 00000100:00100000:1.0:1746155580.466458:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+285:29584:x1830976124084608:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155580.466483:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155580.466499:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131365a00/0x844e5faceb5ed74e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f120e2 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.466574:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131365a00/0x844e5faceb5ed74e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120e2 expref: 286 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.466586:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131365a00/0x844e5faceb5ed74e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f120e2 expref: 286 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155580.466603:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35b:0x0].0x0 (ffff88009fe51d00) 00010000:00010000:1.0:1746155580.466606:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155580.466608:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131365a00, rc 0) 00000100:00100000:1.0:1746155580.466652:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29584:x1830976124084608:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 194us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155580.466657:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10183 00000100:00100000:0.0:1746155580.468674:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155580.468743:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124084864 00000100:00100000:3.0:1746155580.468750:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124084864 00000100:00100000:3.0:1746155580.468781:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4149 00000100:00100000:3.0:1746155580.468787:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a1ab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:29584:x1830976124084864:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155580.469050:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a1ab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:29584:x1830976124084864:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 261us (377us total) trans 8589944162 rc 0/0 00000100:00100000:3.0:1746155580.469058:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4149 00000100:00100000:0.0:1746155580.850751:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746155580.850767:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124711168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746155580.850818:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155580.850961:0:10389:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124711168 00000100:00100000:2.0:1746155580.850968:0:10389:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124711168 00000100:00100000:2.0:1746155580.850997:0:10389:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1746155580.851003:0:10389:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976124711168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746155580.851033:0:10389:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 255262720 pending 0 free 3847225344 avail 3845128192 00000100:00100000:2.0:1746155580.851076:0:10389:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976124711168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.851082:0:10389:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1746155580.851175:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746155580.851182:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124711296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746155580.851204:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155580.851278:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976124711168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746155580.851335:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124711296 00000100:00100000:2.0:1746155580.851338:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124711296 00000100:00100000:2.0:1746155580.852003:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1746155580.852010:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976124711296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746155580.852031:0:8440:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260243456 pending 0 free 3850371072 avail 3848273920 00000100:00100000:2.0:1746155580.858611:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976124711296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6593us (7398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155580.858623:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1746155580.858972:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976124711296:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1746155581.144673:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1746155581.285887:0:3432:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: final resync failed 00000100:00100000:2.0:1746155581.794658:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3298:1830976124711424:0@lo:400:kworker.0 00000100:00100000:2.0:1746155581.794711:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155581.798099:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1830976124711680:0@lo:400:kworker.0 00000100:00100000:3.0:1746155581.798142:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155581.798177:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746155581.798183:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1830976124711552:0@lo:400:kworker.0 00000100:00100000:3.0:1746155581.798198:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155581.798223:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124711680 00000100:00100000:3.0:1746155581.798228:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124711680 00000100:00100000:3.0:1746155581.798257:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124711552 00000100:00100000:3.0:1746155581.798259:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124711552 00000100:00100000:3.0:1746155581.798274:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1746155581.798279:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830976124711680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155581.798315:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830976124711680:12345-0@lo:400:kworker.0 Request processed in 36us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155581.798321:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1746155581.798336:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1746155581.798340:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830976124711552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155581.798359:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800948e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830976124711552:12345-0@lo:400:kworker.0 Request processed in 20us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155581.798364:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1746155581.798376:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155581.798393:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1830976124711552:0@lo:400:kworker.0 00000100:00100000:3.0:1746155581.798400:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1830976124711680:0@lo:400:kworker.0 00000100:00100000:2.0:1746155581.798801:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746155581.798807:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830976124711808:0@lo:400:kworker.0 00000100:00100000:2.0:1746155581.798827:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155581.798928:0:14230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124711424 00000100:00100000:0.0:1746155581.798932:0:14230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124711424 00000100:00100000:0.0:1746155581.798950:0:14230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1746155581.798954:0:14230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3298:x1830976124711424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746155581.798979:0:14230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3298:x1830976124711424:12345-0@lo:400:kworker.0 Request processed in 25us (4269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155581.798984:0:14230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1746155581.799555:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976124711808 00000100:00100000:3.0:1746155581.799558:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976124711808 00000100:00100000:3.0:1746155581.799573:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1746155581.799577:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830976124711808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155581.799600:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830976124711808:12345-0@lo:400:kworker.0 Request processed in 23us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155581.799604:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1746155581.803289:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830976124711808:0@lo:400:kworker.0 00000100:00100000:2.0:1746155581.803301:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3298:1830976124711424:0@lo:400:kworker.0 Debug log: 69442 lines, 69442 kept, 0 dropped, 0 bad.